Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

k8s upgrade to 1.27 fails when "ExpandPersistentVolumes" feature gate is enabled #17252

Open
marek-obuchowicz opened this issue Feb 4, 2025 · 0 comments
Labels
kind/bug Categorizes issue or PR as related to a bug.

Comments

@marek-obuchowicz
Copy link

marek-obuchowicz commented Feb 4, 2025

/kind bug

**1. What kops version are you running?

kops-1.30.3

**2. What Kubernetes version are you running?

1.27.16

3. What cloud provider are you using?

AWS

4. What commands did you run? What is the simplest way to reproduce this issue?

kops upgrade cluster (1.26.x -> 1.27.16) / terraform apply / kops rolling-update cluster --yes

5. What happened after the commands executed?

master nodes don't come up after rolling update. Kubelet reports following error:

Feb 04 20:07:50 i-... kubelet[3571]: E0204 20:07:50.696548    3571 run.go:74] "command failed" err="failed to set feature gates from initial flags-based config: unrecognized feature gate: ExpandPersistentVolumes"

6. What did you expect to happen?

kops edit cluster should not accept cluster spec with deprecated feature gate

7. Please provide your cluster manifest. Execute
kops get --name my.example.com -o yaml to display your cluster manifest.
You may want to remove your cluster name and other sensitive information.

spec:
# [...]
  channel: stable
  cloudProvider: aws
  containerRuntime: containerd
  kubeAPIServer:
    enableAdmissionPlugins:
    - NamespaceLifecycle
    - LimitRanger
    - ServiceAccount
    - PersistentVolumeLabel
    - DefaultStorageClass
    - DefaultTolerationSeconds
    - MutatingAdmissionWebhook
    - ValidatingAdmissionWebhook
    - NodeRestriction
    - PersistentVolumeClaimResize
    - ResourceQuota
    featureGates:
      ExpandPersistentVolumes: "true"
  kubeControllerManager:
    featureGates:
      ExpandPersistentVolumes: "true"
# [...]
  kubelet:
    anonymousAuth: false
    authenticationTokenWebhook: true
    authorizationMode: Webhook
    cgroupDriver: systemd
    featureGates:
      ExpandPersistentVolumes: "true"
    imageGCHighThresholdPercent: 75
    imageGCLowThresholdPercent: 60
# [...]
  kubernetesVersion: 1.27.16
# [...]
@k8s-ci-robot k8s-ci-robot added the kind/bug Categorizes issue or PR as related to a bug. label Feb 4, 2025
@marek-obuchowicz marek-obuchowicz changed the title k8s upgrade to 1.27 fails when "ExpandPersistentVolumes" feature flag is enabled k8s upgrade to 1.27 fails when "ExpandPersistentVolumes" feature gate is enabled Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Categorizes issue or PR as related to a bug.
Projects
None yet
Development

No branches or pull requests

2 participants