Avisi cloud logo

Release notes

Avisi Mangaged Environment Kubernetes release notes

Introduction

This page documents updates to the Avisi Managed Environment Kubernetes clusters. This contains; new or updated functionality, bug fixes, known issues and deprecation announcements.

Upcoming releases


Release notes

Kubernetes v1.30

v1.30.6-u-ame.0

Information

  • Kubernetes version: v1.30.6-ubuntu
  • Cluster controller version: v2.14.0-v1.30
  • Addon controller version: v0.14.1
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [containerd] Upgraded Containerd to v1.7.23
  • [runc] Upgraded Runc to v1.1.15

v1.30.5-u-ame.1

Information

  • Kubernetes version: v1.30.5-ubuntu
  • Cluster controller version: v2.13.1-v1.30
  • Addon controller version: v0.13.3
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [vsphere] Upgraded Ubuntu template to release 2024-10-02

v1.30.5-u-ame.0

Information

  • Kubernetes version: v1.30.5-ubuntu
  • Cluster controller version: v2.13.0-v1.30
  • Addon controller version: v0.13.3
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [containerd] Upgraded Containerd to v1.7.22
  • [openstack] Upgraded OpenStack cloud controller manager to v1.30.1
  • [azure] Upgraded Azure cloud controller manager to v1.30.7

Impact:

No additional impact

v1.30.2-u-ame.2

Information

  • Kubernetes version: v1.30.2-ubuntu
  • Cluster controller version: v2.12.2-v1.30
  • Addon controller version: v0.12.7
  • OS: Ubuntu 22.04.4 LTS

Changes

  • Various bug fixes and improvements

Impact:

No additional impact

v1.30.2-u-ame.1

Information

  • Kubernetes version: v1.30.2-ubuntu
  • Cluster controller version: v2.12.1-v1.30
  • Addon controller version: v0.12.7
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [pss] Changing Pod Security Standards Profile now restarts the kube-apiserver
  • [containerd] Upgraded Containerd to v1.7.19
  • [crictl] Upgraded crictl to v1.30.0
  • [konnectivity] Upgraded Konnectivity to v0.30.3
  • [aws] Upgraded AWS AMIs to release 20240701
  • [aws] Upgraded AWS cloud controller manager to v1.30.2
  • [azure] Upgraded Azure cloud controller manager to v1.30.4
  • [hetzner] Upgraded Hetzner cloud controller manager to v1.20.0
  • [openstack] Upgraded OpenStack cloud controller manager to v1.30.0
  • [vsphere] Upgraded vSphere cloud controller manager to v1.30.1

Impact:

No additional impact

Kubernetes v1.29

v1.29.10-u-ame.0

Information

  • Kubernetes version: v1.29.10-ubuntu
  • Cluster controller version: v2.14.0-v1.29
  • Addon controller version: v0.14.1
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [containerd] Upgraded Containerd to v1.7.23
  • [runc] Upgraded Runc to v1.1.15

v1.29.9-u-ame.1

Information

  • Kubernetes version: v1.29.9-ubuntu
  • Cluster controller version: v2.13.1-v1.29
  • Addon controller version: v0.13.3
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [vsphere] Upgraded Ubuntu template to release 2024-10-02

v1.29.9-u-ame.0

Information

  • Kubernetes version: v1.29.9-ubuntu
  • Cluster controller version: v2.13.0-v1.29
  • Addon controller version: v0.13.3
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [containerd] Upgraded Containerd to v1.7.22
  • [openstack] Upgraded OpenStack cloud controller manager to v1.29.1
  • [azure] Upgraded Azure cloud controller manager to v1.29.11

Impact:

No additional impact

v1.29.6-u-ame.5

Information

  • Kubernetes version: v1.29.6-ubuntu
  • Cluster controller version: v2.12.2-v1.29
  • Addon controller version: v0.12.7
  • OS: Ubuntu 22.04.4 LTS

Changes

  • Various bug fixes and improvements

Impact:

No additional impact

v1.29.6-u-ame.4

Information

  • Kubernetes version: v1.29.6-ubuntu
  • Cluster controller version: v2.12.1-v1.29
  • Addon controller version: v0.12.7
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [pss] Changing Pod Security Standards Profile now restarts the kube-apiserver

Impact:

No additional impact

v1.29.6-u-ame.3

Information

  • Kubernetes version: v1.29.6-ubuntu
  • Cluster controller version: v2.12.0-v1.29
  • Addon controller version: v0.12.7
  • OS: Ubuntu 22.04.4 LTS (20240629)

Changes

  • [addons] Upgrades stackstate-k8s-agent to v3.0.0

Impact:

No additional impact

v1.29.6-u-ame.1

Information

  • Kubernetes version: v1.29.6-ubuntu
  • Cluster controller version: v2.11.6-v1.29
  • Addon controller version: v0.12.6
  • OS: Ubuntu 22.04.4 LTS (20240629)

Changes

  • [cilium] Upgrades Cilium to v1.14.12
  • [containerd] Upgrades Containerd to v1.7.18
  • [runc] Upgrades Runc to v1.1.13
  • [cni] Upgrades CNI-plugins to v1.4.1
  • [aws] Upgrades AWS cloud controller manager to v1.29.3
  • [aws] Upgrades AWS AMIs to release 20240629
  • [openstack] Upgrades OpenStack cloud controller manager to v1.29.0
  • [azure] Upgrades Azure cloud controller manager to v1.29.7
  • [digitalocean] upgrades DigitalOcean cloud controller manager to v0.1.54
  • [vsphere] Upgrades vSphere cloud controller manager to v1.29.0
  • [audit] Upgrades Kubernetes audit logging (Promtail) to v2.9.8

Impact:

No additional impact

v1.29.5-u-ame.6

Information

  • Kubernetes version: v1.29.5-ubuntu
  • Cluster controller version: v2.11.4-v1.29
  • Addon controller version: v0.12.6
  • OS: Ubuntu 22.04.4 LTS (20240530)

Changes

  • [vsphere] Do not use all memory reserved/locked feature when creating vSphere vms
  • [vsphere] Find datastore for VM root partition by 'ame-zone' tag
  • [vsphere] Increase vsphere-syncer memory to 64Mi to prevent OOMKilled on larger clusters
  • [ceph] Allow Ceph CSI to be deployed as additional CSI driver
  • [ceph] Configure mounter in Ceph CSI StorageClasses
  • [addons] Upgrades addon monitoring (Prometheus) to v59.1.0
  • [addons] Upgrades addon ingress-nginx to v1.10.1
  • [addons] Upgrades addon traefik to v2.10.6
  • [addons] Upgrades addon cert-manager to v1.15.0

Impact:

No additional impact

v1.29.5-u-ame.1

Information

  • Kubernetes version: v1.29.5-ubuntu
  • Cluster controller version: v2.11.2-v1.29
  • Addon controller version: v0.12.3
  • OS: Ubuntu 22.04.4 LTS (20240530)

Changes

  • improvements to vSphere cloud provider
  • multi-availability zone support
  • automatic network selection on cluster create
  • automatic datastore selection on cluster create
  • upgrade vSphere CSI driver to v3.2.0
  • upgrade Containerd to v1.7.17
  • upgrade cluster-autoscaler to v1.29.3
  • upgrade Cloud Controller Managers of AWS and Azure
  • upgrade Konnectivity to v0.29.3

Impact:

No additional impact

v1.29.4-u-ame.9

Information

  • Kubernetes version: v1.29.4-ubuntu
  • Cluster controller version: v2.10.8-v1.29
  • OS: Ubuntu 22.04.4 LTS (20240301)

Urgent Notes

In this AME version, the CSI driver for AWS EBS will be upgraded to v1.30. This version of the CSI driver will not be compatible with the previous versions of the driver. This means that downgrading the driver will not be supported and is strongly discouraged. The upgrade will be performed automatically during the upgrade of the cluster.

Changes

  • improve cloud cleanup after cluster deletion
  • support node pool autoscaling using the Cluster Autoscaler
  • add storage class named block for each cloud provider
  • upgrade AWS EBS CSI plugin to v1.30 (see above urgent notes)
  • upgrade Cilium to v1.14.10
  • upgrade Containerd to v1.7.16
  • fix cluster creation error when a custom CNI is used
  • fix an issue where machines without Kubernetes node break node pool reconcile
  • fix an Hetzner action issue when provisioning a new node

v1.29.3-u-ame.4

Information

  • Kubernetes version: v1.29.3-ubuntu
  • Cluster controller version: v2.9.8-v1.29
  • OS: Ubuntu 22.04.4 LTS (20240301)

Changes

  • add events in the Console for node in place upgrades
  • add extra health checking for node in place upgrade to improve cluster upgrade reliability
  • Support Azure multi availability zones
  • Azure: configure workers to run without CSI on worker nodes without secrets
  • add upgrade strategy for replacement on major and minor patches only
  • fix race condition on cluster deletion

v1.29.1-u-ame.11

Information

  • Kubernetes version: v1.29.1-ubuntu
  • Cluster controller version: v2.8.3-v1.29
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Update ingress-nginx
  • Update traefik

v1.29.1-u-ame.9

Information

  • Kubernetes version: v1.29.1-ubuntu
  • Cluster controller version: v2.8.3-v1.29
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Add support for rotating cloud-credentials
  • Enable feature gate UnauthenticatedHTTP2DOSMitigation protection by default
  • Upgrade kube-addon-manager to v9.1.7 and promtail to v2.9.2
  • Fix OpenStack load balancers collection for snapshots
  • Change increase node join timeout to 60min
  • Make OpenStack DNSNameservers configurable
  • Delete left-over OpenStack load balancers, snapshots and volumes.
  • Upgrade node problem detector to v0.8.13
  • Add initial Azure cloud provider support
  • Add custom node problem detector plugin to monitor if system needs a reboot
  • Add support for the Cilium CNI
  • Upgrade runc to v1.1.12
  • Upgrade containerd to v1.7.13

Impact:

No additional impact

v1.29.1-u-ame.3

Information

  • Kubernetes version: v1.29.1-ubuntu
  • Cluster controller version: v2.7.4-v1.29
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Upgrade AME cluster-controller to v2
  • Upgrade Containerd to v1.7.11
  • Upgrade Hetzner cloud-controller-manager to v1.19.0
  • Upgrade Konnectivity Agent to v0.29.0

Impact:

No additional impact

Kubernetes v1.28

v1.28.15-u-ame.0

Information

  • Kubernetes version: v1.28.15-ubuntu
  • Cluster controller version: v2.14.0-v1.28
  • Addon controller version: v0.14.1
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [containerd] Upgraded Containerd to v1.7.23
  • [runc] Upgraded Runc to v1.1.15

v1.28.14-u-ame.1

Information

  • Kubernetes version: v1.28.14-ubuntu
  • Cluster controller version: v2.13.1-v1.28
  • Addon controller version: v0.13.3
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [vsphere] Upgraded Ubuntu template to release 2024-10-02

v1.28.14-u-ame.0

Information

  • Kubernetes version: v1.28.14-ubuntu
  • Cluster controller version: v2.13.0-v1.28
  • Addon controller version: v0.13.3
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [containerd] Upgraded Containerd to v1.7.22
  • [openstack] Upgraded OpenStack cloud controller manager to v1.28.3
  • [azure] Upgraded Azure cloud controller manager to v1.28.13

Impact:

No additional impact

v1.28.11-u-ame.5

Information

  • Kubernetes version: v1.28.11-ubuntu
  • Cluster controller version: v2.12.2-v1.28
  • Addon controller version: v0.12.7
  • OS: Ubuntu 22.04.4 LTS

Changes

  • Various bug fixes and improvements

Impact:

No additional impact

v1.28.11-u-ame.4

Information

  • Kubernetes version: v1.28.11-ubuntu
  • Cluster controller version: v2.12.1-v1.28
  • Addon controller version: v0.12.7
  • OS: Ubuntu 22.04.4 LTS

Changes

  • [pss] Changing Pod Security Standards Profile now restarts the kube-apiserver

Impact:

No additional impact

v1.28.11-u-ame.3

Information

  • Kubernetes version: v1.28.11-ubuntu
  • Cluster controller version: v2.12.0-v1.28
  • Addon controller version: v0.12.7
  • OS: Ubuntu 22.04.4 LTS (20240629)

Changes

  • [addons] Upgrades stackstate-k8s-agent to v3.0.0

Impact:

No additional impact

v1.28.11-u-ame.1

Information

  • Kubernetes version: v1.28.11-ubuntu
  • Cluster controller version: v2.11.6-v1.28
  • Addon controller version: v0.12.6
  • OS: Ubuntu 22.04.4 LTS (20240629)

Changes

  • [cilium] Upgrades Cilium to v1.14.12
  • [containerd] Upgrades Containerd to v1.7.18
  • [runc] Upgrades Runc to v1.1.13
  • [cni] Upgrades CNI-plugins to v1.4.1
  • [aws] Upgrades AWS cloud controller manager to v1.28.6
  • [aws] Upgrades AWS AMIs to release 20240629
  • [openstack] Upgrades OpenStack cloud controller manager to v1.28.2
  • [azure] Upgrades Azure cloud controller manager to v1.28.9
  • [digitalocean] upgrades DigitalOcean cloud controller manager to v0.1.54
  • [vsphere] Upgrades vSphere cloud controller manager to v1.28.1
  • [audit] Upgrades Kubernetes audit logging (Promtail) to v2.9.8

Impact:

No additional impact

v1.28.10-u-ame.6

Information

  • Kubernetes version: v1.28.10-ubuntu
  • Cluster controller version: v2.11.4-v1.28
  • Addon controller version: v0.12.6
  • OS: Ubuntu 22.04.4 LTS (20240530)

Changes

  • [vsphere] Do not use all memory reserved/locked feature when creating vSphere vms
  • [vsphere] Find datastore for VM root partition by 'ame-zone' tag
  • [vsphere] Increase vsphere-syncer memory to 64Mi to prevent OOMKilled on larger clusters
  • [ceph] Allow Ceph CSI to be deployed as additional CSI driver
  • [ceph] Configure mounter in Ceph CSI StorageClasses
  • [addons] Upgrades addon monitoring (Prometheus) to v59.1.0
  • [addons] Upgrades addon ingress-nginx to v1.10.1
  • [addons] Upgrades addon traefik to v2.10.6
  • [addons] Upgrades addon cert-manager to v1.15.0

Impact:

No additional impact

v1.28.10-u-ame.1

Information

  • Kubernetes version: v1.28.10-ubuntu
  • Cluster controller version: v2.11.2-v1.28
  • Addon controller version: v0.12.3
  • OS: Ubuntu 22.04.4 LTS (20240530)

Changes

  • improvements to vSphere cloud provider
  • multi-availability zone support
  • automatic network selection on cluster create
  • automatic datastore selection on cluster create
  • upgrade vSphere CSI driver to v3.2.0
  • upgrade Containerd to v1.7.17
  • upgrade cluster-autoscaler to v1.28.5
  • upgrade Cloud Controller Managers of AWS and Azure
  • upgrade Konnectivity to v0.28.6

Impact:

No additional impact

v1.28.9-u-ame.9

Information

  • Kubernetes version: v1.28.9-ubuntu
  • Cluster controller version: v2.10.8-v1.28
  • OS: Ubuntu 22.04.4 LTS (20240301)

Urgent Notes

In this AME version, the CSI driver for AWS EBS will be upgraded to v1.30. This version of the CSI driver will not be compatible with the previous versions of the driver. This means that downgrading the driver will not be supported and is strongly discouraged. The upgrade will be performed automatically during the upgrade of the cluster.

Changes

  • improve cloud cleanup after cluster deletion
  • support node pool autoscaling using the Cluster Autoscaler
  • add storage class named block for each cloud provider
  • upgrade AWS EBS CSI plugin to v1.30 (see above urgent notes)
  • upgrade Cilium to v1.14.10
  • upgrade Containerd to v1.7.16
  • fix cluster creation error when a custom CNI is used
  • fix an issue where machines without Kubernetes node break node pool reconcile
  • fix an Hetzner action issue when provisioning a new node

v1.28.8-u-ame.4

Information

  • Kubernetes version: v1.28.8-ubuntu
  • Cluster controller version: v2.9.8-v1.28
  • OS: Ubuntu 22.04.4 LTS (20240301)

Changes

  • add events in the Console for node in place upgrades
  • add extra health checking for node in place upgrade to improve cluster upgrade reliability
  • Support Azure multi availability zones
  • Azure: configure workers to run without CSI on worker nodes without secrets
  • add upgrade strategy for replacement on major and minor patches only
  • fix race condition on cluster deletion

v1.28.6-u-ame.11

Information

  • Kubernetes version: v1.28.6-ubuntu
  • Cluster controller version: v2.8.3-v1.28
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Update ingress-nginx
  • Update traefik

Impact:

No additional impact

v1.28.6-u-ame.9

Information

  • Kubernetes version: v1.28.6-ubuntu
  • Cluster controller version: v2.8.3-v1.28
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Add support for rotating cloud-credentials
  • Enable feature gate UnauthenticatedHTTP2DOSMitigation protection by default
  • Upgrade kube-addon-manager to v9.1.7 and promtail to v2.9.2
  • Fix OpenStack load balancers collection for snapshots
  • Change increase node join timeout to 60min
  • Make OpenStack DNSNameservers configurable
  • Delete left-over OpenStack load balancers, snapshots and volumes.
  • Upgrade node problem detector to v0.8.13
  • Add initial Azure cloud provider support
  • Add custom node problem detector plugin to monitor if system needs a reboot
  • Add support for the Cilium CNI
  • Upgrade runc to v1.1.12
  • Upgrade containerd to v1.7.13

Impact:

No additional impact

v1.28.2-u-ame.3

Information

  • Kubernetes version: v1.28.2-ubuntu
  • Cluster controller version: v2.0.3-v1.28
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Upgrade AME cluster-controller to v2
  • Upgrade Containerd to v1.7.6
  • Upgrade Hetzner cloud-controller-manager to v1.18.0
  • Increase OpenStack VM disk size to 50GB

Impact:

No additional impact

v1.28.1-u-ame.3

Information

  • Kubernetes version: v1.28.1-ubuntu
  • Cluster controller version: v1.28.1-3
  • OS: Ubuntu 22.04.2 LTS

Changes

  • Use new versions setup
  • Add initial support for vSphere cloud-provider
  • Add initial support for Hetzner cloud-provider
  • Fix inplace upgrade does not drain nodes
  • Change Calico IP_AUTODETECTION_METHOD to kubernetes-internal-ip
  • Allow konnectivity-agent on uninitialized nodes
  • Support targeted scale down (cordoned nodes will be removed first)
  • Upgrade to Go 1.21.0
  • Upgrade Calico to v3.26.1
  • Upgrade Containerd to v1.7.5
  • Upgrade Runc to v1.1.9
  • Upgrade Etcd to v3.5.9-0
  • Upgrade metrics-server to v0.6.4
  • Upgrade cluster-proportional-autoscaler to v1.8.9
  • Upgrade konnectivity to v0.1.4
  • Upgrade AWS cloud-controller-manager to v1.28.1
  • Upgrade Digitalocean cloud-controller-manager to v0.1.45
  • Upgrade Hetzner cloud-controller-manager to v1.17.2
  • Upgrade Openstack cloud-controller-manager v1.28.0
  • Upgrade vSphere cloud-controller-manager to v1.28.0
  • Upgrade Openstack Cinder CSI to v1.28.0

Impact:

No additional impact


Kubernetes v1.27

v1.27.15-u-ame.3

Information

  • Kubernetes version: v1.27.15-ubuntu
  • Cluster controller version: v2.12.0-v1.27
  • Addon controller version: v0.12.7
  • OS: Ubuntu 22.04.4 LTS (20240629)

Changes

  • [addons] Upgrades stackstate-k8s-agent to v3.0.0

Impact:

No additional impact

v1.27.15-u-ame.1

Information

  • Kubernetes version: v1.27.15-ubuntu
  • Cluster controller version: v2.11.6-v1.27
  • Addon controller version: v0.12.6
  • OS: Ubuntu 22.04.4 LTS (20240629)

Changes

  • [cilium] Upgrades Cilium to v1.14.12
  • [containerd] Upgrades Containerd to v1.7.18
  • [runc] Upgrades Runc to v1.1.13
  • [cni] Upgrades CNI-plugins to v1.4.1
  • [aws] Upgrades AWS cloud controller manager to v1.27.7
  • [aws] Upgrades AWS AMIs to release 20240629
  • [openstack] Upgrades OpenStack cloud controller manager to v1.27.3
  • [azure] Upgrades Azure cloud controller manager to v1.27.17
  • [digitalocean] upgrades DigitalOcean cloud controller manager to v0.1.54
  • [vsphere] Upgrades vSphere cloud controller manager to v1.27.0
  • [audit] Upgrades Kubernetes audit logging (Promtail) to v2.9.8

Impact:

No additional impact

v1.27.14-u-ame.6

Information

  • Kubernetes version: v1.27.14-ubuntu
  • Cluster controller version: v2.11.4-v1.27
  • Addon controller version: v0.12.6
  • OS: Ubuntu 22.04.4 LTS (20240530)

Changes

  • [vsphere] Do not use all memory reserved/locked feature when creating vSphere vms
  • [vsphere] Find datastore for VM root partition by 'ame-zone' tag
  • [vsphere] Increase vsphere-syncer memory to 64Mi to prevent OOMKilled on larger clusters
  • [ceph] Allow Ceph CSI to be deployed as additional CSI driver
  • [ceph] Configure mounter in Ceph CSI StorageClasses
  • [addons] Upgrades addon monitoring (Prometheus) to v59.1.0
  • [addons] Upgrades addon ingress-nginx to v1.10.1
  • [addons] Upgrades addon traefik to v2.10.6
  • [addons] Upgrades addon cert-manager to v1.15.0

Impact:

No additional impact

v1.27.14-u-ame.1

Information

  • Kubernetes version: v1.27.14-ubuntu
  • Cluster controller version: v2.11.2-v1.27
  • Addon controller version: v0.12.3
  • OS: Ubuntu 22.04.4 LTS (20240530)

Changes

  • improvements to vSphere cloud provider
  • multi-availability zone support
  • automatic network selection on cluster create
  • automatic datastore selection on cluster create
  • upgrade vSphere CSI driver to v3.2.0
  • upgrade Containerd to v1.7.17
  • upgrade cluster-autoscaler to v1.27.8
  • upgrade Cloud Controller Managers of AWS and Azure
  • upgrade Konnectivity to v0.1.10

Impact:

No additional impact

v1.27.13-u-ame.9

Information

  • Kubernetes version: v1.27.13-ubuntu
  • Cluster controller version: v2.10.8-v1.27
  • OS: Ubuntu 22.04.4 LTS (20240301)

Urgent Notes

In this AME version, the CSI driver for AWS EBS will be upgraded to v1.30. This version of the CSI driver will not be compatible with the previous versions of the driver. This means that downgrading the driver will not be supported and is strongly discouraged. The upgrade will be performed automatically during the upgrade of the cluster.

Changes

  • improve cloud cleanup after cluster deletion
  • support node pool autoscaling using the Cluster Autoscaler
  • add storage class named block for each cloud provider
  • upgrade AWS EBS CSI plugin to v1.30 (see above urgent notes)
  • upgrade Cilium to v1.14.10
  • upgrade Containerd to v1.7.16
  • fix cluster creation error when a custom CNI is used
  • fix an issue where machines without Kubernetes node break node pool reconcile
  • fix an Hetzner action issue when provisioning a new node

v1.27.12-u-ame.4

Information

  • Kubernetes version: v1.27.12-ubuntu
  • Cluster controller version: v2.9.8-v1.27
  • OS: Ubuntu 22.04.4 LTS (20240301)

Changes

  • add events in the Console for node in place upgrades
  • add extra health checking for node in place upgrade to improve cluster upgrade reliability
  • Support Azure multi availability zones
  • Azure: configure workers to run without CSI on worker nodes without secrets
  • add upgrade strategy for replacement on major and minor patches only
  • fix race condition on cluster deletion

Impact:

No additional impact

v1.27.10-u-ame.11

Information

  • Kubernetes version: v1.27.10-ubuntu
  • Cluster controller version: v2.8.3-v1.27
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Update ingress-nginx
  • Update traefik

Impact:

No additional impact

v1.27.10-u-ame.9

Information

  • Kubernetes version: v1.27.10-ubuntu
  • Cluster controller version: v2.8.3-v1.27
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Add support for rotating cloud-credentials
  • Enable feature gate UnauthenticatedHTTP2DOSMitigation protection by default
  • Upgrade kube-addon-manager to v9.1.7 and promtail to v2.9.2
  • Fix OpenStack load balancers collection for snapshots
  • Change increase node join timeout to 60min
  • Make OpenStack DNSNameservers configurable
  • Delete left-over OpenStack load balancers, snapshots and volumes.
  • Upgrade node problem detector to v0.8.13
  • Add initial Azure cloud provider support
  • Add custom node problem detector plugin to monitor if system needs a reboot
  • Add support for the Cilium CNI
  • Upgrade runc to v1.1.12
  • Upgrade containerd to v1.7.13

Impact:

No additional impact

v1.27.6-u-ame.3

Information

  • Kubernetes version: v1.27.6-ubuntu
  • Cluster controller version: v2.0.3-v1.27
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Upgrade AME cluster-controller to v2
  • Upgrade Containerd to v1.7.6
  • Upgrade Hetzner cloud-controller-manager to v1.18.0
  • Increase OpenStack VM disk size to 50GB

Impact:

No additional impact

v1.27.5-u-ame.3

Information

  • Kubernetes version: v1.27.5-ubuntu
  • Cluster controller version: v2.0.3-v1.27
  • OS: Ubuntu 22.04.2 LTS

Changes

  • Upgrade AME cluster-controller to v2
  • Upgrade Containerd to v1.7.6
  • Upgrade Hetzner cloud-controller-manager to v1.18.0
  • Increase OpenStack VM disk size to 50GB

Impact:

No additional impact

v1.27.5-u-ame.1

Information

  • Kubernetes version: v1.27.5-ubuntu
  • Cluster controller version: v1.27.5-1
  • OS: Ubuntu 22.04.2 LTS

Changes

  • Use new versions setup
  • Add initial support for vSphere cloud-provider
  • Add initial support for Hetzner cloud-provider
  • Fix inplace upgrade does not drain nodes
  • Change Calico IP_AUTODETECTION_METHOD to kubernetes-internal-ip
  • Allow konnectivity-agent on uninitialized nodes
  • Support targeted scale down (cordoned nodes will be removed first)
  • Upgrade to Go 1.21.0
  • Upgrade Calico to v3.26.1
  • Upgrade Containerd to v1.7.5
  • Upgrade Runc to v1.1.9
  • Upgrade metrics-server to v0.6.4
  • Upgrade cluster-proportional-autoscaler to v1.8.9
  • Upgrade konnectivity to v0.1.4
  • Upgrade AWS cloud-controller-manager to v1.27.1
  • Upgrade Digitalocean cloud-controller-manager to v0.1.45
  • Upgrade Hetzner cloud-controller-manager to v1.17.2
  • Upgrade Openstack cloud-controller-manager v1.27.2
  • Upgrade vSphere cloud-controller-manager to v1.27.0
  • Upgrade Openstack Cinder CSI to v1.28.0

Impact:

No additional impact

v1.27.3-u-ame.6

Information

  • Kubernetes version: v1.27.3-ubuntu
  • Cluster controller version: v1.27.3-8
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Improvement do not upgrade curl while joining new node
  • Upgrade AWS EBS CSI plugin to v1.20

Impact:

No additional impact

v1.27.3-u-ame.4

Information

  • Kubernetes version: v1.27.3-ubuntu
  • Cluster controller version: v1.27.3-5
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Add Node Pool Support for Bring Your Own Node Clusters
  • Add inplace upgrade support
  • Support ARM64 Instance types on AWS
  • Improve Cloud Init bootstrapping of nodes
  • support node replacement through annotation
  • Configure node pool ID label on node join

Impact:

No additional impact

v1.27.2-u-ame.3

Information

  • Kubernetes version: v1.27.2-ubuntu
  • Cluster controller version: v0.36.2
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Improve Cloud Init
  • Improve Node Starting time
  • Switch to external AWS cloud-controller
  • Upgrades Etcd to v3.5.7-0
  • Upgrades metrics-server to v0.6.3
  • Upgrades node-problem-detector to v0.8.13

Impact:

No additional impact


Kubernetes v1.26

v1.26.9-u-ame.3

Information

  • Kubernetes version: v1.26.9-ubuntu
  • Cluster controller version: v2.0.3-v1.26
  • OS: Ubuntu 22.04.3 LTS (20230919)

Changes

  • Upgrade AME cluster-controller to v2
  • Upgrade Containerd to v1.7.6
  • Upgrade Hetzner cloud-controller-manager to v1.18.0
  • Increase OpenStack VM disk size to 50GB

Impact:

No additional impact

v1.26.8-u-ame.1

Information

  • Kubernetes version: v1.26.8-ubuntu
  • Cluster controller version: v1.26.8-1
  • OS: Ubuntu 22.04.2 LTS

Changes

  • Use new versions setup
  • Add initial support for vSphere cloud-provider
  • Add initial support for Hetzner cloud-provider
  • Fix inplace upgrade does not drain nodes
  • Change Calico IP_AUTODETECTION_METHOD to kubernetes-internal-ip
  • Allow konnectivity-agent on uninitialized nodes
  • Support targeted scale down (cordoned nodes will be removed first)
  • Upgrade to Go 1.21.0
  • Upgrade Calico to v3.26.1
  • Upgrade Containerd to v1.7.5
  • Upgrade Runc to v1.1.9
  • Upgrade metrics-server to v0.6.4
  • Upgrade cluster-proportional-autoscaler to v1.8.9
  • Upgrade AWS cloud-controller-manager to v1.26.1
  • Upgrade Digitalocean cloud-controller-manager to v0.1.45
  • Upgrade Hetzner cloud-controller-manager to v1.17.2
  • Upgrade Openstack cloud-controller-manager v1.26.3
  • Upgrade vSphere cloud-controller-manager to v1.26.2
  • Upgrade Openstack Cinder CSI to v1.28.0

Impact:

No additional impact

v1.26.6-u-ame.5

Information

  • Kubernetes version: v1.26.6-ubuntu
  • Cluster controller version: v1.26.6-6
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Upgrade AWS EBS CSI plugin to v1.20
  • Improvement do not upgrade curl while joining new node

Impact:

No additional impact

v1.26.6-u-ame.4

Information

  • Kubernetes version: v1.26.6-ubuntu
  • Cluster controller version: v1.26.6-4
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Bugfix setting missing node labels

Impact:

No additional impact

v1.26.6-u-ame.3

Information

  • Kubernetes version: v1.26.6-ubuntu
  • Cluster controller version: v1.26.6-3
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Add Node Pool Support for Bring Your Own Node Clusters
  • Add inplace upgrade support
  • Support ARM64 Instance types on AWS
  • Improve Cloud Init bootstrapping of nodes
  • support node replacement through annotation
  • Configure node pool ID label on node join

Impact:

No additional impact

v1.26.5-u-ame.3

Information

  • Kubernetes version: v1.26.5-ubuntu
  • Cluster controller version: v0.35.25
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Prometheus Agent Mode

Impact:

No additional impact

v1.26.5-u-ame.1

Information

  • Kubernetes version: v1.26.5-ubuntu
  • Cluster controller version: v0.35.25
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Emit PodEvictedEvents when evicting pods

Impact:

No additional impact

v1.26.4-u-ame.4

Information

  • Kubernetes version: v1.26.4-ubuntu
  • Cluster controller version: v0.35.25
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Emit PodEvictedEvents when evicting pods

Impact:

No additional impact

v1.26.4-u-ame.1

Information

  • Kubernetes version: v1.26.2-ubuntu
  • Cluster controller version: v0.35.21
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Increase max-user-instances and fs.inotify.max_user_watches to prevent fsnotify watcher: too many open files issues

Impact:

No additional impact

v1.26.2-u-ame.13

Information

  • Kubernetes version: v1.26.2-ubuntu
  • Cluster controller version: v0.35.19
  • OS: Ubuntu 22.04.1 LTS

Changes

  • Various internal reliablity improvements
  • DigitalOcean support
  • OpenStack Support

Impact:

No additional impact

v1.26.2-u-ame.3

Information

  • Kubernetes version: v1.26.2-ubuntu
  • Cluster controller version: v0.35.6
  • OS: Ubuntu 22.04.1 LTS
  • Date: 21MAR2023

Changes

  • Optimized sysctl settings for nodes
  • Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)

Impact:

No additional impact

v1.26.2-u-ame.1

Information

  • Kubernetes version: v1.26.2-ubuntu
  • Cluster controller version: v0.35.5
  • OS: Ubuntu 22.04.1 LTS
  • Date: 06MAR2023

Changes

  • Upgrade Containerd to v1.6.19
  • Add support for replacing orphaned machines

Impact:

No additional impact

v1.26.0-u-ame.2

Information

  • Kubernetes version: v1.26.0-ubuntu
  • Cluster controller version: 0.35.2
  • OS: Ubuntu 22.04.1 LTS
  • Date: 29DEC2022

Changes

  • Upgrade Containerd to v1.6.14
  • Enable seccomp by default for all workloads
  • NAT gateway is now only provisioned when a node pool exists within the availability zone (AWS only)
  • Upgrade snapshot controller to v4.2.1
  • Upgrade cluster-proportional-autoscaler to 1.8.6
  • Upgrade node problem detector to v0.8.12
  • Add VPC gateway endpoints for S3 within the same region (AWS only)
  • Switch to registry.k8s.io for all Kubernetes images (k8s.grc.io is deprecated)
  • Drop support for Pod Security Policy (replaced by Pod Security Standards)
  • Collect resource usage for cloud resources
  • Upgrade node distribution to Ubuntu 22.04 LTS Jammy

Impact:

No additional impact


Kubernetes v1.25

v1.25.11-u-ame.5

Information

  • Kubernetes version: v1.25.11-ubuntu
  • Cluster controller version: v1.25.11-7
  • OS: Ubuntu 20.04.5 LTS

Changes

  • Upgrade AWS EBS CSI plugin to v1.20
  • Improvement do not upgrade curl while joining new node

Impact:

No additional impact

v1.25.11-u-ame.3

Information

  • Kubernetes version: v1.25.11-ubuntu
  • Cluster controller version: v1.25.11-5
  • OS: Ubuntu 20.04.5 LTS

Changes

  • Add Node Pool Support for Bring Your Own Node Clusters
  • Add inplace upgrade support
  • Support ARM64 Instance types on AWS
  • Improve Cloud Init bootstrapping of nodes
  • support node replacement through annotation
  • Configure node pool ID label on node join

Impact:

No additional impact

v1.25.10-u-ame.3

Information

  • Kubernetes version: v1.25.7-ubuntu
  • Cluster controller version: v0.35.25
  • OS: Ubuntu 20.04.5 LTS
  • Date: 21MAR2023

Changes

  • Prometheus Agent Mode
  • Various internal reliablity improvements
  • DigitalOcean support
  • OpenStack Support
  • Increase max-user-instances and fs.inotify.max_user_watches to prevent fsnotify watcher: too many open files issues
  • Emit PodEvictedEvents when evicting pods

Impact:

No additional impact

v1.25.7-u-ame.3

Information

  • Kubernetes version: v1.25.7-ubuntu
  • Cluster controller version: v0.35.6
  • OS: Ubuntu 20.04.5 LTS
  • Date: 21MAR2023

Changes

  • Optimized sysctl settings for nodes
  • Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)

Impact:

No additional impact

v1.25.7-u-ame.2

Superseded by v1.25.7-u-ame.3

v1.25.7-u-ame.1

Information

  • Kubernetes version: v1.25.7-ubuntu
  • Cluster controller version: v0.35.5
  • OS: Ubuntu 20.04.5 LTS
  • Date: 06MAR2023

Changes

  • Upgrade Containerd to v1.6.19
  • Add support for replacing orphaned machines

Impact:

No additional impact

v1.25.6-u-ame.6

Information

  • Kubernetes version: v1.25.6-ubuntu
  • Cluster controller version: v0.35.6
  • OS: Ubuntu 20.04.5 LTS
  • Date: 21MAR2023

Changes

  • Optimized sysctl settings for nodes
  • Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)
  • Add support for replacing orphaned machines

Impact:

No additional impact

v1.25.5-u-ame.2

Information

  • Kubernetes version: v1.25.5-ubuntu
  • Cluster controller version: 0.35.2
  • OS: Ubuntu 20.04.5 LTS
  • Date: 29DEC2022

Changes

  • Upgrade Etcd to v3.5.6-0
  • Upgrade Containerd to v1.6.14
  • Enable seccomp by default for all workloads
  • NAT gateway is now only provisioned when a node pool exists within the availability zone (AWS only)
  • Upgrade snapshot controller to v4.2.1
  • Upgrade cluster-proportional-autoscaler to 1.8.6
  • Upgrade node problem detector to v0.8.12
  • Add VPC gateway endpoints for S3 within the same region (AWS only)
  • Switch to registry.k8s.io for all Kubernetes images (k8s.grc.io is deprecated)
  • Drop support for Pod Security Policy (replaced by Pod Security Standards)
  • Collect resource usage for cloud resources

Impact:

No additional impact


Kubernetes v1.24

v1.24.15-u-ame.5

Information

  • Kubernetes version: v1.24.15-ubuntu
  • Cluster controller version: v1.25.11-7
  • OS: Ubuntu 20.04.5 LTS

Changes

  • Upgrade AWS EBS CSI plugin to v1.20
  • Improvement do not upgrade curl while joining new node

Impact:

No additional impact

v1.24.15-u-ame.3

Information

  • Kubernetes version: v1.24.15-ubuntu
  • Cluster controller version: v1.25.11-5
  • OS: Ubuntu 20.04.5 LTS

Changes

  • Add Node Pool Support for Bring Your Own Node Clusters
  • Add inplace upgrade support
  • Support ARM64 Instance types on AWS
  • Improve Cloud Init bootstrapping of nodes
  • support node replacement through annotation
  • Configure node pool ID label on node join
  • Fix Bring Your Own Node install script was broken

Impact:

No additional impact

v1.24.8-u-ame.1

Information

  • Kubernetes version: v1.24.8-ubuntu
  • Cluster controller version: v0.33.4
  • OS: Ubuntu 20.04.5 LTS
  • Date: 11nov2022

Changes

Impact:

No additional impact

v1.24.6-u-ame.0

Information

  • Kubernetes version: v1.24.6-ubuntu
  • Cluster controller version: v0.33.0
  • OS: Ubuntu 20.04.5 LTS
  • Date: 30sep2022

Changes

  • Upgrade Konnectivity to v0.0.33

Impact:

No additional impact

v1.24.5-u-ame.2 - security release

Information

  • Kubernetes version: v1.24.5-ubuntu
  • Cluster controller version: v0.32.4
  • OS: Ubuntu 20.04.5 LTS
  • Date: 19sep2022

Changes

  • Upgrade Runc to v1.1.4
  • Improved node installation

v1.24.4-u-ame.0

Information

  • Kubernetes version: v1.24.4-ubuntu
  • Cluster controller version: v0.31.2
  • OS: Ubuntu 20.04.4 LTS
  • Date: 29aug2022

Changes

  • Upgrade Containerd to v1.6.8
  • Upgrade kube-state-metrics to v2.5.0
  • Upgrade snapshot-controller to v4.0.1

Impact:

No additional impact

v1.24.2-u-ame.2

Information

  • Kubernetes version: v1.24.2-ubuntu
  • Cluster controller version: v0.30.4
  • OS: Ubuntu 20.04.4 LTS
  • Date: 7Jul2022

Changes

  • Upgrade Containerd to v1.6.6
  • Upgrade Promtail sidecar to v2.5.0
  • Upgrade EBS CSI to v1.6.1
  • Add gp3 storage class (AWS)

Impact:

No additional impact

v1.24.1-u-ame.1

Information

  • Kubernetes version: v1.24.1-ubuntu
  • Cluster controller version: v0.30.1
  • OS: Ubuntu 20.04.4 LTS
  • Date: 14Jun2022

Changes

  • Upgrade Etcd to v3.5.3-0
  • Upgrade Konnectivity to v0.0.31
  • Upgrade Calico to v3.23.0
  • Upgrade Containerd to v1.6.4
  • Support Openstack (beta)
  • Support DigitalOcean (beta)

Impact:

No additional impact


Kubernetes v1.23

v1.23.14-u-ame.1

Information

  • Kubernetes version: v1.23.14-ubuntu
  • Cluster controller version: v0.33.4
  • OS: Ubuntu 20.04.5 LTS
  • Date: 11nov2022

Changes

Impact:

No additional impact

v1.23.12-u-ame.0

Information

  • Kubernetes version: v1.23.12-ubuntu
  • Cluster controller version: v0.33.0
  • OS: Ubuntu 20.04.5 LTS
  • Date: 30sep2022

Changes

  • Upgrade Konnectivity to v0.0.33

v1.23.11-u-ame.2 - security release

Information

  • Kubernetes version: v1.23.11-ubuntu
  • Cluster controller version: v0.32.4
  • OS: Ubuntu 20.04.5 LTS
  • Date: 19sep2022

Changes

  • Upgrade Runc to v1.1.4
  • Improved node installation

v1.23.10-u-ame.0

Information

  • Kubernetes version: v1.23.10-ubuntu
  • Cluster controller version: v0.31.2
  • OS: Ubuntu 20.04.4 LTS
  • Date: 29aug2022

Changes

  • Upgrade Containerd to v1.6.8
  • Upgrade kube-state-metrics to v2.5.0
  • Upgrade snapshot-controller to v4.0.1

Impact:

No additional impact

v1.23.8-u-ame.1

Information

  • Kubernetes version: v1.23.8-ubuntu
  • Cluster controller version: v0.30.4
  • OS: Ubuntu 20.04.4 LTS
  • Date: 7Jul2022

Changes

  • Upgrade Containerd to v1.6.6
  • Upgrade Promtail sidecar to v2.5.0
  • Upgrade EBS CSI to v1.6.1
  • Add gp3 storage class (AWS)

Impact:

No additional impact

v1.23.7-u-ame.1

Information

  • Kubernetes version: v1.23.7-ubuntu
  • Cluster controller version: v0.30.1
  • OS: Ubuntu 20.04.4 LTS
  • Date: 14Jun2022

Changes

  • Upgrade Etcd to v3.5.3-0
  • Upgrade Konnectivity to v0.0.31
  • Upgrade Calico to v3.23.0
  • Upgrade Containerd to v1.6.4
  • Support Openstack (beta)
  • Support DigitalOcean (beta)

Impact:

Control plane will be briefly offline during the upgrade

v1.23.6-u-ame.0

Information

  • Kubernetes version: v1.23.6-ubuntu
  • Cluster controller version: v0.28.0
  • OS: Ubuntu 20.04.4 LTS
  • Date: 05may2022

Changes

  • Upgrade node-problem-detector to v0.8.10
  • Upgrade cluster-proportional-autoscaler to v1.8.5
  • Upgrade metrics-server to v0.6.1
  • Upgrade Etcd to v3.5.1-0
  • Upgrade Containerd to v1.6.3

Impact:

Control plane will be briefly offline during the upgrade

v1.23.5-u-ame.0

Information

  • Kubernetes version: v1.23.5-ubuntu
  • Cluster controller version: v0.27.3
  • OS: Ubuntu 20.04.4 LTS
  • Date: 22mar2022

Changes

  • Resolve CVE-2022-0847
  • Resolve CVE-2022-0778
  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4
  • Fix NFS mounts

Impact:

No additional impact

v1.23.4-u-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.23.4-ubuntu
  • Cluster controller version: v0.27.2
  • Ubuntu 20.04.3 LTS

Changes

Impact:

No additional impact


Kubernetes v1.22

v1.22.14-u-ame.0 - security release

Information

  • Kubernetes version: v1.22.14-ubuntu
  • Cluster controller version: v0.29.5
  • OS: Ubuntu 20.04.5 LTS
  • Date: 19sep2022

Impact:

No additional impact

v1.22.13-u-ame.0

Information

  • Kubernetes version: v1.22.13-ubuntu
  • Cluster controller version: v0.29.4
  • OS: Ubuntu 20.04.4 LTS
  • Date: 29aug2022

Impact:

No additional impact

v1.22.13-ame.0

Information

  • Kubernetes version: v1.22.13
  • Cluster controller version: v0.29.4
  • OS: Centos 7
  • Date: 29aug2022

Impact:

No additional impact

v1.22.11-u-ame.0

Information

  • Kubernetes version: v1.22.11-ubuntu
  • Cluster controller version: v0.29.3
  • OS: Ubuntu 20.04.4 LTS
  • Date: 7Jul2022

Changes

  • Upgrade Containerd to v1.5.13
  • Upgrade Crictl to v1.22.1

Impact:

No additional impact

v1.22.11-ame.0

Information

  • Kubernetes version: v1.22.11
  • Cluster controller version: v0.29.3
  • OS: Centos 7
  • Date: 7Jul2022

Changes

  • Upgrade Crictl to v1.22.1

Impact:

No additional impact

v1.22.9-u-ame.0

Information

  • Kubernetes version: v1.22.9-ubuntu
  • Cluster controller version: v0.28.0
  • OS: Ubuntu 20.04.4 LTS
  • Date: 22mar2022

Changes

  • Upgrade node-problem-detector to v0.8.10
  • Upgrade cluster-proportional-autoscaler to v1.8.5
  • Upgrade metrics-server to v0.6.1
  • Upgrade Etcd to v3.5.1-0
  • Upgrade Containerd to v1.5.11

Impact:

Control plane will be briefly offline during the upgrade

Information

  • Kubernetes version: v1.22.8-ubuntu
  • Cluster controller version: v0.27.3
  • OS: Ubuntu 20.04.4 LTS
  • Date: 22mar2022

Changes

  • Resolve CVE-2022-0847
  • Resolve CVE-2022-0778
  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4
  • Fix NFS mounts

Impact:

No additional impact

v1.22.8-ame.0

Information

  • Kubernetes version: v1.22.8
  • Cluster controller version: v0.27.3
  • Date: 22mar2022

Changes

  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4

Impact:

No additional impact

v1.22.7-u-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.22.7-ubuntu
  • Cluster controller version: v0.27.2
  • Ubuntu 20.04.3 LTS

Changes

Impact:

No additional impact

v1.22.7-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.22.7
  • Cluster controller version: v0.27.2

Changes

Impact:

No additional impact

v1.22.6-u-ame.1 - 25feb2022

Versions

  • Kubernetes version: v1.22.6-ubuntu
  • Cluster controller version: v0.27.1
  • Ubuntu 20.04.3 LTS

Changes

  • Various improvements
  • Support Pod Security Feature Gate
  • Remove installation of deprecated Pod Security Policy resources
  • Full support for stopping and destroying clusters

Impact:

No additional impact

v1.22.6-ame.1 - 25feb2022

Versions

  • Kubernetes version: v1.22.6
  • Cluster controller version: v0.27.1

Changes

  • Various improvements
  • Support Pod Security Feature Gate
  • Remove installation of deprecated Pod Security Policy resources
  • Full support for stopping and destroying clusters

Impact:

No additional impact

v1.22.6-u-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.22.6-ubuntu
  • Cluster controller version: v0.26.1
  • Ubuntu 20.04.3 LTS

Changes

  • Resolve CVE-2022-0185
  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.5.9
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.22.6-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.22.6
  • Cluster controller version: v0.26.1

Changes

  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.4.12 (from v1.5.5)
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.22.2-ame.0 - 20sep2021

Versions

  • Kubernetes version: v1.22.2
  • Cluster controller version: v0.23.0

Changes

  • Update registry.avisi.cloud for CNI images
  • Upgrade apiserver network proxy to v0.0.24
  • Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.


Kubernetes v1.21

v1.21.11-u-ame.0

Information

  • Kubernetes version: v1.21.11-ubuntu
  • Cluster controller version: v0.27.3
  • OS: Ubuntu 20.04.4 LTS
  • Date: 22mar2022

Changes

  • Resolve CVE-2022-0847
  • Resolve CVE-2022-0778
  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4
  • Fix NFS mounts

Impact:

No additional impact

v1.21.11-ame.0

Information

  • Kubernetes version: v1.21.11
  • Cluster controller version: v0.27.3
  • Date: 22mar2022

Changes

  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4

Impact:

No additional impact

v1.21.10-u-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.21.10-ubuntu
  • Cluster controller version: v0.27.2
  • Ubuntu 20.04.3 LTS

Changes

Impact:

No additional impact

v1.21.10-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.21.10
  • Cluster controller version: v0.27.2

Changes

Impact:

No additional impact

v1.21.9-u-ame.1 - 25feb2022

Versions

  • Kubernetes version: v1.21.9-ubuntu
  • Cluster controller version: v0.26.3
  • Ubuntu 20.04.3 LTS

Changes

  • Minor bug fixes

Impact:

No additional impact

v1.21.9-ame.1 - 25feb2022

Versions

  • Kubernetes version: v1.21.9
  • Cluster controller version: v0.26.3

Changes

  • Minor bug fixes

Impact:

No additional impact

v1.21.9-u-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.21.9-ubuntu
  • Cluster controller version: v0.26.1
  • Ubuntu 20.04.3 LTS

Changes

  • Resolve CVE-2022-0185
  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.5.9
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.21.9-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.21.9
  • Cluster controller version: v0.26.1

Changes

  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.4.12 (from v1.5.5)
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.21.5-ame.0 - 20sep2021

  • Kubernetes version: v1.21.5
  • Cluster controller version: v0.23.0

Changes

  • Update registry.avisi.cloud for CNI images
  • Upgrade apiserver network proxy to v0.0.24
  • Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.


Kubernetes v1.20

v1.20.15-u-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.20.15-ubuntu
  • Cluster controller version: v0.26.1
  • Ubuntu 20.04.3 LTS

Changes

  • Resolve CVE-2022-0185
  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.5.9
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.15-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.20.15
  • Cluster controller version: v0.26.1

Changes

  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.4.12 (from v1.5.5)
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.11-ame.0 - 20sep2021

Versions

  • Kubernetes version: v1.20.11
  • Cluster controller version: v0.23.0

Changes

  • Update registry.avisi.cloud for CNI images
  • Upgrade apiserver network proxy to v0.0.24
  • Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.


v1.20.8-ame.0 - 29jul2021

  • Kubernetes version: v1.20.8
  • Cluster controller version: v0.21.1

Changes

  • Upgrade containerd to v1.5.4
  • Upgrade apiserver network proxy to v0.0.21

Impact

No additional impact


v1.20.6-ame.1 - 19jul2021

Versions

  • Kubernetes version: v1.20.6
  • Cluster controller version: v0.21.0

Changes

  • Upgrade calico to v3.19.1
  • upgrade ceph-csi to v3.3.1
  • Make IAM policy cluster unique
  • renew certificate 3 months before its expiry
  • Various bug fixes

Impact:

API SERVER DOWNTIME

Control plane will be briefly down during the upgrade

On this page

IntroductionUpcoming releasesRelease notesKubernetes v1.30v1.30.6-u-ame.0v1.30.5-u-ame.1v1.30.5-u-ame.0v1.30.2-u-ame.2v1.30.2-u-ame.1Kubernetes v1.29v1.29.10-u-ame.0v1.29.9-u-ame.1v1.29.9-u-ame.0v1.29.6-u-ame.5v1.29.6-u-ame.4v1.29.6-u-ame.3v1.29.6-u-ame.1v1.29.5-u-ame.6v1.29.5-u-ame.1v1.29.4-u-ame.9v1.29.3-u-ame.4v1.29.1-u-ame.11v1.29.1-u-ame.9v1.29.1-u-ame.3Kubernetes v1.28v1.28.15-u-ame.0v1.28.14-u-ame.1v1.28.14-u-ame.0v1.28.11-u-ame.5v1.28.11-u-ame.4v1.28.11-u-ame.3v1.28.11-u-ame.1v1.28.10-u-ame.6v1.28.10-u-ame.1v1.28.9-u-ame.9v1.28.8-u-ame.4v1.28.6-u-ame.11v1.28.6-u-ame.9v1.28.2-u-ame.3v1.28.1-u-ame.3Kubernetes v1.27v1.27.15-u-ame.3v1.27.15-u-ame.1v1.27.14-u-ame.6v1.27.14-u-ame.1v1.27.13-u-ame.9v1.27.12-u-ame.4v1.27.10-u-ame.11v1.27.10-u-ame.9v1.27.6-u-ame.3v1.27.5-u-ame.3v1.27.5-u-ame.1v1.27.3-u-ame.6v1.27.3-u-ame.4v1.27.2-u-ame.3Kubernetes v1.26v1.26.9-u-ame.3v1.26.8-u-ame.1v1.26.6-u-ame.5v1.26.6-u-ame.4v1.26.6-u-ame.3v1.26.5-u-ame.3v1.26.5-u-ame.1v1.26.4-u-ame.4v1.26.4-u-ame.1v1.26.2-u-ame.13v1.26.2-u-ame.3v1.26.2-u-ame.1v1.26.0-u-ame.2Kubernetes v1.25v1.25.11-u-ame.5v1.25.11-u-ame.3v1.25.10-u-ame.3v1.25.7-u-ame.3v1.25.7-u-ame.2v1.25.7-u-ame.1v1.25.6-u-ame.6v1.25.5-u-ame.2Kubernetes v1.24v1.24.15-u-ame.5v1.24.15-u-ame.3v1.24.8-u-ame.1v1.24.6-u-ame.0v1.24.5-u-ame.2 - security releasev1.24.4-u-ame.0v1.24.2-u-ame.2v1.24.1-u-ame.1Kubernetes v1.23v1.23.14-u-ame.1v1.23.12-u-ame.0v1.23.11-u-ame.2 - security releasev1.23.10-u-ame.0v1.23.8-u-ame.1v1.23.7-u-ame.1v1.23.6-u-ame.0v1.23.5-u-ame.0v1.23.4-u-ame.0 - 04mar2022Kubernetes v1.22v1.22.14-u-ame.0 - security releasev1.22.13-u-ame.0v1.22.13-ame.0v1.22.11-u-ame.0v1.22.11-ame.0v1.22.9-u-ame.0v1.22.8-ame.0v1.22.7-u-ame.0 - 04mar2022v1.22.7-ame.0 - 04mar2022v1.22.6-u-ame.1 - 25feb2022v1.22.6-ame.1 - 25feb2022v1.22.6-u-ame.0 - 2feb2022v1.22.6-ame.0 - 2feb2022v1.22.2-ame.0 - 20sep2021Kubernetes v1.21v1.21.11-u-ame.0v1.21.11-ame.0v1.21.10-u-ame.0 - 04mar2022v1.21.10-ame.0 - 04mar2022v1.21.9-u-ame.1 - 25feb2022v1.21.9-ame.1 - 25feb2022v1.21.9-u-ame.0 - 2feb2022v1.21.9-ame.0 - 2feb2022v1.21.5-ame.0 - 20sep2021Kubernetes v1.20v1.20.15-u-ame.0 - 2feb2022v1.20.15-ame.0 - 2feb2022v1.20.11-ame.0 - 20sep2021v1.20.8-ame.0 - 29jul2021v1.20.6-ame.1 - 19jul2021