Release notes

Release notes for Avisi Cloud Kubernetes.

Introduction

This page documents updates to the Avisi Managed Environment Kubernetes clusters. This contains; new or updated functionality, bug fixes, known issues and deprecation announcements.

• Please see our Kubernetes lifecycle policy for more information about how we handle our version management.
• Check out our how to upgrade for information on how to upgrade your cluster.

Table of Content

Upcoming releases#

Release notes#

Kubernetes v1.29#

v1.29.3-u-ame.4#

Information

• Kubernetes version: v1.29.3-ubuntu
• Cluster controller version: v2.9.8-v1.29
• OS: Ubuntu 22.04.4 LTS (20240301)

Changes

• add events in the Console for node in place upgrades
• add extra health checking for node in place upgrade to improve cluster upgrade reliability
• Support Azure multi availability zones
• Azure: configure workers to run without CSI on worker nodes without secrets
• add upgrade strategy for replacement on major and minor patches only
• fix race condition on cluster deletion

v1.29.1-u-ame.11#

Information

• Kubernetes version: v1.29.1-ubuntu
• Cluster controller version: v2.8.3-v1.29
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Update ingress-nginx
• Update traefik

v1.29.1-u-ame.9#

Information

• Kubernetes version: v1.29.1-ubuntu
• Cluster controller version: v2.8.3-v1.29
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Add support for rotating cloud-credentials
• Enable feature gate UnauthenticatedHTTP2DOSMitigation protection by default
• Upgrade kube-addon-manager to v9.1.7 and promtail to v2.9.2
• Fix OpenStack load balancers collection for snapshots
• Change increase node join timeout to 60min
• Make OpenStack DNSNameservers configurable
• Delete left-over OpenStack load balancers, snapshots and volumes.
• Upgrade node problem detector to v0.8.13
• Add initial Azure cloud provider support
• Add custom node problem detector plugin to monitor if system needs a reboot
• Add support for the Cilium CNI
• Upgrade runc to v1.1.12
• Upgrade containerd to v1.7.13

Impact:

No additional impact

v1.29.1-u-ame.3#

Information

• Kubernetes version: v1.29.1-ubuntu
• Cluster controller version: v2.7.4-v1.29
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Upgrade AME cluster-controller to v2
• Upgrade Containerd to v1.7.11
• Upgrade Hetzner cloud-controller-manager to v1.19.0
• Upgrade Konnectivity Agent to v0.29.0

Impact:

No additional impact

Kubernetes v1.28#

v1.28.8-u-ame.4#

Information

• Kubernetes version: v1.28.8-ubuntu
• Cluster controller version: v2.9.8-v1.28
• OS: Ubuntu 22.04.4 LTS (20240301)

Changes

• add events in the Console for node in place upgrades
• add extra health checking for node in place upgrade to improve cluster upgrade reliability
• Support Azure multi availability zones
• Azure: configure workers to run without CSI on worker nodes without secrets
• add upgrade strategy for replacement on major and minor patches only
• fix race condition on cluster deletion

v1.28.6-u-ame.11#

Information

• Kubernetes version: v1.28.6-ubuntu
• Cluster controller version: v2.8.3-v1.28
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Update ingress-nginx
• Update traefik

Impact:

No additional impact

v1.28.6-u-ame.9#

Information

• Kubernetes version: v1.28.6-ubuntu
• Cluster controller version: v2.8.3-v1.28
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Add support for rotating cloud-credentials
• Enable feature gate UnauthenticatedHTTP2DOSMitigation protection by default
• Upgrade kube-addon-manager to v9.1.7 and promtail to v2.9.2
• Fix OpenStack load balancers collection for snapshots
• Change increase node join timeout to 60min
• Make OpenStack DNSNameservers configurable
• Delete left-over OpenStack load balancers, snapshots and volumes.
• Upgrade node problem detector to v0.8.13
• Add initial Azure cloud provider support
• Add custom node problem detector plugin to monitor if system needs a reboot
• Add support for the Cilium CNI
• Upgrade runc to v1.1.12
• Upgrade containerd to v1.7.13

Impact:

No additional impact

v1.28.2-u-ame.3#

Information

• Kubernetes version: v1.28.2-ubuntu
• Cluster controller version: v2.0.3-v1.28
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Upgrade AME cluster-controller to v2
• Upgrade Containerd to v1.7.6
• Upgrade Hetzner cloud-controller-manager to v1.18.0
• Increase OpenStack VM disk size to 50GB

Impact:

No additional impact

v1.28.1-u-ame.3#

Information

• Kubernetes version: v1.28.1-ubuntu
• Cluster controller version: v1.28.1-3
• OS: Ubuntu 22.04.2 LTS

Changes

• Use new versions setup
• Add initial support for vSphere cloud-provider
• Add initial support for Hetzner cloud-provider
• Fix inplace upgrade does not drain nodes
• Change Calico IP_AUTODETECTION_METHOD to kubernetes-internal-ip
• Allow konnectivity-agent on uninitialized nodes
• Support targeted scale down (cordoned nodes will be removed first)
• Upgrade to Go 1.21.0
• Upgrade Calico to v3.26.1
• Upgrade Containerd to v1.7.5
• Upgrade Runc to v1.1.9
• Upgrade Etcd to v3.5.9-0
• Upgrade metrics-server to v0.6.4
• Upgrade cluster-proportional-autoscaler to v1.8.9
• Upgrade konnectivity to v0.1.4
• Upgrade AWS cloud-controller-manager to v1.28.1
• Upgrade Digitalocean cloud-controller-manager to v0.1.45
• Upgrade Hetzner cloud-controller-manager to v1.17.2
• Upgrade Openstack cloud-controller-manager v1.28.0
• Upgrade vSphere cloud-controller-manager to v1.28.0
• Upgrade Openstack Cinder CSI to v1.28.0

Impact:

No additional impact

Kubernetes v1.27#

v1.27.12-u-ame.4#

Information

• Kubernetes version: v1.27.12-ubuntu
• Cluster controller version: v2.9.8-v1.27
• OS: Ubuntu 22.04.4 LTS (20240301)

Changes

• add events in the Console for node in place upgrades
• add extra health checking for node in place upgrade to improve cluster upgrade reliability
• Support Azure multi availability zones
• Azure: configure workers to run without CSI on worker nodes without secrets
• add upgrade strategy for replacement on major and minor patches only
• fix race condition on cluster deletion

Impact:

No additional impact

v1.27.10-u-ame.11#

Information

• Kubernetes version: v1.27.10-ubuntu
• Cluster controller version: v2.8.3-v1.27
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Update ingress-nginx
• Update traefik

Impact:

No additional impact

v1.27.10-u-ame.9#

Information

• Kubernetes version: v1.27.10-ubuntu
• Cluster controller version: v2.8.3-v1.27
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Add support for rotating cloud-credentials
• Enable feature gate UnauthenticatedHTTP2DOSMitigation protection by default
• Upgrade kube-addon-manager to v9.1.7 and promtail to v2.9.2
• Fix OpenStack load balancers collection for snapshots
• Change increase node join timeout to 60min
• Make OpenStack DNSNameservers configurable
• Delete left-over OpenStack load balancers, snapshots and volumes.
• Upgrade node problem detector to v0.8.13
• Add initial Azure cloud provider support
• Add custom node problem detector plugin to monitor if system needs a reboot
• Add support for the Cilium CNI
• Upgrade runc to v1.1.12
• Upgrade containerd to v1.7.13

Impact:

No additional impact

v1.27.6-u-ame.3#

Information

• Kubernetes version: v1.27.6-ubuntu
• Cluster controller version: v2.0.3-v1.27
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Upgrade AME cluster-controller to v2
• Upgrade Containerd to v1.7.6
• Upgrade Hetzner cloud-controller-manager to v1.18.0
• Increase OpenStack VM disk size to 50GB

Impact:

No additional impact

v1.27.5-u-ame.3#

Information

• Kubernetes version: v1.27.5-ubuntu
• Cluster controller version: v2.0.3-v1.27
• OS: Ubuntu 22.04.2 LTS

Changes

• Upgrade AME cluster-controller to v2
• Upgrade Containerd to v1.7.6
• Upgrade Hetzner cloud-controller-manager to v1.18.0
• Increase OpenStack VM disk size to 50GB

Impact:

No additional impact

v1.27.5-u-ame.1#

Information

• Kubernetes version: v1.27.5-ubuntu
• Cluster controller version: v1.27.5-1
• OS: Ubuntu 22.04.2 LTS

Changes

• Use new versions setup
• Add initial support for vSphere cloud-provider
• Add initial support for Hetzner cloud-provider
• Fix inplace upgrade does not drain nodes
• Change Calico IP_AUTODETECTION_METHOD to kubernetes-internal-ip
• Allow konnectivity-agent on uninitialized nodes
• Support targeted scale down (cordoned nodes will be removed first)
• Upgrade to Go 1.21.0
• Upgrade Calico to v3.26.1
• Upgrade Containerd to v1.7.5
• Upgrade Runc to v1.1.9
• Upgrade metrics-server to v0.6.4
• Upgrade cluster-proportional-autoscaler to v1.8.9
• Upgrade konnectivity to v0.1.4
• Upgrade AWS cloud-controller-manager to v1.27.1
• Upgrade Digitalocean cloud-controller-manager to v0.1.45
• Upgrade Hetzner cloud-controller-manager to v1.17.2
• Upgrade Openstack cloud-controller-manager v1.27.2
• Upgrade vSphere cloud-controller-manager to v1.27.0
• Upgrade Openstack Cinder CSI to v1.28.0

Impact:

No additional impact

v1.27.3-u-ame.6#

Information

• Kubernetes version: v1.27.3-ubuntu
• Cluster controller version: v1.27.3-8
• OS: Ubuntu 22.04.1 LTS

Changes

• Improvement do not upgrade curl while joining new node
• Upgrade AWS EBS CSI plugin to v1.20

Impact:

No additional impact

v1.27.3-u-ame.4#

Information

• Kubernetes version: v1.27.3-ubuntu
• Cluster controller version: v1.27.3-5
• OS: Ubuntu 22.04.1 LTS

Changes

• Add Node Pool Support for Bring Your Own Node Clusters
• Add inplace upgrade support
• Support ARM64 Instance types on AWS
• Improve Cloud Init bootstrapping of nodes
• support node replacement through annotation
• Configure node pool ID label on node join

Impact:

No additional impact

v1.27.2-u-ame.3#

Information

• Kubernetes version: v1.27.2-ubuntu
• Cluster controller version: v0.36.2
• OS: Ubuntu 22.04.1 LTS

Changes

• Improve Cloud Init
• Improve Node Starting time
• Switch to external AWS cloud-controller
• Upgrades Etcd to v3.5.7-0
• Upgrades metrics-server to v0.6.3
• Upgrades node-problem-detector to v0.8.13

Impact:

No additional impact

Kubernetes v1.26#

v1.26.9-u-ame.3#

Information

• Kubernetes version: v1.26.9-ubuntu
• Cluster controller version: v2.0.3-v1.26
• OS: Ubuntu 22.04.3 LTS (20230919)

Changes

• Upgrade AME cluster-controller to v2
• Upgrade Containerd to v1.7.6
• Upgrade Hetzner cloud-controller-manager to v1.18.0
• Increase OpenStack VM disk size to 50GB

Impact:

No additional impact

v1.26.8-u-ame.1#

Information

• Kubernetes version: v1.26.8-ubuntu
• Cluster controller version: v1.26.8-1
• OS: Ubuntu 22.04.2 LTS

Changes

• Use new versions setup
• Add initial support for vSphere cloud-provider
• Add initial support for Hetzner cloud-provider
• Fix inplace upgrade does not drain nodes
• Change Calico IP_AUTODETECTION_METHOD to kubernetes-internal-ip
• Allow konnectivity-agent on uninitialized nodes
• Support targeted scale down (cordoned nodes will be removed first)
• Upgrade to Go 1.21.0
• Upgrade Calico to v3.26.1
• Upgrade Containerd to v1.7.5
• Upgrade Runc to v1.1.9
• Upgrade metrics-server to v0.6.4
• Upgrade cluster-proportional-autoscaler to v1.8.9
• Upgrade AWS cloud-controller-manager to v1.26.1
• Upgrade Digitalocean cloud-controller-manager to v0.1.45
• Upgrade Hetzner cloud-controller-manager to v1.17.2
• Upgrade Openstack cloud-controller-manager v1.26.3
• Upgrade vSphere cloud-controller-manager to v1.26.2
• Upgrade Openstack Cinder CSI to v1.28.0

Impact:

No additional impact

v1.26.6-u-ame.5#

Information

• Kubernetes version: v1.26.6-ubuntu
• Cluster controller version: v1.26.6-6
• OS: Ubuntu 22.04.1 LTS

Changes

• Upgrade AWS EBS CSI plugin to v1.20
• Improvement do not upgrade curl while joining new node

Impact:

No additional impact

v1.26.6-u-ame.4#

Information

• Kubernetes version: v1.26.6-ubuntu
• Cluster controller version: v1.26.6-4
• OS: Ubuntu 22.04.1 LTS

Changes

• Bugfix setting missing node labels

Impact:

No additional impact

v1.26.6-u-ame.3#

Information

• Kubernetes version: v1.26.6-ubuntu
• Cluster controller version: v1.26.6-3
• OS: Ubuntu 22.04.1 LTS

Changes

• Add Node Pool Support for Bring Your Own Node Clusters
• Add inplace upgrade support
• Support ARM64 Instance types on AWS
• Improve Cloud Init bootstrapping of nodes
• support node replacement through annotation
• Configure node pool ID label on node join

Impact:

No additional impact

v1.26.5-u-ame.3#

Information

• Kubernetes version: v1.26.5-ubuntu
• Cluster controller version: v0.35.25
• OS: Ubuntu 22.04.1 LTS

Changes

• Prometheus Agent Mode

Impact:

No additional impact

v1.26.5-u-ame.1#

Information

• Kubernetes version: v1.26.5-ubuntu
• Cluster controller version: v0.35.25
• OS: Ubuntu 22.04.1 LTS

Changes

• Emit PodEvictedEvents when evicting pods

Impact:

No additional impact

v1.26.4-u-ame.4#

Information

• Kubernetes version: v1.26.4-ubuntu
• Cluster controller version: v0.35.25
• OS: Ubuntu 22.04.1 LTS

Changes

• Emit PodEvictedEvents when evicting pods

Impact:

No additional impact

v1.26.4-u-ame.1#

Information

• Kubernetes version: v1.26.2-ubuntu
• Cluster controller version: v0.35.21
• OS: Ubuntu 22.04.1 LTS

Changes

• Increase max-user-instances and fs.inotify.max_user_watches to prevent fsnotify watcher: too many open files issues

Impact:

No additional impact

v1.26.2-u-ame.13#

Information

• Kubernetes version: v1.26.2-ubuntu
• Cluster controller version: v0.35.19
• OS: Ubuntu 22.04.1 LTS

Changes

• Various internal reliablity improvements
• DigitalOcean support
• OpenStack Support

Impact:

No additional impact

v1.26.2-u-ame.3#

Information

• Kubernetes version: v1.26.2-ubuntu
• Cluster controller version: v0.35.6
• OS: Ubuntu 22.04.1 LTS
• Date: 21MAR2023

Changes

• Optimized sysctl settings for nodes
• Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)

Impact:

No additional impact

v1.26.2-u-ame.1#

Information

• Kubernetes version: v1.26.2-ubuntu
• Cluster controller version: v0.35.5
• OS: Ubuntu 22.04.1 LTS
• Date: 06MAR2023

Changes

• Upgrade Containerd to v1.6.19
• Add support for replacing orphaned machines

Impact:

No additional impact

v1.26.0-u-ame.2#

Information

• Kubernetes version: v1.26.0-ubuntu
• Cluster controller version: 0.35.2
• OS: Ubuntu 22.04.1 LTS
• Date: 29DEC2022

Changes

• Upgrade Containerd to v1.6.14
• Enable seccomp by default for all workloads
• NAT gateway is now only provisioned when a node pool exists within the availability zone (AWS only)
• Upgrade snapshot controller to v4.2.1
• Upgrade cluster-proportional-autoscaler to 1.8.6
• Upgrade node problem detector to v0.8.12
• Add VPC gateway endpoints for S3 within the same region (AWS only)
• Switch to registry.k8s.io for all Kubernetes images (k8s.grc.io is deprecated)
• Drop support for Pod Security Policy (replaced by Pod Security Standards)
• Collect resource usage for cloud resources
• Upgrade node distribution to Ubuntu 22.04 LTS Jammy

Impact:

No additional impact

Kubernetes v1.25#

v1.25.11-u-ame.5#

Information

• Kubernetes version: v1.25.11-ubuntu
• Cluster controller version: v1.25.11-7
• OS: Ubuntu 20.04.5 LTS

Changes

• Upgrade AWS EBS CSI plugin to v1.20
• Improvement do not upgrade curl while joining new node

Impact:

No additional impact

v1.25.11-u-ame.3#

Information

• Kubernetes version: v1.25.11-ubuntu
• Cluster controller version: v1.25.11-5
• OS: Ubuntu 20.04.5 LTS

Changes

• Add Node Pool Support for Bring Your Own Node Clusters
• Add inplace upgrade support
• Support ARM64 Instance types on AWS
• Improve Cloud Init bootstrapping of nodes
• support node replacement through annotation
• Configure node pool ID label on node join

Impact:

No additional impact

v1.25.10-u-ame.3#

Information

• Kubernetes version: v1.25.7-ubuntu
• Cluster controller version: v0.35.25
• OS: Ubuntu 20.04.5 LTS
• Date: 21MAR2023

Changes

• Prometheus Agent Mode
• Various internal reliablity improvements
• DigitalOcean support
• OpenStack Support
• Increase max-user-instances and fs.inotify.max_user_watches to prevent fsnotify watcher: too many open files issues
• Emit PodEvictedEvents when evicting pods

Impact:

No additional impact

v1.25.7-u-ame.3#

Information

• Kubernetes version: v1.25.7-ubuntu
• Cluster controller version: v0.35.6
• OS: Ubuntu 20.04.5 LTS
• Date: 21MAR2023

Changes

• Optimized sysctl settings for nodes
• Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)

Impact:

No additional impact

v1.25.7-u-ame.2#

Superseded by v1.25.7-u-ame.3

v1.25.7-u-ame.1#

Information

• Kubernetes version: v1.25.7-ubuntu
• Cluster controller version: v0.35.5
• OS: Ubuntu 20.04.5 LTS
• Date: 06MAR2023

Changes

• Upgrade Containerd to v1.6.19
• Add support for replacing orphaned machines

Impact:

No additional impact

v1.25.6-u-ame.6#

Information

• Kubernetes version: v1.25.6-ubuntu
• Cluster controller version: v0.35.6
• OS: Ubuntu 20.04.5 LTS
• Date: 21MAR2023

Changes

• Optimized sysctl settings for nodes
• Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)
• Add support for replacing orphaned machines

Impact:

No additional impact

v1.25.5-u-ame.2#

Information

• Kubernetes version: v1.25.5-ubuntu
• Cluster controller version: 0.35.2
• OS: Ubuntu 20.04.5 LTS
• Date: 29DEC2022

Changes

• Upgrade Etcd to v3.5.6-0
• Upgrade Containerd to v1.6.14
• Enable seccomp by default for all workloads
• NAT gateway is now only provisioned when a node pool exists within the availability zone (AWS only)
• Upgrade snapshot controller to v4.2.1
• Upgrade cluster-proportional-autoscaler to 1.8.6
• Upgrade node problem detector to v0.8.12
• Add VPC gateway endpoints for S3 within the same region (AWS only)
• Switch to registry.k8s.io for all Kubernetes images (k8s.grc.io is deprecated)
• Drop support for Pod Security Policy (replaced by Pod Security Standards)
• Collect resource usage for cloud resources

Impact:

No additional impact

Kubernetes v1.24#

v1.24.15-u-ame.5#

Information

• Kubernetes version: v1.24.15-ubuntu
• Cluster controller version: v1.25.11-7
• OS: Ubuntu 20.04.5 LTS

Changes

• Upgrade AWS EBS CSI plugin to v1.20
• Improvement do not upgrade curl while joining new node

Impact:

No additional impact

v1.24.15-u-ame.3#

Information

• Kubernetes version: v1.24.15-ubuntu
• Cluster controller version: v1.25.11-5
• OS: Ubuntu 20.04.5 LTS

Changes

• Add Node Pool Support for Bring Your Own Node Clusters
• Add inplace upgrade support
• Support ARM64 Instance types on AWS
• Improve Cloud Init bootstrapping of nodes
• support node replacement through annotation
• Configure node pool ID label on node join
• Fix Bring Your Own Node install script was broken

Impact:

No additional impact

v1.24.8-u-ame.1#

Information

• Kubernetes version: v1.24.8-ubuntu
• Cluster controller version: v0.33.4
• OS: Ubuntu 20.04.5 LTS
• Date: 11nov2022

Changes

• Fix CVE-2022-3162: Unauthorized read of Custom Resources
• Fix CVE-2022-3294: Node address isn’t always verified when proxying

Impact:

No additional impact

v1.24.6-u-ame.0#

Information

• Kubernetes version: v1.24.6-ubuntu
• Cluster controller version: v0.33.0
• OS: Ubuntu 20.04.5 LTS
• Date: 30sep2022

Changes

• Upgrade Konnectivity to v0.0.33

Impact:

No additional impact

v1.24.5-u-ame.2 - security release#

Information

• Kubernetes version: v1.24.5-ubuntu
• Cluster controller version: v0.32.4
• OS: Ubuntu 20.04.5 LTS
• Date: 19sep2022

Changes

• Upgrade Runc to v1.1.4
• Improved node installation

v1.24.4-u-ame.0#

Information

• Kubernetes version: v1.24.4-ubuntu
• Cluster controller version: v0.31.2
• OS: Ubuntu 20.04.4 LTS
• Date: 29aug2022

Changes

• Upgrade Containerd to v1.6.8
• Upgrade kube-state-metrics to v2.5.0
• Upgrade snapshot-controller to v4.0.1

Impact:

No additional impact

v1.24.2-u-ame.2#

Information

• Kubernetes version: v1.24.2-ubuntu
• Cluster controller version: v0.30.4
• OS: Ubuntu 20.04.4 LTS
• Date: 7Jul2022

Changes

• Upgrade Containerd to v1.6.6
• Upgrade Promtail sidecar to v2.5.0
• Upgrade EBS CSI to v1.6.1
• Add gp3 storage class (AWS)

Impact:

No additional impact

v1.24.1-u-ame.1#

Information

• Kubernetes version: v1.24.1-ubuntu
• Cluster controller version: v0.30.1
• OS: Ubuntu 20.04.4 LTS
• Date: 14Jun2022

Changes

• Upgrade Etcd to v3.5.3-0
• Upgrade Konnectivity to v0.0.31
• Upgrade Calico to v3.23.0
• Upgrade Containerd to v1.6.4
• Support Openstack (beta)
• Support DigitalOcean (beta)

Impact:

No additional impact

Kubernetes v1.23#

v1.23.14-u-ame.1#

Information

• Kubernetes version: v1.23.14-ubuntu
• Cluster controller version: v0.33.4
• OS: Ubuntu 20.04.5 LTS
• Date: 11nov2022

Changes

• Fix CVE-2022-3162: Unauthorized read of Custom Resources
• Fix CVE-2022-3294: Node address isn’t always verified when proxying

Impact:

No additional impact

v1.23.12-u-ame.0#

Information

• Kubernetes version: v1.23.12-ubuntu
• Cluster controller version: v0.33.0
• OS: Ubuntu 20.04.5 LTS
• Date: 30sep2022

Changes

• Upgrade Konnectivity to v0.0.33

v1.23.11-u-ame.2 - security release#

Information

• Kubernetes version: v1.23.11-ubuntu
• Cluster controller version: v0.32.4
• OS: Ubuntu 20.04.5 LTS
• Date: 19sep2022

Changes

• Upgrade Runc to v1.1.4
• Improved node installation

v1.23.10-u-ame.0#

Information

• Kubernetes version: v1.23.10-ubuntu
• Cluster controller version: v0.31.2
• OS: Ubuntu 20.04.4 LTS
• Date: 29aug2022

Changes

• Upgrade Containerd to v1.6.8
• Upgrade kube-state-metrics to v2.5.0
• Upgrade snapshot-controller to v4.0.1

Impact:

No additional impact

v1.23.8-u-ame.1#

Information

• Kubernetes version: v1.23.8-ubuntu
• Cluster controller version: v0.30.4
• OS: Ubuntu 20.04.4 LTS
• Date: 7Jul2022

Changes

• Upgrade Containerd to v1.6.6
• Upgrade Promtail sidecar to v2.5.0
• Upgrade EBS CSI to v1.6.1
• Add gp3 storage class (AWS)

Impact:

No additional impact

v1.23.7-u-ame.1#

Information

• Kubernetes version: v1.23.7-ubuntu
• Cluster controller version: v0.30.1
• OS: Ubuntu 20.04.4 LTS
• Date: 14Jun2022

Changes

• Upgrade Etcd to v3.5.3-0
• Upgrade Konnectivity to v0.0.31
• Upgrade Calico to v3.23.0
• Upgrade Containerd to v1.6.4
• Support Openstack (beta)
• Support DigitalOcean (beta)

Impact:

Control plane will be briefly offline during the upgrade

v1.23.6-u-ame.0#

Information

• Kubernetes version: v1.23.6-ubuntu
• Cluster controller version: v0.28.0
• OS: Ubuntu 20.04.4 LTS
• Date: 05may2022

Changes

• Upgrade node-problem-detector to v0.8.10
• Upgrade cluster-proportional-autoscaler to v1.8.5
• Upgrade metrics-server to v0.6.1
• Upgrade Etcd to v3.5.1-0
• Upgrade Containerd to v1.6.3

Impact:

Control plane will be briefly offline during the upgrade

v1.23.5-u-ame.0#

Information

• Kubernetes version: v1.23.5-ubuntu
• Cluster controller version: v0.27.3
• OS: Ubuntu 20.04.4 LTS
• Date: 22mar2022

Changes

• Resolve CVE-2022-0847
• Resolve CVE-2022-0778
• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4
• Fix NFS mounts

Impact:

No additional impact

v1.23.4-u-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.23.4-ubuntu
• Cluster controller version: v0.27.2
• Ubuntu 20.04.3 LTS

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

Kubernetes v1.22#

v1.22.14-u-ame.0 - security release#

Information

• Kubernetes version: v1.22.14-ubuntu
• Cluster controller version: v0.29.5
• OS: Ubuntu 20.04.5 LTS
• Date: 19sep2022

Impact:

No additional impact

v1.22.13-u-ame.0#

Information

• Kubernetes version: v1.22.13-ubuntu
• Cluster controller version: v0.29.4
• OS: Ubuntu 20.04.4 LTS
• Date: 29aug2022

Impact:

No additional impact

v1.22.13-ame.0#

Information

• Kubernetes version: v1.22.13
• Cluster controller version: v0.29.4
• OS: Centos 7
• Date: 29aug2022

Impact:

No additional impact

v1.22.11-u-ame.0#

Information

• Kubernetes version: v1.22.11-ubuntu
• Cluster controller version: v0.29.3
• OS: Ubuntu 20.04.4 LTS
• Date: 7Jul2022

Changes

• Upgrade Containerd to v1.5.13
• Upgrade Crictl to v1.22.1

Impact:

No additional impact

v1.22.11-ame.0#

Information

• Kubernetes version: v1.22.11
• Cluster controller version: v0.29.3
• OS: Centos 7
• Date: 7Jul2022

Changes

• Upgrade Crictl to v1.22.1

Impact:

No additional impact

v1.22.9-u-ame.0#

Information

• Kubernetes version: v1.22.9-ubuntu
• Cluster controller version: v0.28.0
• OS: Ubuntu 20.04.4 LTS
• Date: 22mar2022

Changes

• Upgrade node-problem-detector to v0.8.10
• Upgrade cluster-proportional-autoscaler to v1.8.5
• Upgrade metrics-server to v0.6.1
• Upgrade Etcd to v3.5.1-0
• Upgrade Containerd to v1.5.11

Impact:

Control plane will be briefly offline during the upgrade

Information

• Kubernetes version: v1.22.8-ubuntu
• Cluster controller version: v0.27.3
• OS: Ubuntu 20.04.4 LTS
• Date: 22mar2022

Changes

• Resolve CVE-2022-0847
• Resolve CVE-2022-0778
• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4
• Fix NFS mounts

Impact:

No additional impact

v1.22.8-ame.0#

Information

• Kubernetes version: v1.22.8
• Cluster controller version: v0.27.3
• Date: 22mar2022

Changes

• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4

Impact:

No additional impact

v1.22.7-u-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.22.7-ubuntu
• Cluster controller version: v0.27.2
• Ubuntu 20.04.3 LTS

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

v1.22.7-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.22.7
• Cluster controller version: v0.27.2

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

v1.22.6-u-ame.1 - 25feb2022#

Versions

• Kubernetes version: v1.22.6-ubuntu
• Cluster controller version: v0.27.1
• Ubuntu 20.04.3 LTS

Changes

• Various improvements
• Support Pod Security Feature Gate
• Remove installation of deprecated Pod Security Policy resources
• Full support for stopping and destroying clusters

Impact:

No additional impact

v1.22.6-ame.1 - 25feb2022#

Versions

• Kubernetes version: v1.22.6
• Cluster controller version: v0.27.1

Changes

• Various improvements
• Support Pod Security Feature Gate
• Remove installation of deprecated Pod Security Policy resources
• Full support for stopping and destroying clusters

Impact:

No additional impact

v1.22.6-u-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.22.6-ubuntu
• Cluster controller version: v0.26.1
• Ubuntu 20.04.3 LTS

Changes

• Resolve CVE-2022-0185
• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.5.9
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.22.6-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.22.6
• Cluster controller version: v0.26.1

Changes

• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.4.12 (from v1.5.5)
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.22.2-ame.0 - 20sep2021#

Versions

• Kubernetes version: v1.22.2
• Cluster controller version: v0.23.0

Changes

• Update registry.avisi.cloud for CNI images
• Upgrade apiserver network proxy to v0.0.24
• Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

Kubernetes v1.21#

v1.21.11-u-ame.0#

Information

• Kubernetes version: v1.21.11-ubuntu
• Cluster controller version: v0.27.3
• OS: Ubuntu 20.04.4 LTS
• Date: 22mar2022

Changes

• Resolve CVE-2022-0847
• Resolve CVE-2022-0778
• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4
• Fix NFS mounts

Impact:

No additional impact

v1.21.11-ame.0#

Information

• Kubernetes version: v1.21.11
• Cluster controller version: v0.27.3
• Date: 22mar2022

Changes

• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4

Impact:

No additional impact

v1.21.10-u-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.21.10-ubuntu
• Cluster controller version: v0.27.2
• Ubuntu 20.04.3 LTS

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

v1.21.10-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.21.10
• Cluster controller version: v0.27.2

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

v1.21.9-u-ame.1 - 25feb2022#

Versions

• Kubernetes version: v1.21.9-ubuntu
• Cluster controller version: v0.26.3
• Ubuntu 20.04.3 LTS

Changes

• Minor bug fixes

Impact:

No additional impact

v1.21.9-ame.1 - 25feb2022#

Versions

• Kubernetes version: v1.21.9
• Cluster controller version: v0.26.3

Changes

• Minor bug fixes

Impact:

No additional impact

v1.21.9-u-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.21.9-ubuntu
• Cluster controller version: v0.26.1
• Ubuntu 20.04.3 LTS

Changes

• Resolve CVE-2022-0185
• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.5.9
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.21.9-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.21.9
• Cluster controller version: v0.26.1

Changes

• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.4.12 (from v1.5.5)
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.21.5-ame.0 - 20sep2021#

• Kubernetes version: v1.21.5
• Cluster controller version: v0.23.0

Changes

• Update registry.avisi.cloud for CNI images
• Upgrade apiserver network proxy to v0.0.24
• Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

Kubernetes v1.20#

v1.20.15-u-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.20.15-ubuntu
• Cluster controller version: v0.26.1
• Ubuntu 20.04.3 LTS

Changes

• Resolve CVE-2022-0185
• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.5.9
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.15-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.20.15
• Cluster controller version: v0.26.1

Changes

• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.4.12 (from v1.5.5)
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.11-ame.0 - 20sep2021#

Versions

• Kubernetes version: v1.20.11
• Cluster controller version: v0.23.0

Changes

• Update registry.avisi.cloud for CNI images
• Upgrade apiserver network proxy to v0.0.24
• Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.8-ame.0 - 29jul2021#

• Kubernetes version: v1.20.8
• Cluster controller version: v0.21.1

Changes

• Upgrade containerd to v1.5.4
• Upgrade apiserver network proxy to v0.0.21

Impact

No additional impact

v1.20.6-ame.1 - 19jul2021#

Versions

• Kubernetes version: v1.20.6
• Cluster controller version: v0.21.0

Changes

• Upgrade calico to v3.19.1
• upgrade ceph-csi to v3.3.1
• Make IAM policy cluster unique
• renew certificate 3 months before its expiry
• Various bug fixes

Impact:

API SERVER DOWNTIME

Control plane will be briefly down during the upgrade