Release Notes.

Release notes for Avisi Cloud Kubernetes.

Introduction

This page documents updates to the Avisi Managed Environment Kubernetes clusters. This contains; new or updated functionality, bug fixes, known issues and deprecation announcements.

• Please see our Kubernetes lifecycle policy for more information about how we handle our version management.
• Check out our how to upgrade for information on how to upgrade your cluster.

Table of Content

Upcoming releases#

Kubernetes v1.27#

Release notes#

Kubernetes v1.26#

v1.26.2-u-ame.3#

Information

• Kubernetes version: v1.26.2-ubuntu
• Cluster controller version: v0.35.6
• OS: Ubuntu 22.04.1 LTS
• Date: 21MAR2023

Changes

• Optimized sysctl settings for nodes
• Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)

Impact:

No additional impact

v1.26.2-u-ame.1#

Information

• Kubernetes version: v1.26.2-ubuntu
• Cluster controller version: v0.35.5
• OS: Ubuntu 22.04.1 LTS
• Date: 06MAR2023

Changes

• Upgrade Containerd to v1.6.19
• Add support for replacing orphaned machines

Impact:

No additional impact

v1.26.0-u-ame.2#

Information

• Kubernetes version: v1.26.0-ubuntu
• Cluster controller version: 0.35.2
• OS: Ubuntu 22.04.1 LTS
• Date: 29DEC2022

Changes

• Upgrade Containerd to v1.6.14
• Enable seccomp by default for all workloads
• NAT gateway is now only provisioned when a node pool exists within the availability zone (AWS only)
• Upgrade snapshot controller to v4.2.1
• Upgrade cluster-proportional-autoscaler to 1.8.6
• Upgrade node problem detector to v0.8.12
• Add VPC gateway endpoints for S3 within the same region (AWS only)
• Switch to registry.k8s.io for all Kubernetes images (k8s.grc.io is deprecated)
• Drop support for Pod Security Policy (replaced by Pod Security Standards)
• Collect resource usage for cloud resources
• Upgrade node distribution to Ubuntu 22.04 LTS Jammy

Impact:

No additional impact

Kubernetes v1.25#

v1.25.7-u-ame.3#

Information

• Kubernetes version: v1.25.7-ubuntu
• Cluster controller version: v0.35.6
• OS: Ubuntu 20.04.5 LTS
• Date: 21MAR2023

Changes

• Optimized sysctl settings for nodes
• Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)

Impact:

No additional impact

v1.25.7-u-ame.2#

Superseded by v1.25.7-u-ame.3

v1.25.7-u-ame.1#

Information

• Kubernetes version: v1.25.7-ubuntu
• Cluster controller version: v0.35.5
• OS: Ubuntu 20.04.5 LTS
• Date: 06MAR2023

Changes

• Upgrade Containerd to v1.6.19
• Add support for replacing orphaned machines

Impact:

No additional impact

v1.25.6-u-ame.6#

Information

• Kubernetes version: v1.25.6-ubuntu
• Cluster controller version: v0.35.6
• OS: Ubuntu 20.04.5 LTS
• Date: 21MAR2023

Changes

• Optimized sysctl settings for nodes
• Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)
• Add support for replacing orphaned machines

Impact:

No additional impact

v1.25.5-u-ame.2#

Information

• Kubernetes version: v1.25.5-ubuntu
• Cluster controller version: 0.35.2
• OS: Ubuntu 20.04.5 LTS
• Date: 29DEC2022

Changes

• Upgrade Containerd to v1.6.14
• Enable seccomp by default for all workloads
• NAT gateway is now only provisioned when a node pool exists within the availability zone (AWS only)
• Upgrade snapshot controller to v4.2.1
• Upgrade cluster-proportional-autoscaler to 1.8.6
• Upgrade node problem detector to v0.8.12
• Add VPC gateway endpoints for S3 within the same region (AWS only)
• Switch to registry.k8s.io for all Kubernetes images (k8s.grc.io is deprecated)
• Drop support for Pod Security Policy (replaced by Pod Security Standards)
• Collect resource usage for cloud resources

Impact:

No additional impact

Kubernetes v1.24#

v1.24.8-u-ame.1#

Information

• Kubernetes version: v1.24.8-ubuntu
• Cluster controller version: v0.33.4
• OS: Ubuntu 20.04.5 LTS
• Date: 11nov2022

Changes

• Fix CVE-2022-3162: Unauthorized read of Custom Resources
• Fix CVE-2022-3294: Node address isn’t always verified when proxying

Impact:

No additional impact

v1.24.6-u-ame.0#

Information

• Kubernetes version: v1.24.6-ubuntu
• Cluster controller version: v0.33.0
• OS: Ubuntu 20.04.5 LTS
• Date: 30sep2022

Changes

• Upgrade Konnectivity to v0.0.33

Impact:

No additional impact

v1.24.5-u-ame.2 - security release#

Information

• Kubernetes version: v1.24.5-ubuntu
• Cluster controller version: v0.32.4
• OS: Ubuntu 20.04.5 LTS
• Date: 19sep2022

Changes

• Upgrade Runc to v1.1.4
• Improved node installation

v1.24.4-u-ame.0#

Information

• Kubernetes version: v1.24.4-ubuntu
• Cluster controller version: v0.31.2
• OS: Ubuntu 20.04.4 LTS
• Date: 29aug2022

Changes

• Upgrade Containerd to v1.6.8
• Upgrade kube-state-metrics to v2.5.0
• Upgrade snapshot-controller to v4.0.1

Impact:

No additional impact

v1.24.2-u-ame.2#

Information

• Kubernetes version: v1.24.2-ubuntu
• Cluster controller version: v0.30.4
• OS: Ubuntu 20.04.4 LTS
• Date: 7Jul2022

Changes

• Upgrade Containerd to v1.6.6
• Upgrade Promtail sidecar to v2.5.0
• Upgrade EBS CSI to v1.6.1
• Add gp3 storage class (AWS)

Impact:

No additional impact

v1.24.1-u-ame.1#

Information

• Kubernetes version: v1.24.1-ubuntu
• Cluster controller version: v0.30.1
• OS: Ubuntu 20.04.4 LTS
• Date: 14Jun2022

Changes

• Upgrade Etcd to v3.5.3-0
• Upgrade Konnectivity to v0.0.31
• Upgrade Calico to v3.23.0
• Upgrade Containerd to v1.6.4
• Support Openstack (beta)
• Support DigitalOcean (beta)

Impact:

No additional impact

Kubernetes v1.23#

v1.23.14-u-ame.1#

Information

• Kubernetes version: v1.23.14-ubuntu
• Cluster controller version: v0.33.4
• OS: Ubuntu 20.04.5 LTS
• Date: 11nov2022

Changes

• Fix CVE-2022-3162: Unauthorized read of Custom Resources
• Fix CVE-2022-3294: Node address isn’t always verified when proxying

Impact:

No additional impact

v1.23.12-u-ame.0#

Information

• Kubernetes version: v1.23.12-ubuntu
• Cluster controller version: v0.33.0
• OS: Ubuntu 20.04.5 LTS
• Date: 30sep2022

Changes

• Upgrade Konnectivity to v0.0.33

v1.23.11-u-ame.2 - security release#

Information

• Kubernetes version: v1.23.11-ubuntu
• Cluster controller version: v0.32.4
• OS: Ubuntu 20.04.5 LTS
• Date: 19sep2022

Changes

• Upgrade Runc to v1.1.4
• Improved node installation

v1.23.10-u-ame.0#

Information

• Kubernetes version: v1.23.10-ubuntu
• Cluster controller version: v0.31.2
• OS: Ubuntu 20.04.4 LTS
• Date: 29aug2022

Changes

• Upgrade Containerd to v1.6.8
• Upgrade kube-state-metrics to v2.5.0
• Upgrade snapshot-controller to v4.0.1

Impact:

No additional impact

v1.23.8-u-ame.1#

Information

• Kubernetes version: v1.23.8-ubuntu
• Cluster controller version: v0.30.4
• OS: Ubuntu 20.04.4 LTS
• Date: 7Jul2022

Changes

• Upgrade Containerd to v1.6.6
• Upgrade Promtail sidecar to v2.5.0
• Upgrade EBS CSI to v1.6.1
• Add gp3 storage class (AWS)

Impact:

No additional impact

v1.23.7-u-ame.1#

Information

• Kubernetes version: v1.23.7-ubuntu
• Cluster controller version: v0.30.1
• OS: Ubuntu 20.04.4 LTS
• Date: 14Jun2022

Changes

• Upgrade Etcd to v3.5.3-0
• Upgrade Konnectivity to v0.0.31
• Upgrade Calico to v3.23.0
• Upgrade Containerd to v1.6.4
• Support Openstack (beta)
• Support DigitalOcean (beta)

Impact:

Control plane will be briefly offline during the upgrade

v1.23.6-u-ame.0#

Information

• Kubernetes version: v1.23.6-ubuntu
• Cluster controller version: v0.28.0
• OS: Ubuntu 20.04.4 LTS
• Date: 05may2022

Changes

• Upgrade node-problem-detector to v0.8.10
• Upgrade cluster-proportional-autoscaler to v1.8.5
• Upgrade metrics-server to v0.6.1
• Upgrade Etcd to v3.5.1-0
• Upgrade Containerd to v1.6.3

Impact:

Control plane will be briefly offline during the upgrade

v1.23.5-u-ame.0#

Information

• Kubernetes version: v1.23.5-ubuntu
• Cluster controller version: v0.27.3
• OS: Ubuntu 20.04.4 LTS
• Date: 22mar2022

Changes

• Resolve CVE-2022-0847
• Resolve CVE-2022-0778
• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4
• Fix NFS mounts

Impact:

No additional impact

v1.23.4-u-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.23.4-ubuntu
• Cluster controller version: v0.27.2
• Ubuntu 20.04.3 LTS

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

Kubernetes v1.22#

v1.22.14-u-ame.0 - security release#

Information

• Kubernetes version: v1.22.14-ubuntu
• Cluster controller version: v0.29.5
• OS: Ubuntu 20.04.5 LTS
• Date: 19sep2022

Impact:

No additional impact

v1.22.13-u-ame.0#

Information

• Kubernetes version: v1.22.13-ubuntu
• Cluster controller version: v0.29.4
• OS: Ubuntu 20.04.4 LTS
• Date: 29aug2022

Impact:

No additional impact

v1.22.13-ame.0#

Information

• Kubernetes version: v1.22.13
• Cluster controller version: v0.29.4
• OS: Centos 7
• Date: 29aug2022

Impact:

No additional impact

v1.22.11-u-ame.0#

Information

• Kubernetes version: v1.22.11-ubuntu
• Cluster controller version: v0.29.3
• OS: Ubuntu 20.04.4 LTS
• Date: 7Jul2022

Changes

• Upgrade Containerd to v1.5.13
• Upgrade Crictl to v1.22.1

Impact:

No additional impact

v1.22.11-ame.0#

Information

• Kubernetes version: v1.22.11
• Cluster controller version: v0.29.3
• OS: Centos 7
• Date: 7Jul2022

Changes

• Upgrade Crictl to v1.22.1

Impact:

No additional impact

v1.22.9-u-ame.0#

Information

• Kubernetes version: v1.22.9-ubuntu
• Cluster controller version: v0.28.0
• OS: Ubuntu 20.04.4 LTS
• Date: 22mar2022

Changes

• Upgrade node-problem-detector to v0.8.10
• Upgrade cluster-proportional-autoscaler to v1.8.5
• Upgrade metrics-server to v0.6.1
• Upgrade Etcd to v3.5.1-0
• Upgrade Containerd to v1.5.11

Impact:

Control plane will be briefly offline during the upgrade

Information

• Kubernetes version: v1.22.8-ubuntu
• Cluster controller version: v0.27.3
• OS: Ubuntu 20.04.4 LTS
• Date: 22mar2022

Changes

• Resolve CVE-2022-0847
• Resolve CVE-2022-0778
• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4
• Fix NFS mounts

Impact:

No additional impact

v1.22.8-ame.0#

Information

• Kubernetes version: v1.22.8
• Cluster controller version: v0.27.3
• Date: 22mar2022

Changes

• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4

Impact:

No additional impact

v1.22.7-u-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.22.7-ubuntu
• Cluster controller version: v0.27.2
• Ubuntu 20.04.3 LTS

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

v1.22.7-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.22.7
• Cluster controller version: v0.27.2

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

v1.22.6-u-ame.1 - 25feb2022#

Versions

• Kubernetes version: v1.22.6-ubuntu
• Cluster controller version: v0.27.1
• Ubuntu 20.04.3 LTS

Changes

• Various improvements
• Support Pod Security Feature Gate
• Remove installation of deprecated Pod Security Policy resources
• Full support for stopping and destroying clusters

Impact:

No additional impact

v1.22.6-ame.1 - 25feb2022#

Versions

• Kubernetes version: v1.22.6
• Cluster controller version: v0.27.1

Changes

• Various improvements
• Support Pod Security Feature Gate
• Remove installation of deprecated Pod Security Policy resources
• Full support for stopping and destroying clusters

Impact:

No additional impact

v1.22.6-u-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.22.6-ubuntu
• Cluster controller version: v0.26.1
• Ubuntu 20.04.3 LTS

Changes

• Resolve CVE-2022-0185
• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.5.9
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.22.6-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.22.6
• Cluster controller version: v0.26.1

Changes

• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.4.12 (from v1.5.5)
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.22.2-ame.0 - 20sep2021#

Versions

• Kubernetes version: v1.22.2
• Cluster controller version: v0.23.0

Changes

• Update registry.avisi.cloud for CNI images
• Upgrade apiserver network proxy to v0.0.24
• Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

Kubernetes v1.21#

v1.21.11-u-ame.0#

Information

• Kubernetes version: v1.21.11-ubuntu
• Cluster controller version: v0.27.3
• OS: Ubuntu 20.04.4 LTS
• Date: 22mar2022

Changes

• Resolve CVE-2022-0847
• Resolve CVE-2022-0778
• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4
• Fix NFS mounts

Impact:

No additional impact

v1.21.11-ame.0#

Information

• Kubernetes version: v1.21.11
• Cluster controller version: v0.27.3
• Date: 22mar2022

Changes

• Upgrade Ceph CSI plugin to v3.5.1
• Upgrade Konnectivity to v0.0.30
• Upgrade Calico to v3.21.4

Impact:

No additional impact

v1.21.10-u-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.21.10-ubuntu
• Cluster controller version: v0.27.2
• Ubuntu 20.04.3 LTS

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

v1.21.10-ame.0 - 04mar2022#

Versions

• Kubernetes version: v1.21.10
• Cluster controller version: v0.27.2

Changes

• Resolve containerd CVE CVE-2022-23648

Impact:

No additional impact

v1.21.9-u-ame.1 - 25feb2022#

Versions

• Kubernetes version: v1.21.9-ubuntu
• Cluster controller version: v0.26.3
• Ubuntu 20.04.3 LTS

Changes

• Minor bug fixes

Impact:

No additional impact

v1.21.9-ame.1 - 25feb2022#

Versions

• Kubernetes version: v1.21.9
• Cluster controller version: v0.26.3

Changes

• Minor bug fixes

Impact:

No additional impact

v1.21.9-u-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.21.9-ubuntu
• Cluster controller version: v0.26.1
• Ubuntu 20.04.3 LTS

Changes

• Resolve CVE-2022-0185
• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.5.9
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.21.9-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.21.9
• Cluster controller version: v0.26.1

Changes

• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.4.12 (from v1.5.5)
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.21.5-ame.0 - 20sep2021#

• Kubernetes version: v1.21.5
• Cluster controller version: v0.23.0

Changes

• Update registry.avisi.cloud for CNI images
• Upgrade apiserver network proxy to v0.0.24
• Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

Kubernetes v1.20#

v1.20.15-u-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.20.15-ubuntu
• Cluster controller version: v0.26.1
• Ubuntu 20.04.3 LTS

Changes

• Resolve CVE-2022-0185
• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.5.9
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.15-ame.0 - 2feb2022#

Versions

• Kubernetes version: v1.20.15
• Cluster controller version: v0.26.1

Changes

• Resolve CVE-2021-4034
• Improved node-provisioner
• Improved periodic reconcile
• Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
• Various bug fixes
• Upgrade Calico to v3.21.2
• Upgrade Containerd to v1.4.12 (from v1.5.5)
• Upgrade kube-state-metrics to v2.3.0
• Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.11-ame.0 - 20sep2021#

Versions

• Kubernetes version: v1.20.11
• Cluster controller version: v0.23.0

Changes

• Update registry.avisi.cloud for CNI images
• Upgrade apiserver network proxy to v0.0.24
• Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.8-ame.0 - 29jul2021#

• Kubernetes version: v1.20.8
• Cluster controller version: v0.21.1

Changes

• Upgrade containerd to v1.5.4
• Upgrade apiserver network proxy to v0.0.21

Impact

No additional impact

v1.20.6-ame.1 - 19jul2021#

Versions

• Kubernetes version: v1.20.6
• Cluster controller version: v0.21.0

Changes

• Upgrade calico to v3.19.1
• upgrade ceph-csi to v3.3.1
• Make IAM policy cluster unique
• renew certificate 3 months before its expiry
• Various bug fixes

Impact:

API SERVER DOWNTIME

Control plane will be briefly down during the upgrade