Release Notes.

Release notes for Avisi Cloud Kubernetes.

Introduction

This page documents updates to the Avisi Managed Environment Kubernetes clusters. This contains; new or updated functionality, bug fixes, known issues and deprecation announcements.

Table of Content

Upcoming releases

Kubernetes v1.27


Release notes

Kubernetes v1.26

v1.26.2-u-ame.3

Information

  • Kubernetes version: v1.26.2-ubuntu
  • Cluster controller version: v0.35.6
  • OS: Ubuntu 22.04.1 LTS
  • Date: 21MAR2023

Changes

  • Optimized sysctl settings for nodes
  • Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)

Impact:

No additional impact

v1.26.2-u-ame.1

Information

  • Kubernetes version: v1.26.2-ubuntu
  • Cluster controller version: v0.35.5
  • OS: Ubuntu 22.04.1 LTS
  • Date: 06MAR2023

Changes

  • Upgrade Containerd to v1.6.19
  • Add support for replacing orphaned machines

Impact:

No additional impact

v1.26.0-u-ame.2

Information

  • Kubernetes version: v1.26.0-ubuntu
  • Cluster controller version: 0.35.2
  • OS: Ubuntu 22.04.1 LTS
  • Date: 29DEC2022

Changes

  • Upgrade Containerd to v1.6.14
  • Enable seccomp by default for all workloads
  • NAT gateway is now only provisioned when a node pool exists within the availability zone (AWS only)
  • Upgrade snapshot controller to v4.2.1
  • Upgrade cluster-proportional-autoscaler to 1.8.6
  • Upgrade node problem detector to v0.8.12
  • Add VPC gateway endpoints for S3 within the same region (AWS only)
  • Switch to registry.k8s.io for all Kubernetes images (k8s.grc.io is deprecated)
  • Drop support for Pod Security Policy (replaced by Pod Security Standards)
  • Collect resource usage for cloud resources
  • Upgrade node distribution to Ubuntu 22.04 LTS Jammy

Impact:

No additional impact

Kubernetes v1.25

v1.25.7-u-ame.3

Information

  • Kubernetes version: v1.25.7-ubuntu
  • Cluster controller version: v0.35.6
  • OS: Ubuntu 20.04.5 LTS
  • Date: 21MAR2023

Changes

  • Optimized sysctl settings for nodes
  • Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)

Impact:

No additional impact

v1.25.7-u-ame.2

Superseded by v1.25.7-u-ame.3

v1.25.7-u-ame.1

Information

  • Kubernetes version: v1.25.7-ubuntu
  • Cluster controller version: v0.35.5
  • OS: Ubuntu 20.04.5 LTS
  • Date: 06MAR2023

Changes

  • Upgrade Containerd to v1.6.19
  • Add support for replacing orphaned machines

Impact:

No additional impact

v1.25.6-u-ame.6

Information

  • Kubernetes version: v1.25.6-ubuntu
  • Cluster controller version: v0.35.6
  • OS: Ubuntu 20.04.5 LTS
  • Date: 21MAR2023

Changes

  • Optimized sysctl settings for nodes
  • Calico upgrade to v3.25 (fix broken http/2 health checking for calico-controller)
  • Add support for replacing orphaned machines

Impact:

No additional impact

v1.25.5-u-ame.2

Information

  • Kubernetes version: v1.25.5-ubuntu
  • Cluster controller version: 0.35.2
  • OS: Ubuntu 20.04.5 LTS
  • Date: 29DEC2022

Changes

  • Upgrade Containerd to v1.6.14
  • Enable seccomp by default for all workloads
  • NAT gateway is now only provisioned when a node pool exists within the availability zone (AWS only)
  • Upgrade snapshot controller to v4.2.1
  • Upgrade cluster-proportional-autoscaler to 1.8.6
  • Upgrade node problem detector to v0.8.12
  • Add VPC gateway endpoints for S3 within the same region (AWS only)
  • Switch to registry.k8s.io for all Kubernetes images (k8s.grc.io is deprecated)
  • Drop support for Pod Security Policy (replaced by Pod Security Standards)
  • Collect resource usage for cloud resources

Impact:

No additional impact

Kubernetes v1.24

v1.24.8-u-ame.1

Information

  • Kubernetes version: v1.24.8-ubuntu
  • Cluster controller version: v0.33.4
  • OS: Ubuntu 20.04.5 LTS
  • Date: 11nov2022

Changes

Impact:

No additional impact

v1.24.6-u-ame.0

Information

  • Kubernetes version: v1.24.6-ubuntu
  • Cluster controller version: v0.33.0
  • OS: Ubuntu 20.04.5 LTS
  • Date: 30sep2022

Changes

  • Upgrade Konnectivity to v0.0.33

Impact:

No additional impact

v1.24.5-u-ame.2 - security release

Information

  • Kubernetes version: v1.24.5-ubuntu
  • Cluster controller version: v0.32.4
  • OS: Ubuntu 20.04.5 LTS
  • Date: 19sep2022

Changes

  • Upgrade Runc to v1.1.4
  • Improved node installation

v1.24.4-u-ame.0

Information

  • Kubernetes version: v1.24.4-ubuntu
  • Cluster controller version: v0.31.2
  • OS: Ubuntu 20.04.4 LTS
  • Date: 29aug2022

Changes

  • Upgrade Containerd to v1.6.8
  • Upgrade kube-state-metrics to v2.5.0
  • Upgrade snapshot-controller to v4.0.1

Impact:

No additional impact

v1.24.2-u-ame.2

Information

  • Kubernetes version: v1.24.2-ubuntu
  • Cluster controller version: v0.30.4
  • OS: Ubuntu 20.04.4 LTS
  • Date: 7Jul2022

Changes

  • Upgrade Containerd to v1.6.6
  • Upgrade Promtail sidecar to v2.5.0
  • Upgrade EBS CSI to v1.6.1
  • Add gp3 storage class (AWS)

Impact:

No additional impact

v1.24.1-u-ame.1

Information

  • Kubernetes version: v1.24.1-ubuntu
  • Cluster controller version: v0.30.1
  • OS: Ubuntu 20.04.4 LTS
  • Date: 14Jun2022

Changes

  • Upgrade Etcd to v3.5.3-0
  • Upgrade Konnectivity to v0.0.31
  • Upgrade Calico to v3.23.0
  • Upgrade Containerd to v1.6.4
  • Support Openstack (beta)
  • Support DigitalOcean (beta)

Impact:

No additional impact


Kubernetes v1.23

v1.23.14-u-ame.1

Information

  • Kubernetes version: v1.23.14-ubuntu
  • Cluster controller version: v0.33.4
  • OS: Ubuntu 20.04.5 LTS
  • Date: 11nov2022

Changes

Impact:

No additional impact

v1.23.12-u-ame.0

Information

  • Kubernetes version: v1.23.12-ubuntu
  • Cluster controller version: v0.33.0
  • OS: Ubuntu 20.04.5 LTS
  • Date: 30sep2022

Changes

  • Upgrade Konnectivity to v0.0.33

v1.23.11-u-ame.2 - security release

Information

  • Kubernetes version: v1.23.11-ubuntu
  • Cluster controller version: v0.32.4
  • OS: Ubuntu 20.04.5 LTS
  • Date: 19sep2022

Changes

  • Upgrade Runc to v1.1.4
  • Improved node installation

v1.23.10-u-ame.0

Information

  • Kubernetes version: v1.23.10-ubuntu
  • Cluster controller version: v0.31.2
  • OS: Ubuntu 20.04.4 LTS
  • Date: 29aug2022

Changes

  • Upgrade Containerd to v1.6.8
  • Upgrade kube-state-metrics to v2.5.0
  • Upgrade snapshot-controller to v4.0.1

Impact:

No additional impact

v1.23.8-u-ame.1

Information

  • Kubernetes version: v1.23.8-ubuntu
  • Cluster controller version: v0.30.4
  • OS: Ubuntu 20.04.4 LTS
  • Date: 7Jul2022

Changes

  • Upgrade Containerd to v1.6.6
  • Upgrade Promtail sidecar to v2.5.0
  • Upgrade EBS CSI to v1.6.1
  • Add gp3 storage class (AWS)

Impact:

No additional impact

v1.23.7-u-ame.1

Information

  • Kubernetes version: v1.23.7-ubuntu
  • Cluster controller version: v0.30.1
  • OS: Ubuntu 20.04.4 LTS
  • Date: 14Jun2022

Changes

  • Upgrade Etcd to v3.5.3-0
  • Upgrade Konnectivity to v0.0.31
  • Upgrade Calico to v3.23.0
  • Upgrade Containerd to v1.6.4
  • Support Openstack (beta)
  • Support DigitalOcean (beta)

Impact:

Control plane will be briefly offline during the upgrade

v1.23.6-u-ame.0

Information

  • Kubernetes version: v1.23.6-ubuntu
  • Cluster controller version: v0.28.0
  • OS: Ubuntu 20.04.4 LTS
  • Date: 05may2022

Changes

  • Upgrade node-problem-detector to v0.8.10
  • Upgrade cluster-proportional-autoscaler to v1.8.5
  • Upgrade metrics-server to v0.6.1
  • Upgrade Etcd to v3.5.1-0
  • Upgrade Containerd to v1.6.3

Impact:

Control plane will be briefly offline during the upgrade

v1.23.5-u-ame.0

Information

  • Kubernetes version: v1.23.5-ubuntu
  • Cluster controller version: v0.27.3
  • OS: Ubuntu 20.04.4 LTS
  • Date: 22mar2022

Changes

  • Resolve CVE-2022-0847
  • Resolve CVE-2022-0778
  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4
  • Fix NFS mounts

Impact:

No additional impact

v1.23.4-u-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.23.4-ubuntu
  • Cluster controller version: v0.27.2
  • Ubuntu 20.04.3 LTS

Changes

Impact:

No additional impact

Kubernetes v1.22

v1.22.14-u-ame.0 - security release

Information

  • Kubernetes version: v1.22.14-ubuntu
  • Cluster controller version: v0.29.5
  • OS: Ubuntu 20.04.5 LTS
  • Date: 19sep2022

Impact:

No additional impact

v1.22.13-u-ame.0

Information

  • Kubernetes version: v1.22.13-ubuntu
  • Cluster controller version: v0.29.4
  • OS: Ubuntu 20.04.4 LTS
  • Date: 29aug2022

Impact:

No additional impact

v1.22.13-ame.0

Information

  • Kubernetes version: v1.22.13
  • Cluster controller version: v0.29.4
  • OS: Centos 7
  • Date: 29aug2022

Impact:

No additional impact

v1.22.11-u-ame.0

Information

  • Kubernetes version: v1.22.11-ubuntu
  • Cluster controller version: v0.29.3
  • OS: Ubuntu 20.04.4 LTS
  • Date: 7Jul2022

Changes

  • Upgrade Containerd to v1.5.13
  • Upgrade Crictl to v1.22.1

Impact:

No additional impact

v1.22.11-ame.0

Information

  • Kubernetes version: v1.22.11
  • Cluster controller version: v0.29.3
  • OS: Centos 7
  • Date: 7Jul2022

Changes

  • Upgrade Crictl to v1.22.1

Impact:

No additional impact

v1.22.9-u-ame.0

Information

  • Kubernetes version: v1.22.9-ubuntu
  • Cluster controller version: v0.28.0
  • OS: Ubuntu 20.04.4 LTS
  • Date: 22mar2022

Changes

  • Upgrade node-problem-detector to v0.8.10
  • Upgrade cluster-proportional-autoscaler to v1.8.5
  • Upgrade metrics-server to v0.6.1
  • Upgrade Etcd to v3.5.1-0
  • Upgrade Containerd to v1.5.11

Impact:

Control plane will be briefly offline during the upgrade

Information

  • Kubernetes version: v1.22.8-ubuntu
  • Cluster controller version: v0.27.3
  • OS: Ubuntu 20.04.4 LTS
  • Date: 22mar2022

Changes

  • Resolve CVE-2022-0847
  • Resolve CVE-2022-0778
  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4
  • Fix NFS mounts

Impact:

No additional impact

v1.22.8-ame.0

Information

  • Kubernetes version: v1.22.8
  • Cluster controller version: v0.27.3
  • Date: 22mar2022

Changes

  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4

Impact:

No additional impact

v1.22.7-u-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.22.7-ubuntu
  • Cluster controller version: v0.27.2
  • Ubuntu 20.04.3 LTS

Changes

Impact:

No additional impact

v1.22.7-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.22.7
  • Cluster controller version: v0.27.2

Changes

Impact:

No additional impact

v1.22.6-u-ame.1 - 25feb2022

Versions

  • Kubernetes version: v1.22.6-ubuntu
  • Cluster controller version: v0.27.1
  • Ubuntu 20.04.3 LTS

Changes

  • Various improvements
  • Support Pod Security Feature Gate
  • Remove installation of deprecated Pod Security Policy resources
  • Full support for stopping and destroying clusters

Impact:

No additional impact

v1.22.6-ame.1 - 25feb2022

Versions

  • Kubernetes version: v1.22.6
  • Cluster controller version: v0.27.1

Changes

  • Various improvements
  • Support Pod Security Feature Gate
  • Remove installation of deprecated Pod Security Policy resources
  • Full support for stopping and destroying clusters

Impact:

No additional impact

v1.22.6-u-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.22.6-ubuntu
  • Cluster controller version: v0.26.1
  • Ubuntu 20.04.3 LTS

Changes

  • Resolve CVE-2022-0185
  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.5.9
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.22.6-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.22.6
  • Cluster controller version: v0.26.1

Changes

  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.4.12 (from v1.5.5)
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.22.2-ame.0 - 20sep2021

Versions

  • Kubernetes version: v1.22.2
  • Cluster controller version: v0.23.0

Changes

  • Update registry.avisi.cloud for CNI images
  • Upgrade apiserver network proxy to v0.0.24
  • Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

Kubernetes v1.21

v1.21.11-u-ame.0

Information

  • Kubernetes version: v1.21.11-ubuntu
  • Cluster controller version: v0.27.3
  • OS: Ubuntu 20.04.4 LTS
  • Date: 22mar2022

Changes

  • Resolve CVE-2022-0847
  • Resolve CVE-2022-0778
  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4
  • Fix NFS mounts

Impact:

No additional impact

v1.21.11-ame.0

Information

  • Kubernetes version: v1.21.11
  • Cluster controller version: v0.27.3
  • Date: 22mar2022

Changes

  • Upgrade Ceph CSI plugin to v3.5.1
  • Upgrade Konnectivity to v0.0.30
  • Upgrade Calico to v3.21.4

Impact:

No additional impact

v1.21.10-u-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.21.10-ubuntu
  • Cluster controller version: v0.27.2
  • Ubuntu 20.04.3 LTS

Changes

Impact:

No additional impact

v1.21.10-ame.0 - 04mar2022

Versions

  • Kubernetes version: v1.21.10
  • Cluster controller version: v0.27.2

Changes

Impact:

No additional impact

v1.21.9-u-ame.1 - 25feb2022

Versions

  • Kubernetes version: v1.21.9-ubuntu
  • Cluster controller version: v0.26.3
  • Ubuntu 20.04.3 LTS

Changes

  • Minor bug fixes

Impact:

No additional impact

v1.21.9-ame.1 - 25feb2022

Versions

  • Kubernetes version: v1.21.9
  • Cluster controller version: v0.26.3

Changes

  • Minor bug fixes

Impact:

No additional impact

v1.21.9-u-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.21.9-ubuntu
  • Cluster controller version: v0.26.1
  • Ubuntu 20.04.3 LTS

Changes

  • Resolve CVE-2022-0185
  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.5.9
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.21.9-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.21.9
  • Cluster controller version: v0.26.1

Changes

  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.4.12 (from v1.5.5)
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.21.5-ame.0 - 20sep2021

  • Kubernetes version: v1.21.5
  • Cluster controller version: v0.23.0

Changes

  • Update registry.avisi.cloud for CNI images
  • Upgrade apiserver network proxy to v0.0.24
  • Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.


Kubernetes v1.20

v1.20.15-u-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.20.15-ubuntu
  • Cluster controller version: v0.26.1
  • Ubuntu 20.04.3 LTS

Changes

  • Resolve CVE-2022-0185
  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.5.9
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.15-ame.0 - 2feb2022

Versions

  • Kubernetes version: v1.20.15
  • Cluster controller version: v0.26.1

Changes

  • Resolve CVE-2021-4034
  • Improved node-provisioner
  • Improved periodic reconcile
  • Eviction threshold increased from 300Mi to 600Mi for nodes < 5000Mi
  • Various bug fixes
  • Upgrade Calico to v3.21.2
  • Upgrade Containerd to v1.4.12 (from v1.5.5)
  • Upgrade kube-state-metrics to v2.3.0
  • Upgrade Konnectivity to v0.0.27

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.

v1.20.11-ame.0 - 20sep2021

Versions

  • Kubernetes version: v1.20.11
  • Cluster controller version: v0.23.0

Changes

  • Update registry.avisi.cloud for CNI images
  • Upgrade apiserver network proxy to v0.0.24
  • Resolve CVE-2021-25741

Impact:

API SERVER DOWNTIME

Control plane will be briefly offline during the upgrade.


v1.20.8-ame.0 - 29jul2021

  • Kubernetes version: v1.20.8
  • Cluster controller version: v0.21.1

Changes

  • Upgrade containerd to v1.5.4
  • Upgrade apiserver network proxy to v0.0.21

Impact

No additional impact


v1.20.6-ame.1 - 19jul2021

Versions

  • Kubernetes version: v1.20.6
  • Cluster controller version: v0.21.0

Changes

  • Upgrade calico to v3.19.1
  • upgrade ceph-csi to v3.3.1
  • Make IAM policy cluster unique
  • renew certificate 3 months before its expiry
  • Various bug fixes

Impact:

API SERVER DOWNTIME

Control plane will be briefly down during the upgrade