The Shift to cgroup v2 in Kubernetes: What You Need to Know
In Linux, cgroups (control groups) are a kernel feature used for managing system resources. Kubernetes uses cgroups to allocate resources like CPU and memory to containers, ensuring that applications run smoothly without interfering with each other. With the release of Kubernetes v1.31, support for v1 cgroup management moved into maintenance mode. Support for v2 cgroup management has been stable since Kubernetes v1.25.
Compared with cgroup v1, cgroup v2 provides a single unified hierarchy, a more consistent interface, and a stronger foundation for resource isolation and modern resource-management features.
Deprecation of cgroup v1
Kubernetes has deprecated cgroup v1.
Starting with Kubernetes v1.35, failCgroupV1 defaults to true, so the kubelet does not start
on a cgroup v1 node by default. Administrators can temporarily set failCgroupV1: false in the
kubelet configuration file, but removal will
follow the Kubernetes deprecation policy.
Further removal work is tracked in KEP-5573: Remove cgroup v1 support.
If you are still on a release older than v1.35, migrate every Linux node to
cgroup v2 before upgrading, or plan to set the temporary failCgroupV1: false
override. If you are already on v1.35 or later, confirm that every Linux node
runs cgroup v2 (or that you intentionally keep the override). Under the default
configuration, a remaining cgroup v1 node fails during kubelet startup.
For kubeadm-managed clusters, Kubernetes v1.35 also makes this an earlier, stricter check. The
SystemVerification preflight check, provided by k8s.io/system-validators, returns an error during
kubeadm init, kubeadm join, and kubeadm upgrade when it detects cgroup v1 with kubelet v1.35 or
later; with an older kubelet, the check remains a warning. See
kubernetes/system-validators#1.12.1 release notes for details.
The top FAQs cover three main areas: why to migrate, the benefits and drawbacks, and key points to keep in mind when using cgroup v2.
Limitations of cgroup v1 and Improvements with cgroup v2
The Linux kernel documentation describes both interfaces:
Let's enumerate some known issues.
active_file memory is not considered available memory
The kubelet treats active_file memory as not reclaimable. For I/O-intensive workloads, a large
page cache can therefore make the kubelet report memory pressure and evict Pods. This is a
known kubelet issue
(kubernetes/kubernetes#43916); migrating to
cgroup v2 does not by itself change that calculation. The documented workaround is to set equal
memory requests and limits for containers that perform intensive I/O, after measuring an appropriate
value.
Memory QoS updates in Kubernetes v1.36
Memory QoS was introduced as an alpha feature in Kubernetes v1.22 and updated in v1.27. It remains alpha in v1.36, but now separates memory throttling from memory reservation and adds tiered memory protection:
Memory QoS is available only on Linux nodes that use cgroup v2. It relies on the cgroup v2 memory
controller: memory.high provides throttling, while memory.min and memory.low provide hard and
soft protection when tiered reservation is enabled. cgroup v1 cannot provide this protection model.
Enabling the
MemoryQoSfeature gate appliesmemory.highthrottling to Burstable containers. The threshold is derived from the request, limit, andmemoryThrottlingFactor(default0.9).memoryReservationPolicy: Noneis the default. It does not writememory.minormemory.low.memoryReservationPolicy: TieredReservationmaps Guaranteed Pod memory requests tomemory.min(hard protection) and Burstable Pod requests tomemory.low(soft protection). BestEffort Pods receive neither protection.The kubelet exposes Alpha metrics for the total
memory.minandmemory.lowreservations on a node.Kernel 5.9 or later is recommended. On older kernels,
memory.highreclaim can trigger a known livelock; from v1.36 the kubelet logs a warning when Memory QoS is enabled on an affected kernel.
For example, to opt in to tiered protection:
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
featureGates:
MemoryQoS: true
memoryReservationPolicy: TieredReservation
memoryThrottlingFactor: 0.9The overall Kubernetes recommendation is not to enable Alpha features in production; however, if you
judge that memory QoS with tiered reservations is useful for your platform in production, make sure
to test the configuration and account for hard-reserved memory before you enable
the TieredReservation feature gate.
See the
Pod QoS documentation
for the current mapping of Kubernetes QoS classes to cgroup v2 controls.
Container-aware OOM handling
On cgroup v2 nodes, the kubelet defaults singleProcessOOMKill to false. It therefore sets
memory.oom.group for each container cgroup so that an OOM event kills all processes in that
container together, rather than leaving a partially functioning multi-process container. Set
singleProcessOOMKill: true only if you need the cgroup v1-compatible behavior where the kernel
may kill one process at a time. See the
KubeletConfiguration reference
for this setting.
This behavior is scoped to a container cgroup, not the whole Pod. Also, cgroup.kill is a separate
administrative interface: writing 1 to it sends SIGKILL to every process in that cgroup and its
descendants; it does not configure OOM behavior. The cgroup v2 memory controller additionally
provides memory.events counters that monitoring systems and userspace OOM managers can observe.
Rootless support
In cgroup v1, delegating controllers to less privileged containers may be dangerous.
Unlike cgroup v1, cgroup v2 officially supports delegation. Most implementations of rootless containers rely on systemd for delegating v2 controllers to non-root users.
This delegation mechanism is separate from Kubernetes Pod user namespaces, which map container users to unprivileged host users. Pod user namespace support graduated to stable in Kubernetes v1.36; check its filesystem, kernel, CRI runtime, and OCI runtime prerequisites before enabling it.
What else?
eBPF stories:
In cgroup v1, device access controls are exposed through interface files.
The cgroup v2 device controller has no interface files, and is implemented on top of cgroup BPF.
Cilium attaches BPF cgroup programs for socket-based load balancing. Its default cgroup root is
/run/cilium/cgroupv2.
Pressure Stall Information (PSI) reports CPU, memory, and I/O contention at node, Pod, and container level. On supported clusters, the kubelet exposes PSI by default (
KubeletPSIis stable and locked on). PSI requires cgroup v2, Linux 4.20 or later,CONFIG_PSI=y, and a kernel not booted withpsi=0. The kubelet surfaces the data through the Summary API and/metrics/cadvisor.When migrating, update software that reads the cgroup filesystem directly. The migration guidance recommends cAdvisor v0.43.0 or later and lists compatible Java, Node.js, and
automaxprocsversions.
CPU weight conversion in newer OCI runtimes
cgroup v1 uses cpu.shares, whereas cgroup v2 uses cpu.weight. Newer OCI runtimes use an improved
non-linear conversion that preserves the default priority and gives small CPU requests more usable
granularity. The change is implemented in the OCI runtime rather than Kubernetes: it is available
in crun v1.23 and runc v1.3.2. After upgrading a runtime, monitoring or policy tools that predict
exact cpu.weight values may need updates. Read
New Conversion from cgroup v1 CPU Shares to v2 CPU Weight
for the formula, examples, and compatibility considerations.
In-place resource updates
In-place Pod vertical scaling graduated to stable in Kubernetes v1.35. Kubernetes v1.36 then enabled in-place vertical scaling for Pod-level resources by default, as a Beta feature. The kubelet coordinates changes between the Pod-level and container cgroups so that increases create headroom before container limits grow, while decreases constrain containers before shrinking the Pod-level boundary. Accurate aggregate enforcement for this v1.36 feature requires cgroup v2.
(节选)
原文:Kubernetes Blog|The Shift to cgroup v2 in Kubernetes: What You Need to Know,2026-10-07

成为第一条评论!
Nobody's responded to this post yet. Add your thoughts and get the conversation going.