Failure to load images with kind v0.26.0 and kindes/node:v1.32.1 #3853
Description
What happened:
Our CI tries to figure out the latest versions of kind and kindest/node to run integration tests against various k8s versions. After the image with v1.32.1 (roughly, I know it worked on Tuesday the 21st, but not on Thursday the 23rd) we started seeing CI failures for the combination of kind 0.26.0 and kindes/node v1.32.1. The error occurs when trying to load an image into the cluster:
[2025-01-24T08:51:40Z] executing 00-setup...
Ensuring kind version v0.27.0-alpha is available...
Want kubectl version: v1.32.1
Have kubectl version: v1.32.1
[2025-01-24T08:51:40Z] starting cluster...
Creating cluster "k8stest" ...
✓ Ensuring node image (kindest/node:v1.32.1) 🖼
✓ Preparing nodes 📦
✓ Writing configuration 📜
✓ Starting control-plane 🕹️
✓ Installing CNI 🔌
✓ Installing StorageClass 💾
Set kubectl context to "kind-k8stest"
You can now use your cluster with:
kubectl cluster-info --context kind-k8stest
Have a nice day! 👋
[2025-01-24T08:51:55Z] loading container images...
Image: "spire-server:latest-local" with ID "sha256:83de609b1ad3b445d26a9355b2926140f1bb0010649aa9858a270bd2acb14870" not yet present on node "k8stest-control-plane", loading...
ERROR: failed to detect containerd snapshotter
Stack Trace:
sigs.k8s.io/kind/pkg/errors.New
/home/sorin/github/kubernetes-sig/kind/pkg/errors/errors.go:28
sigs.k8s.io/kind/pkg/cluster/nodeutils.parseSnapshotter
/home/sorin/github/kubernetes-sig/kind/pkg/cluster/nodeutils/util.go:107
sigs.k8s.io/kind/pkg/cluster/nodeutils.getSnapshotter
/home/sorin/github/kubernetes-sig/kind/pkg/cluster/nodeutils/util.go:97
sigs.k8s.io/kind/pkg/cluster/nodeutils.LoadImageArchive
/home/sorin/github/kubernetes-sig/kind/pkg/cluster/nodeutils/util.go:81
sigs.k8s.io/kind/pkg/cmd/kind/load/docker-image.loadImage
/home/sorin/github/kubernetes-sig/kind/pkg/cmd/kind/load/docker-image/docker-image.go:205
sigs.k8s.io/kind/pkg/cmd/kind/load/docker-image.runE.func1
/home/sorin/github/kubernetes-sig/kind/pkg/cmd/kind/load/docker-image/docker-image.go:190
sigs.k8s.io/kind/pkg/errors.UntilErrorConcurrent.func1
/home/sorin/github/kubernetes-sig/kind/pkg/errors/concurrent.go:30
runtime.goexit
/usr/lib/go/src/runtime/asm_amd64.s:1700
[2025-01-24T08:51:56Z] step 00-setup failed
See also our issue for the build failing spiffe/spire#5812
Doing some more experiments from main I can see that:
- main works
- 586b038 works
- 82a216b fails
- Also seems to work with kindest/node:v1.31.4 and kind v0.26.0
So it's safe to say that 586b038 is what makes it work, but what makes it break is the new image for v1.32.1
What you expected to happen:
To be able to load images.
How to reproduce it (as minimally and precisely as possible):
kind create cluster --name loadimage --image kindest/node:v1.32.1
kind load docker-image kindest/node:v1.32.1 --name loadimage
Anything else we need to know?:
Environment:
Linux
- kind version: (use
kind version): v0.26.0 - Runtime info: (use
docker info,podman infoornerdctl info):
Client:
Version: 27.3.1
Context: default
Debug Mode: false
Plugins:
buildx: Docker Buildx (Docker Inc.)
Version: 0.19.3
Path: /usr/lib/docker/cli-plugins/docker-buildx
compose: Docker Compose (Docker Inc.)
Version: 2.32.4
Path: /usr/lib/docker/cli-plugins/docker-compose
Server:
Containers: 10
Running: 4
Paused: 0
Stopped: 6
Images: 39
Server Version: 27.3.1
Storage Driver: overlay2
Backing Filesystem: btrfs
Supports d_type: true
Using metacopy: true
Native Overlay Diff: false
userxattr: false
Logging Driver: json-file
Cgroup Driver: systemd
Cgroup Version: 2
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
Swarm: inactive
Runtimes: io.containerd.runc.v2 runc
Default Runtime: runc
Init Binary: docker-init
containerd version: c507a0257ea6462fbd6f5ba4f5c74facb04021f4.m
runc version:
init version: de40ad0
Security Options:
seccomp
Profile: builtin
cgroupns
Kernel Version: 6.12.9-arch1-1
Operating System: Arch Linux
OSType: linux
Architecture: x86_64
CPUs: 16
Total Memory: 30.66GiB
Name: bitsy
ID: 96781e78-8781-42e7-9c94-52924e7b3db0
Docker Root Dir: /var/lib/docker
Debug Mode: false
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false
- OS (e.g. from
/etc/os-release):
Arch Linux (my laptop)/Ubuntu 22.04 for CI - Kubernetes version: (use
kubectl version):
v1.32.1 - Any proxies or other special environment settings?:
No