Skip to content

CI: Suite-k8s-1.11.K8sServicesTest Checks service across nodes Tests NodePort BPF Tests with XDP, direct routing and Hybrid: Exit code 28 #10942

@tgraf

Description

@tgraf

CI failure

/home/jenkins/workspace/Cilium-PR-Ginkgo-Tests-Validated/k8s-1.11-gopath/src/github.com/cilium/cilium/test/ginkgo-ext/scopes.go:430
Pod "testclient-zqnzp" can not connect to service "tftp://10.10.1.250:30396/hello"
Expected command: kubectl exec -n default testclient-zqnzp -- curl --path-as-is -s -D /dev/stderr --fail --connect-timeout 5 --max-time 8 tftp://10.10.1.250:30396/hello -w "time-> DNS: '%{time_namelookup}(%{remote_ip})', Connect: '%{time_connect}',Transfer '%{time_starttransfer}', total '%{time_total}'" 
To succeed, but it failed:
Exitcode: 28 
Stdout:
 	 time-> DNS: '0.000015()', Connect: '0.000030',Transfer '0.000000', total '4.205183'
Stderr:
 	 command terminated with exit code 28
	 

/home/jenkins/workspace/Cilium-PR-Ginkgo-Tests-Validated/k8s-1.11-gopath/src/github.com/cilium/cilium/test/k8sT/Services.go:685
Standard Output
Number of "context deadline exceeded" in logs: 0
Number of "level=error" in logs: 0
⚠️  Number of "level=warning" in logs: 13
Number of "Cilium API handler panicked" in logs: 0
Number of "Goroutine took lock for more than" in logs: 0
Top 3 errors/warnings:
Skipping symbol substitution
BPF system config check: NOT OK.
Unable to release endpoint ID
Cilium pods: [cilium-74qsm cilium-xsnwl]
Netpols loaded: 
CiliumNetworkPolicies loaded: 
Endpoint Policy Enforcement:
Pod                          Ingress   Egress
testds-g9xrj                           
app1-798d4f944d-ll2cp                  
app2-dc85b4585-mxbx8                   
coredns-687db6485c-ftxnf               
test-k8s2-848b6f7864-rtrbv             
testclient-tw94f                       
testclient-zqnzp                       
testds-ffgz4                           
app3-68fb594d47-cglgt                  
Cilium agent 'cilium-74qsm': Status: Ok  Health: Ok Nodes "" ContinerRuntime:  Kubernetes: Ok KVstore: Ok Controllers: Total 19 Failed 0
Cilium agent 'cilium-xsnwl': Status: Ok  Health: Ok Nodes "" ContinerRuntime:  Kubernetes: Ok KVstore: Ok Controllers: Total 26 Failed 0

Standard Error
STEP: Installing Cilium
STEP: Installing DNS Deployment
STEP: Restarting DNS Pods
STEP: Performing Cilium preflight check
STEP: Performing Cilium status preflight check
STEP: Performing Cilium controllers preflight check
STEP: Performing Cilium health check
STEP: Performing Cilium service preflight check
STEP: Performing K8s service preflight check
STEP: Waiting for cilium-operator to be ready
STEP: Waiting for kube-dns to be ready
STEP: Running kube-dns preflight check
STEP: Performing K8s service preflight check
STEP: Making 10 HTTP requests from outside cluster to "http://192.168.36.11:32129"
STEP: Making 10 HTTP requests from outside cluster to "tftp://192.168.36.11:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "http://10.110.91.76:10080"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://10.110.91.76:10080"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://10.110.91.76:10069/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://10.110.91.76:10069/hello"
STEP: Making 10 curl requests from k8s1 to "http://127.0.0.1:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://127.0.0.1:30396/hello"
STEP: Making 10 curl requests from k8s1 to "http://[::ffff:127.0.0.1]:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://[::ffff:127.0.0.1]:30396/hello"
STEP: Making 10 curl requests from k8s1 to "http://192.168.36.11:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://192.168.36.11:30396/hello"
STEP: Making 10 curl requests from k8s1 to "http://[::ffff:192.168.36.11]:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://[::ffff:192.168.36.11]:30396/hello"
STEP: Making 10 curl requests from k8s1 to "http://192.168.36.12:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://192.168.36.12:30396/hello"
STEP: Making 10 curl requests from k8s1 to "http://[::ffff:192.168.36.12]:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://[::ffff:192.168.36.12]:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://192.168.36.11:30396/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://192.168.36.11:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "http://192.168.36.11:32129"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://192.168.36.11:32129"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://[::ffff:192.168.36.11]:30396/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://[::ffff:192.168.36.11]:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "http://[::ffff:192.168.36.11]:32129"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://[::ffff:192.168.36.11]:32129"
STEP: Making ten curl requests from "testclient-tw94f" to "http://192.168.36.12:32129"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://192.168.36.12:32129"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://192.168.36.12:30396/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://192.168.36.12:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "http://[::ffff:192.168.36.12]:32129"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://[::ffff:192.168.36.12]:32129"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://[::ffff:192.168.36.12]:30396/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://[::ffff:192.168.36.12]:30396/hello"
STEP: Making 10 curl requests from k8s1 to "http://10.10.0.187:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://10.10.0.187:30396/hello"
STEP: Making 10 curl requests from k8s1 to "http://[::ffff:10.10.0.187]:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://[::ffff:10.10.0.187]:30396/hello"
STEP: Making 10 curl requests from k8s1 to "http://10.10.1.250:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://10.10.1.250:30396/hello"
STEP: Making 10 curl requests from k8s1 to "http://[::ffff:10.10.1.250]:32129"
STEP: Making 10 curl requests from k8s1 to "tftp://[::ffff:10.10.1.250]:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "http://127.0.0.1:32129"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://127.0.0.1:32129"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://127.0.0.1:30396/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://127.0.0.1:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "http://[::ffff:127.0.0.1]:32129"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://[::ffff:127.0.0.1]:32129"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://[::ffff:127.0.0.1]:30396/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://[::ffff:127.0.0.1]:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "http://10.10.0.187:32129"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://10.10.0.187:32129"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://10.10.0.187:30396/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://10.10.0.187:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "http://[::ffff:10.10.0.187]:32129"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://[::ffff:10.10.0.187]:32129"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://[::ffff:10.10.0.187]:30396/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://[::ffff:10.10.0.187]:30396/hello"
STEP: Making ten curl requests from "testclient-tw94f" to "http://10.10.1.250:32129"
STEP: Making ten curl requests from "testclient-zqnzp" to "http://10.10.1.250:32129"
STEP: Making ten curl requests from "testclient-tw94f" to "tftp://10.10.1.250:30396/hello"
STEP: Making ten curl requests from "testclient-zqnzp" to "tftp://10.10.1.250:30396/hello"
=== Test Finished at 2020-04-10T19:12:24Z====
===================== TEST FAILED =====================

Related:

4ba80f6b_K8sServicesTest_Checks_service_across_nodes_Tests_NodePort_BPF_Tests_with_XDP,_direct_routing_and_Hybrid.zip

Metadata

Metadata

Assignees

Labels

area/CIContinuous Integration testing issue or flakearea/datapathImpacts bpf/ or low-level forwarding details, including map management and monitor messages.kind/bugThis is a bug in the Cilium logic.priority/highThis is considered vital to an upcoming release.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions