Skip to content

FAIL: TestSvc2Svc : PodInitializing / readiness issue #4004

@ldemailly

Description

@ldemailly

https://storage.googleapis.com/istio-prow/pull/istio_istio/4003/e2e-simpleTests/631/build-log.txt

The test should probably retry a few times / add some readyness

I0306 02:26:59.984] --- FAIL: TestSvc2Svc (1.02s)
I0306 02:26:59.985] 	simple1_test.go:119: kubectl failure to run fortio command failed: "Fortio 0.7.3 running at 0 queries per second, 2->2 procs, for 10s: http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo\n02:26:59 I httprunner.go:73> Starting http test for http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo with 4 threads at -1.0 qps\n02:26:59 E http.go:603> Unable to connect to {10.11.253.149 8080 } : dial tcp 10.11.253.149:8080: connect: connection refused\nAborting because error -1 for http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo: \"\"\ncommand terminated with exit code 1\n" exit status 1
I0306 02:26:59.985] === RUN   TestAuth
I0306 02:26:59.985] 2018-03-06T02:26:59.983655Z	info	Running command kubectl get pods -n simple-auth-test-8343ebd544fe4095825a -l app=fortio-noistio -o jsonpath={.items[*].metadata.name}
I0306 02:27:00.280] 2018-03-06T02:27:00.280195Z	info	Command output: 
I0306 02:27:00.280]  raw-cli-deployement-5cd88fb45d-tkcqv, err: <nil>
I0306 02:27:00.280] 2018-03-06T02:27:00.280236Z	info	From client, non istio injected pod "raw-cli-deployement-5cd88fb45d-tkcqv"
I0306 02:27:00.281] 2018-03-06T02:27:00.280244Z	info	Running command kubectl exec -n simple-auth-test-8343ebd544fe4095825a raw-cli-deployement-5cd88fb45d-tkcqv -- /usr/local/bin/fortio load -qps 5 -t 1s http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo
I0306 02:27:00.954] 2018-03-06T02:27:00.954263Z	info	Command output: 
I0306 02:27:00.954]  Fortio 0.7.3 running at 5 queries per second, 2->2 procs, for 1s: http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo
I0306 02:27:00.954] 02:27:00 I httprunner.go:73> Starting http test for http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo with 4 threads at 5.0 qps
I0306 02:27:00.955] 02:27:00 E http.go:730> Read error &{{0xc420190500}} {10.11.253.149 8080 } 0 : read tcp 10.8.2.7:34434->10.11.253.149:8080: read: connection reset by peer
I0306 02:27:00.955] Aborting because error -1 for http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo: ""
I0306 02:27:00.955] command terminated with exit code 1
I0306 02:27:00.955] , err: exit status 1
I0306 02:27:00.955] 2018-03-06T02:27:00.954319Z	info	Got expected error with auth on and non istio->istio connection: command failed: "Fortio 0.7.3 running at 5 queries per second, 2->2 procs, for 1s: http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo\n02:27:00 I httprunner.go:73> Starting http test for http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo with 4 threads at 5.0 qps\n02:27:00 E http.go:730> Read error &{{0xc420190500}} {10.11.253.149 8080 } 0 : read tcp 10.8.2.7:34434->10.11.253.149:8080: read: connection reset by peer\nAborting because error -1 for http://echosrv.simple-auth-test-8343ebd544fe4095825a:8080/echo: \"\"\ncommand terminated with exit code 1\n" exit status 1
I0306 02:27:00.955] --- PASS: TestAuth (0.97s)
I0306 02:27:00.956] FAIL
I0306 02:27:00.956] 2018-03-06T02:27:00.954350Z	info	Saving logs
I0306 02:27:00.956] 2018-03-06T02:27:00.954361Z	info	Creating status file
I0306 02:27:00.956] 2018-03-06T02:27:00.954577Z	info	Created Status file /home/bootstrap/go/src/istio.io/istio/_artifacts/simple-auth-test-8343ebd544fe4095825a/simple_auth_test.json
I0306 02:27:00.956] 2018-03-06T02:27:00.954595Z	info	Running command kubectl get ingress --all-namespaces
I0306 02:27:01.217] 2018-03-06T02:27:01.216692Z	info	Command output: 
I0306 02:27:01.217]  NAMESPACE                               NAME            HOSTS     ADDRESS   PORTS     AGE
I0306 02:27:01.217] simple-auth-test-8343ebd544fe4095825a   istio-ingress   *                   80        22s
I0306 02:27:01.217] , err: <nil>
I0306 02:27:01.217] 2018-03-06T02:27:01.216728Z	info	Running command kubectl get pods -n simple-auth-test-8343ebd544fe4095825a
I0306 02:27:01.586] 2018-03-06T02:27:01.586095Z	info	Command output: 
I0306 02:27:01.586]  NAME                                   READY     STATUS            RESTARTS   AGE
I0306 02:27:01.586] echosrv-deployment-5c5d669856-2w8cq    0/2       PodInitializing   0          18s
I0306 02:27:01.586] echosrv-deployment-5c5d669856-f7645    2/2       Running           0          18s
I0306 02:27:01.586] istio-ca-5c56678f9b-jvgqz              1/1       Running           0          1m
I0306 02:27:01.587] istio-ingress-7bb5ffd785-cz7x4         1/1       Running           0          1m
I0306 02:27:01.587] istio-mixer-6f79b559b7-6btjk           3/3       Running           0          1m
I0306 02:27:01.587] istio-pilot-54768746c-tkfgv            2/2       Running           0          1m
I0306 02:27:01.587] prometheus-cf8456855-888tp             1/1       Running           0          1m
I0306 02:27:01.587] raw-cli-deployement-5cd88fb45d-tkcqv   1/1       Running           0          18s
I0306 02:27:01.587] zipkin-7988c559b7-zq5jj                1/1       Running           0          1m

One of the 2 pods is still PodInitializing

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions