Skip to content

CI: K8sKafkaPolicyTest Kafka Policy Tests KafkaPolicies #8777

@nebril

Description

@nebril

CI failure

Test output:

/home/jenkins/workspace/Ginkgo-CI-Tests-Pipeline/k8s-1.10-gopath/src/github.com/cilium/cilium/test/ginkgo-ext/scopes.go:420
Failed to produce to empire-hq on topic empire-announce
Expected
    <*errors.errorString | 0xc0005030e0>: {
        s: "ExecKafkaPodCmd: command 'kubectl exec -n default empire-hq-6f98fd55c7-k6gmh sh -- -c \"echo 'Happy 40th Birthday to General Tagge' | ./kafka-produce.sh --topic empire-announce\"' failed Exitcode: 1 \nStdout:\n \t \nStderr:\n \t [2019-08-05 02:52:18,875] WARN Removing server kafka-service:9092 from bootstrap.servers as DNS resolution failed for kafka-service (org.apache.kafka.clients.ClientUtils)\n\t org.apache.kafka.common.KafkaException: Failed to construct kafka producer\n\t \tat org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:416)\n\t \tat org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:288)\n\t \tat kafka.producer.NewShinyProducer.<init>(BaseProducer.scala:40)\n\t \tat kafka.tools.ConsoleProducer$.main(ConsoleProducer.scala:48)\n\t \tat kafka.tools.ConsoleProducer.main(ConsoleProducer.scala)\n\t Caused by: org.apache.kafka.common.config.ConfigException: No resolvable bootstrap urls given in bootstrap.servers\n\t \tat org.apache.kafka.clients.ClientUtils.parseAndValidateAddresses(ClientUtils.java:64)\n\t \tat org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:373)\n\t \t... 4 more\n\t command terminated with exit code 1\n\t \n",
    }
to be nil
/home/jenkins/workspace/Ginkgo-CI-Tests-Pipeline/k8s-1.10-gopath/src/github.com/cilium/cilium/test/k8sT/KafkaPolicies.go:236

Seems like Kafka broker failure:

2019-08-05T02:51:08.856470289Z /usr/lib/python2.7/dist-packages/supervisor/options.py:296: UserWarning: Supervisord is running as root and it is searching for its configuration file in default locations (including its current working directory); you probably want to specify a "-c" argument specifying an absolute path to a configuration file for improved security.
2019-08-05T02:51:08.85655577Z   'Supervisord is running as root and it is searching '
2019-08-05T02:51:08.912524557Z 2019-08-05 02:51:08,912 CRIT Supervisor running as root (no user in config file)
2019-08-05T02:51:08.912619025Z 2019-08-05 02:51:08,912 WARN Included extra file "/etc/supervisor/conf.d/kafkaproxy.conf" during parsing
2019-08-05T02:51:08.912654614Z 2019-08-05 02:51:08,912 WARN Included extra file "/etc/supervisor/conf.d/zookeeper.conf" during parsing
2019-08-05T02:51:08.912661395Z 2019-08-05 02:51:08,912 WARN Included extra file 
"/etc/supervisor/conf.d/kafka.conf" during parsing
2019-08-05T02:51:08.956783785Z 2019-08-05 02:51:08,956 INFO RPC interface 'supervisor' initialized
2019-08-05T02:51:08.957008041Z 2019-08-05 02:51:08,956 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2019-08-05T02:51:08.957293828Z 2019-08-05 02:51:08,957 INFO supervisord started with pid 1
2019-08-05T02:51:09.964836635Z 2019-08-05 02:51:09,962 INFO spawned: 'zookeeper' with pid 8
2019-08-05T02:51:09.964855433Z 2019-08-05 02:51:09,964 INFO spawned: 'kafka_proxy' with pid 9
2019-08-05T02:51:09.965850897Z 2019-08-05 02:51:09,965 INFO spawned: 'kafka' with pid 10
2019-08-05T02:51:09.971813905Z 2019-08-05 02:51:09,971 INFO exited: kafka_proxy (exit status 2; not expected)
2019-08-05T02:51:11.051749593Z 2019-08-05 02:51:11,051 INFO success: zookeeper entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2019-08-05T02:51:11.053020839Z 2019-08-05 02:51:11,052 INFO spawned: 'kafka_proxy' with pid 259
2019-08-05T02:51:11.053344759Z 2019-08-05 02:51:11,053 INFO success: kafka entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2019-08-05T02:51:11.05985448Z 2019-08-05 02:51:11,059 INFO exited: kafka_proxy (exit status 2; not expected)
2019-08-05T02:51:13.09070723Z 2019-08-05 02:51:13,088 INFO spawned: 'kafka_proxy' with pid 272
2019-08-05T02:51:13.101894211Z 2019-08-05 02:51:13,101 INFO exited: kafka_proxy (exit status 2; not expected)
2019-08-05T02:51:16.618403922Z 2019-08-05 02:51:16,618 INFO spawned: 'kafka_proxy' with pid 304
2019-08-05T02:51:16.622548689Z 2019-08-05 02:51:16,622 INFO exited: kafka_proxy (exit status 2; not expected)
2019-08-05T02:51:17.624170015Z 2019-08-05 02:51:17,623 INFO gave up: kafka_proxy entered FATAL state, too many start retries too quickly

5289e4d7_K8sKafkaPolicyTest_Kafka_Policy_Tests_KafkaPolicies.zip

https://jenkins.cilium.io/job/Ginkgo-CI-Tests-Pipeline/7970/testReport/junit/Suite-k8s-1/10/K8sKafkaPolicyTest_Kafka_Policy_Tests_KafkaPolicies/

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/CIContinuous Integration testing issue or flake

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions