Skip to content

Cilium with etcd spams logs with "retrying of unary invoker failed" #9791

@joestringer

Description

@joestringer

Multiple users have reported seeing these messages in the logs when running recent (eg v1.6) releases of Cilium:

{"level":"warn","ts":"2019-12-19T17:25:29.221Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-62c44804-9924-4add-a807-d58b11854d2f/etc-server1:2379","attempt":0,"error":"rpc error: code = Canceled desc = context canceled"}

Questions:

  • What does this log mean?
  • Does it imply broken etcd connectivity?
  • What are the debugging steps?
  • This log does not follow the standard Cilium log output format, can we turn it into a meaningful log or report its status through a Cilium controller?

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/bugThis is a bug in the Cilium logic.kind/community-reportThis was reported by a user in the Cilium community, eg via Slack.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions