Skip to content

ClickHouse - KafkaEngine - failure scenarios #9752

@guidoiaquinti

Description

@guidoiaquinti

Bug description

We should make sure the ClickHouse Kafka engine is configured correctly to don't DDOS Kafka in case of issues. We should make sure we have a way to configure:

  • error retries, exponential backoff with jitter
  • insert rate (as by going at full speed it can melt both CH and Kafka)

Environment

  • PostHog Cloud
  • self-hosted PostHog (ClickHouse-based), version/commit: please provide

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working rightclickhouseRelated to ClickHouse specific bugs or improvementsstale

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions