Skip to content

Prometheus metrics for worker containers and volumes don't coincide with API responses #1921

@william-tran

Description

@william-tran

Bug Report

When I fly workers or fly volumes, the number of containers and volumes per worker reported by the CLI, coming from the /workers or /volumes endpoints, don't coincide with the prometheus metrics. I also noticed that when running multiple ATCs, there could be more than one ATC reporting for a single worker, where only one of those numbers reported is anywhere close to the number reported by the API. This makes reporting difficult, as I can't find a way to tell my Grafana which number to use, max(concourse_workers_containers) by (worker) only works if the number is always increasing. But maybe that's just my noobness with PromQL. Nevertheless, among the multiple numbers emitted by prometheus, none equal the API response.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions