Replies: 1 comment
-
As an aside, how do you debug the data inflows? I tried using wireshark to see if the central Prometheus instance is getting samples with zero values, but the data in the packets is partially compressed so that does not seem like the best way to do it. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi, I have some nodes running prometheus-agent pushing their own metrics to a central server. Rarely, the metrics of a random node start oscillating between the real value and 0.
Example:
The exporter on the node has no such issue:
Notably, the agents are configured to scrape every minute. So it makes no sense that the data is even changing more often than one minute:
Neither the central prometheus instance nor the agent are emitting errors/warnings about the impacted node. The issue remains even after restarting the agent. Any ideas for what this is?
Beta Was this translation helpful? Give feedback.
All reactions