-
Notifications
You must be signed in to change notification settings - Fork 597
TraceQL Metrics: Vulture checks #4886
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TraceQL Metrics: Vulture checks #4886
Conversation
758c196
to
c20aeb7
Compare
91db817
to
ab712af
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great job!
cmd/tempo-vulture/main.go
Outdated
} | ||
timeSeries := resp.Series[0] | ||
if timeSeries == nil { | ||
tm.incorrectResult++ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we have incorrectResultMetrics?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Makes sense. Changed
To be sure latest write is less than default ingestion_time_range_slack
7af4d0f
to
369344b
Compare
+ review fix and minor changes in comments |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
What this PR does
it adds TraceQL Metrics check:
count_over_time()
is not zeroWhich issue(s) this PR fixes
Fixes #
How it has been tested
Run tempo and vulture locally via docker-compose.

Results:
High amount of notfound_metrics due to bug: #4896
After the fix #4962, checked locally via docker-compose with Rhytm enabled and with one binary mode, Rhythm disabled. Additionally, run in k8s with Rhythm enabled
Checklist
CHANGELOG.md
updated - the order of entries should be[CHANGE]
,[FEATURE]
,[ENHANCEMENT]
,[BUGFIX]