-
Notifications
You must be signed in to change notification settings - Fork 9.7k
Add util/compression package to consolidate snappy/zstd use in Prometheus. #16156
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
6c48d3a
to
ca21aa2
Compare
This comment was marked as resolved.
This comment was marked as resolved.
e954941
to
5755960
Compare
This comment was marked as resolved.
This comment was marked as resolved.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great! I tried my best to do a very deep review, and things look correct in general :)
I noticed some extra changes unrelated to "consolidate compression in a single package", i.e., changes on wlog metrics. That was a bit too much for me today; I am not sure if you want to keep it in this same PR or do a follow-up to keep PRs with a single scope. Either way, I'll try to look at the metric changes at another moment
7c60b21
to
9470c33
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just need a rebase and LGTM
ee621e2
to
231a188
Compare
…heus. Signed-off-by: bwplotka <bwplotka@gmail.com> Apply suggestions from code review Co-authored-by: Arthur Silva Sens <arthursens2005@gmail.com> Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com> tmp Signed-off-by: bwplotka <bwplotka@gmail.com> Addressed comments. Signed-off-by: bwplotka <bwplotka@gmail.com> Update util/compression/buffers.go Co-authored-by: Arthur Silva Sens <arthursens2005@gmail.com> Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com> Fix lint? Signed-off-by: bwplotka <bwplotka@gmail.com>
* Upgrade mimir-prometheus * Adjust tests to match new pretty printing format in prometheus/prometheus#16083 * Fix breaking change from prometheus/prometheus#16156 * Upgrade to github.com/oklog/ulid/v2 (prometheus/prometheus#16168) * Bring in changes from prometheus/prometheus#16199 * Remove OOO native histograms flag (prometheus/prometheus#16207) * Add changelog entries * Ignore deprecation warning for `model.NameValidationScheme` * Remove outdated native histogram OOO integration test
We had a bit mess on our compression uses, trying to consolidate all compressions we use in one package.
At some point we can add gzip, and potentially replace all snappy uses with this util pkg. I noticed this and kind of needed in #16046 (e.g. for my micro-benchmarks that use compressions as well).