Skip to content

Conversation

jhesketh
Copy link
Contributor

@jhesketh jhesketh commented Aug 15, 2024

What this PR does

  • Adds feature flag for disabling aggregations
  • Refactors and breaks out aggregation to support different functions
  • Implements max aggregation function

Which issue(s) this PR fixes or relates to

Related to #2280

Checklist

  • Tests updated.
  • Documentation added.
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX].
  • about-versioning.md updated with experimental features.

@jhesketh jhesketh force-pushed the jhesketh/mqe-aggregations branch from b9fefa3 to 6e424ff Compare August 19, 2024 12:33
Copy link
Contributor

@charleskorn charleskorn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall design looks good to me 🚀

@jhesketh
Copy link
Contributor Author

Benchmark vs main:


goos: linux
goarch: amd64
pkg: github.com/grafana/mimir/pkg/streamingpromql/benchmarks
cpu: Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz
                                                                                                                      │   main.txt   │              agg.txt               │
                                                                                                                      │    sec/op    │    sec/op     vs base              │
Query/sum_over_time(a_1[1m]),_instant_query/Mimir-8                                                                      610.6µ ± 4%   637.0µ ±  2%  +4.32% (p=0.009 n=6)
Query/sum_over_time(a_1[1m]),_instant_query/Prometheus-8                                                                 657.9µ ± 1%   671.1µ ±  6%       ~ (p=0.132 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_100_steps/Mimir-8                                                         681.7µ ± 6%   687.7µ ±  1%       ~ (p=0.589 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_100_steps/Prometheus-8                                                    721.2µ ± 1%   740.8µ ±  2%  +2.72% (p=0.002 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_1000_steps/Mimir-8                                                        892.0µ ± 6%   912.9µ ±  4%       ~ (p=0.240 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_1000_steps/Prometheus-8                                                   988.2µ ± 1%   994.6µ ±  2%       ~ (p=0.093 n=6)
Query/sum_over_time(a_100[1m]),_instant_query/Mimir-8                                                                    1.272m ± 2%   1.324m ±  1%  +4.07% (p=0.002 n=6)
Query/sum_over_time(a_100[1m]),_instant_query/Prometheus-8                                                               1.437m ± 1%   1.467m ±  4%       ~ (p=0.065 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_100_steps/Mimir-8                                                       4.208m ± 1%   4.293m ±  1%  +2.03% (p=0.002 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_100_steps/Prometheus-8                                                  4.937m ± 1%   4.992m ±  3%  +1.11% (p=0.004 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_1000_steps/Mimir-8                                                      21.05m ± 1%   21.34m ±  1%  +1.34% (p=0.002 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_1000_steps/Prometheus-8                                                 29.44m ± 2%   29.77m ±  1%       ~ (p=0.065 n=6)
Query/sum_over_time(a_2000[1m]),_instant_query/Mimir-8                                                                   10.28m ± 1%   10.50m ±  1%  +2.10% (p=0.002 n=6)
Query/sum_over_time(a_2000[1m]),_instant_query/Prometheus-8                                                              12.23m ± 2%   12.66m ±  2%  +3.49% (p=0.002 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_100_steps/Mimir-8                                                      69.28m ± 1%   69.45m ±  1%       ~ (p=0.394 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_100_steps/Prometheus-8                                                 82.20m ± 2%   82.53m ±  1%       ~ (p=0.485 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_1000_steps/Mimir-8                                                     398.0m ± 1%   398.9m ±  0%       ~ (p=0.818 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_1000_steps/Prometheus-8                                                561.4m ± 1%   562.8m ±  0%       ~ (p=0.394 n=6)
Query/sum_over_time(nh_1[1m]),_instant_query/Mimir-8                                                                     653.6µ ± 2%   671.1µ ±  3%  +2.68% (p=0.009 n=6)
Query/sum_over_time(nh_1[1m]),_instant_query/Prometheus-8                                                                685.5µ ± 1%   700.4µ ±  6%       ~ (p=0.394 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_100_steps/Mimir-8                                                        1.058m ± 1%   1.055m ±  2%       ~ (p=0.937 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_100_steps/Prometheus-8                                                   1.021m ± 5%   1.041m ±  3%       ~ (p=0.065 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_1000_steps/Mimir-8                                                       2.395m ± 2%   2.401m ±  1%       ~ (p=0.240 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_1000_steps/Prometheus-8                                                  2.716m ± 2%   2.755m ±  2%       ~ (p=0.093 n=6)
Query/sum_over_time(nh_100[1m]),_instant_query/Mimir-8                                                                   1.739m ± 1%   1.762m ±  1%       ~ (p=0.132 n=6)
Query/sum_over_time(nh_100[1m]),_instant_query/Prometheus-8                                                              2.045m ± 2%   2.078m ±  1%  +1.62% (p=0.015 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_100_steps/Mimir-8                                                      35.66m ± 0%   36.30m ±  1%  +1.77% (p=0.002 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_100_steps/Prometheus-8                                                 29.37m ± 1%   29.73m ±  1%  +1.21% (p=0.002 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_1000_steps/Mimir-8                                                     169.2m ± 1%   170.3m ±  0%       ~ (p=0.093 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_1000_steps/Prometheus-8                                                198.2m ± 1%   198.8m ±  1%       ~ (p=0.394 n=6)
Query/sum_over_time(nh_2000[1m]),_instant_query/Mimir-8                                                                  17.71m ± 4%   18.09m ±  7%       ~ (p=0.132 n=6)
Query/sum_over_time(nh_2000[1m]),_instant_query/Prometheus-8                                                             22.35m ± 1%   23.05m ±  1%  +3.12% (p=0.002 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_100_steps/Mimir-8                                                     695.4m ± 1%   697.6m ±  1%       ~ (p=0.589 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_100_steps/Prometheus-8                                                579.8m ± 1%   578.5m ±  2%       ~ (p=0.937 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_1000_steps/Mimir-8                                                     3.580 ± 0%    3.597 ±  1%       ~ (p=0.093 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_1000_steps/Prometheus-8                                                4.191 ± 4%    4.183 ±  0%       ~ (p=0.699 n=6)
Query/sum(a_1),_instant_query/Mimir-8                                                                                    673.5µ ± 3%   670.3µ ±  1%       ~ (p=0.699 n=6)
Query/sum(a_1),_instant_query/Prometheus-8                                                                               667.6µ ± 2%   686.8µ ±  3%  +2.87% (p=0.015 n=6)
Query/sum(a_1),_range_query_with_100_steps/Mimir-8                                                                       688.9µ ± 2%   699.6µ ±  3%  +1.55% (p=0.015 n=6)
Query/sum(a_1),_range_query_with_100_steps/Prometheus-8                                                                  722.7µ ± 3%   714.8µ ±  1%       ~ (p=0.240 n=6)
Query/sum(a_1),_range_query_with_1000_steps/Mimir-8                                                                      848.9µ ± 1%   846.4µ ±  2%       ~ (p=1.000 n=6)
Query/sum(a_1),_range_query_with_1000_steps/Prometheus-8                                                                 933.1µ ± 3%   939.8µ ± 10%       ~ (p=0.394 n=6)
Query/sum(a_100),_instant_query/Mimir-8                                                                                  2.186m ± 1%   2.231m ±  1%  +2.07% (p=0.009 n=6)
Query/sum(a_100),_instant_query/Prometheus-8                                                                             2.250m ± 1%   2.255m ±  2%       ~ (p=0.394 n=6)
Query/sum(a_100),_range_query_with_100_steps/Mimir-8                                                                     3.512m ± 3%   3.599m ±  1%  +2.48% (p=0.026 n=6)
Query/sum(a_100),_range_query_with_100_steps/Prometheus-8                                                                3.546m ± 1%   3.563m ±  1%       ~ (p=0.065 n=6)
Query/sum(a_100),_range_query_with_1000_steps/Mimir-8                                                                    15.83m ± 2%   15.83m ±  1%       ~ (p=0.818 n=6)
Query/sum(a_100),_range_query_with_1000_steps/Prometheus-8                                                               16.12m ± 1%   16.11m ±  5%       ~ (p=0.937 n=6)
Query/sum(a_2000),_instant_query/Mimir-8                                                                                 25.98m ± 1%   25.81m ±  2%       ~ (p=0.699 n=6)
Query/sum(a_2000),_instant_query/Prometheus-8                                                                            26.60m ± 5%   26.81m ±  3%       ~ (p=1.000 n=6)
Query/sum(a_2000),_range_query_with_100_steps/Mimir-8                                                                    51.70m ± 1%   52.51m ±  1%  +1.57% (p=0.002 n=6)
Query/sum(a_2000),_range_query_with_100_steps/Prometheus-8                                                               55.26m ± 2%   54.49m ±  3%       ~ (p=0.180 n=6)
Query/sum(a_2000),_range_query_with_1000_steps/Mimir-8                                                                   277.0m ± 1%   278.0m ±  1%       ~ (p=0.310 n=6)
Query/sum(a_2000),_range_query_with_1000_steps/Prometheus-8                                                              336.8m ± 2%   335.7m ±  1%       ~ (p=0.699 n=6)
Query/sum_without_(l)(h_1),_instant_query/Mimir-8                                                                        781.8µ ± 1%   802.9µ ±  3%  +2.69% (p=0.015 n=6)
Query/sum_without_(l)(h_1),_instant_query/Prometheus-8                                                                   809.8µ ± 2%   820.6µ ±  3%       ~ (p=0.310 n=6)
Query/sum_without_(l)(h_1),_range_query_with_100_steps/Mimir-8                                                           898.6µ ± 3%   890.2µ ±  1%       ~ (p=0.310 n=6)
Query/sum_without_(l)(h_1),_range_query_with_100_steps/Prometheus-8                                                      918.2µ ± 1%   922.0µ ±  2%       ~ (p=0.394 n=6)
Query/sum_without_(l)(h_1),_range_query_with_1000_steps/Mimir-8                                                          1.706m ± 2%   1.718m ±  2%       ~ (p=0.180 n=6)
Query/sum_without_(l)(h_1),_range_query_with_1000_steps/Prometheus-8                                                     1.775m ± 1%   1.803m ±  2%  +1.57% (p=0.002 n=6)
Query/sum_without_(l)(h_100),_instant_query/Mimir-8                                                                      9.232m ± 3%   9.452m ±  4%  +2.39% (p=0.041 n=6)
Query/sum_without_(l)(h_100),_instant_query/Prometheus-8                                                                 9.227m ± 1%   9.571m ±  2%  +3.72% (p=0.002 n=6)
Query/sum_without_(l)(h_100),_range_query_with_100_steps/Mimir-8                                                         17.14m ± 1%   17.51m ±  2%  +2.14% (p=0.004 n=6)
Query/sum_without_(l)(h_100),_range_query_with_100_steps/Prometheus-8                                                    17.61m ± 3%   17.47m ±  1%       ~ (p=0.065 n=6)
Query/sum_without_(l)(h_100),_range_query_with_1000_steps/Mimir-8                                                        87.56m ± 1%   87.51m ±  1%       ~ (p=0.818 n=6)
Query/sum_without_(l)(h_100),_range_query_with_1000_steps/Prometheus-8                                                   95.16m ± 8%   96.29m ±  7%       ~ (p=0.699 n=6)
Query/sum_without_(l)(h_2000),_instant_query/Mimir-8                                                                     166.9m ± 1%   168.5m ±  1%       ~ (p=0.093 n=6)
Query/sum_without_(l)(h_2000),_instant_query/Prometheus-8                                                                170.6m ± 1%   172.4m ±  2%  +1.09% (p=0.015 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_100_steps/Mimir-8                                                        317.4m ± 2%   320.1m ±  1%       ~ (p=0.310 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_100_steps/Prometheus-8                                                   354.3m ± 1%   355.1m ±  2%       ~ (p=0.240 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_1000_steps/Mimir-8                                                        1.673 ± 1%    1.677 ±  1%       ~ (p=0.180 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                   2.749 ± 2%    2.758 ±  2%       ~ (p=0.818 n=6)
Query/sum_without_(le)(h_1),_instant_query/Mimir-8                                                                       776.9µ ± 3%   801.4µ ±  2%  +3.16% (p=0.041 n=6)
Query/sum_without_(le)(h_1),_instant_query/Prometheus-8                                                                  782.3µ ± 1%   805.7µ ±  2%  +2.98% (p=0.004 n=6)
Query/sum_without_(le)(h_1),_range_query_with_100_steps/Mimir-8                                                          882.3µ ± 1%   895.2µ ±  3%       ~ (p=0.132 n=6)
Query/sum_without_(le)(h_1),_range_query_with_100_steps/Prometheus-8                                                     911.0µ ± 2%   905.3µ ±  2%       ~ (p=0.394 n=6)
Query/sum_without_(le)(h_1),_range_query_with_1000_steps/Mimir-8                                                         1.654m ± 1%   1.677m ±  1%  +1.39% (p=0.009 n=6)
Query/sum_without_(le)(h_1),_range_query_with_1000_steps/Prometheus-8                                                    1.721m ± 2%   1.728m ±  3%       ~ (p=0.485 n=6)
Query/sum_without_(le)(h_100),_instant_query/Mimir-8                                                                     9.273m ± 1%   9.499m ±  1%  +2.44% (p=0.002 n=6)
Query/sum_without_(le)(h_100),_instant_query/Prometheus-8                                                                9.404m ± 3%   9.652m ±  7%  +2.64% (p=0.041 n=6)
Query/sum_without_(le)(h_100),_range_query_with_100_steps/Mimir-8                                                        17.30m ± 4%   17.56m ±  1%       ~ (p=0.240 n=6)
Query/sum_without_(le)(h_100),_range_query_with_100_steps/Prometheus-8                                                   17.86m ± 1%   18.10m ±  7%  +1.35% (p=0.015 n=6)
Query/sum_without_(le)(h_100),_range_query_with_1000_steps/Mimir-8                                                       88.79m ± 1%   88.13m ±  1%       ~ (p=0.310 n=6)
Query/sum_without_(le)(h_100),_range_query_with_1000_steps/Prometheus-8                                                 101.19m ± 7%   96.79m ±  4%       ~ (p=0.310 n=6)
Query/sum_without_(le)(h_2000),_instant_query/Mimir-8                                                                    171.3m ± 1%   175.6m ±  2%  +2.48% (p=0.004 n=6)
Query/sum_without_(le)(h_2000),_instant_query/Prometheus-8                                                               173.0m ± 1%   174.5m ±  2%  +0.91% (p=0.009 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_100_steps/Mimir-8                                                       325.6m ± 2%   330.3m ±  1%  +1.42% (p=0.041 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_100_steps/Prometheus-8                                                  367.7m ± 1%   368.2m ±  1%       ~ (p=0.310 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_1000_steps/Mimir-8                                                       1.719 ± 1%    1.716 ±  0%       ~ (p=0.699 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                  2.931 ± 1%    2.935 ±  1%       ~ (p=0.818 n=6)
Query/sum(nh_1),_instant_query/Mimir-8                                                                                   807.7µ ± 2%   814.7µ ±  2%       ~ (p=0.093 n=6)
Query/sum(nh_1),_instant_query/Prometheus-8                                                                              810.6µ ± 1%   815.0µ ±  2%       ~ (p=0.065 n=6)
Query/sum(nh_1),_range_query_with_100_steps/Mimir-8                                                                      906.2µ ± 6%   912.4µ ±  2%       ~ (p=0.699 n=6)
Query/sum(nh_1),_range_query_with_100_steps/Prometheus-8                                                                 968.0µ ± 6%   987.9µ ±  3%       ~ (p=0.394 n=6)
Query/sum(nh_1),_range_query_with_1000_steps/Mimir-8                                                                     1.735m ± 5%   1.768m ±  3%       ~ (p=0.394 n=6)
Query/sum(nh_1),_range_query_with_1000_steps/Prometheus-8                                                                2.303m ± 5%   2.298m ±  5%       ~ (p=0.937 n=6)
Query/sum(nh_100),_instant_query/Mimir-8                                                                                 11.91m ± 1%   11.89m ±  0%       ~ (p=0.699 n=6)
Query/sum(nh_100),_instant_query/Prometheus-8                                                                            11.93m ± 1%   12.02m ±  4%       ~ (p=0.132 n=6)
Query/sum(nh_100),_range_query_with_100_steps/Mimir-8                                                                    21.69m ± 6%   21.97m ±  8%       ~ (p=0.132 n=6)
Query/sum(nh_100),_range_query_with_100_steps/Prometheus-8                                                               23.45m ± 6%   22.92m ±  4%       ~ (p=0.180 n=6)
Query/sum(nh_100),_range_query_with_1000_steps/Mimir-8                                                                   116.5m ± 6%   121.7m ±  7%       ~ (p=0.093 n=6)
Query/sum(nh_100),_range_query_with_1000_steps/Prometheus-8                                                              162.2m ± 4%   162.1m ±  2%       ~ (p=0.818 n=6)
Query/sum(nh_2000),_instant_query/Mimir-8                                                                                216.1m ± 1%   217.4m ±  1%       ~ (p=0.065 n=6)
Query/sum(nh_2000),_instant_query/Prometheus-8                                                                           216.7m ± 1%   218.5m ±  1%       ~ (p=0.093 n=6)
Query/sum(nh_2000),_range_query_with_100_steps/Mimir-8                                                                   422.1m ± 1%   432.1m ±  3%  +2.37% (p=0.009 n=6)
Query/sum(nh_2000),_range_query_with_100_steps/Prometheus-8                                                              539.6m ± 1%   544.5m ± 10%       ~ (p=0.310 n=6)
Query/sum(nh_2000),_range_query_with_1000_steps/Mimir-8                                                                   2.332 ± 2%    2.370 ±  3%       ~ (p=0.093 n=6)
Query/sum(nh_2000),_range_query_with_1000_steps/Prometheus-8                                                              4.087 ± 2%    4.079 ±  3%       ~ (p=1.000 n=6)
Query/sum_by_(l)(h_1),_instant_query/Mimir-8                                                                             792.5µ ± 2%   790.8µ ±  4%       ~ (p=1.000 n=6)
Query/sum_by_(l)(h_1),_instant_query/Prometheus-8                                                                        815.0µ ± 5%   802.2µ ±  1%       ~ (p=0.065 n=6)
Query/sum_by_(l)(h_1),_range_query_with_100_steps/Mimir-8                                                                893.3µ ± 3%   878.5µ ±  1%       ~ (p=0.093 n=6)
Query/sum_by_(l)(h_1),_range_query_with_100_steps/Prometheus-8                                                           920.6µ ± 1%   904.0µ ±  0%  -1.79% (p=0.002 n=6)
Query/sum_by_(l)(h_1),_range_query_with_1000_steps/Mimir-8                                                               1.651m ± 3%   1.664m ±  1%       ~ (p=0.310 n=6)
Query/sum_by_(l)(h_1),_range_query_with_1000_steps/Prometheus-8                                                          1.702m ± 2%   1.715m ±  1%       ~ (p=0.180 n=6)
Query/sum_by_(l)(h_100),_instant_query/Mimir-8                                                                           9.411m ± 1%   9.489m ±  1%       ~ (p=0.065 n=6)
Query/sum_by_(l)(h_100),_instant_query/Prometheus-8                                                                      9.473m ± 2%   9.499m ±  1%       ~ (p=0.818 n=6)
Query/sum_by_(l)(h_100),_range_query_with_100_steps/Mimir-8                                                              17.42m ± 2%   17.49m ±  1%       ~ (p=0.240 n=6)
Query/sum_by_(l)(h_100),_range_query_with_100_steps/Prometheus-8                                                         17.93m ± 1%   17.91m ±  3%       ~ (p=0.699 n=6)
Query/sum_by_(l)(h_100),_range_query_with_1000_steps/Mimir-8                                                             88.51m ± 1%   88.75m ±  0%       ~ (p=0.818 n=6)
Query/sum_by_(l)(h_100),_range_query_with_1000_steps/Prometheus-8                                                        101.5m ± 4%   103.2m ±  4%       ~ (p=0.180 n=6)
Query/sum_by_(l)(h_2000),_instant_query/Mimir-8                                                                          172.1m ± 3%   173.8m ±  3%       ~ (p=0.310 n=6)
Query/sum_by_(l)(h_2000),_instant_query/Prometheus-8                                                                     172.5m ± 1%   176.3m ±  0%  +2.18% (p=0.002 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_100_steps/Mimir-8                                                             327.3m ± 2%   330.4m ±  1%       ~ (p=0.093 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_100_steps/Prometheus-8                                                        368.4m ± 1%   368.8m ±  1%       ~ (p=0.394 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_1000_steps/Mimir-8                                                             1.711 ± 0%    1.714 ±  1%       ~ (p=0.132 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                        2.928 ± 2%    2.923 ±  4%       ~ (p=0.818 n=6)
Query/sum_by_(le)(h_1),_instant_query/Mimir-8                                                                            785.8µ ± 2%   799.9µ ±  2%  +1.79% (p=0.026 n=6)
Query/sum_by_(le)(h_1),_instant_query/Prometheus-8                                                                       792.8µ ± 1%   819.8µ ±  3%  +3.40% (p=0.002 n=6)
Query/sum_by_(le)(h_1),_range_query_with_100_steps/Mimir-8                                                               898.6µ ± 1%   916.2µ ±  1%  +1.96% (p=0.004 n=6)
Query/sum_by_(le)(h_1),_range_query_with_100_steps/Prometheus-8                                                          916.4µ ± 3%   915.1µ ±  1%       ~ (p=0.937 n=6)
Query/sum_by_(le)(h_1),_range_query_with_1000_steps/Mimir-8                                                              1.684m ± 1%   1.701m ±  0%  +0.96% (p=0.026 n=6)
Query/sum_by_(le)(h_1),_range_query_with_1000_steps/Prometheus-8                                                         1.790m ± 2%   1.792m ±  1%       ~ (p=0.937 n=6)
Query/sum_by_(le)(h_100),_instant_query/Mimir-8                                                                          9.143m ± 3%   9.304m ±  2%  +1.76% (p=0.026 n=6)
Query/sum_by_(le)(h_100),_instant_query/Prometheus-8                                                                     9.415m ± 2%   9.521m ±  1%       ~ (p=0.132 n=6)
Query/sum_by_(le)(h_100),_range_query_with_100_steps/Mimir-8                                                             17.20m ± 1%   17.45m ±  1%  +1.50% (p=0.002 n=6)
Query/sum_by_(le)(h_100),_range_query_with_100_steps/Prometheus-8                                                        17.60m ± 2%   17.73m ±  3%       ~ (p=0.180 n=6)
Query/sum_by_(le)(h_100),_range_query_with_1000_steps/Mimir-8                                                            87.87m ± 1%   87.88m ±  1%       ~ (p=0.937 n=6)
Query/sum_by_(le)(h_100),_range_query_with_1000_steps/Prometheus-8                                                       93.58m ± 6%   95.48m ±  3%       ~ (p=0.699 n=6)
Query/sum_by_(le)(h_2000),_instant_query/Mimir-8                                                                         167.3m ± 1%   168.1m ±  1%       ~ (p=0.310 n=6)
Query/sum_by_(le)(h_2000),_instant_query/Prometheus-8                                                                    169.2m ± 1%   171.1m ±  1%  +1.12% (p=0.015 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_100_steps/Mimir-8                                                            318.8m ± 1%   319.7m ±  1%       ~ (p=0.310 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_100_steps/Prometheus-8                                                       353.7m ± 1%   354.0m ±  0%       ~ (p=0.937 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_1000_steps/Mimir-8                                                            1.668 ± 1%    1.667 ±  0%       ~ (p=0.818 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                       2.749 ± 0%    2.742 ±  0%       ~ (p=0.240 n=6)
Query/sum_by_(l)(nh_1),_instant_query/Mimir-8                                                                            816.4µ ± 4%   809.3µ ±  1%       ~ (p=0.394 n=6)
Query/sum_by_(l)(nh_1),_instant_query/Prometheus-8                                                                       810.8µ ± 1%   822.0µ ±  1%  +1.39% (p=0.004 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_100_steps/Mimir-8                                                               908.2µ ± 2%   909.2µ ±  1%       ~ (p=0.589 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_100_steps/Prometheus-8                                                          986.2µ ± 4%   991.6µ ±  1%       ~ (p=0.310 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_1000_steps/Mimir-8                                                              1.770m ± 3%   1.815m ±  2%       ~ (p=0.132 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_1000_steps/Prometheus-8                                                         2.292m ± 4%   2.310m ±  3%       ~ (p=0.937 n=6)
Query/sum_by_(l)(nh_100),_instant_query/Mimir-8                                                                          12.01m ± 0%   12.10m ±  1%  +0.81% (p=0.004 n=6)
Query/sum_by_(l)(nh_100),_instant_query/Prometheus-8                                                                     12.06m ± 1%   12.08m ±  1%       ~ (p=0.818 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_100_steps/Mimir-8                                                             21.59m ± 5%   21.39m ±  4%       ~ (p=0.394 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_100_steps/Prometheus-8                                                        27.38m ± 6%   27.82m ±  5%       ~ (p=0.699 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_1000_steps/Mimir-8                                                            111.4m ± 2%   113.2m ±  2%  +1.67% (p=0.026 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_1000_steps/Prometheus-8                                                       229.1m ± 2%   229.9m ±  2%       ~ (p=0.937 n=6)
Query/sum_by_(l)(nh_2000),_instant_query/Mimir-8                                                                         219.6m ± 1%   221.9m ±  1%  +1.03% (p=0.026 n=6)
Query/sum_by_(l)(nh_2000),_instant_query/Prometheus-8                                                                    219.6m ± 1%   222.0m ±  1%       ~ (p=0.065 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_100_steps/Mimir-8                                                            427.4m ± 2%   430.5m ±  1%       ~ (p=0.818 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_100_steps/Prometheus-8                                                       684.9m ± 2%   677.2m ±  1%       ~ (p=0.485 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_1000_steps/Mimir-8                                                            2.785 ± 3%    2.772 ±  4%       ~ (p=0.699 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_1000_steps/Prometheus-8                                                       5.632 ± 1%    5.623 ±  2%       ~ (p=0.394 n=6)
Query/sum(a_1_+_b_1),_instant_query/Mimir-8                                                                              1.221m ± 1%   1.249m ±  1%  +2.26% (p=0.002 n=6)
Query/sum(a_1_+_b_1),_instant_query/Prometheus-8                                                                         1.261m ± 1%   1.312m ±  6%  +4.06% (p=0.041 n=6)
Query/sum(a_1_+_b_1),_range_query_with_100_steps/Mimir-8                                                                 1.284m ± 3%   1.273m ±  2%       ~ (p=0.240 n=6)
Query/sum(a_1_+_b_1),_range_query_with_100_steps/Prometheus-8                                                            1.368m ± 2%   1.358m ±  1%       ~ (p=0.093 n=6)
Query/sum(a_1_+_b_1),_range_query_with_1000_steps/Mimir-8                                                                1.608m ± 3%   1.591m ±  2%  -1.09% (p=0.041 n=6)
Query/sum(a_1_+_b_1),_range_query_with_1000_steps/Prometheus-8                                                           2.192m ± 1%   2.227m ±  2%  +1.58% (p=0.002 n=6)
Query/sum(a_100_+_b_100),_instant_query/Mimir-8                                                                          4.404m ± 1%   4.373m ±  1%       ~ (p=0.180 n=6)
Query/sum(a_100_+_b_100),_instant_query/Prometheus-8                                                                     4.326m ± 5%   4.341m ±  1%       ~ (p=0.818 n=6)
Query/sum(a_100_+_b_100),_range_query_with_100_steps/Mimir-8                                                             7.087m ± 2%   7.246m ±  1%  +2.25% (p=0.004 n=6)
Query/sum(a_100_+_b_100),_range_query_with_100_steps/Prometheus-8                                                        11.82m ± 4%   11.82m ±  1%       ~ (p=0.937 n=6)
Query/sum(a_100_+_b_100),_range_query_with_1000_steps/Mimir-8                                                            31.15m ± 0%   31.45m ±  1%       ~ (p=0.093 n=6)
Query/sum(a_100_+_b_100),_range_query_with_1000_steps/Prometheus-8                                                       82.10m ± 3%   81.13m ±  6%       ~ (p=0.699 n=6)
Query/sum(a_2000_+_b_2000),_instant_query/Mimir-8                                                                        57.58m ± 3%   57.25m ±  3%       ~ (p=0.589 n=6)
Query/sum(a_2000_+_b_2000),_instant_query/Prometheus-8                                                                   57.14m ± 1%   58.17m ±  2%  +1.81% (p=0.015 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_100_steps/Mimir-8                                                           112.1m ± 1%   114.0m ±  2%       ~ (p=0.065 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_100_steps/Prometheus-8                                                      239.6m ± 1%   238.9m ±  1%       ~ (p=0.589 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_1000_steps/Mimir-8                                                          574.9m ± 1%   574.0m ±  1%       ~ (p=0.818 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_1000_steps/Prometheus-8                                                      2.006 ± 5%    2.013 ±  4%       ~ (p=0.699 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_instant_query/Mimir-8                                                                  716.9µ ± 2%   725.9µ ±  1%  +1.24% (p=0.009 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_instant_query/Prometheus-8                                                             755.7µ ± 3%   760.2µ ±  2%       ~ (p=0.699 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_100_steps/Mimir-8                                                     958.5µ ± 1%   949.5µ ±  1%       ~ (p=0.240 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_100_steps/Prometheus-8                                                1.056m ± 2%   1.052m ±  1%       ~ (p=0.589 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_1000_steps/Mimir-8                                                    2.028m ± 1%   2.047m ±  2%       ~ (p=0.065 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_1000_steps/Prometheus-8                                               2.798m ± 0%   2.780m ±  0%  -0.64% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_instant_query/Mimir-8                                                                4.043m ± 4%   4.072m ±  3%       ~ (p=0.180 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_instant_query/Prometheus-8                                                           5.227m ± 1%   5.344m ±  2%  +2.24% (p=0.015 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_100_steps/Mimir-8                                                   21.90m ± 1%   21.78m ±  1%       ~ (p=0.240 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_100_steps/Prometheus-8                                              28.56m ± 4%   28.53m ±  5%       ~ (p=0.818 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_1000_steps/Mimir-8                                                  120.7m ± 1%   120.9m ±  0%       ~ (p=1.000 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_1000_steps/Prometheus-8                                             198.5m ± 2%   198.5m ±  3%       ~ (p=1.000 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_instant_query/Mimir-8                                                               64.90m ± 3%   66.17m ±  2%       ~ (p=0.093 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_instant_query/Prometheus-8                                                          90.58m ± 1%   92.97m ±  2%  +2.64% (p=0.015 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_100_steps/Mimir-8                                                  408.0m ± 1%   410.3m ±  0%       ~ (p=0.093 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_100_steps/Prometheus-8                                             572.8m ± 2%   574.4m ±  2%       ~ (p=0.589 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_1000_steps/Mimir-8                                                  2.344 ± 1%    2.338 ±  0%       ~ (p=0.699 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_1000_steps/Prometheus-8                                             4.755 ± 2%    4.757 ±  4%       ~ (p=0.589 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_instant_query/Mimir-8                                                              646.8µ ± 1%   657.7µ ±  3%       ~ (p=0.132 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_instant_query/Prometheus-8                                                         680.5µ ± 2%   680.0µ ±  3%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_100_steps/Mimir-8                                                 719.9µ ± 4%   727.0µ ±  2%       ~ (p=0.180 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_100_steps/Prometheus-8                                            748.6µ ± 1%   764.6µ ±  2%  +2.13% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_1000_steps/Mimir-8                                                925.2µ ± 2%   924.6µ ±  1%       ~ (p=0.937 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_1000_steps/Prometheus-8                                           1.096m ± 3%   1.101m ±  3%       ~ (p=0.818 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_instant_query/Mimir-8                                                            1.331m ± 1%   1.351m ±  2%       ~ (p=0.065 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_instant_query/Prometheus-8                                                       1.573m ± 4%   1.594m ±  1%       ~ (p=0.132 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_100_steps/Mimir-8                                               4.283m ± 1%   4.335m ±  2%  +1.22% (p=0.026 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_100_steps/Prometheus-8                                          5.392m ± 1%   5.416m ±  1%       ~ (p=0.589 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_1000_steps/Mimir-8                                              21.44m ± 1%   21.37m ±  1%  -0.33% (p=0.041 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_1000_steps/Prometheus-8                                         32.74m ± 1%   32.66m ±  3%       ~ (p=0.485 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_instant_query/Mimir-8                                                           10.41m ± 2%   10.76m ±  3%  +3.35% (p=0.004 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_instant_query/Prometheus-8                                                      14.45m ± 2%   14.72m ±  3%       ~ (p=0.093 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_100_steps/Mimir-8                                              67.24m ± 1%   67.25m ±  1%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_100_steps/Prometheus-8                                         91.53m ± 3%   92.50m ±  2%       ~ (p=0.485 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_1000_steps/Mimir-8                                             388.8m ± 0%   389.0m ±  1%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_1000_steps/Prometheus-8                                        665.4m ± 1%   671.8m ±  1%  +0.96% (p=0.009 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_instant_query/Mimir-8                             1.256m ± 4%   1.240m ±  2%       ~ (p=0.589 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_instant_query/Prometheus-8                        1.283m ± 2%   1.294m ±  4%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_100_steps/Mimir-8                1.356m ± 4%   1.333m ±  2%  -1.70% (p=0.015 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_100_steps/Prometheus-8           1.490m ± 3%   1.478m ±  2%       ~ (p=0.394 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_1000_steps/Mimir-8               1.714m ± 5%   1.721m ±  5%       ~ (p=0.485 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_1000_steps/Prometheus-8          2.512m ± 2%   2.511m ±  1%       ~ (p=0.818 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_instant_query/Mimir-8                         2.432m ± 1%   2.472m ±  2%  +1.64% (p=0.041 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_instant_query/Prometheus-8                    2.869m ± 3%   2.853m ±  4%       ~ (p=0.937 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_100_steps/Mimir-8            8.213m ± 1%   8.251m ±  1%       ~ (p=0.485 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_100_steps/Prometheus-8       10.35m ± 1%   10.40m ±  2%       ~ (p=0.132 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_1000_steps/Mimir-8           40.59m ± 1%   40.52m ±  1%       ~ (p=0.937 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_1000_steps/Prometheus-8      63.22m ± 1%   63.47m ±  1%       ~ (p=0.093 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_instant_query/Mimir-8                       21.21m ± 3%   21.31m ±  3%       ~ (p=0.485 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_instant_query/Prometheus-8                  28.34m ± 6%   28.95m ±  2%       ~ (p=0.240 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_100_steps/Mimir-8          134.2m ± 1%   134.7m ±  1%       ~ (p=0.132 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_100_steps/Prometheus-8     181.1m ± 1%   181.3m ±  2%       ~ (p=0.937 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_1000_steps/Mimir-8         780.4m ± 1%   774.3m ±  0%       ~ (p=0.065 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_1000_steps/Prometheus-8     1.350 ± 1%    1.356 ±  1%       ~ (p=0.240 n=6)
geomean                                                                                                                  17.12m        17.25m        +0.76%

                                                                                                                      │    main.txt    │               agg.txt               │
                                                                                                                      │      B/op      │     B/op       vs base              │
Query/sum_over_time(a_1[1m]),_instant_query/Mimir-8                                                                      22.04Ki ±  0%    22.04Ki ± 0%       ~ (p=0.485 n=6)
Query/sum_over_time(a_1[1m]),_instant_query/Prometheus-8                                                                 24.02Ki ±  0%    24.04Ki ± 0%       ~ (p=0.121 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_100_steps/Mimir-8                                                         22.98Ki ±  0%    22.97Ki ± 0%       ~ (p=0.240 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_100_steps/Prometheus-8                                                    25.47Ki ±  0%    25.48Ki ± 0%       ~ (p=0.615 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_1000_steps/Mimir-8                                                        26.95Ki ±  0%    26.94Ki ± 1%       ~ (p=0.584 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_1000_steps/Prometheus-8                                                   29.54Ki ±  0%    29.51Ki ± 0%       ~ (p=0.394 n=6)
Query/sum_over_time(a_100[1m]),_instant_query/Mimir-8                                                                    118.5Ki ±  0%    118.5Ki ± 0%       ~ (p=0.093 n=6)
Query/sum_over_time(a_100[1m]),_instant_query/Prometheus-8                                                               135.3Ki ±  0%    135.3Ki ± 0%       ~ (p=0.818 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_100_steps/Mimir-8                                                       210.4Ki ±  0%    210.4Ki ± 0%       ~ (p=0.485 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_100_steps/Prometheus-8                                                  222.2Ki ±  0%    222.2Ki ± 0%       ~ (p=0.589 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_1000_steps/Mimir-8                                                      596.1Ki ±  0%    594.4Ki ± 1%       ~ (p=0.240 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_1000_steps/Prometheus-8                                                 607.0Ki ±  0%    606.6Ki ± 0%       ~ (p=0.699 n=6)
Query/sum_over_time(a_2000[1m]),_instant_query/Mimir-8                                                                   1.908Mi ±  0%    1.904Mi ± 0%       ~ (p=0.065 n=6)
Query/sum_over_time(a_2000[1m]),_instant_query/Prometheus-8                                                              2.246Mi ±  0%    2.247Mi ± 0%       ~ (p=1.000 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_100_steps/Mimir-8                                                      3.813Mi ±  5%    3.819Mi ± 1%       ~ (p=0.937 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_100_steps/Prometheus-8                                                 3.979Mi ±  5%    3.988Mi ± 0%       ~ (p=0.485 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_1000_steps/Mimir-8                                                     10.97Mi ±  1%    10.98Mi ± 0%       ~ (p=0.485 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_1000_steps/Prometheus-8                                                11.34Mi ±  1%    11.31Mi ± 1%       ~ (p=0.485 n=6)
Query/sum_over_time(nh_1[1m]),_instant_query/Mimir-8                                                                     27.75Ki ±  0%    27.76Ki ± 0%       ~ (p=0.485 n=6)
Query/sum_over_time(nh_1[1m]),_instant_query/Prometheus-8                                                                30.11Ki ±  0%    30.10Ki ± 0%       ~ (p=0.905 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_100_steps/Mimir-8                                                        60.42Ki ±  0%    60.38Ki ± 0%       ~ (p=0.589 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_100_steps/Prometheus-8                                                   67.90Ki ±  0%    67.89Ki ± 0%       ~ (p=0.959 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_1000_steps/Mimir-8                                                       288.5Ki ±  0%    288.6Ki ± 0%       ~ (p=0.699 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_1000_steps/Prometheus-8                                                  310.5Ki ±  0%    310.5Ki ± 0%       ~ (p=1.000 n=6)
Query/sum_over_time(nh_100[1m]),_instant_query/Mimir-8                                                                   157.3Ki ±  0%    157.4Ki ± 0%       ~ (p=0.240 n=6)
Query/sum_over_time(nh_100[1m]),_instant_query/Prometheus-8                                                              202.3Ki ±  0%    202.3Ki ± 0%       ~ (p=0.818 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_100_steps/Mimir-8                                                      2.760Mi ±  0%    2.763Mi ± 0%       ~ (p=0.394 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_100_steps/Prometheus-8                                                 2.949Mi ±  0%    2.950Mi ± 0%       ~ (p=0.310 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_1000_steps/Mimir-8                                                     24.89Mi ±  0%    24.89Mi ± 0%       ~ (p=0.589 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_1000_steps/Prometheus-8                                                26.44Mi ±  0%    26.44Mi ± 0%       ~ (p=0.937 n=6)
Query/sum_over_time(nh_2000[1m]),_instant_query/Mimir-8                                                                  2.554Mi ±  0%    2.556Mi ± 0%       ~ (p=0.699 n=6)
Query/sum_over_time(nh_2000[1m]),_instant_query/Prometheus-8                                                             3.430Mi ±  0%    3.428Mi ± 0%       ~ (p=1.000 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_100_steps/Mimir-8                                                     54.42Mi ±  0%    54.52Mi ± 0%       ~ (p=0.240 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_100_steps/Prometheus-8                                                58.26Mi ±  0%    58.25Mi ± 0%       ~ (p=0.818 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_1000_steps/Mimir-8                                                    531.8Mi ±  0%    531.9Mi ± 0%       ~ (p=0.240 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_1000_steps/Prometheus-8                                               559.1Mi ±  0%    559.2Mi ± 0%       ~ (p=0.818 n=6)
Query/sum(a_1),_instant_query/Mimir-8                                                                                    22.34Ki ±  0%    22.49Ki ± 0%  +0.69% (p=0.002 n=6)
Query/sum(a_1),_instant_query/Prometheus-8                                                                               23.63Ki ±  0%    23.63Ki ± 0%       ~ (p=0.619 n=6)
Query/sum(a_1),_range_query_with_100_steps/Mimir-8                                                                       22.96Ki ±  0%    23.09Ki ± 0%  +0.57% (p=0.002 n=6)
Query/sum(a_1),_range_query_with_100_steps/Prometheus-8                                                                  24.73Ki ±  0%    24.73Ki ± 0%       ~ (p=0.900 n=6)
Query/sum(a_1),_range_query_with_1000_steps/Mimir-8                                                                      27.44Ki ±  1%    27.56Ki ± 0%  +0.41% (p=0.002 n=6)
Query/sum(a_1),_range_query_with_1000_steps/Prometheus-8                                                                 29.25Ki ±  0%    29.30Ki ± 0%       ~ (p=0.288 n=6)
Query/sum(a_100),_instant_query/Mimir-8                                                                                  153.9Ki ±  0%    155.8Ki ± 0%  +1.18% (p=0.002 n=6)
Query/sum(a_100),_instant_query/Prometheus-8                                                                             171.0Ki ±  0%    171.0Ki ± 0%       ~ (p=0.394 n=6)
Query/sum(a_100),_range_query_with_100_steps/Mimir-8                                                                     210.0Ki ±  0%    212.0Ki ± 0%  +0.94% (p=0.002 n=6)
Query/sum(a_100),_range_query_with_100_steps/Prometheus-8                                                                227.0Ki ±  0%    227.0Ki ± 0%       ~ (p=0.310 n=6)
Query/sum(a_100),_range_query_with_1000_steps/Mimir-8                                                                    637.5Ki ±  0%    639.3Ki ± 1%       ~ (p=0.065 n=6)
Query/sum(a_100),_range_query_with_1000_steps/Prometheus-8                                                               649.3Ki ±  0%    650.5Ki ± 0%       ~ (p=0.132 n=6)
Query/sum(a_2000),_instant_query/Mimir-8                                                                                 2.617Mi ±  0%    2.646Mi ± 0%  +1.10% (p=0.002 n=6)
Query/sum(a_2000),_instant_query/Prometheus-8                                                                            2.980Mi ±  0%    2.979Mi ± 0%       ~ (p=0.699 n=6)
Query/sum(a_2000),_range_query_with_100_steps/Mimir-8                                                                    3.718Mi ±  0%    3.753Mi ± 0%  +0.92% (p=0.002 n=6)
Query/sum(a_2000),_range_query_with_100_steps/Prometheus-8                                                               4.079Mi ±  0%    4.075Mi ± 0%       ~ (p=0.240 n=6)
Query/sum(a_2000),_range_query_with_1000_steps/Mimir-8                                                                   11.95Mi ±  1%    11.97Mi ± 1%       ~ (p=0.485 n=6)
Query/sum(a_2000),_range_query_with_1000_steps/Prometheus-8                                                              12.12Mi ±  1%    12.13Mi ± 0%       ~ (p=0.818 n=6)
Query/sum_without_(l)(h_1),_instant_query/Mimir-8                                                                        30.58Ki ±  0%    31.35Ki ± 0%  +2.50% (p=0.002 n=6)
Query/sum_without_(l)(h_1),_instant_query/Prometheus-8                                                                   32.71Ki ±  0%    32.74Ki ± 0%  +0.09% (p=0.009 n=6)
Query/sum_without_(l)(h_1),_range_query_with_100_steps/Mimir-8                                                           34.16Ki ±  0%    34.86Ki ± 0%  +2.06% (p=0.002 n=6)
Query/sum_without_(l)(h_1),_range_query_with_100_steps/Prometheus-8                                                      36.57Ki ±  0%    36.57Ki ± 0%       ~ (p=0.686 n=6)
Query/sum_without_(l)(h_1),_range_query_with_1000_steps/Mimir-8                                                          60.56Ki ±  1%    61.33Ki ± 1%  +1.26% (p=0.002 n=6)
Query/sum_without_(l)(h_1),_range_query_with_1000_steps/Prometheus-8                                                     62.86Ki ±  1%    62.89Ki ± 0%       ~ (p=0.699 n=6)
Query/sum_without_(l)(h_100),_instant_query/Mimir-8                                                                      901.1Ki ±  0%    913.0Ki ± 0%  +1.32% (p=0.002 n=6)
Query/sum_without_(l)(h_100),_instant_query/Prometheus-8                                                                 1.002Mi ±  0%    1.005Mi ± 0%       ~ (p=0.818 n=6)
Query/sum_without_(l)(h_100),_range_query_with_100_steps/Mimir-8                                                         1.220Mi ±  0%    1.228Mi ± 1%  +0.65% (p=0.002 n=6)
Query/sum_without_(l)(h_100),_range_query_with_100_steps/Prometheus-8                                                    1.339Mi ±  1%    1.341Mi ± 0%       ~ (p=0.180 n=6)
Query/sum_without_(l)(h_100),_range_query_with_1000_steps/Mimir-8                                                        3.674Mi ±  0%    3.682Mi ± 1%  +0.20% (p=0.002 n=6)
Query/sum_without_(l)(h_100),_range_query_with_1000_steps/Prometheus-8                                                   3.777Mi ±  1%    3.757Mi ± 1%       ~ (p=0.180 n=6)
Query/sum_without_(l)(h_2000),_instant_query/Mimir-8                                                                     18.69Mi ±  0%    18.91Mi ± 1%  +1.15% (p=0.002 n=6)
Query/sum_without_(l)(h_2000),_instant_query/Prometheus-8                                                                21.23Mi ±  0%    21.22Mi ± 0%       ~ (p=0.818 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_100_steps/Mimir-8                                                        25.34Mi ±  0%    25.53Mi ± 0%  +0.79% (p=0.002 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_100_steps/Prometheus-8                                                   27.52Mi ±  0%    27.50Mi ± 0%  -0.09% (p=0.026 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_1000_steps/Mimir-8                                                       75.34Mi ±  0%    75.47Mi ± 1%       ~ (p=0.132 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                  264.8Mi ±  0%    264.7Mi ± 0%       ~ (p=0.310 n=6)
Query/sum_without_(le)(h_1),_instant_query/Mimir-8                                                                       30.39Ki ±  0%    30.58Ki ± 0%  +0.61% (p=0.002 n=6)
Query/sum_without_(le)(h_1),_instant_query/Prometheus-8                                                                  31.15Ki ±  0%    31.17Ki ± 0%       ~ (p=0.818 n=6)
Query/sum_without_(le)(h_1),_range_query_with_100_steps/Mimir-8                                                          33.88Ki ±  0%    34.12Ki ± 0%  +0.72% (p=0.002 n=6)
Query/sum_without_(le)(h_1),_range_query_with_100_steps/Prometheus-8                                                     35.20Ki ±  0%    35.19Ki ± 0%       ~ (p=0.485 n=6)
Query/sum_without_(le)(h_1),_range_query_with_1000_steps/Mimir-8                                                         60.49Ki ±  0%    60.90Ki ± 1%       ~ (p=0.093 n=6)
Query/sum_without_(le)(h_1),_range_query_with_1000_steps/Prometheus-8                                                    61.35Ki ±  1%    61.32Ki ± 0%       ~ (p=0.589 n=6)
Query/sum_without_(le)(h_100),_instant_query/Mimir-8                                                                     925.6Ki ±  1%    944.4Ki ± 0%  +2.03% (p=0.002 n=6)
Query/sum_without_(le)(h_100),_instant_query/Prometheus-8                                                                1.042Mi ±  0%    1.041Mi ± 0%       ~ (p=0.065 n=6)
Query/sum_without_(le)(h_100),_range_query_with_100_steps/Mimir-8                                                        1.244Mi ±  0%    1.265Mi ± 0%  +1.64% (p=0.002 n=6)
Query/sum_without_(le)(h_100),_range_query_with_100_steps/Prometheus-8                                                   1.374Mi ±  0%    1.371Mi ± 0%       ~ (p=0.394 n=6)
Query/sum_without_(le)(h_100),_range_query_with_1000_steps/Mimir-8                                                       3.692Mi ±  0%    3.717Mi ± 1%  +0.67% (p=0.002 n=6)
Query/sum_without_(le)(h_100),_range_query_with_1000_steps/Prometheus-8                                                  3.816Mi ±  1%    3.802Mi ± 1%       ~ (p=0.589 n=6)
Query/sum_without_(le)(h_2000),_instant_query/Mimir-8                                                                    19.35Mi ±  0%    19.68Mi ± 1%  +1.73% (p=0.002 n=6)
Query/sum_without_(le)(h_2000),_instant_query/Prometheus-8                                                               22.10Mi ±  1%    22.08Mi ± 0%       ~ (p=0.699 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_100_steps/Mimir-8                                                       27.81Mi ±  3%    27.69Mi ± 3%       ~ (p=1.000 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_100_steps/Prometheus-8                                                  28.26Mi ±  0%    28.26Mi ± 0%       ~ (p=0.818 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_1000_steps/Mimir-8                                                      107.5Mi ±  0%    107.7Mi ± 0%  +0.23% (p=0.009 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                 296.7Mi ±  0%    296.7Mi ± 0%       ~ (p=0.818 n=6)
Query/sum(nh_1),_instant_query/Mimir-8                                                                                   38.55Ki ±  0%    38.68Ki ± 0%  +0.33% (p=0.002 n=6)
Query/sum(nh_1),_instant_query/Prometheus-8                                                                              40.15Ki ±  0%    40.13Ki ± 0%       ~ (p=0.589 n=6)
Query/sum(nh_1),_range_query_with_100_steps/Mimir-8                                                                      92.26Ki ±  0%    92.37Ki ± 0%  +0.12% (p=0.009 n=6)
Query/sum(nh_1),_range_query_with_100_steps/Prometheus-8                                                                 119.1Ki ±  0%    119.1Ki ± 0%       ~ (p=0.974 n=6)
Query/sum(nh_1),_range_query_with_1000_steps/Mimir-8                                                                     549.7Ki ±  0%    550.0Ki ± 0%       ~ (p=0.065 n=6)
Query/sum(nh_1),_range_query_with_1000_steps/Prometheus-8                                                                800.0Ki ±  0%    800.0Ki ± 0%       ~ (p=0.699 n=6)
Query/sum(nh_100),_instant_query/Mimir-8                                                                                 1.034Mi ±  0%    1.035Mi ± 0%  +0.15% (p=0.041 n=6)
Query/sum(nh_100),_instant_query/Prometheus-8                                                                            1.050Mi ±  0%    1.051Mi ± 0%       ~ (p=0.589 n=6)
Query/sum(nh_100),_range_query_with_100_steps/Mimir-8                                                                    5.949Mi ±  0%    5.951Mi ± 0%       ~ (p=0.180 n=6)
Query/sum(nh_100),_range_query_with_100_steps/Prometheus-8                                                               5.979Mi ±  0%    5.977Mi ± 0%       ~ (p=0.937 n=6)
Query/sum(nh_100),_range_query_with_1000_steps/Mimir-8                                                                   50.26Mi ±  0%    50.27Mi ± 0%       ~ (p=0.132 n=6)
Query/sum(nh_100),_range_query_with_1000_steps/Prometheus-8                                                              50.65Mi ±  0%    50.66Mi ± 0%       ~ (p=0.589 n=6)
Query/sum(nh_2000),_instant_query/Mimir-8                                                                                20.01Mi ±  0%    20.19Mi ± 1%  +0.89% (p=0.015 n=6)
Query/sum(nh_2000),_instant_query/Prometheus-8                                                                           20.40Mi ±  1%    20.40Mi ± 0%       ~ (p=0.485 n=6)
Query/sum(nh_2000),_range_query_with_100_steps/Mimir-8                                                                   118.3Mi ±  0%    118.4Mi ± 0%       ~ (p=1.000 n=6)
Query/sum(nh_2000),_range_query_with_100_steps/Prometheus-8                                                              119.8Mi ±  0%    119.8Mi ± 0%       ~ (p=0.180 n=6)
Query/sum(nh_2000),_range_query_with_1000_steps/Mimir-8                                                                 1002.0Mi ±  0%   1002.1Mi ± 0%       ~ (p=0.240 n=6)
Query/sum(nh_2000),_range_query_with_1000_steps/Prometheus-8                                                             1.009Gi ±  0%    1.009Gi ± 0%       ~ (p=0.180 n=6)
Query/sum_by_(l)(h_1),_instant_query/Mimir-8                                                                             30.34Ki ±  0%    30.57Ki ± 0%  +0.76% (p=0.002 n=6)
Query/sum_by_(l)(h_1),_instant_query/Prometheus-8                                                                        31.13Ki ±  0%    31.12Ki ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(l)(h_1),_range_query_with_100_steps/Mimir-8                                                                33.85Ki ±  0%    34.09Ki ± 0%  +0.72% (p=0.002 n=6)
Query/sum_by_(l)(h_1),_range_query_with_100_steps/Prometheus-8                                                           35.19Ki ±  0%    35.17Ki ± 0%       ~ (p=0.288 n=6)
Query/sum_by_(l)(h_1),_range_query_with_1000_steps/Mimir-8                                                               60.41Ki ±  1%    60.77Ki ± 1%       ~ (p=0.132 n=6)
Query/sum_by_(l)(h_1),_range_query_with_1000_steps/Prometheus-8                                                          61.42Ki ±  0%    61.45Ki ± 1%       ~ (p=0.394 n=6)
Query/sum_by_(l)(h_100),_instant_query/Mimir-8                                                                           924.4Ki ±  0%    944.9Ki ± 0%  +2.22% (p=0.002 n=6)
Query/sum_by_(l)(h_100),_instant_query/Prometheus-8                                                                      1.041Mi ±  0%    1.042Mi ± 0%       ~ (p=0.485 n=6)
Query/sum_by_(l)(h_100),_range_query_with_100_steps/Mimir-8                                                              1.243Mi ±  0%    1.264Mi ± 0%  +1.63% (p=0.002 n=6)
Query/sum_by_(l)(h_100),_range_query_with_100_steps/Prometheus-8                                                         1.371Mi ±  0%    1.372Mi ± 0%       ~ (p=0.180 n=6)
Query/sum_by_(l)(h_100),_range_query_with_1000_steps/Mimir-8                                                             3.702Mi ±  0%    3.721Mi ± 0%  +0.51% (p=0.004 n=6)
Query/sum_by_(l)(h_100),_range_query_with_1000_steps/Prometheus-8                                                        3.809Mi ±  1%    3.819Mi ± 1%       ~ (p=0.937 n=6)
Query/sum_by_(l)(h_2000),_instant_query/Mimir-8                                                                          19.38Mi ±  1%    19.77Mi ± 1%  +2.04% (p=0.002 n=6)
Query/sum_by_(l)(h_2000),_instant_query/Prometheus-8                                                                     22.11Mi ±  0%    22.08Mi ± 0%       ~ (p=0.485 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_100_steps/Mimir-8                                                             27.81Mi ±  2%    27.98Mi ± 3%       ~ (p=0.699 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_100_steps/Prometheus-8                                                        28.27Mi ±  0%    28.29Mi ± 0%       ~ (p=0.394 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_1000_steps/Mimir-8                                                            107.4Mi ±  0%    107.5Mi ± 0%       ~ (p=0.485 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                       296.6Mi ±  0%    296.7Mi ± 0%       ~ (p=0.485 n=6)
Query/sum_by_(le)(h_1),_instant_query/Mimir-8                                                                            30.53Ki ±  0%    31.32Ki ± 0%  +2.59% (p=0.002 n=6)
Query/sum_by_(le)(h_1),_instant_query/Prometheus-8                                                                       32.68Ki ±  0%    32.72Ki ± 0%  +0.12% (p=0.017 n=6)
Query/sum_by_(le)(h_1),_range_query_with_100_steps/Mimir-8                                                               34.09Ki ±  0%    34.82Ki ± 0%  +2.15% (p=0.002 n=6)
Query/sum_by_(le)(h_1),_range_query_with_100_steps/Prometheus-8                                                          36.55Ki ±  0%    36.55Ki ± 0%       ~ (p=0.937 n=6)
Query/sum_by_(le)(h_1),_range_query_with_1000_steps/Mimir-8                                                              60.52Ki ±  0%    61.26Ki ± 1%  +1.23% (p=0.002 n=6)
Query/sum_by_(le)(h_1),_range_query_with_1000_steps/Prometheus-8                                                         62.75Ki ±  1%    62.73Ki ± 0%       ~ (p=0.699 n=6)
Query/sum_by_(le)(h_100),_instant_query/Mimir-8                                                                          901.9Ki ±  1%    914.2Ki ± 0%  +1.37% (p=0.002 n=6)
Query/sum_by_(le)(h_100),_instant_query/Prometheus-8                                                                     1.004Mi ±  0%    1.003Mi ± 0%       ~ (p=0.180 n=6)
Query/sum_by_(le)(h_100),_range_query_with_100_steps/Mimir-8                                                             1.218Mi ±  0%    1.228Mi ± 0%  +0.88% (p=0.002 n=6)
Query/sum_by_(le)(h_100),_range_query_with_100_steps/Prometheus-8                                                        1.341Mi ±  0%    1.340Mi ± 0%       ~ (p=0.310 n=6)
Query/sum_by_(le)(h_100),_range_query_with_1000_steps/Mimir-8                                                            3.680Mi ±  0%    3.683Mi ± 0%       ~ (p=0.485 n=6)
Query/sum_by_(le)(h_100),_range_query_with_1000_steps/Prometheus-8                                                       3.762Mi ±  0%    3.778Mi ± 1%       ~ (p=0.180 n=6)
Query/sum_by_(le)(h_2000),_instant_query/Mimir-8                                                                         18.70Mi ±  0%    18.88Mi ± 0%  +0.95% (p=0.002 n=6)
Query/sum_by_(le)(h_2000),_instant_query/Prometheus-8                                                                    21.22Mi ±  0%    21.24Mi ± 0%       ~ (p=0.589 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_100_steps/Mimir-8                                                            25.34Mi ±  1%    25.50Mi ± 0%  +0.61% (p=0.002 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_100_steps/Prometheus-8                                                       27.51Mi ±  0%    27.52Mi ± 0%       ~ (p=0.818 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_1000_steps/Mimir-8                                                           75.23Mi ±  0%    75.34Mi ± 0%       ~ (p=0.589 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                      264.8Mi ±  0%    264.8Mi ± 0%       ~ (p=0.699 n=6)
Query/sum_by_(l)(nh_1),_instant_query/Mimir-8                                                                            39.96Ki ±  0%    40.10Ki ± 0%  +0.36% (p=0.002 n=6)
Query/sum_by_(l)(nh_1),_instant_query/Prometheus-8                                                                       40.23Ki ±  0%    40.26Ki ± 0%  +0.09% (p=0.026 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_100_steps/Mimir-8                                                               93.65Ki ±  0%    93.83Ki ± 0%  +0.19% (p=0.002 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_100_steps/Prometheus-8                                                          119.2Ki ±  0%    119.2Ki ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_1000_steps/Mimir-8                                                              551.1Ki ±  0%    551.1Ki ± 0%       ~ (p=0.937 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_1000_steps/Prometheus-8                                                         800.1Ki ±  0%    800.2Ki ± 0%       ~ (p=0.937 n=6)
Query/sum_by_(l)(nh_100),_instant_query/Mimir-8                                                                          1.054Mi ±  0%    1.068Mi ± 0%  +1.29% (p=0.002 n=6)
Query/sum_by_(l)(nh_100),_instant_query/Prometheus-8                                                                     1.115Mi ±  0%    1.116Mi ± 0%       ~ (p=0.394 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_100_steps/Mimir-8                                                             6.002Mi ±  0%    6.013Mi ± 0%  +0.18% (p=0.002 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_100_steps/Prometheus-8                                                        8.460Mi ±  0%    8.461Mi ± 0%       ~ (p=0.132 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_1000_steps/Mimir-8                                                            50.48Mi ±  0%    50.48Mi ± 0%       ~ (p=0.818 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_1000_steps/Prometheus-8                                                       74.79Mi ±  0%    74.97Mi ± 0%  +0.25% (p=0.004 n=6)
Query/sum_by_(l)(nh_2000),_instant_query/Mimir-8                                                                         20.61Mi ±  0%    20.93Mi ± 1%  +1.57% (p=0.002 n=6)
Query/sum_by_(l)(nh_2000),_instant_query/Prometheus-8                                                                    21.84Mi ±  1%    21.83Mi ± 1%       ~ (p=1.000 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_100_steps/Mimir-8                                                            121.1Mi ±  1%    120.9Mi ± 1%       ~ (p=0.485 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_100_steps/Prometheus-8                                                       170.5Mi ±  0%    170.5Mi ± 0%       ~ (p=0.937 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_1000_steps/Mimir-8                                                           1.014Gi ±  0%    1.014Gi ± 0%       ~ (p=0.589 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_1000_steps/Prometheus-8                                                      1.517Gi ±  0%    1.517Gi ± 0%       ~ (p=0.065 n=6)
Query/sum(a_1_+_b_1),_instant_query/Mimir-8                                                                              43.91Ki ±  0%    44.08Ki ± 0%  +0.39% (p=0.002 n=6)
Query/sum(a_1_+_b_1),_instant_query/Prometheus-8                                                                         47.47Ki ±  0%    47.42Ki ± 0%       ~ (p=0.143 n=6)
Query/sum(a_1_+_b_1),_range_query_with_100_steps/Mimir-8                                                                 47.21Ki ±  0%    47.35Ki ± 0%  +0.30% (p=0.004 n=6)
Query/sum(a_1_+_b_1),_range_query_with_100_steps/Prometheus-8                                                            53.59Ki ±  1%    53.61Ki ± 0%       ~ (p=1.000 n=6)
Query/sum(a_1_+_b_1),_range_query_with_1000_steps/Mimir-8                                                                70.35Ki ±  1%    70.40Ki ± 0%       ~ (p=0.310 n=6)
Query/sum(a_1_+_b_1),_range_query_with_1000_steps/Prometheus-8                                                           105.2Ki ±  0%    105.1Ki ± 0%       ~ (p=0.818 n=6)
Query/sum(a_100_+_b_100),_instant_query/Mimir-8                                                                          326.0Ki ±  0%    327.7Ki ± 0%  +0.52% (p=0.002 n=6)
Query/sum(a_100_+_b_100),_instant_query/Prometheus-8                                                                     428.6Ki ±  0%    428.5Ki ± 0%       ~ (p=0.818 n=6)
Query/sum(a_100_+_b_100),_range_query_with_100_steps/Mimir-8                                                             638.3Ki ±  0%    640.3Ki ± 0%  +0.30% (p=0.002 n=6)
Query/sum(a_100_+_b_100),_range_query_with_100_steps/Prometheus-8                                                        641.1Ki ±  0%    640.2Ki ± 0%       ~ (p=0.699 n=6)
Query/sum(a_100_+_b_100),_range_query_with_1000_steps/Mimir-8                                                            2.833Mi ±  0%    2.836Mi ± 0%       ~ (p=0.240 n=6)
Query/sum(a_100_+_b_100),_range_query_with_1000_steps/Prometheus-8                                                       2.295Mi ±  1%    2.295Mi ± 0%       ~ (p=1.000 n=6)
Query/sum(a_2000_+_b_2000),_instant_query/Mimir-8                                                                        5.668Mi ±  0%    5.696Mi ± 0%  +0.50% (p=0.002 n=6)
Query/sum(a_2000_+_b_2000),_instant_query/Prometheus-8                                                                   8.057Mi ±  0%    8.063Mi ± 0%       ~ (p=0.061 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_100_steps/Mimir-8                                                           11.75Mi ±  1%    11.83Mi ± 0%  +0.63% (p=0.004 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_100_steps/Prometheus-8                                                      10.29Mi ± 15%    10.31Mi ± 1%       ~ (p=0.937 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_1000_steps/Mimir-8                                                          56.47Mi ±  1%    56.78Mi ± 1%       ~ (p=0.240 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_1000_steps/Prometheus-8                                                     122.0Mi ±  0%    121.9Mi ± 0%       ~ (p=0.699 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_instant_query/Mimir-8                                                                  29.52Ki ±  0%    30.32Ki ± 0%  +2.70% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_instant_query/Prometheus-8                                                             34.65Ki ±  0%    34.65Ki ± 0%       ~ (p=0.394 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_100_steps/Mimir-8                                                     35.14Ki ±  0%    35.85Ki ± 0%  +2.03% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_100_steps/Prometheus-8                                                40.20Ki ±  0%    40.18Ki ± 0%       ~ (p=0.197 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_1000_steps/Mimir-8                                                    58.09Ki ±  0%    58.75Ki ± 1%  +1.13% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_1000_steps/Prometheus-8                                               63.13Ki ±  0%    62.99Ki ± 0%       ~ (p=0.093 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_instant_query/Mimir-8                                                                687.4Ki ±  0%    698.1Ki ± 0%  +1.56% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_instant_query/Prometheus-8                                                           938.9Ki ±  0%    937.8Ki ± 0%       ~ (p=0.310 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_100_steps/Mimir-8                                                   1.231Mi ±  0%    1.241Mi ± 0%  +0.84% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_100_steps/Prometheus-8                                              1.476Mi ±  0%    1.474Mi ± 0%       ~ (p=0.589 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_1000_steps/Mimir-8                                                  3.423Mi ±  0%    3.431Mi ± 0%       ~ (p=0.394 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_1000_steps/Prometheus-8                                             3.653Mi ±  1%    3.650Mi ± 2%       ~ (p=0.937 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_instant_query/Mimir-8                                                               14.42Mi ±  0%    14.67Mi ± 0%  +1.74% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_instant_query/Prometheus-8                                                          19.41Mi ±  0%    19.40Mi ± 0%       ~ (p=0.818 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_100_steps/Mimir-8                                                  25.56Mi ±  0%    25.73Mi ± 1%  +0.67% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_100_steps/Prometheus-8                                             30.06Mi ±  0%    30.06Mi ± 0%       ~ (p=0.937 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_1000_steps/Mimir-8                                                 70.16Mi ±  0%    70.34Mi ± 0%       ~ (p=0.132 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_1000_steps/Prometheus-8                                            262.0Mi ±  0%    262.1Mi ± 0%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_instant_query/Mimir-8                                                              24.51Ki ±  0%    24.65Ki ± 0%  +0.58% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_instant_query/Prometheus-8                                                         26.12Ki ±  0%    26.13Ki ± 0%       ~ (p=0.818 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_100_steps/Mimir-8                                                 25.48Ki ±  0%    25.61Ki ± 0%  +0.52% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_100_steps/Prometheus-8                                            27.55Ki ±  0%    27.54Ki ± 0%       ~ (p=0.485 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_1000_steps/Mimir-8                                                29.42Ki ±  0%    29.61Ki ± 1%  +0.64% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_1000_steps/Prometheus-8                                           31.71Ki ±  0%    31.71Ki ± 0%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_instant_query/Mimir-8                                                            123.7Ki ±  0%    125.3Ki ± 0%  +1.35% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_instant_query/Prometheus-8                                                       161.3Ki ±  0%    161.4Ki ± 0%  +0.05% (p=0.017 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_100_steps/Mimir-8                                               214.8Ki ±  0%    216.3Ki ± 0%  +0.72% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_100_steps/Prometheus-8                                          251.6Ki ±  0%    252.0Ki ± 0%  +0.17% (p=0.015 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_1000_steps/Mimir-8                                              601.8Ki ±  1%    603.2Ki ± 0%       ~ (p=0.310 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_1000_steps/Prometheus-8                                         636.8Ki ±  1%    637.5Ki ± 0%       ~ (p=0.310 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_instant_query/Mimir-8                                                           1.930Mi ±  0%    1.962Mi ± 0%  +1.66% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_instant_query/Prometheus-8                                                      2.712Mi ±  0%    2.708Mi ± 0%       ~ (p=0.065 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_100_steps/Mimir-8                                              3.758Mi ±  0%    3.791Mi ± 0%  +0.89% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_100_steps/Prometheus-8                                         4.533Mi ±  4%    4.519Mi ± 0%       ~ (p=0.589 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_1000_steps/Mimir-8                                             11.05Mi ±  2%    11.26Mi ± 2%       ~ (p=0.240 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_1000_steps/Prometheus-8                                        11.80Mi ±  1%    11.76Mi ± 0%       ~ (p=0.132 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_instant_query/Mimir-8                             48.47Ki ±  0%    48.79Ki ± 0%  +0.68% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_instant_query/Prometheus-8                        54.57Ki ±  0%    54.57Ki ± 0%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_100_steps/Mimir-8                52.41Ki ±  0%    52.69Ki ± 0%  +0.55% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_100_steps/Prometheus-8           61.00Ki ±  0%    60.97Ki ± 0%       ~ (p=0.485 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_1000_steps/Mimir-8               74.40Ki ±  0%    74.85Ki ± 0%  +0.61% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_1000_steps/Prometheus-8          111.6Ki ±  0%    111.6Ki ± 0%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_instant_query/Mimir-8                         246.8Ki ±  0%    250.3Ki ± 0%  +1.42% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_instant_query/Prometheus-8                    324.4Ki ±  0%    324.3Ki ± 0%       ~ (p=0.818 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_100_steps/Mimir-8            431.4Ki ±  0%    434.8Ki ± 0%  +0.78% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_100_steps/Prometheus-8       511.1Ki ±  0%    511.2Ki ± 0%       ~ (p=0.786 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_1000_steps/Mimir-8           1.190Mi ±  0%    1.193Mi ± 0%       ~ (p=0.394 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_1000_steps/Prometheus-8      1.289Mi ±  0%    1.287Mi ± 0%  -0.16% (p=0.009 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_instant_query/Mimir-8                       3.854Mi ±  0%    3.920Mi ± 0%  +1.72% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_instant_query/Prometheus-8                  5.404Mi ±  0%    5.400Mi ± 0%       ~ (p=0.310 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_100_steps/Mimir-8          7.565Mi ±  1%    7.641Mi ± 1%  +1.01% (p=0.004 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_100_steps/Prometheus-8     9.084Mi ±  1%    9.101Mi ± 1%       ~ (p=0.394 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_1000_steps/Mimir-8         22.63Mi ±  1%    22.78Mi ± 1%       ~ (p=0.132 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_1000_steps/Prometheus-8    56.68Mi ±  1%    56.54Mi ± 1%       ~ (p=0.589 n=6)
geomean                                                                                                                  1.161Mi          1.165Mi       +0.33%

                                                                                                                      │  main.txt   │               agg.txt                │
                                                                                                                      │  allocs/op  │  allocs/op    vs base                │
Query/sum_over_time(a_1[1m]),_instant_query/Mimir-8                                                                      391.0 ± 0%     391.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(a_1[1m]),_instant_query/Prometheus-8                                                                 430.0 ± 0%     430.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(a_1[1m]),_range_query_with_100_steps/Mimir-8                                                         400.0 ± 0%     400.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(a_1[1m]),_range_query_with_100_steps/Prometheus-8                                                    444.0 ± 0%     444.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(a_1[1m]),_range_query_with_1000_steps/Mimir-8                                                        423.0 ± 0%     423.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(a_1[1m]),_range_query_with_1000_steps/Prometheus-8                                                   467.0 ± 0%     467.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(a_100[1m]),_instant_query/Mimir-8                                                                   1.901k ± 0%    1.901k ± 0%       ~ (p=0.455 n=6)
Query/sum_over_time(a_100[1m]),_instant_query/Prometheus-8                                                              1.954k ± 0%    1.954k ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(a_100[1m]),_range_query_with_100_steps/Mimir-8                                                      2.709k ± 0%    2.709k ± 0%       ~ (p=1.000 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_100_steps/Prometheus-8                                                 2.766k ± 0%    2.766k ± 0%       ~ (p=0.455 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_1000_steps/Mimir-8                                                     5.029k ± 0%    5.029k ± 0%       ~ (p=0.424 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_1000_steps/Prometheus-8                                                5.085k ± 0%    5.084k ± 0%       ~ (p=0.184 n=6)
Query/sum_over_time(a_2000[1m]),_instant_query/Mimir-8                                                                  30.80k ± 0%    30.80k ± 0%       ~ (p=0.446 n=6)
Query/sum_over_time(a_2000[1m]),_instant_query/Prometheus-8                                                             30.88k ± 0%    30.88k ± 0%       ~ (p=0.370 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_100_steps/Mimir-8                                                     46.93k ± 0%    46.93k ± 0%       ~ (p=0.937 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_100_steps/Prometheus-8                                                46.99k ± 0%    46.99k ± 0%       ~ (p=0.608 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_1000_steps/Mimir-8                                                    92.98k ± 0%    92.98k ± 0%       ~ (p=0.299 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_1000_steps/Prometheus-8                                               93.08k ± 0%    93.07k ± 0%       ~ (p=0.699 n=6)
Query/sum_over_time(nh_1[1m]),_instant_query/Mimir-8                                                                     463.0 ± 0%     463.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(nh_1[1m]),_instant_query/Prometheus-8                                                                509.0 ± 0%     509.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(nh_1[1m]),_range_query_with_100_steps/Mimir-8                                                       1.092k ± 0%    1.092k ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(nh_1[1m]),_range_query_with_100_steps/Prometheus-8                                                  1.306k ± 0%    1.306k ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_over_time(nh_1[1m]),_range_query_with_1000_steps/Mimir-8                                                      5.604k ± 0%    5.604k ± 0%       ~ (p=1.000 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_1000_steps/Prometheus-8                                                 6.720k ± 0%    6.720k ± 0%       ~ (p=1.000 n=6)
Query/sum_over_time(nh_100[1m]),_instant_query/Mimir-8                                                                  2.864k ± 0%    2.864k ± 0%       ~ (p=1.000 n=6)
Query/sum_over_time(nh_100[1m]),_instant_query/Prometheus-8                                                             3.526k ± 0%    3.526k ± 0%       ~ (p=1.000 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_100_steps/Mimir-8                                                     53.84k ± 0%    53.84k ± 0%       ~ (p=0.394 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_100_steps/Prometheus-8                                                64.57k ± 0%    64.57k ± 0%       ~ (p=0.418 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_1000_steps/Mimir-8                                                    504.7k ± 0%    504.7k ± 0%       ~ (p=0.426 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_1000_steps/Prometheus-8                                               605.4k ± 0%    605.4k ± 0%       ~ (p=0.329 n=6)
Query/sum_over_time(nh_2000[1m]),_instant_query/Mimir-8                                                                 48.88k ± 0%    48.88k ± 0%       ~ (p=0.413 n=6)
Query/sum_over_time(nh_2000[1m]),_instant_query/Prometheus-8                                                            60.99k ± 0%    60.99k ± 0%       ~ (p=0.461 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_100_steps/Mimir-8                                                    1.065M ± 0%    1.065M ± 0%       ~ (p=0.974 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_100_steps/Prometheus-8                                               1.278M ± 0%    1.277M ± 0%       ~ (p=0.485 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_1000_steps/Mimir-8                                                   10.09M ± 0%    10.09M ± 0%       ~ (p=0.699 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_1000_steps/Prometheus-8                                              12.10M ± 0%    12.10M ± 0%       ~ (p=0.390 n=6)
Query/sum(a_1),_instant_query/Mimir-8                                                                                    389.0 ± 0%     391.0 ± 0%  +0.51% (p=0.002 n=6)
Query/sum(a_1),_instant_query/Prometheus-8                                                                               418.0 ± 0%     418.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum(a_1),_range_query_with_100_steps/Mimir-8                                                                       394.0 ± 0%     396.0 ± 0%  +0.51% (p=0.002 n=6)
Query/sum(a_1),_range_query_with_100_steps/Prometheus-8                                                                  428.0 ± 0%     428.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum(a_1),_range_query_with_1000_steps/Mimir-8                                                                      420.0 ± 0%     422.0 ± 0%  +0.48% (p=0.002 n=6)
Query/sum(a_1),_range_query_with_1000_steps/Prometheus-8                                                                 454.0 ± 0%     454.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum(a_100),_instant_query/Mimir-8                                                                                 2.294k ± 0%    2.395k ± 0%  +4.40% (p=0.002 n=6)
Query/sum(a_100),_instant_query/Prometheus-8                                                                            2.330k ± 0%    2.330k ± 0%       ~ (p=1.000 n=6)
Query/sum(a_100),_range_query_with_100_steps/Mimir-8                                                                    2.702k ± 0%    2.803k ± 0%  +3.74% (p=0.002 n=6)
Query/sum(a_100),_range_query_with_100_steps/Prometheus-8                                                               2.742k ± 0%    2.743k ± 0%       ~ (p=0.242 n=6)
Query/sum(a_100),_range_query_with_1000_steps/Mimir-8                                                                   5.318k ± 0%    5.419k ± 0%  +1.90% (p=0.002 n=6)
Query/sum(a_100),_range_query_with_1000_steps/Prometheus-8                                                              5.355k ± 0%    5.358k ± 0%  +0.06% (p=0.048 n=6)
Query/sum(a_2000),_instant_query/Mimir-8                                                                                38.86k ± 0%    40.88k ± 0%  +5.20% (p=0.002 n=6)
Query/sum(a_2000),_instant_query/Prometheus-8                                                                           38.92k ± 0%    38.94k ± 0%       ~ (p=0.106 n=6)
Query/sum(a_2000),_range_query_with_100_steps/Mimir-8                                                                   46.91k ± 0%    48.91k ± 0%  +4.26% (p=0.002 n=6)
Query/sum(a_2000),_range_query_with_100_steps/Prometheus-8                                                              46.97k ± 0%    46.96k ± 0%       ~ (p=0.087 n=6)
Query/sum(a_2000),_range_query_with_1000_steps/Mimir-8                                                                  99.00k ± 0%   101.01k ± 0%  +2.03% (p=0.002 n=6)
Query/sum(a_2000),_range_query_with_1000_steps/Prometheus-8                                                             99.01k ± 0%    99.01k ± 0%       ~ (p=0.790 n=6)
Query/sum_without_(l)(h_1),_instant_query/Mimir-8                                                                        515.0 ± 0%     527.0 ± 0%  +2.33% (p=0.002 n=6)
Query/sum_without_(l)(h_1),_instant_query/Prometheus-8                                                                   539.0 ± 0%     539.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_without_(l)(h_1),_range_query_with_100_steps/Mimir-8                                                           540.0 ± 0%     552.0 ± 0%  +2.22% (p=0.002 n=6)
Query/sum_without_(l)(h_1),_range_query_with_100_steps/Prometheus-8                                                      569.0 ± 0%     569.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_without_(l)(h_1),_range_query_with_1000_steps/Mimir-8                                                          696.0 ± 0%     708.0 ± 0%  +1.72% (p=0.002 n=6)
Query/sum_without_(l)(h_1),_range_query_with_1000_steps/Prometheus-8                                                     726.0 ± 0%     726.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_without_(l)(h_100),_instant_query/Mimir-8                                                                     12.55k ± 0%    13.16k ± 0%  +4.84% (p=0.002 n=6)
Query/sum_without_(l)(h_100),_instant_query/Prometheus-8                                                                12.59k ± 0%    12.59k ± 0%       ~ (p=0.591 n=6)
Query/sum_without_(l)(h_100),_range_query_with_100_steps/Mimir-8                                                        14.97k ± 0%    15.58k ± 0%  +4.06% (p=0.002 n=6)
Query/sum_without_(l)(h_100),_range_query_with_100_steps/Prometheus-8                                                   15.01k ± 0%    15.00k ± 0%       ~ (p=0.621 n=6)
Query/sum_without_(l)(h_100),_range_query_with_1000_steps/Mimir-8                                                       30.62k ± 0%    31.23k ± 0%  +1.98% (p=0.002 n=6)
Query/sum_without_(l)(h_100),_range_query_with_1000_steps/Prometheus-8                                                  30.64k ± 0%    30.64k ± 0%       ~ (p=0.909 n=6)
Query/sum_without_(l)(h_2000),_instant_query/Mimir-8                                                                    243.2k ± 0%    255.5k ± 0%  +5.05% (p=0.002 n=6)
Query/sum_without_(l)(h_2000),_instant_query/Prometheus-8                                                               263.4k ± 2%    260.6k ± 3%       ~ (p=0.515 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_100_steps/Mimir-8                                                       291.5k ± 0%    303.5k ± 0%  +4.12% (p=0.002 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_100_steps/Prometheus-8                                                  291.4k ± 0%    291.4k ± 0%       ~ (p=0.786 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_1000_steps/Mimir-8                                                      605.7k ± 0%    617.7k ± 0%  +1.98% (p=0.002 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                 629.6k ± 0%    629.6k ± 0%       ~ (p=0.699 n=6)
Query/sum_without_(le)(h_1),_instant_query/Mimir-8                                                                       503.0 ± 0%     510.0 ± 0%  +1.39% (p=0.002 n=6)
Query/sum_without_(le)(h_1),_instant_query/Prometheus-8                                                                  531.0 ± 0%     531.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_without_(le)(h_1),_range_query_with_100_steps/Mimir-8                                                          529.0 ± 0%     536.0 ± 0%  +1.32% (p=0.002 n=6)
Query/sum_without_(le)(h_1),_range_query_with_100_steps/Prometheus-8                                                     561.0 ± 0%     561.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_without_(le)(h_1),_range_query_with_1000_steps/Mimir-8                                                         685.0 ± 0%     692.0 ± 0%  +1.02% (p=0.002 n=6)
Query/sum_without_(le)(h_1),_range_query_with_1000_steps/Prometheus-8                                                    718.0 ± 0%     718.0 ± 0%       ~ (p=1.000 n=6)
Query/sum_without_(le)(h_100),_instant_query/Mimir-8                                                                    12.75k ± 0%    13.45k ± 0%  +5.48% (p=0.002 n=6)
Query/sum_without_(le)(h_100),_instant_query/Prometheus-8                                                               12.70k ± 0%    12.70k ± 0%       ~ (p=0.535 n=6)
Query/sum_without_(le)(h_100),_range_query_with_100_steps/Mimir-8                                                       15.18k ± 0%    15.88k ± 0%  +4.64% (p=0.002 n=6)
Query/sum_without_(le)(h_100),_range_query_with_100_steps/Prometheus-8                                                  15.12k ± 0%    15.12k ± 0%       ~ (p=0.652 n=6)
Query/sum_without_(le)(h_100),_range_query_with_1000_steps/Mimir-8                                                      30.83k ± 0%    31.54k ± 0%  +2.30% (p=0.002 n=6)
Query/sum_without_(le)(h_100),_range_query_with_1000_steps/Prometheus-8                                                 30.76k ± 0%    30.75k ± 0%       ~ (p=0.180 n=6)
Query/sum_without_(le)(h_2000),_instant_query/Mimir-8                                                                   248.2k ± 0%    262.4k ± 0%  +5.72% (p=0.002 n=6)
Query/sum_without_(le)(h_2000),_instant_query/Prometheus-8                                                              261.3k ± 3%    264.6k ± 3%       ~ (p=1.000 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_100_steps/Mimir-8                                                      298.8k ± 0%    312.5k ± 0%  +4.60% (p=0.002 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_100_steps/Prometheus-8                                                 293.5k ± 0%    293.5k ± 0%       ~ (p=0.485 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_1000_steps/Mimir-8                                                     619.4k ± 0%    633.4k ± 0%  +2.25% (p=0.002 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                635.6k ± 0%    635.7k ± 0%       ~ (p=0.310 n=6)
Query/sum(nh_1),_instant_query/Mimir-8                                                                                   653.0 ± 0%     655.0 ± 0%  +0.31% (p=0.002 n=6)
Query/sum(nh_1),_instant_query/Prometheus-8                                                                              687.0 ± 0%     687.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum(nh_1),_range_query_with_100_steps/Mimir-8                                                                     1.722k ± 0%    1.724k ± 0%  +0.12% (p=0.002 n=6)
Query/sum(nh_1),_range_query_with_100_steps/Prometheus-8                                                                2.256k ± 0%    2.256k ± 0%       ~ (p=1.000 n=6) ¹
Query/sum(nh_1),_range_query_with_1000_steps/Mimir-8                                                                    10.74k ± 0%    10.75k ± 0%  +0.02% (p=0.002 n=6)
Query/sum(nh_1),_range_query_with_1000_steps/Prometheus-8                                                               15.78k ± 0%    15.78k ± 0%       ~ (p=1.000 n=6)
Query/sum(nh_100),_instant_query/Mimir-8                                                                                18.82k ± 0%    18.92k ± 0%  +0.53% (p=0.002 n=6)
Query/sum(nh_100),_instant_query/Prometheus-8                                                                           18.86k ± 0%    18.86k ± 0%       ~ (p=0.686 n=6)
Query/sum(nh_100),_range_query_with_100_steps/Mimir-8                                                                   118.9k ± 0%    119.0k ± 0%  +0.08% (p=0.002 n=6)
Query/sum(nh_100),_range_query_with_100_steps/Prometheus-8                                                              119.5k ± 0%    119.5k ± 0%       ~ (p=0.790 n=6)
Query/sum(nh_100),_range_query_with_1000_steps/Mimir-8                                                                  1.021M ± 0%    1.021M ± 0%  +0.01% (p=0.002 n=6)
Query/sum(nh_100),_range_query_with_1000_steps/Prometheus-8                                                             1.026M ± 0%    1.026M ± 0%       ~ (p=0.734 n=6)
Query/sum(nh_2000),_instant_query/Mimir-8                                                                               367.2k ± 0%    369.2k ± 0%  +0.55% (p=0.002 n=6)
Query/sum(nh_2000),_instant_query/Prometheus-8                                                                          368.0k ± 0%    368.0k ± 0%       ~ (p=1.000 n=6)
Query/sum(nh_2000),_range_query_with_100_steps/Mimir-8                                                                  2.368M ± 0%    2.370M ± 0%  +0.09% (p=0.002 n=6)
Query/sum(nh_2000),_range_query_with_100_steps/Prometheus-8                                                             2.370M ± 0%    2.370M ± 0%       ~ (p=0.818 n=6)
Query/sum(nh_2000),_range_query_with_1000_steps/Mimir-8                                                                 20.40M ± 0%    20.40M ± 0%  +0.01% (p=0.002 n=6)
Query/sum(nh_2000),_range_query_with_1000_steps/Prometheus-8                                                            20.41M ± 0%    20.41M ± 0%       ~ (p=0.190 n=6)
Query/sum_by_(l)(h_1),_instant_query/Mimir-8                                                                             502.0 ± 0%     509.0 ± 0%  +1.39% (p=0.002 n=6)
Query/sum_by_(l)(h_1),_instant_query/Prometheus-8                                                                        531.0 ± 0%     531.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_by_(l)(h_1),_range_query_with_100_steps/Mimir-8                                                                528.0 ± 0%     534.5 ± 0%  +1.23% (p=0.002 n=6)
Query/sum_by_(l)(h_1),_range_query_with_100_steps/Prometheus-8                                                           561.0 ± 0%     561.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_by_(l)(h_1),_range_query_with_1000_steps/Mimir-8                                                               684.0 ± 0%     691.0 ± 0%  +1.02% (p=0.002 n=6)
Query/sum_by_(l)(h_1),_range_query_with_1000_steps/Prometheus-8                                                          718.0 ± 0%     718.0 ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(l)(h_100),_instant_query/Mimir-8                                                                          12.75k ± 0%    13.45k ± 0%  +5.49% (p=0.002 n=6)
Query/sum_by_(l)(h_100),_instant_query/Prometheus-8                                                                     12.70k ± 0%    12.70k ± 0%       ~ (p=0.320 n=6)
Query/sum_by_(l)(h_100),_range_query_with_100_steps/Mimir-8                                                             15.18k ± 0%    15.88k ± 0%  +4.59% (p=0.002 n=6)
Query/sum_by_(l)(h_100),_range_query_with_100_steps/Prometheus-8                                                        15.12k ± 0%    15.12k ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(l)(h_100),_range_query_with_1000_steps/Mimir-8                                                            30.84k ± 0%    31.54k ± 0%  +2.28% (p=0.002 n=6)
Query/sum_by_(l)(h_100),_range_query_with_1000_steps/Prometheus-8                                                       30.75k ± 0%    30.76k ± 0%       ~ (p=0.197 n=6)
Query/sum_by_(l)(h_2000),_instant_query/Mimir-8                                                                         248.3k ± 0%    262.5k ± 0%  +5.70% (p=0.002 n=6)
Query/sum_by_(l)(h_2000),_instant_query/Prometheus-8                                                                    264.1k ± 2%    262.4k ± 2%       ~ (p=0.310 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_100_steps/Mimir-8                                                            299.0k ± 0%    312.7k ± 0%  +4.55% (p=0.002 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_100_steps/Prometheus-8                                                       293.5k ± 0%    293.5k ± 0%       ~ (p=0.310 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_1000_steps/Mimir-8                                                           619.4k ± 0%    633.5k ± 0%  +2.27% (p=0.002 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                      635.7k ± 0%    635.6k ± 0%       ~ (p=0.457 n=6)
Query/sum_by_(le)(h_1),_instant_query/Mimir-8                                                                            514.0 ± 0%     526.0 ± 0%  +2.33% (p=0.002 n=6)
Query/sum_by_(le)(h_1),_instant_query/Prometheus-8                                                                       539.0 ± 0%     539.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_by_(le)(h_1),_range_query_with_100_steps/Mimir-8                                                               539.0 ± 0%     551.0 ± 0%  +2.23% (p=0.002 n=6)
Query/sum_by_(le)(h_1),_range_query_with_100_steps/Prometheus-8                                                          569.0 ± 0%     569.0 ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(le)(h_1),_range_query_with_1000_steps/Mimir-8                                                              695.0 ± 0%     707.0 ± 0%  +1.73% (p=0.002 n=6)
Query/sum_by_(le)(h_1),_range_query_with_1000_steps/Prometheus-8                                                         726.0 ± 0%     726.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_by_(le)(h_100),_instant_query/Mimir-8                                                                         12.55k ± 0%    13.16k ± 0%  +4.83% (p=0.002 n=6)
Query/sum_by_(le)(h_100),_instant_query/Prometheus-8                                                                    12.59k ± 0%    12.59k ± 0%       ~ (p=0.405 n=6)
Query/sum_by_(le)(h_100),_range_query_with_100_steps/Mimir-8                                                            14.97k ± 0%    15.57k ± 0%  +4.02% (p=0.002 n=6)
Query/sum_by_(le)(h_100),_range_query_with_100_steps/Prometheus-8                                                       15.01k ± 0%    15.01k ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(le)(h_100),_range_query_with_1000_steps/Mimir-8                                                           30.63k ± 0%    31.23k ± 0%  +1.98% (p=0.002 n=6)
Query/sum_by_(le)(h_100),_range_query_with_1000_steps/Prometheus-8                                                      30.64k ± 0%    30.64k ± 0%  +0.02% (p=0.030 n=6)
Query/sum_by_(le)(h_2000),_instant_query/Mimir-8                                                                        243.2k ± 0%    255.5k ± 0%  +5.07% (p=0.002 n=6)
Query/sum_by_(le)(h_2000),_instant_query/Prometheus-8                                                                   262.5k ± 2%    266.1k ± 3%       ~ (p=0.485 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_100_steps/Mimir-8                                                           291.5k ± 0%    303.5k ± 0%  +4.12% (p=0.002 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_100_steps/Prometheus-8                                                      291.4k ± 0%    291.4k ± 0%       ~ (p=0.667 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_1000_steps/Mimir-8                                                          605.7k ± 0%    617.7k ± 0%  +1.98% (p=0.002 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                     629.6k ± 0%    629.5k ± 0%       ~ (p=0.485 n=6)
Query/sum_by_(l)(nh_1),_instant_query/Mimir-8                                                                            661.0 ± 0%     663.0 ± 0%  +0.30% (p=0.002 n=6)
Query/sum_by_(l)(nh_1),_instant_query/Prometheus-8                                                                       692.0 ± 0%     692.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_by_(l)(nh_1),_range_query_with_100_steps/Mimir-8                                                              1.730k ± 0%    1.732k ± 0%  +0.12% (p=0.002 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_100_steps/Prometheus-8                                                         2.261k ± 0%    2.261k ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_by_(l)(nh_1),_range_query_with_1000_steps/Mimir-8                                                             10.75k ± 0%    10.75k ± 0%  +0.02% (p=0.002 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_1000_steps/Prometheus-8                                                        15.78k ± 0%    15.78k ± 0%       ~ (p=0.242 n=6)
Query/sum_by_(l)(nh_100),_instant_query/Mimir-8                                                                         19.04k ± 0%    19.25k ± 0%  +1.06% (p=0.002 n=6)
Query/sum_by_(l)(nh_100),_instant_query/Prometheus-8                                                                    19.49k ± 0%    19.49k ± 0%       ~ (p=0.288 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_100_steps/Mimir-8                                                            119.7k ± 0%    119.9k ± 0%  +0.17% (p=0.002 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_100_steps/Prometheus-8                                                       169.6k ± 0%    169.6k ± 0%       ~ (p=0.682 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_1000_steps/Mimir-8                                                           1.021M ± 0%    1.022M ± 0%  +0.02% (p=0.002 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_1000_steps/Prometheus-8                                                      1.521M ± 0%    1.521M ± 0%  +0.00% (p=0.015 n=6)
Query/sum_by_(l)(nh_2000),_instant_query/Mimir-8                                                                        371.9k ± 0%    376.1k ± 0%  +1.12% (p=0.002 n=6)
Query/sum_by_(l)(nh_2000),_instant_query/Prometheus-8                                                                   383.6k ± 0%    383.8k ± 0%       ~ (p=0.255 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_100_steps/Mimir-8                                                           2.386M ± 0%    2.390M ± 0%  +0.14% (p=0.002 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_100_steps/Prometheus-8                                                      3.383M ± 0%    3.383M ± 0%       ~ (p=0.848 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_1000_steps/Mimir-8                                                          20.42M ± 0%    20.43M ± 0%  +0.02% (p=0.002 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_1000_steps/Prometheus-8                                                     30.42M ± 0%    30.42M ± 0%       ~ (p=0.699 n=6)
Query/sum(a_1_+_b_1),_instant_query/Mimir-8                                                                              748.0 ± 0%     750.0 ± 0%  +0.27% (p=0.002 n=6)
Query/sum(a_1_+_b_1),_instant_query/Prometheus-8                                                                         813.0 ± 0%     812.0 ± 0%       ~ (p=0.567 n=6)
Query/sum(a_1_+_b_1),_range_query_with_100_steps/Mimir-8                                                                 757.0 ± 0%     759.0 ± 0%  +0.26% (p=0.002 n=6)
Query/sum(a_1_+_b_1),_range_query_with_100_steps/Prometheus-8                                                           1.025k ± 0%    1.025k ± 0%       ~ (p=0.455 n=6)
Query/sum(a_1_+_b_1),_range_query_with_1000_steps/Mimir-8                                                                810.0 ± 0%     812.0 ± 0%  +0.25% (p=0.002 n=6)
Query/sum(a_1_+_b_1),_range_query_with_1000_steps/Prometheus-8                                                          2.877k ± 0%    2.877k ± 0%       ~ (p=1.000 n=6)
Query/sum(a_100_+_b_100),_instant_query/Mimir-8                                                                         5.164k ± 0%    5.265k ± 0%  +1.96% (p=0.002 n=6)
Query/sum(a_100_+_b_100),_instant_query/Prometheus-8                                                                    5.264k ± 0%    5.264k ± 0%       ~ (p=1.000 n=6)
Query/sum(a_100_+_b_100),_range_query_with_100_steps/Mimir-8                                                            5.981k ± 0%    6.082k ± 0%  +1.69% (p=0.002 n=6)
Query/sum(a_100_+_b_100),_range_query_with_100_steps/Prometheus-8                                                       6.290k ± 0%    6.288k ± 0%       ~ (p=0.816 n=6)
Query/sum(a_100_+_b_100),_range_query_with_1000_steps/Mimir-8                                                           11.23k ± 0%    11.33k ± 0%  +0.90% (p=0.002 n=6)
Query/sum(a_100_+_b_100),_range_query_with_1000_steps/Prometheus-8                                                      15.20k ± 0%    15.20k ± 0%       ~ (p=0.784 n=6)
Query/sum(a_2000_+_b_2000),_instant_query/Mimir-8                                                                       89.73k ± 0%    91.73k ± 0%  +2.23% (p=0.002 n=6)
Query/sum(a_2000_+_b_2000),_instant_query/Prometheus-8                                                                  89.89k ± 0%    89.88k ± 0%       ~ (p=0.225 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_100_steps/Mimir-8                                                          105.8k ± 0%    107.8k ± 0%  +1.89% (p=0.002 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_100_steps/Prometheus-8                                                     102.2k ± 2%    102.1k ± 0%  -0.05% (p=0.041 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_1000_steps/Mimir-8                                                         210.3k ± 0%    212.3k ± 0%  +0.97% (p=0.002 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_1000_steps/Prometheus-8                                                    221.9k ± 0%    221.9k ± 0%       ~ (p=0.240 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_instant_query/Mimir-8                                                                  509.0 ± 0%     522.0 ± 0%  +2.55% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_instant_query/Prometheus-8                                                             584.0 ± 0%     584.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_100_steps/Mimir-8                                                     558.0 ± 0%     570.0 ± 0%  +2.15% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_100_steps/Prometheus-8                                                631.0 ± 0%     631.0 ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_1000_steps/Mimir-8                                                    697.0 ± 0%     709.0 ± 0%  +1.72% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_1000_steps/Prometheus-8                                               769.0 ± 0%     769.0 ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_instant_query/Mimir-8                                                               10.16k ± 0%    10.77k ± 0%  +5.97% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_instant_query/Prometheus-8                                                          12.63k ± 0%    12.63k ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_100_steps/Mimir-8                                                  15.00k ± 0%    15.61k ± 0%  +4.03% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_100_steps/Prometheus-8                                             17.46k ± 0%    17.46k ± 0%       ~ (p=0.169 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_1000_steps/Mimir-8                                                 28.85k ± 0%    29.46k ± 0%  +2.12% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_1000_steps/Prometheus-8                                            31.30k ± 0%    31.30k ± 0%       ~ (p=0.805 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_instant_query/Mimir-8                                                              194.9k ± 0%    207.0k ± 0%  +6.18% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_instant_query/Prometheus-8                                                         252.7k ± 1%    253.5k ± 1%       ~ (p=0.394 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_100_steps/Mimir-8                                                 291.5k ± 0%    303.6k ± 0%  +4.12% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_100_steps/Prometheus-8                                            339.6k ± 0%    339.6k ± 0%       ~ (p=1.000 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_1000_steps/Mimir-8                                                569.7k ± 0%    581.8k ± 0%  +2.13% (p=0.002 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_1000_steps/Prometheus-8                                           641.8k ± 0%    641.8k ± 0%       ~ (p=0.132 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_instant_query/Mimir-8                                                              418.0 ± 0%     420.0 ± 0%  +0.48% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_instant_query/Prometheus-8                                                         465.0 ± 0%     465.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_100_steps/Mimir-8                                                 427.0 ± 0%     429.0 ± 0%  +0.47% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_100_steps/Prometheus-8                                            479.0 ± 0%     479.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_1000_steps/Mimir-8                                                450.0 ± 0%     452.0 ± 0%  +0.44% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_1000_steps/Prometheus-8                                           502.0 ± 0%     502.0 ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_without_(l)(rate(a_100[1m])),_instant_query/Mimir-8                                                           1.929k ± 0%    2.030k ± 0%  +5.26% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_instant_query/Prometheus-8                                                      2.395k ± 0%    2.395k ± 0%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_100_steps/Mimir-8                                              2.737k ± 0%    2.837k ± 0%  +3.67% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_100_steps/Prometheus-8                                         3.199k ± 0%    3.199k ± 0%       ~ (p=0.727 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_1000_steps/Mimir-8                                             5.056k ± 0%    5.157k ± 0%  +2.00% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_1000_steps/Prometheus-8                                        5.517k ± 0%    5.519k ± 0%  +0.03% (p=0.028 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_instant_query/Mimir-8                                                          30.83k ± 0%    32.84k ± 0%  +6.50% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_instant_query/Prometheus-8                                                     38.92k ± 0%    38.92k ± 0%       ~ (p=0.563 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_100_steps/Mimir-8                                             46.95k ± 0%    48.95k ± 0%  +4.27% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_100_steps/Prometheus-8                                        55.03k ± 0%    55.02k ± 0%       ~ (p=0.413 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_1000_steps/Mimir-8                                            93.05k ± 0%    95.06k ± 0%  +2.16% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_1000_steps/Prometheus-8                                       101.1k ± 0%    101.1k ± 0%       ~ (p=0.855 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_instant_query/Mimir-8                             817.0 ± 0%     821.0 ± 0%  +0.49% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_instant_query/Prometheus-8                        937.0 ± 0%     937.0 ± 0%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_100_steps/Mimir-8                834.0 ± 0%     837.5 ± 0%  +0.42% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_100_steps/Prometheus-8          1.151k ± 0%    1.151k ± 0%       ~ (p=1.000 n=6) ¹
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_1000_steps/Mimir-8               880.0 ± 0%     884.0 ± 0%  +0.45% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_1000_steps/Prometheus-8         2.997k ± 0%    2.997k ± 0%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_instant_query/Mimir-8                        3.839k ± 0%    4.041k ± 0%  +5.26% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_instant_query/Prometheus-8                   4.779k ± 0%    4.779k ± 0%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_100_steps/Mimir-8           5.454k ± 0%    5.655k ± 0%  +3.69% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_100_steps/Prometheus-8      6.590k ± 0%    6.591k ± 0%       ~ (p=0.931 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_1000_steps/Mimir-8          10.10k ± 0%    10.30k ± 0%  +2.00% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_1000_steps/Prometheus-8     13.03k ± 0%    13.03k ± 0%       ~ (p=0.567 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_instant_query/Mimir-8                      61.66k ± 0%    65.66k ± 0%  +6.49% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_instant_query/Prometheus-8                 77.82k ± 0%    77.81k ± 0%       ~ (p=0.784 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_100_steps/Mimir-8         93.84k ± 0%    97.85k ± 0%  +4.27% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_100_steps/Prometheus-8    110.2k ± 0%    110.2k ± 0%  -0.05% (p=0.017 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_1000_steps/Mimir-8        186.1k ± 0%    190.1k ± 0%  +2.15% (p=0.002 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_1000_steps/Prometheus-8   210.0k ± 0%    210.0k ± 0%       ~ (p=0.394 n=6)
geomean                                                                                                                 15.32k         15.47k       +0.99%
¹ all samples are equal

                                                                                                                      │   main.txt   │               agg.txt               │
                                                                                                                      │      B       │       B        vs base              │
Query/sum_over_time(a_1[1m]),_instant_query/Mimir-8                                                                     69.87Ki ± 3%   70.38Ki ±  1%  +0.72% (p=0.039 n=6)
Query/sum_over_time(a_1[1m]),_instant_query/Prometheus-8                                                                71.19Ki ± 3%   70.38Ki ±  3%       ~ (p=0.225 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_100_steps/Mimir-8                                                        69.29Ki ± 3%   69.67Ki ±  2%       ~ (p=0.558 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_100_steps/Prometheus-8                                                   70.25Ki ± 3%   70.00Ki ±  2%       ~ (p=0.617 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_1000_steps/Mimir-8                                                       69.69Ki ± 3%   69.06Ki ±  2%       ~ (p=0.455 n=6)
Query/sum_over_time(a_1[1m]),_range_query_with_1000_steps/Prometheus-8                                                  69.19Ki ± 2%   69.50Ki ±  2%       ~ (p=0.970 n=6)
Query/sum_over_time(a_100[1m]),_instant_query/Mimir-8                                                                   67.98Ki ± 1%   68.04Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_over_time(a_100[1m]),_instant_query/Prometheus-8                                                              68.01Ki ± 2%   68.06Ki ±  2%       ~ (p=0.818 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_100_steps/Mimir-8                                                      68.16Ki ± 1%   67.76Ki ±  1%       ~ (p=0.132 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_100_steps/Prometheus-8                                                 67.79Ki ± 2%   67.88Ki ±  1%       ~ (p=1.000 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_1000_steps/Mimir-8                                                     69.06Ki ± 3%   68.98Ki ±  1%       ~ (p=0.790 n=6)
Query/sum_over_time(a_100[1m]),_range_query_with_1000_steps/Prometheus-8                                                68.75Ki ± 1%   69.12Ki ±  4%       ~ (p=0.565 n=6)
Query/sum_over_time(a_2000[1m]),_instant_query/Mimir-8                                                                  69.88Ki ± 1%   69.81Ki ±  1%       ~ (p=0.621 n=6)
Query/sum_over_time(a_2000[1m]),_instant_query/Prometheus-8                                                             70.56Ki ± 2%   70.00Ki ±  2%       ~ (p=0.169 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_100_steps/Mimir-8                                                     77.06Ki ± 1%   77.24Ki ±  1%       ~ (p=0.848 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_100_steps/Prometheus-8                                                75.15Ki ± 2%   74.75Ki ±  2%       ~ (p=0.310 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_1000_steps/Mimir-8                                                    122.3Ki ± 0%   122.4Ki ±  1%       ~ (p=0.669 n=6)
Query/sum_over_time(a_2000[1m]),_range_query_with_1000_steps/Prometheus-8                                               110.4Ki ± 1%   110.4Ki ±  1%       ~ (p=0.777 n=6)
Query/sum_over_time(nh_1[1m]),_instant_query/Mimir-8                                                                    75.50Ki ± 1%   75.00Ki ±  1%       ~ (p=0.442 n=6)
Query/sum_over_time(nh_1[1m]),_instant_query/Prometheus-8                                                               74.55Ki ± 3%   74.81Ki ±  4%       ~ (p=0.701 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_100_steps/Mimir-8                                                       74.12Ki ± 2%   73.69Ki ±  3%       ~ (p=0.483 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_100_steps/Prometheus-8                                                  74.87Ki ± 1%   74.15Ki ±  1%       ~ (p=0.100 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_1000_steps/Mimir-8                                                      72.27Ki ± 1%   72.30Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_over_time(nh_1[1m]),_range_query_with_1000_steps/Prometheus-8                                                 72.52Ki ± 1%   71.80Ki ±  1%       ~ (p=0.065 n=6)
Query/sum_over_time(nh_100[1m]),_instant_query/Mimir-8                                                                  70.62Ki ± 1%   70.30Ki ±  2%       ~ (p=0.279 n=6)
Query/sum_over_time(nh_100[1m]),_instant_query/Prometheus-8                                                             73.19Ki ± 1%   73.29Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_100_steps/Mimir-8                                                     74.31Ki ± 1%   74.37Ki ±  2%       ~ (p=0.937 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_100_steps/Prometheus-8                                                74.38Ki ± 1%   74.19Ki ±  1%       ~ (p=0.470 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_1000_steps/Mimir-8                                                    121.0Ki ± 2%   121.6Ki ±  2%       ~ (p=0.619 n=6)
Query/sum_over_time(nh_100[1m]),_range_query_with_1000_steps/Prometheus-8                                               122.5Ki ± 1%   122.3Ki ±  1%       ~ (p=0.310 n=6)
Query/sum_over_time(nh_2000[1m]),_instant_query/Mimir-8                                                                 73.51Ki ± 2%   73.32Ki ±  2%       ~ (p=0.818 n=6)
Query/sum_over_time(nh_2000[1m]),_instant_query/Prometheus-8                                                            75.70Ki ± 2%   74.81Ki ±  2%       ~ (p=0.132 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_100_steps/Mimir-8                                                    170.6Ki ± 1%   170.8Ki ±  1%       ~ (p=0.286 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_100_steps/Prometheus-8                                               170.2Ki ± 2%   172.5Ki ±  5%       ~ (p=0.734 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_1000_steps/Mimir-8                                                   602.2Ki ± 0%   602.2Ki ±  0%       ~ (p=0.937 n=6)
Query/sum_over_time(nh_2000[1m]),_range_query_with_1000_steps/Prometheus-8                                              606.9Ki ± 0%   609.2Ki ±  0%  +0.38% (p=0.026 n=6)
Query/sum(a_1),_instant_query/Mimir-8                                                                                   70.06Ki ± 3%   69.38Ki ±  2%       ~ (p=0.513 n=6)
Query/sum(a_1),_instant_query/Prometheus-8                                                                              69.94Ki ± 1%   69.44Ki ±  4%       ~ (p=0.457 n=6)
Query/sum(a_1),_range_query_with_100_steps/Mimir-8                                                                      69.59Ki ± 5%   68.81Ki ±  2%       ~ (p=0.937 n=6)
Query/sum(a_1),_range_query_with_100_steps/Prometheus-8                                                                 69.55Ki ± 2%   69.62Ki ±  2%       ~ (p=0.589 n=6)
Query/sum(a_1),_range_query_with_1000_steps/Mimir-8                                                                     69.18Ki ± 3%   68.47Ki ±  2%       ~ (p=0.589 n=6)
Query/sum(a_1),_range_query_with_1000_steps/Prometheus-8                                                                68.97Ki ± 2%   69.75Ki ±  2%       ~ (p=0.223 n=6)
Query/sum(a_100),_instant_query/Mimir-8                                                                                 67.58Ki ± 1%   67.49Ki ±  1%       ~ (p=0.310 n=6)
Query/sum(a_100),_instant_query/Prometheus-8                                                                            68.01Ki ± 1%   68.23Ki ±  1%       ~ (p=0.420 n=6)
Query/sum(a_100),_range_query_with_100_steps/Mimir-8                                                                    67.69Ki ± 1%   67.89Ki ±  1%       ~ (p=0.394 n=6)
Query/sum(a_100),_range_query_with_100_steps/Prometheus-8                                                               68.62Ki ± 2%   68.39Ki ±  1%       ~ (p=0.699 n=6)
Query/sum(a_100),_range_query_with_1000_steps/Mimir-8                                                                   67.12Ki ± 1%   66.68Ki ±  2%       ~ (p=0.818 n=6)
Query/sum(a_100),_range_query_with_1000_steps/Prometheus-8                                                              70.28Ki ± 2%   69.55Ki ±  3%       ~ (p=0.310 n=6)
Query/sum(a_2000),_instant_query/Mimir-8                                                                                69.06Ki ± 1%   68.12Ki ±  1%       ~ (p=0.093 n=6)
Query/sum(a_2000),_instant_query/Prometheus-8                                                                           70.06Ki ± 2%   69.75Ki ±  2%       ~ (p=0.379 n=6)
Query/sum(a_2000),_range_query_with_100_steps/Mimir-8                                                                   68.73Ki ± 1%   68.95Ki ±  1%       ~ (p=0.699 n=6)
Query/sum(a_2000),_range_query_with_100_steps/Prometheus-8                                                              76.26Ki ± 3%   76.19Ki ±  1%       ~ (p=0.699 n=6)
Query/sum(a_2000),_range_query_with_1000_steps/Mimir-8                                                                  72.26Ki ± 2%   72.49Ki ±  1%       ~ (p=0.589 n=6)
Query/sum(a_2000),_range_query_with_1000_steps/Prometheus-8                                                             125.7Ki ± 5%   125.5Ki ±  0%       ~ (p=0.554 n=6)
Query/sum_without_(l)(h_1),_instant_query/Mimir-8                                                                       68.99Ki ± 4%   69.10Ki ±  2%       ~ (p=0.855 n=6)
Query/sum_without_(l)(h_1),_instant_query/Prometheus-8                                                                  69.61Ki ± 1%   68.40Ki ±  2%       ~ (p=0.063 n=6)
Query/sum_without_(l)(h_1),_range_query_with_100_steps/Mimir-8                                                          68.19Ki ± 3%   69.04Ki ±  2%       ~ (p=0.143 n=6)
Query/sum_without_(l)(h_1),_range_query_with_100_steps/Prometheus-8                                                     68.62Ki ± 3%   68.41Ki ±  2%       ~ (p=0.937 n=6)
Query/sum_without_(l)(h_1),_range_query_with_1000_steps/Mimir-8                                                         67.53Ki ± 2%   68.19Ki ±  2%       ~ (p=0.589 n=6)
Query/sum_without_(l)(h_1),_range_query_with_1000_steps/Prometheus-8                                                    68.04Ki ± 3%   68.15Ki ±  1%       ~ (p=0.853 n=6)
Query/sum_without_(l)(h_100),_instant_query/Mimir-8                                                                     68.75Ki ± 1%   68.71Ki ±  0%       ~ (p=0.818 n=6)
Query/sum_without_(l)(h_100),_instant_query/Prometheus-8                                                                69.02Ki ± 1%   69.48Ki ±  1%       ~ (p=0.589 n=6)
Query/sum_without_(l)(h_100),_range_query_with_100_steps/Mimir-8                                                        68.18Ki ± 2%   68.44Ki ±  1%       ~ (p=0.310 n=6)
Query/sum_without_(l)(h_100),_range_query_with_100_steps/Prometheus-8                                                   70.63Ki ± 2%   70.53Ki ±  1%       ~ (p=0.818 n=6)
Query/sum_without_(l)(h_100),_range_query_with_1000_steps/Mimir-8                                                       69.76Ki ± 1%   69.71Ki ±  1%       ~ (p=0.699 n=6)
Query/sum_without_(l)(h_100),_range_query_with_1000_steps/Prometheus-8                                                  88.47Ki ± 3%   88.29Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_without_(l)(h_2000),_instant_query/Mimir-8                                                                    73.54Ki ± 2%   71.63Ki ±  1%  -2.60% (p=0.004 n=6)
Query/sum_without_(l)(h_2000),_instant_query/Prometheus-8                                                               71.78Ki ± 4%   74.16Ki ±  4%       ~ (p=0.180 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_100_steps/Mimir-8                                                       72.48Ki ± 2%   72.39Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_100_steps/Prometheus-8                                                  113.3Ki ± 3%   113.7Ki ±  2%       ~ (p=0.485 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_1000_steps/Mimir-8                                                      73.10Ki ± 4%   73.76Ki ±  3%       ~ (p=0.937 n=6)
Query/sum_without_(l)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                 263.0Ki ± 3%   263.4Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_without_(le)(h_1),_instant_query/Mimir-8                                                                      69.60Ki ± 3%   69.38Ki ±  1%       ~ (p=0.619 n=6)
Query/sum_without_(le)(h_1),_instant_query/Prometheus-8                                                                 69.27Ki ± 2%   69.76Ki ±  2%       ~ (p=0.699 n=6)
Query/sum_without_(le)(h_1),_range_query_with_100_steps/Mimir-8                                                         67.54Ki ± 2%   68.32Ki ±  2%       ~ (p=0.240 n=6)
Query/sum_without_(le)(h_1),_range_query_with_100_steps/Prometheus-8                                                    68.99Ki ± 2%   69.42Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_without_(le)(h_1),_range_query_with_1000_steps/Mimir-8                                                        67.64Ki ± 1%   67.72Ki ±  1%       ~ (p=0.818 n=6)
Query/sum_without_(le)(h_1),_range_query_with_1000_steps/Prometheus-8                                                   67.92Ki ± 2%   68.16Ki ±  1%       ~ (p=0.699 n=6)
Query/sum_without_(le)(h_100),_instant_query/Mimir-8                                                                    68.85Ki ± 1%   68.49Ki ±  1%       ~ (p=0.240 n=6)
Query/sum_without_(le)(h_100),_instant_query/Prometheus-8                                                               69.29Ki ± 0%   69.11Ki ±  2%       ~ (p=0.485 n=6)
Query/sum_without_(le)(h_100),_range_query_with_100_steps/Mimir-8                                                       68.56Ki ± 2%   68.78Ki ±  1%       ~ (p=0.558 n=6)
Query/sum_without_(le)(h_100),_range_query_with_100_steps/Prometheus-8                                                  71.51Ki ± 2%   71.58Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_without_(le)(h_100),_range_query_with_1000_steps/Mimir-8                                                      71.84Ki ± 1%   71.90Ki ±  2%       ~ (p=0.937 n=6)
Query/sum_without_(le)(h_100),_range_query_with_1000_steps/Prometheus-8                                                 90.33Ki ± 4%   91.52Ki ±  5%       ~ (p=0.851 n=6)
Query/sum_without_(le)(h_2000),_instant_query/Mimir-8                                                                   73.17Ki ± 4%   73.02Ki ±  2%       ~ (p=0.589 n=6)
Query/sum_without_(le)(h_2000),_instant_query/Prometheus-8                                                              73.35Ki ± 2%   74.09Ki ±  3%       ~ (p=0.132 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_100_steps/Mimir-8                                                      81.33Ki ± 4%   81.56Ki ±  3%       ~ (p=0.818 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_100_steps/Prometheus-8                                                 118.7Ki ± 2%   120.1Ki ±  1%       ~ (p=0.180 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_1000_steps/Mimir-8                                                     108.3Ki ± 3%   108.0Ki ±  4%       ~ (p=0.699 n=6)
Query/sum_without_(le)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                296.1Ki ± 0%   296.8Ki ±  1%       ~ (p=0.331 n=6)
Query/sum(nh_1),_instant_query/Mimir-8                                                                                  76.19Ki ± 3%   76.25Ki ±  2%       ~ (p=0.699 n=6)
Query/sum(nh_1),_instant_query/Prometheus-8                                                                             76.92Ki ± 3%   76.62Ki ±  2%       ~ (p=0.461 n=6)
Query/sum(nh_1),_range_query_with_100_steps/Mimir-8                                                                     73.18Ki ± 1%   72.96Ki ±  1%       ~ (p=0.699 n=6)
Query/sum(nh_1),_range_query_with_100_steps/Prometheus-8                                                                72.53Ki ± 1%   72.82Ki ±  1%       ~ (p=0.937 n=6)
Query/sum(nh_1),_range_query_with_1000_steps/Mimir-8                                                                    72.68Ki ± 1%   71.88Ki ±  1%  -1.10% (p=0.041 n=6)
Query/sum(nh_1),_range_query_with_1000_steps/Prometheus-8                                                               71.96Ki ± 2%   72.57Ki ±  1%       ~ (p=0.093 n=6)
Query/sum(nh_100),_instant_query/Mimir-8                                                                                70.62Ki ± 1%   70.67Ki ±  1%       ~ (p=0.814 n=6)
Query/sum(nh_100),_instant_query/Prometheus-8                                                                           70.61Ki ± 1%   70.49Ki ±  1%       ~ (p=0.794 n=6)
Query/sum(nh_100),_range_query_with_100_steps/Mimir-8                                                                   69.76Ki ± 1%   69.38Ki ±  1%       ~ (p=0.093 n=6)
Query/sum(nh_100),_range_query_with_100_steps/Prometheus-8                                                              74.92Ki ± 2%   75.32Ki ±  1%       ~ (p=0.258 n=6)
Query/sum(nh_100),_range_query_with_1000_steps/Mimir-8                                                                  70.93Ki ± 1%   70.98Ki ±  1%       ~ (p=0.623 n=6)
Query/sum(nh_100),_range_query_with_1000_steps/Prometheus-8                                                             121.5Ki ± 1%   121.7Ki ±  1%       ~ (p=0.937 n=6)
Query/sum(nh_2000),_instant_query/Mimir-8                                                                               72.09Ki ± 1%   72.54Ki ±  1%       ~ (p=0.589 n=6)
Query/sum(nh_2000),_instant_query/Prometheus-8                                                                          74.36Ki ± 1%   73.56Ki ±  1%  -1.08% (p=0.015 n=6)
Query/sum(nh_2000),_range_query_with_100_steps/Mimir-8                                                                  72.68Ki ± 1%   71.90Ki ±  1%  -1.07% (p=0.015 n=6)
Query/sum(nh_2000),_range_query_with_100_steps/Prometheus-8                                                             178.2Ki ± 2%   176.8Ki ±  1%       ~ (p=0.589 n=6)
Query/sum(nh_2000),_range_query_with_1000_steps/Mimir-8                                                                 75.36Ki ± 1%   75.64Ki ±  1%       ~ (p=1.000 n=6)
Query/sum(nh_2000),_range_query_with_1000_steps/Prometheus-8                                                            748.5Ki ± 3%   755.5Ki ± 10%       ~ (p=0.699 n=6)
Query/sum_by_(l)(h_1),_instant_query/Mimir-8                                                                            68.81Ki ± 3%   69.12Ki ±  4%       ~ (p=0.816 n=6)
Query/sum_by_(l)(h_1),_instant_query/Prometheus-8                                                                       69.19Ki ± 3%   69.94Ki ±  1%       ~ (p=0.167 n=6)
Query/sum_by_(l)(h_1),_range_query_with_100_steps/Mimir-8                                                               68.19Ki ± 2%   68.86Ki ±  2%       ~ (p=0.065 n=6)
Query/sum_by_(l)(h_1),_range_query_with_100_steps/Prometheus-8                                                          69.41Ki ± 1%   69.22Ki ±  2%       ~ (p=0.937 n=6)
Query/sum_by_(l)(h_1),_range_query_with_1000_steps/Mimir-8                                                              67.92Ki ± 2%   67.74Ki ±  3%       ~ (p=0.937 n=6)
Query/sum_by_(l)(h_1),_range_query_with_1000_steps/Prometheus-8                                                         67.69Ki ± 2%   68.03Ki ±  2%       ~ (p=0.818 n=6)
Query/sum_by_(l)(h_100),_instant_query/Mimir-8                                                                          69.04Ki ± 1%   69.02Ki ±  1%       ~ (p=0.729 n=6)
Query/sum_by_(l)(h_100),_instant_query/Prometheus-8                                                                     69.20Ki ± 1%   69.28Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_by_(l)(h_100),_range_query_with_100_steps/Mimir-8                                                             68.71Ki ± 2%   68.82Ki ±  1%       ~ (p=0.699 n=6)
Query/sum_by_(l)(h_100),_range_query_with_100_steps/Prometheus-8                                                        71.10Ki ± 1%   71.04Ki ±  1%       ~ (p=0.974 n=6)
Query/sum_by_(l)(h_100),_range_query_with_1000_steps/Mimir-8                                                            71.99Ki ± 3%   71.85Ki ±  2%       ~ (p=0.485 n=6)
Query/sum_by_(l)(h_100),_range_query_with_1000_steps/Prometheus-8                                                       89.24Ki ± 4%   88.56Ki ±  1%       ~ (p=0.180 n=6)
Query/sum_by_(l)(h_2000),_instant_query/Mimir-8                                                                         73.48Ki ± 2%   73.75Ki ±  2%       ~ (p=0.818 n=6)
Query/sum_by_(l)(h_2000),_instant_query/Prometheus-8                                                                    72.88Ki ± 3%   73.01Ki ±  4%       ~ (p=0.485 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_100_steps/Mimir-8                                                            82.00Ki ± 2%   82.77Ki ±  3%       ~ (p=0.818 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_100_steps/Prometheus-8                                                       121.2Ki ± 1%   120.3Ki ±  3%       ~ (p=0.065 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_1000_steps/Mimir-8                                                           106.8Ki ± 4%   108.3Ki ±  4%       ~ (p=1.000 n=6)
Query/sum_by_(l)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                      296.7Ki ± 1%   295.7Ki ±  1%       ~ (p=0.394 n=6)
Query/sum_by_(le)(h_1),_instant_query/Mimir-8                                                                           68.94Ki ± 3%   68.37Ki ±  2%       ~ (p=0.333 n=6)
Query/sum_by_(le)(h_1),_instant_query/Prometheus-8                                                                      69.18Ki ± 3%   69.00Ki ±  3%       ~ (p=0.699 n=6)
Query/sum_by_(le)(h_1),_range_query_with_100_steps/Mimir-8                                                              68.81Ki ± 3%   68.79Ki ±  2%       ~ (p=0.818 n=6)
Query/sum_by_(le)(h_1),_range_query_with_100_steps/Prometheus-8                                                         69.10Ki ± 4%   68.89Ki ±  2%       ~ (p=0.818 n=6)
Query/sum_by_(le)(h_1),_range_query_with_1000_steps/Mimir-8                                                             67.74Ki ± 3%   67.89Ki ±  1%       ~ (p=0.738 n=6)
Query/sum_by_(le)(h_1),_range_query_with_1000_steps/Prometheus-8                                                        68.32Ki ± 1%   68.33Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_by_(le)(h_100),_instant_query/Mimir-8                                                                         68.84Ki ± 1%   68.81Ki ±  1%       ~ (p=1.000 n=6)
Query/sum_by_(le)(h_100),_instant_query/Prometheus-8                                                                    69.19Ki ± 1%   69.86Ki ±  1%  +0.97% (p=0.015 n=6)
Query/sum_by_(le)(h_100),_range_query_with_100_steps/Mimir-8                                                            68.29Ki ± 2%   68.04Ki ±  1%       ~ (p=0.699 n=6)
Query/sum_by_(le)(h_100),_range_query_with_100_steps/Prometheus-8                                                       70.72Ki ± 1%   69.79Ki ±  2%  -1.32% (p=0.035 n=6)
Query/sum_by_(le)(h_100),_range_query_with_1000_steps/Mimir-8                                                           70.02Ki ± 1%   69.79Ki ±  1%       ~ (p=0.970 n=6)
Query/sum_by_(le)(h_100),_range_query_with_1000_steps/Prometheus-8                                                      88.58Ki ± 1%   88.42Ki ±  3%       ~ (p=0.818 n=6)
Query/sum_by_(le)(h_2000),_instant_query/Mimir-8                                                                        73.29Ki ± 2%   71.74Ki ±  2%  -2.12% (p=0.015 n=6)
Query/sum_by_(le)(h_2000),_instant_query/Prometheus-8                                                                   71.43Ki ± 3%   71.45Ki ±  4%       ~ (p=0.818 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_100_steps/Mimir-8                                                           72.35Ki ± 2%   72.20Ki ±  2%       ~ (p=0.589 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_100_steps/Prometheus-8                                                      113.5Ki ± 4%   113.6Ki ±  4%       ~ (p=0.937 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_1000_steps/Mimir-8                                                          74.46Ki ± 2%   72.63Ki ±  3%       ~ (p=0.132 n=6)
Query/sum_by_(le)(h_2000),_range_query_with_1000_steps/Prometheus-8                                                     264.3Ki ± 0%   264.6Ki ±  1%       ~ (p=0.818 n=6)
Query/sum_by_(l)(nh_1),_instant_query/Mimir-8                                                                           75.92Ki ± 4%   75.00Ki ±  6%       ~ (p=0.370 n=6)
Query/sum_by_(l)(nh_1),_instant_query/Prometheus-8                                                                      75.56Ki ± 3%   76.37Ki ±  1%       ~ (p=0.193 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_100_steps/Mimir-8                                                              72.86Ki ± 1%   73.18Ki ±  1%  +0.45% (p=0.041 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_100_steps/Prometheus-8                                                         72.73Ki ± 1%   72.39Ki ±  1%       ~ (p=0.331 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_1000_steps/Mimir-8                                                             72.72Ki ± 1%   72.12Ki ±  1%  -0.82% (p=0.015 n=6)
Query/sum_by_(l)(nh_1),_range_query_with_1000_steps/Prometheus-8                                                        72.40Ki ± 1%   72.28Ki ±  1%       ~ (p=0.818 n=6)
Query/sum_by_(l)(nh_100),_instant_query/Mimir-8                                                                         70.86Ki ± 1%   70.71Ki ±  1%       ~ (p=0.394 n=6)
Query/sum_by_(l)(nh_100),_instant_query/Prometheus-8                                                                    70.75Ki ± 1%   70.69Ki ±  0%       ~ (p=1.000 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_100_steps/Mimir-8                                                            75.26Ki ± 0%   75.28Ki ±  1%       ~ (p=1.000 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_100_steps/Prometheus-8                                                       80.00Ki ± 1%   79.75Ki ±  1%       ~ (p=0.394 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_1000_steps/Mimir-8                                                           122.0Ki ± 0%   121.5Ki ±  1%       ~ (p=0.065 n=6)
Query/sum_by_(l)(nh_100),_range_query_with_1000_steps/Prometheus-8                                                      174.2Ki ± 1%   174.3Ki ±  1%       ~ (p=0.699 n=6)
Query/sum_by_(l)(nh_2000),_instant_query/Mimir-8                                                                        75.60Ki ± 1%   75.70Ki ±  3%       ~ (p=1.000 n=6)
Query/sum_by_(l)(nh_2000),_instant_query/Prometheus-8                                                                   74.72Ki ± 2%   74.82Ki ±  4%       ~ (p=0.937 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_100_steps/Mimir-8                                                           182.9Ki ± 0%   183.3Ki ±  1%       ~ (p=0.818 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_100_steps/Prometheus-8                                                      276.5Ki ± 1%   275.8Ki ±  1%       ~ (p=0.310 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_1000_steps/Mimir-8                                                          741.7Ki ± 5%   768.7Ki ±  5%       ~ (p=0.180 n=6)
Query/sum_by_(l)(nh_2000),_range_query_with_1000_steps/Prometheus-8                                                     1.114Mi ± 0%   1.114Mi ±  0%       ~ (p=0.937 n=6)
Query/sum(a_1_+_b_1),_instant_query/Mimir-8                                                                             70.24Ki ± 1%   70.12Ki ±  3%       ~ (p=0.784 n=6)
Query/sum(a_1_+_b_1),_instant_query/Prometheus-8                                                                        69.41Ki ± 2%   69.92Ki ±  2%       ~ (p=0.418 n=6)
Query/sum(a_1_+_b_1),_range_query_with_100_steps/Mimir-8                                                                70.02Ki ± 3%   70.29Ki ±  1%       ~ (p=0.180 n=6)
Query/sum(a_1_+_b_1),_range_query_with_100_steps/Prometheus-8                                                           69.83Ki ± 1%   69.71Ki ±  3%       ~ (p=0.937 n=6)
Query/sum(a_1_+_b_1),_range_query_with_1000_steps/Mimir-8                                                               68.71Ki ± 1%   69.25Ki ±  1%  +0.78% (p=0.041 n=6)
Query/sum(a_1_+_b_1),_range_query_with_1000_steps/Prometheus-8                                                          69.25Ki ± 1%   69.39Ki ±  1%       ~ (p=0.937 n=6)
Query/sum(a_100_+_b_100),_instant_query/Mimir-8                                                                         68.25Ki ± 2%   67.90Ki ±  2%       ~ (p=0.310 n=6)
Query/sum(a_100_+_b_100),_instant_query/Prometheus-8                                                                    68.59Ki ± 1%   68.53Ki ±  2%       ~ (p=0.699 n=6)
Query/sum(a_100_+_b_100),_range_query_with_100_steps/Mimir-8                                                            68.82Ki ± 1%   68.49Ki ±  1%       ~ (p=0.258 n=6)
Query/sum(a_100_+_b_100),_range_query_with_100_steps/Prometheus-8                                                       68.92Ki ± 2%   68.62Ki ±  2%       ~ (p=0.818 n=6)
Query/sum(a_100_+_b_100),_range_query_with_1000_steps/Mimir-8                                                           68.75Ki ± 1%   68.36Ki ±  1%       ~ (p=0.240 n=6)
Query/sum(a_100_+_b_100),_range_query_with_1000_steps/Prometheus-8                                                      74.78Ki ± 2%   75.04Ki ±  2%       ~ (p=0.485 n=6)
Query/sum(a_2000_+_b_2000),_instant_query/Mimir-8                                                                       70.87Ki ± 1%   70.67Ki ±  1%       ~ (p=0.310 n=6)
Query/sum(a_2000_+_b_2000),_instant_query/Prometheus-8                                                                  72.71Ki ± 3%   72.14Ki ±  2%       ~ (p=0.589 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_100_steps/Mimir-8                                                          71.60Ki ± 1%   71.80Ki ±  1%       ~ (p=0.240 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_100_steps/Prometheus-8                                                     91.90Ki ± 3%   92.66Ki ±  2%       ~ (p=0.513 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_1000_steps/Mimir-8                                                         80.00Ki ± 2%   80.51Ki ±  1%       ~ (p=0.240 n=6)
Query/sum(a_2000_+_b_2000),_range_query_with_1000_steps/Prometheus-8                                                    156.9Ki ± 0%   156.7Ki ±  1%       ~ (p=0.288 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_instant_query/Mimir-8                                                                 69.39Ki ± 2%   69.51Ki ±  2%       ~ (p=0.937 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_instant_query/Prometheus-8                                                            70.14Ki ± 1%   70.07Ki ±  3%       ~ (p=0.699 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_100_steps/Mimir-8                                                    68.46Ki ± 1%   68.64Ki ±  3%       ~ (p=1.000 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_100_steps/Prometheus-8                                               69.21Ki ± 2%   69.05Ki ±  2%       ~ (p=0.699 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_1000_steps/Mimir-8                                                   67.61Ki ± 2%   67.04Ki ±  2%       ~ (p=0.310 n=6)
Query/sum_by_(le)(rate(h_1[1m])),_range_query_with_1000_steps/Prometheus-8                                              67.15Ki ± 1%   67.52Ki ±  1%       ~ (p=0.058 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_instant_query/Mimir-8                                                               69.29Ki ± 1%   69.38Ki ±  1%       ~ (p=0.485 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_instant_query/Prometheus-8                                                          69.44Ki ± 1%   69.41Ki ±  0%       ~ (p=0.937 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_100_steps/Mimir-8                                                  67.76Ki ± 2%   67.71Ki ±  1%       ~ (p=0.937 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_100_steps/Prometheus-8                                             70.46Ki ± 4%   70.43Ki ±  2%       ~ (p=1.000 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_1000_steps/Mimir-8                                                 69.00Ki ± 1%   68.95Ki ±  3%       ~ (p=0.937 n=6)
Query/sum_by_(le)(rate(h_100[1m])),_range_query_with_1000_steps/Prometheus-8                                            84.80Ki ± 2%   85.20Ki ±  3%       ~ (p=0.937 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_instant_query/Mimir-8                                                              74.23Ki ± 3%   73.57Ki ±  2%       ~ (p=0.065 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_instant_query/Prometheus-8                                                         74.31Ki ± 1%   74.43Ki ±  2%       ~ (p=0.485 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_100_steps/Mimir-8                                                 72.30Ki ± 1%   72.44Ki ±  2%       ~ (p=0.981 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_100_steps/Prometheus-8                                            110.3Ki ± 2%   109.7Ki ±  1%       ~ (p=0.394 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_1000_steps/Mimir-8                                                74.01Ki ± 2%   73.40Ki ±  2%       ~ (p=0.310 n=6)
Query/sum_by_(le)(rate(h_2000[1m])),_range_query_with_1000_steps/Prometheus-8                                           264.3Ki ± 2%   263.6Ki ±  0%  -0.25% (p=0.028 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_instant_query/Mimir-8                                                             69.57Ki ± 2%   69.59Ki ±  2%       ~ (p=0.729 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_instant_query/Prometheus-8                                                        69.45Ki ± 1%   70.27Ki ±  4%       ~ (p=0.132 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_100_steps/Mimir-8                                                68.82Ki ± 3%   69.32Ki ±  3%       ~ (p=0.394 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_100_steps/Prometheus-8                                           69.52Ki ± 3%   69.49Ki ±  3%       ~ (p=0.623 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_1000_steps/Mimir-8                                               68.69Ki ± 2%   69.37Ki ±  3%       ~ (p=0.937 n=6)
Query/sum_without_(l)(rate(a_1[1m])),_range_query_with_1000_steps/Prometheus-8                                          68.71Ki ± 4%   69.09Ki ±  0%       ~ (p=0.071 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_instant_query/Mimir-8                                                           68.06Ki ± 1%   67.71Ki ±  1%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_instant_query/Prometheus-8                                                      68.75Ki ± 1%   68.24Ki ±  1%  -0.74% (p=0.026 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_100_steps/Mimir-8                                              67.41Ki ± 1%   67.59Ki ±  1%       ~ (p=0.310 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_100_steps/Prometheus-8                                         67.83Ki ± 1%   67.52Ki ±  2%       ~ (p=0.589 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_1000_steps/Mimir-8                                             65.53Ki ± 1%   66.28Ki ±  3%       ~ (p=0.093 n=6)
Query/sum_without_(l)(rate(a_100[1m])),_range_query_with_1000_steps/Prometheus-8                                        67.90Ki ± 2%   67.62Ki ±  2%       ~ (p=0.169 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_instant_query/Mimir-8                                                          69.31Ki ± 1%   69.32Ki ±  1%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_instant_query/Prometheus-8                                                     69.73Ki ± 1%   69.57Ki ±  2%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_100_steps/Mimir-8                                             68.39Ki ± 2%   67.59Ki ±  2%       ~ (p=0.065 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_100_steps/Prometheus-8                                        75.19Ki ± 1%   75.58Ki ±  1%       ~ (p=0.310 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_1000_steps/Mimir-8                                            70.92Ki ± 2%   71.33Ki ±  2%       ~ (p=0.589 n=6)
Query/sum_without_(l)(rate(a_2000[1m])),_range_query_with_1000_steps/Prometheus-8                                       110.9Ki ± 0%   110.9Ki ±  0%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_instant_query/Mimir-8                            68.91Ki ± 2%   69.68Ki ±  3%       ~ (p=0.485 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_instant_query/Prometheus-8                       69.71Ki ± 2%   69.30Ki ±  2%       ~ (p=0.240 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_100_steps/Mimir-8               69.68Ki ± 1%   69.59Ki ±  1%       ~ (p=0.669 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_100_steps/Prometheus-8          69.65Ki ± 2%   69.29Ki ±  2%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_1000_steps/Mimir-8              69.33Ki ± 1%   68.55Ki ±  2%       ~ (p=0.141 n=6)
Query/sum_without_(l)(rate(a_1[1m]))_/_sum_without_(l)(rate(b_1[1m])),_range_query_with_1000_steps/Prometheus-8         69.20Ki ± 1%   69.09Ki ±  1%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_instant_query/Mimir-8                        68.25Ki ± 1%   68.20Ki ±  1%       ~ (p=0.513 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_instant_query/Prometheus-8                   68.70Ki ± 0%   68.70Ki ±  1%       ~ (p=1.000 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_100_steps/Mimir-8           68.20Ki ± 2%   67.83Ki ±  2%       ~ (p=0.394 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_100_steps/Prometheus-8      68.38Ki ± 2%   68.15Ki ±  2%       ~ (p=0.818 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_1000_steps/Mimir-8          67.16Ki ± 2%   66.37Ki ±  2%       ~ (p=0.394 n=6)
Query/sum_without_(l)(rate(a_100[1m]))_/_sum_without_(l)(rate(b_100[1m])),_range_query_with_1000_steps/Prometheus-8     69.02Ki ± 2%   68.50Ki ±  2%       ~ (p=0.394 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_instant_query/Mimir-8                      69.99Ki ± 1%   69.65Ki ±  2%       ~ (p=0.485 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_instant_query/Prometheus-8                 70.48Ki ± 1%   70.48Ki ±  2%       ~ (p=0.937 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_100_steps/Mimir-8         69.67Ki ± 2%   69.92Ki ±  2%       ~ (p=0.699 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_100_steps/Prometheus-8    76.17Ki ± 2%   77.22Ki ±  2%  +1.37% (p=0.048 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_1000_steps/Mimir-8        74.49Ki ± 2%   75.50Ki ±  3%       ~ (p=0.240 n=6)
Query/sum_without_(l)(rate(a_2000[1m]))_/_sum_without_(l)(rate(b_2000[1m])),_range_query_with_1000_steps/Prometheus-8   99.96Ki ± 2%   99.47Ki ±  3%       ~ (p=0.310 n=6)
geomean                                                                                                                 81.92Ki        81.90Ki        -0.02%


tldr: about a 5% overhead with no pooling of aggregation functions.

Copy link
Contributor

@charleskorn charleskorn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall LGTM 🚀

I'd like to see some up-to-date benchmark results with the latest round of changes (especially the fix for emitAnnotationFunc).

My main concern is the change in 6605803: I don't believe this is correct, or an improvement:

  • consider the case where an output group receives a float, then a histogram, then a final float for a single output timestamp: we'll end up returning the final float, but we should return nothing
  • we'll also now do a whole lot more work: instead of checking for the possibility of conflicts once per output series, and only checking for conflicts at each point if there are histograms and floats present in a single output series, we'll now do a check for every single input point

@jhesketh
Copy link
Contributor Author

My main concern is the change in 6605803: I don't believe this is correct

Good catch, thanks. For simplicity I will revert this, but I may look at doing something else in a separate PR.

This PR should be ready now, so long as we're okay with doing the Compact in a separate PR. ie there is likely something wrong here, but it's not a regression over the current state.

@jhesketh jhesketh marked this pull request as ready for review August 28, 2024 01:17
@jhesketh jhesketh requested a review from a team as a code owner August 28, 2024 01:17
@jhesketh jhesketh requested a review from tacole02 as a code owner August 28, 2024 01:38
Copy link
Contributor

@charleskorn charleskorn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM modulo small suggestions below

@jhesketh jhesketh enabled auto-merge (squash) August 28, 2024 02:00
@jhesketh jhesketh merged commit ce3b88a into grafana:main Aug 28, 2024
29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants