-
Notifications
You must be signed in to change notification settings - Fork 296
Closed
Labels
Description
Benchmark comparison has identified performance shifts at:
Please review the report below and take corrective/congratulatory action as appropriate :slightly_smiling_face:
⏱️ Performance Benchmark Report: 1ef8c4c
Performance shifts
| Change | Before [39640754] <main~1> | After [1ef8c4ca] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|--------------------------------------------------------------------------------------------|
| + | 959±10μs | 9.74±0.2ms | 10.16 | cube.CubeCreation.time_create(True, 'construct') |
| + | 576±2μs | 6.68±0.08ms | 11.6 | cube.CubeCreation.time_create(True, 'instantiate') |
| + | 87.5±2ms | 105±1ms | 1.2 | cube.CubeEquality.time_equality(False, True, 'all_equal') |
| + | 25.5±0.8ms | 43.2±1ms | 1.7 | cube.CubeEquality.time_equality(False, True, 'coord_inequality') |
| + | 239±2ms | 444±3ms | 1.86 | cube.CubeEquality.time_equality(True, True, 'all_equal') |
| + | 136±1ms | 341±3ms | 2.51 | cube.CubeEquality.time_equality(True, True, 'coord_inequality') |
| + | 269±2ms | 469±5ms | 1.75 | cube.CubeEquality.time_equality(True, True, 'data_inequality') |
| + | 54.6±0.3μs | 34.8±0.4ms | 637.19 | cube.CubeEquality.time_equality(True, True, 'metadata_inequality') |
| + | 14.8±0.4ms | 27.7±0.2ms | 1.87 | load.ugrid.BasicLoading.time_load_file(1) |
| + | 45.4±0.7ms | 204±1ms | 4.49 | load.ugrid.BasicLoading.time_load_file(200000) |
| + | 14.9±0.2ms | 28.8±0.5ms | 1.94 | load.ugrid.BasicLoadingTime.time_load_file(1) |
| + | 14.9±0.3ms | 28.8±0.4ms | 1.93 | load.ugrid.BasicLoadingTime.time_load_file(200000) |
| + | 15.9±0.2ms | 33.5±0.6ms | 2.11 | load.ugrid.Callback.time_load_file_callback(1) |
| + | 54.9±0.2ms | 274±2ms | 4.98 | load.ugrid.Callback.time_load_file_callback(200000) |
| + | 16.0±0.2ms | 34.4±1ms | 2.15 | load.ugrid.CallbackTime.time_load_file_callback(1) |
| + | 16.6±0.2ms | 35.1±0.5ms | 2.12 | load.ugrid.CallbackTime.time_load_file_callback(200000) |
| + | 16.2±0.2ms | 204±2ms | 12.55 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50) |
| + | 19.7±0.4ms | 202±1ms | 10.26 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500) |
| + | 1.27±0.09M | 8.83±0.01M | 6.96 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(50) |
| + | 115±1ms | 641±7ms | 5.6 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50) |
| + | 578±4ms | 1.12±0.01s | 1.93 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500) |
| + | 1.49±0.08M | 9.92±0.3M | 6.68 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.tracemalloc_stream_file2file(50) |
| + | 75.0±0.6ms | 613±7ms | 8.17 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(50) |
| + | 530±3ms | 1.06±0s | 2 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(500) |
| + | 1.39±0.04M | 10.2±0.3M | 7.31 | mesh.utils.regions_combine.CombineRegionsSaveData.tracemalloc_save(50) |
| + | 79.9±0.9ms | 649±6ms | 8.13 | save.NetcdfSave.time_netcdf_save_cube(50, True) |
| + | 472±2ms | 1.03±0s | 2.19 | save.NetcdfSave.time_netcdf_save_cube(600, True) |
| + | 62.6±0.6ms | 93.4±1ms | 1.49 | save.NetcdfSave.time_netcdf_save_mesh(50, True) |
| + | 1.85±0.2M | 10.2±0.3M | 5.49 | save.NetcdfSave.tracemalloc_netcdf_save(50, True) |
Full benchmark results
Benchmarks that have stayed the same:
| Change | Before [39640754] <main~1> | After [1ef8c4ca] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|---------------------------------------------------------------------------------------------|
| | 21.0±0.1ms | 20.8±0.3ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(False) |
| | 52.2±1ms | 52.4±0.4ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(True) |
| | 35.2±0.4ms | 34.8±0.2ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(False) |
| | 164±2ms | 163±1ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(True) |
| | 22.7±0.3ms | 22.7±0.1ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(False) |
| | 31.4±0.4ms | 31.0±0.4ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(True) |
| | 22.9±0.3ms | 22.8±0.1ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(False) |
| | 31.5±0.3ms | 31.5±0.3ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(True) |
| | 20.6±0.3ms | 20.7±0.1ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(False) |
| | 44.1±0.9ms | 44.5±0.4ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(True) |
| | 124±0.8ms | 124±0.7ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(False) |
| | 125±1ms | 124±1ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(True) |
| | 21.6±0.2ms | 21.9±0.3ms | 1.02 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(False) |
| | 48.0±0.9ms | 48.3±0.8ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(True) |
| | 22.9±0.2ms | 23.3±0.3ms | 1.02 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(False) |
| | 57.6±0.6ms | 57.1±1ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(True) |
| | 20.7±0.3ms | 21.0±0.1ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(False) |
| | 44.8±0.8ms | 45.2±1ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(True) |
| | 1.07±0s | 1.06±0.01s | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(False) |
| | 1.06±0.01s | 1.05±0.01s | 1 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(True) |
| | 211±3ms | 208±2ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(False) |
| | 340±10ms | 335±4ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(True) |
| | 21.9±0.3ms | 21.7±0.2ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(False) |
| | 29.7±0.3ms | 29.8±0.3ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(True) |
| | 22.0±0.2ms | 22.0±0.3ms | 1 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(False) |
| | 59.0±0.9ms | 59.6±0.9ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(True) |
| | 23.0±0.2ms | 22.8±0.2ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(False) |
| | 60.6±1ms | 61.8±0.8ms | 1.02 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(True) |
| | 22.9±0.2ms | 23.0±0.4ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(False) |
| | 57.6±0.8ms | 57.2±0.7ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(True) |
| | 7.91±0.1ms | 7.83±0.1ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(False) |
| | 21.7±0.5ms | 21.8±0.5ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(True) |
| | 19.7±0.2ms | 19.9±0.3ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(False) |
| | 122±1ms | 122±1ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(True) |
| | 8.22±0.1ms | 8.22±0.06ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(False) |
| | 20.1±0.4ms | 20.2±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(True) |
| | 8.00±0.06ms | 8.34±0.1ms | 1.04 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(False) |
| | 19.9±0.4ms | 20.3±0.5ms | 1.02 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(True) |
| | 7.65±0.08ms | 7.69±0.07ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(False) |
| | 20.3±0.3ms | 20.5±0.5ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(True) |
| | 23.9±0.3ms | 24.0±0.1ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(False) |
| | 34.1±0.7ms | 34.2±0.5ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(True) |
| | 8.04±0.1ms | 8.01±0.09ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(False) |
| | 20.6±0.4ms | 20.7±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(True) |
| | 8.92±0.04ms | 8.97±0.04ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(False) |
| | 22.7±0.5ms | 22.8±0.8ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(True) |
| | 7.73±0.1ms | 7.80±0.1ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(False) |
| | 20.2±0.4ms | 20.7±1ms | 1.02 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(True) |
| | 528±2ms | 529±4ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(False) |
| | 534±3ms | 536±5ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(True) |
| | 44.3±0.4ms | 44.8±0.3ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(False) |
| | 131±1ms | 132±2ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(True) |
| | 8.10±0.1ms | 7.97±0.04ms | 0.98 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(False) |
| | 19.7±0.4ms | 19.4±0.5ms | 0.98 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(True) |
| | 7.92±0.06ms | 8.17±0.08ms | 1.03 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(False) |
| | 22.2±0.7ms | 22.3±0.7ms | 1 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(True) |
| | 8.28±0.1ms | 8.18±0.04ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(False) |
| | 22.2±0.5ms | 21.9±0.6ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(True) |
| | 8.18±0.1ms | 8.42±0.1ms | 1.03 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(False) |
| | 21.7±0.4ms | 21.4±0.6ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(True) |
| | 22.3±0.3ms | 22.7±0.3ms | 1.02 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(False) |
| | 82.5±0.5ms | 82.7±1ms | 1 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(True) |
| | 22.4±0.2ms | 22.7±0.3ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(False) |
| | 93.4±0.7ms | 92.7±0.8ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(True) |
| | 21.2±0.2ms | 21.4±0.4ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(False) |
| | 55.1±1ms | 55.0±1ms | 1 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(True) |
| | 8.20±0.05ms | 8.32±0.1ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(False) |
| | 27.3±0.7ms | 27.6±0.6ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(True) |
| | 8.08±0.2ms | 8.19±0.09ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(False) |
| | 28.6±0.7ms | 28.6±0.8ms | 1 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(True) |
| | 7.93±0.2ms | 7.95±0.05ms | 1 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(False) |
| | 22.2±0.7ms | 22.3±0.7ms | 1 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(True) |
| | 225±4ms | 218±2ms | 0.97 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(False) |
| | 277±2ms | 275±2ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(True) |
| | 1.14±0.01ms | 1.17±0.01ms | 1.03 | cube.CubeCreation.time_create(False, 'construct') |
| | 397±5μs | 393±4μs | 0.99 | cube.CubeCreation.time_create(False, 'instantiate') |
| | 85.8±1ms | 85.3±1ms | 0.99 | cube.CubeEquality.time_equality(False, False, 'all_equal') |
| | 24.0±0.4ms | 24.4±0.3ms | 1.02 | cube.CubeEquality.time_equality(False, False, 'coord_inequality') |
| | 99.8±1ms | 101±1ms | 1.01 | cube.CubeEquality.time_equality(False, False, 'data_inequality') |
| | 17.3±0.3μs | 17.6±0.2μs | 1.01 | cube.CubeEquality.time_equality(False, False, 'metadata_inequality') |
| | 101±2ms | 118±2ms | 1.17 | cube.CubeEquality.time_equality(False, True, 'data_inequality') |
| | 17.4±0.2μs | 17.5±0.4μs | 1.01 | cube.CubeEquality.time_equality(False, True, 'metadata_inequality') |
| | 170±2ms | 170±1ms | 1 | cube.CubeEquality.time_equality(True, False, 'all_equal') |
| | 65.6±1ms | 66.6±1ms | 1.02 | cube.CubeEquality.time_equality(True, False, 'coord_inequality') |
| | 199±0.9ms | 196±2ms | 0.98 | cube.CubeEquality.time_equality(True, False, 'data_inequality') |
| | 51.6±0.3μs | 53.0±0.6μs | 1.03 | cube.CubeEquality.time_equality(True, False, 'metadata_inequality') |
| | 809±20μs | 783±5μs | 0.97 | import_iris.Iris.time__concatenate |
| | 182±2μs | 183±3μs | 1.01 | import_iris.Iris.time__constraints |
| | 112±1μs | 113±3μs | 1.01 | import_iris.Iris.time__data_manager |
| | 90.9±0.2μs | 91.8±4μs | 1.01 | import_iris.Iris.time__deprecation |
| | 159±2μs | 159±4μs | 1 | import_iris.Iris.time__lazy_data |
| | 883±6μs | 877±9μs | 0.99 | import_iris.Iris.time__merge |
| | 74.0±0.4μs | 74.2±5μs | 1 | import_iris.Iris.time__representation |
| | 605±8μs | 599±5μs | 0.99 | import_iris.Iris.time_analysis |
| | 142±2μs | 139±3μs | 0.98 | import_iris.Iris.time_analysis__area_weighted |
| | 105±1μs | 106±3μs | 1.01 | import_iris.Iris.time_analysis__grid_angles |
| | 246±2μs | 245±2μs | 1 | import_iris.Iris.time_analysis__interpolation |
| | 189±1μs | 187±2μs | 0.99 | import_iris.Iris.time_analysis__regrid |
| | 109±0.7μs | 110±3μs | 1.01 | import_iris.Iris.time_analysis__scipy_interpolate |
| | 135±0.8μs | 136±4μs | 1.01 | import_iris.Iris.time_analysis_calculus |
| | 318±1μs | 319±2μs | 1 | import_iris.Iris.time_analysis_cartography |
| | 91.3±0.7μs | 91.7±4μs | 1 | import_iris.Iris.time_analysis_geomerty |
| | 206±1μs | 208±3μs | 1.01 | import_iris.Iris.time_analysis_maths |
| | 94.0±0.4μs | 92.9±4μs | 0.99 | import_iris.Iris.time_analysis_stats |
| | 168±4μs | 168±4μs | 1 | import_iris.Iris.time_analysis_trajectory |
| | 311±3μs | 313±4μs | 1.01 | import_iris.Iris.time_aux_factory |
| | 80.0±0.7μs | 81.0±4μs | 1.01 | import_iris.Iris.time_common |
| | 157±1μs | 159±3μs | 1.01 | import_iris.Iris.time_common_lenient |
| | 1.32±0.01ms | 1.32±0ms | 1 | import_iris.Iris.time_common_metadata |
| | 166±3μs | 165±4μs | 0.99 | import_iris.Iris.time_common_mixin |
| | 1.15±0.01ms | 1.14±0.01ms | 0.99 | import_iris.Iris.time_common_resolve |
| | 196±1μs | 198±2μs | 1.01 | import_iris.Iris.time_config |
| | 126±0.6μs | 132±2μs | 1.05 | import_iris.Iris.time_coord_categorisation |
| | 375±5μs | 375±3μs | 1 | import_iris.Iris.time_coord_systems |
| | 747±4μs | 759±8μs | 1.02 | import_iris.Iris.time_coords |
| | 631±5μs | 628±5μs | 0.99 | import_iris.Iris.time_cube |
| | 237±3μs | 237±4μs | 1 | import_iris.Iris.time_exceptions |
| | 74.0±0.3μs | 74.3±5μs | 1 | import_iris.Iris.time_experimental |
| | 176±2μs | 182±3μs | 1.03 | import_iris.Iris.time_fileformats |
| | 250±1μs | 254±4μs | 1.02 | import_iris.Iris.time_fileformats__ff |
| | 2.55±0.01ms | 2.54±0.01ms | 1 | import_iris.Iris.time_fileformats__ff_cross_references |
| | 75.5±0.2μs | 75.7±4μs | 1 | import_iris.Iris.time_fileformats__pp_lbproc_pairs |
| | 112±0.4μs | 111±4μs | 1 | import_iris.Iris.time_fileformats_abf |
| | 424±9μs | 423±4μs | 1 | import_iris.Iris.time_fileformats_cf |
| | 4.63±0.04ms | 4.73±0.02ms | 1.02 | import_iris.Iris.time_fileformats_dot |
| | 70.9±0.7μs | 73.5±3μs | 1.04 | import_iris.Iris.time_fileformats_name |
| | 247±1μs | 251±4μs | 1.02 | import_iris.Iris.time_fileformats_name_loaders |
| | 113±0.5μs | 115±3μs | 1.03 | import_iris.Iris.time_fileformats_netcdf |
| | 120±3μs | 121±2μs | 1.01 | import_iris.Iris.time_fileformats_nimrod |
| | 206±1μs | 207±2μs | 1 | import_iris.Iris.time_fileformats_nimrod_load_rules |
| | 774±7μs | 773±2μs | 1 | import_iris.Iris.time_fileformats_pp |
| | 176±2μs | 175±2μs | 0.99 | import_iris.Iris.time_fileformats_pp_load_rules |
| | 136±1μs | 139±2μs | 1.02 | import_iris.Iris.time_fileformats_pp_save_rules |
| | 535±3μs | 532±4μs | 0.99 | import_iris.Iris.time_fileformats_rules |
| | 219±2μs | 218±5μs | 1 | import_iris.Iris.time_fileformats_structured_array_identification |
| | 81.6±1μs | 81.6±4μs | 1 | import_iris.Iris.time_fileformats_um |
| | 155±5μs | 154±4μs | 0.99 | import_iris.Iris.time_fileformats_um__fast_load |
| | 136±0.8μs | 142±2μs | 1.04 | import_iris.Iris.time_fileformats_um__fast_load_structured_fields |
| | 72.9±0.3μs | 72.9±4μs | 1 | import_iris.Iris.time_fileformats_um__ff_replacement |
| | 77.8±0.5μs | 78.1±4μs | 1 | import_iris.Iris.time_fileformats_um__optimal_array_structuring |
| | 938±4μs | 929±5μs | 0.99 | import_iris.Iris.time_fileformats_um_cf_map |
| | 134±0.5μs | 135±4μs | 1 | import_iris.Iris.time_io |
| | 173±1μs | 174±3μs | 1 | import_iris.Iris.time_io_format_picker |
| | 210±1μs | 209±10μs | 1 | import_iris.Iris.time_iris |
| | 124±0.9μs | 125±4μs | 1.01 | import_iris.Iris.time_iterate |
| | 8.00±0.03ms | 8.01±0.1ms | 1 | import_iris.Iris.time_palette |
| | 1.75±0.01ms | 1.76±0.01ms | 1 | import_iris.Iris.time_plot |
| | 217±1μs | 218±3μs | 1.01 | import_iris.Iris.time_quickplot |
| | 2.13±0.01ms | 2.08±0.03ms | 0.97 | import_iris.Iris.time_std_names |
| | 1.82±0.01ms | 1.81±0.03ms | 1 | import_iris.Iris.time_symbols |
| | 136±7ms | 134±7ms | 0.99 | import_iris.Iris.time_tests |
| | 251±4μs | 250±10μs | 1 | import_iris.Iris.time_third_party_cartopy |
| | 5.06±0.04ms | 5.06±0.04ms | 1 | import_iris.Iris.time_third_party_cf_units |
| | 116±0.5μs | 117±9μs | 1.01 | import_iris.Iris.time_third_party_cftime |
| | 2.71±0.01ms | 2.70±0.01ms | 1 | import_iris.Iris.time_third_party_matplotlib |
| | 1.28±0ms | 1.28±0.01ms | 1 | import_iris.Iris.time_third_party_numpy |
| | 167±2μs | 168±8μs | 1.01 | import_iris.Iris.time_third_party_scipy |
| | 98.2±0.8μs | 98.7±3μs | 1.01 | import_iris.Iris.time_time |
| | 353±6μs | 342±2μs | 0.97 | import_iris.Iris.time_util |
| | 71.3±0.6μs | 70.7±0.5μs | 0.99 | iterate.IZip.time_izip |
| | 9.61±0.03ms | 9.87±0.1ms | 1.03 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF') |
| | 16.1±0.3ms | 14.8±0.4ms | 0.92 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF') |
| | 9.63±0.09ms | 9.88±0.1ms | 1.03 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP') |
| | 9.60±0.09ms | 9.79±0.04ms | 1.02 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF') |
| | 13.2±0.3ms | 13.1±0.4ms | 1 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF') |
| | 9.62±0.2ms | 10.1±0.1ms | 1.05 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP') |
| | 1.44±0.01s | 1.48±0.01s | 1.02 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF') |
| | 12.2±0.2ms | 12.2±0.07ms | 1 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF') |
| | 1.44±0.02s | 1.50±0.01s | 1.04 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP') |
| | 1.43±0.02s | 1.48±0.01s | 1.04 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF') |
| | 12.0±0.3ms | 12.2±0.1ms | 1.02 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF') |
| | 1.45±0.01s | 1.49±0.01s | 1.03 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP') |
| | 5.15±0.04ms | 5.26±0.06ms | 1.02 | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF') |
| | 12.1±0.3ms | 11.8±0.03ms | 0.97 | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF') |
| | 5.06±0.01ms | 5.28±0.08ms | 1.04 | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP') |
| | 5.09±0.03ms | 5.25±0.1ms | 1.03 | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF') |
| | 11.9±0.2ms | 11.8±0.06ms | 0.99 | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF') |
| | 5.14±0.05ms | 5.33±0.1ms | 1.04 | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP') |
| | 22.9±0.9ms | 22.2±1ms | 0.97 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF') |
| | 23.0±0.8ms | 23.2±0.4ms | 1.01 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF') |
| | 11.9±0.5ms | 11.7±2ms | 0.98 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP') |
| | 28.2±2ms | 28.2±1ms | 1 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF') |
| | 82.8±0.7ms | 82.4±0.6ms | 1 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF') |
| | 27.6±1ms | 27.5±1ms | 0.99 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP') |
| | 591±3ms | 596±4ms | 1.01 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF') |
| | 3.36±0.06ms | 3.34±0.07ms | 1 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF') |
| | 592±2ms | 596±2ms | 1.01 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP') |
| | 601±4ms | 604±3ms | 1 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF') |
| | 3.38±0.1ms | 3.42±0.1ms | 1.01 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF') |
| | 600±6ms | 604±6ms | 1.01 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP') |
| | 2.03±0.08ms | 2.09±0.06ms | 1.03 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF') |
| | 3.39±0.07ms | 3.22±0.2ms | 0.95 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF') |
| | 1.99±0.09ms | 2.09±0.05ms | 1.05 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP') |
| | 2.01±0.07ms | 2.11±0.08ms | 1.05 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF') |
| | 3.39±0.09ms | 3.56±0.1ms | 1.05 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF') |
| | 2.04±0.07ms | 2.17±0.05ms | 1.07 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP') |
| | 337±2ms | 343±4ms | 1.02 | load.ManyCubes.time_many_cube_load |
| | 89.4±1ms | 90.0±2ms | 1.01 | load.ManyVars.time_many_var_load |
| | 9.67±0.03ms | 10.0±0.1ms | 1.04 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF') |
| | 9.74±0.02ms | 9.99±0.07ms | 1.03 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP') |
| | 1.44±0.01s | 1.48±0.01s | 1.03 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF') |
| | 1.47±0.01s | 1.52±0.01s | 1.03 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP') |
| | 5.20±0.05ms | 5.33±0.04ms | 1.02 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF') |
| | 5.19±0.08ms | 5.28±0.03ms | 1.02 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP') |
| | 8.63±0.1ms | 8.87±0.04ms | 1.03 | load.StructuredFF.time_structured_load((1280, 960, 5), False) |
| | 5.60±0.04ms | 5.50±0.02ms | 0.98 | load.StructuredFF.time_structured_load((1280, 960, 5), True) |
| | 1.42±0.01s | 1.48±0.01s | 1.04 | load.StructuredFF.time_structured_load((2, 2, 1000), False) |
| | 419±6ms | 420±5ms | 1 | load.StructuredFF.time_structured_load((2, 2, 1000), True) |
| | 4.23±0.04ms | 4.37±0.04ms | 1.03 | load.StructuredFF.time_structured_load((2, 2, 2), False) |
| | 4.22±0.03ms | 4.24±0.05ms | 1 | load.StructuredFF.time_structured_load((2, 2, 2), True) |
| | 158±0.9ms | 162±3ms | 1.02 | load.TimeConstraint.time_time_constraint(20, 'FF') |
| | 15.1±0.2ms | 15.6±0.4ms | 1.03 | load.TimeConstraint.time_time_constraint(20, 'NetCDF') |
| | 159±0.9ms | 167±2ms | 1.05 | load.TimeConstraint.time_time_constraint(20, 'PP') |
| | 31.9±0.2ms | 32.7±0.7ms | 1.02 | load.TimeConstraint.time_time_constraint(3, 'FF') |
| | 14.6±0.07ms | 15.0±0.6ms | 1.02 | load.TimeConstraint.time_time_constraint(3, 'NetCDF') |
| | 32.2±0.3ms | 33.0±0.6ms | 1.03 | load.TimeConstraint.time_time_constraint(3, 'PP') |
| | 8.80±0.09ms | 8.65±0.1ms | 0.98 | load.ugrid.BasicLoading.time_load_mesh(1) |
| | 16.7±0.6ms | 16.1±0.4ms | 0.97 | load.ugrid.BasicLoading.time_load_mesh(200000) |
| | 8.85±0.1ms | 8.84±0.1ms | 1 | load.ugrid.BasicLoadingTime.time_load_mesh(1) |
| | 11.5±0.3ms | 11.7±0.7ms | 1.02 | load.ugrid.BasicLoadingTime.time_load_mesh(200000) |
| | 3.28±0.1ms | 3.73±0.06ms | 1.14 | load.ugrid.DataRealisation.time_realise_data(10000) |
| | 6.18±0.5ms | 6.52±0.1ms | 1.06 | load.ugrid.DataRealisation.time_realise_data(200000) |
| | 35.5±0.6ms | 36.9±1ms | 1.04 | load.ugrid.DataRealisationTime.time_realise_data(10000) |
| | 782±3ms | 776±7ms | 0.99 | load.ugrid.DataRealisationTime.time_realise_data(200000) |
| | 1.34±0.02s | 1.36±0.02s | 1.01 | merge_concat.Concatenate.time_concatenate(False) |
| | 422±2ms | 425±3ms | 1.01 | merge_concat.Concatenate.time_concatenate(True) |
| | 2.42±0G | 2.42±0G | 1 | merge_concat.Concatenate.tracemalloc_concatenate(False) |
| | 110±2M | 110±5M | 1 | merge_concat.Concatenate.tracemalloc_concatenate(True) |
| | 34.9±4ms | 36.6±4ms | 1.05 | merge_concat.Merge.time_merge |
| | 126±0.03M | 126±0.03M | 1 | merge_concat.Merge.tracemalloc_merge |
| | 359±1ns | 388±20ns | 1.08 | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) |
| | 197±1ms | 196±1ms | 1 | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(500) |
| | 772±0.5k | 771±0.2k | 1 | mesh.utils.regions_combine.CombineRegionsComputeRealData.tracemalloc_compute_data(50) |
| | 60.2±0M | 60.2±0M | 1 | mesh.utils.regions_combine.CombineRegionsComputeRealData.tracemalloc_compute_data(500) |
| | 25±0.09M | 27.8±0M | 1.11 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(500) |
| | 96.5±0.02M | 101±2M | 1.05 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.tracemalloc_stream_file2file(500) |
| | 96.5±0.02M | 102±0.3M | 1.05 | mesh.utils.regions_combine.CombineRegionsSaveData.tracemalloc_save(500) |
| | 2.1752849999999997 | 2.1752849999999997 | 1 | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(50) |
| | 216.01528499999998 | 216.01528499999998 | 1 | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(500) |
| | 6.66±0.03ms | 6.67±0.05ms | 1 | plot.AuxSort.time_aux_sort |
| | 76.8±5ms | 78.9±5ms | 1.03 | regridding.CurvilinearRegridding.time_regrid_pic |
| | 136±3M | 136±3M | 1 | regridding.CurvilinearRegridding.tracemalloc_regrid_pic |
| | 103±6ms | 103±6ms | 1 | regridding.HorizontalChunkedRegridding.time_regrid_area_w |
| | 66.0±6ms | 64.9±3ms | 0.98 | regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid |
| | 107±0.09M | 107±0.08M | 1 | regridding.HorizontalChunkedRegridding.tracemalloc_regrid_area_w |
| | 147±0.04M | 147±0.04M | 1 | regridding.HorizontalChunkedRegridding.tracemalloc_regrid_area_w_new_grid |
| | 4.70±0.06ms | 4.70±0.07ms | 1 | save.NetcdfSave.time_netcdf_save_cube(50, False) |
| | 40.9±0.2ms | 41.5±0.3ms | 1.01 | save.NetcdfSave.time_netcdf_save_cube(600, False) |
| | 87.3±0.5ns | 86.7±0.3ns | 0.99 | save.NetcdfSave.time_netcdf_save_mesh(50, False) |
| | 87.3±0.4ns | 87.4±0.5ns | 1 | save.NetcdfSave.time_netcdf_save_mesh(600, False) |
| | 409±3ms | 440±2ms | 1.07 | save.NetcdfSave.time_netcdf_save_mesh(600, True) |
| | 31.6±0.3k | 31.6±0.3k | 1 | save.NetcdfSave.tracemalloc_netcdf_save(50, False) |
| | 31.6±0.3k | 31.6±0.3k | 1 | save.NetcdfSave.tracemalloc_netcdf_save(600, False) |
| | 208±20M | 225±10M | 1.09 | save.NetcdfSave.tracemalloc_netcdf_save(600, True) |
| | 39.0±0.5ms | 38.5±0.2ms | 0.99 | stats.PearsonR.time_lazy |
| | 9.15±0.1ms | 9.20±0.2ms | 1.01 | stats.PearsonR.time_real |
| | 29.8±0.7M | 29.4±0.7M | 0.99 | stats.PearsonR.tracemalloc_lazy |
| | 18.3±0.01M | 18.3±0.01M | 1 | stats.PearsonR.tracemalloc_real |
| | 24.6±0.2ms | 24.2±0.5ms | 0.98 | trajectory.TrajectoryInterpolation.time_trajectory_linear |
| | 59.5±0.5ms | 62.0±5ms | 1.04 | trajectory.TrajectoryInterpolation.time_trajectory_nearest |
| | 17.6±0.02M | 17.6±0.02M | 1 | trajectory.TrajectoryInterpolation.tracemalloc_trajectory_linear |
| | 7.75±0.02M | 7.75±0.02M | 1 | trajectory.TrajectoryInterpolation.tracemalloc_trajectory_nearest |
Benchmarks that have got worse:
| Change | Before [39640754] <main~1> | After [1ef8c4ca] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|--------------------------------------------------------------------------------------------|
| + | 959±10μs | 9.74±0.2ms | 10.16 | cube.CubeCreation.time_create(True, 'construct') |
| + | 576±2μs | 6.68±0.08ms | 11.6 | cube.CubeCreation.time_create(True, 'instantiate') |
| + | 87.5±2ms | 105±1ms | 1.2 | cube.CubeEquality.time_equality(False, True, 'all_equal') |
| + | 25.5±0.8ms | 43.2±1ms | 1.7 | cube.CubeEquality.time_equality(False, True, 'coord_inequality') |
| + | 239±2ms | 444±3ms | 1.86 | cube.CubeEquality.time_equality(True, True, 'all_equal') |
| + | 136±1ms | 341±3ms | 2.51 | cube.CubeEquality.time_equality(True, True, 'coord_inequality') |
| + | 269±2ms | 469±5ms | 1.75 | cube.CubeEquality.time_equality(True, True, 'data_inequality') |
| + | 54.6±0.3μs | 34.8±0.4ms | 637.19 | cube.CubeEquality.time_equality(True, True, 'metadata_inequality') |
| + | 14.8±0.4ms | 27.7±0.2ms | 1.87 | load.ugrid.BasicLoading.time_load_file(1) |
| + | 45.4±0.7ms | 204±1ms | 4.49 | load.ugrid.BasicLoading.time_load_file(200000) |
| + | 14.9±0.2ms | 28.8±0.5ms | 1.94 | load.ugrid.BasicLoadingTime.time_load_file(1) |
| + | 14.9±0.3ms | 28.8±0.4ms | 1.93 | load.ugrid.BasicLoadingTime.time_load_file(200000) |
| + | 15.9±0.2ms | 33.5±0.6ms | 2.11 | load.ugrid.Callback.time_load_file_callback(1) |
| + | 54.9±0.2ms | 274±2ms | 4.98 | load.ugrid.Callback.time_load_file_callback(200000) |
| + | 16.0±0.2ms | 34.4±1ms | 2.15 | load.ugrid.CallbackTime.time_load_file_callback(1) |
| + | 16.6±0.2ms | 35.1±0.5ms | 2.12 | load.ugrid.CallbackTime.time_load_file_callback(200000) |
| + | 16.2±0.2ms | 204±2ms | 12.55 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50) |
| + | 19.7±0.4ms | 202±1ms | 10.26 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500) |
| + | 1.27±0.09M | 8.83±0.01M | 6.96 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(50) |
| + | 115±1ms | 641±7ms | 5.6 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50) |
| + | 578±4ms | 1.12±0.01s | 1.93 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500) |
| + | 1.49±0.08M | 9.92±0.3M | 6.68 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.tracemalloc_stream_file2file(50) |
| + | 75.0±0.6ms | 613±7ms | 8.17 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(50) |
| + | 530±3ms | 1.06±0s | 2 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(500) |
| + | 1.39±0.04M | 10.2±0.3M | 7.31 | mesh.utils.regions_combine.CombineRegionsSaveData.tracemalloc_save(50) |
| + | 79.9±0.9ms | 649±6ms | 8.13 | save.NetcdfSave.time_netcdf_save_cube(50, True) |
| + | 472±2ms | 1.03±0s | 2.19 | save.NetcdfSave.time_netcdf_save_cube(600, True) |
| + | 62.6±0.6ms | 93.4±1ms | 1.49 | save.NetcdfSave.time_netcdf_save_mesh(50, True) |
| + | 1.85±0.2M | 10.2±0.3M | 5.49 | save.NetcdfSave.tracemalloc_netcdf_save(50, True) |
Generated by GHA run 16081968514