/platform_tests b76f8cf
Platform Tests Output

Job PR-5072-b76f8cf is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-5072/b76f8cf/index.html

/benchmark b76f8cf module=tabular preset=tabular_best benchmark=tabular_full time_limit=8h

Benchmark Output

Benchmark Test Result - Fail Evaluation Results Path: s3://autogluon-ci-benchmark/evaluation/tabular/numpy
The dashboard website is: http://autogluon-staging.s3-website-us-west-2.amazonaws.com/benchmark-dashboard/numpy/28a242ebe8d55ba770c991b9db153ab4623c9abd/index.html

Noticed below list of errors from the benchmark run
results_automlbenchmark_8h_ag_bench_20250422T071618.csv

Noticed below list of errors from the benchmark run results_automlbenchmark_8h_ag_bench_20250422T071618.csv

There were also many failures in the benchmark but not enough error messages presented in the logs. I'll probably run a few benchmarks locally to see if I can find anything.

/benchmark b76f8cf module=tabular preset=tabular_best benchmark=tabular_small time_limit=1h
Benchmark Output

Benchmark Test Result - Fail Evaluation Results Path: s3://autogluon-ci-benchmark/evaluation/tabular/numpy
The dashboard website is: http://autogluon-staging.s3-website-us-west-2.amazonaws.com/benchmark-dashboard/numpy/086da85bf166228734d9687f82b4d06ea4b584f4/index.html

Job PR-5072-3deb4c2 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-5072/3deb4c2/index.html

Job PR-5072-5f8bd20 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-5072/5f8bd20/index.html

Noticed below list of errors from the benchmark run results_automlbenchmark_8h_ag_bench_20250422T071618.csv

There were also many failures in the benchmark but not enough error messages presented in the logs. I'll probably run a few benchmarks locally to see if I can find anything.

After some digging, I think the root cause is due to inconsistent numpy versions used in automlbenchmark evaluation and virtual env created for AutoGluon feature branch for training. I created a PR Innixma/automlbenchmark#12 to upgrade numpy in our custom automlbenchmark branch.

/benchmark b76f8cf module=tabular preset=tabular_best benchmark=tabular_full time_limit=1h
Benchmark Output

/benchmark b76f8cf module=tabular preset=tabular_best benchmark=tabular_full time_limit=1h
Benchmark Output

Benchmark Test Result - Pass Evaluation Results Path: s3://autogluon-ci-benchmark/evaluation/tabular/numpy
The dashboard website is: http://autogluon-staging.s3-website-us-west-2.amazonaws.com/benchmark-dashboard/numpy/b913ac86a773bbdb61b8a0573b14d664e95ec32d/index.html

/platform_tests 5f8bd20
Platform Tests Output

Job PR-5072-ca062d5 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-5072/ca062d5/index.html

@tonyhoo @suzhoum Why does this PR revert the fix I made in #5045 to support sklearn<1.6?