ray/release/air_tests/air_benchmarks
Dmitri Gekhtman 8bdeb30510
[docs][ml][kuberay] Add a --disable-check flag to the XGBoost benchmark. (#27277)
This PR adds a flag --disable-check to the XGBoost benchmark script which disables the RuntimeError that comes up if training or prediction took too long. This is meant for non-CI exploratory use-cases.

Specifically, the reason is this:
We will include the XGBoost benchmark as an example workload for the KubeRay documentation.
The actual performance of the workload is highly sensitive to infrastructure environment, so we won't want to raise an alarming RuntimeError if the workload took too long on the user's infrastructure.
(When I tried the 100Gb benchmark on KubeRay, training ran just a couple of minutes longer than the 1000 second cutoff.)
2022-07-29 14:31:10 -07:00
..
workloads [docs][ml][kuberay] Add a --disable-check flag to the XGBoost benchmark. (#27277) 2022-07-29 14:31:10 -07:00
app_config.yaml [air] Add AIR distributed training benchmark for Torch FashionMNIST (#26436) 2022-07-13 10:53:24 +01:00
compute_cpu_1.yaml [air] Add AIR distributed training benchmark for Torch FashionMNIST (#26436) 2022-07-13 10:53:24 +01:00
compute_cpu_4.yaml [air] Add AIR distributed training benchmark for Torch FashionMNIST (#26436) 2022-07-13 10:53:24 +01:00
compute_cpu_8.yaml [air/benchmarks] train/tune benchmark (#26564) 2022-07-19 18:24:39 +01:00
compute_gpu_1.yaml [AIR][CUJ] Make distributing training benchmark at silver tier (#26640) 2022-07-17 22:07:09 -07:00
compute_gpu_2x2.yaml [air/benchmark] Torch benchmarks for 4x4 (#26692) 2022-07-19 17:06:37 +01:00
compute_gpu_4_g4_12xl.yaml [air/benchmarks] train/tune benchmark (#26564) 2022-07-19 18:24:39 +01:00
compute_gpu_4x4.yaml [air/benchmark] Torch benchmarks for 4x4 (#26692) 2022-07-19 17:06:37 +01:00
compute_gpu_8_g4_12xl.yaml [air] large tune/torch benchmark (#26763) 2022-07-23 01:17:25 -07:00
compute_gpu_16.yaml [AIR][CUJ] Make distributing training benchmark at silver tier (#26640) 2022-07-17 22:07:09 -07:00
data_20_nodes.yaml [air] add bulk ingest benchmarks (#26618) 2022-07-15 22:01:23 -07:00
xgboost_app_config.yaml [air] Add xgboost release test for silver tier(10-node case). (#26460) 2022-07-15 13:21:10 -07:00
xgboost_compute_tpl.yaml [air] Add xgboost release test for silver tier(10-node case). (#26460) 2022-07-15 13:21:10 -07:00