ray/release
Dmitri Gekhtman 8bdeb30510
[docs][ml][kuberay] Add a --disable-check flag to the XGBoost benchmark. (#27277)
This PR adds a flag --disable-check to the XGBoost benchmark script which disables the RuntimeError that comes up if training or prediction took too long. This is meant for non-CI exploratory use-cases.

Specifically, the reason is this:
We will include the XGBoost benchmark as an example workload for the KubeRay documentation.
The actual performance of the workload is highly sensitive to infrastructure environment, so we won't want to raise an alarming RuntimeError if the workload took too long on the user's infrastructure.
(When I tried the 100Gb benchmark on KubeRay, training ran just a couple of minutes longer than the 1000 second cutoff.)
2022-07-29 14:31:10 -07:00
..
air_tests [docs][ml][kuberay] Add a --disable-check flag to the XGBoost benchmark. (#27277) 2022-07-29 14:31:10 -07:00
benchmarks [Core] install jemalloc in Ray docker and use jemalloc in benchmark release tests (#26112) 2022-06-27 23:26:56 -07:00
cluster_tests [tune/release] Add up/down scaling release test (#25392) 2022-07-13 22:57:24 +01:00
golden_notebook_tests [air] Add annotation for Tune module. (#27060) 2022-07-27 13:53:46 -07:00
jobs_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
kubernetes_manual_tests [minor] Fix legacy OSS operator test (#23540) 2022-04-18 17:47:42 -07:00
lightgbm_tests [AIR] Remove ML code from ray.util (#27005) 2022-07-27 14:24:19 +01:00
long_running_distributed_tests [tune] Increase volume size for long running pbt failure (#27163) 2022-07-28 22:57:26 -07:00
long_running_tests [Release test] Add a memory monitor to nightly test long running actor death (#27083) 2022-07-27 07:32:10 -07:00
microbenchmark [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
ml_user_tests [rllib/release] Fix rllib connect test with Tuner() API (#27155) 2022-07-28 11:08:02 +01:00
nightly_tests [RLlib/Serve/Release tests] Few code refactoring for better use of efficient NumPy functions. (#26284) 2022-07-27 22:38:35 +02:00
ray_release [ci/release] Fix fetching logs from staging clusters (#26515) 2022-07-13 11:15:50 +01:00
release_logs [release/1.13.0] Add release logs (#24509) 2022-06-21 23:51:25 +01:00
rllib_tests [RLlib] Revert 41c9ef70. (#27243) 2022-07-29 11:05:15 -07:00
runtime_env_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
serve_tests [Serve] Remove release tests for checkpoint_path (#27194) 2022-07-28 12:30:30 -07:00
train_tests/horovod [air] update remaining dict scaling_configs (#26856) 2022-07-21 18:55:21 -07:00
tune_tests [tune/rllib/release] Load correct metadata file in rllib cloud tests (#27164) 2022-07-28 15:51:09 +01:00
util [release] Update download_wheels.sh to include Python 3.10 (#25508) 2022-06-06 22:42:50 +01:00
xgboost_tests [AIR] Remove ML code from ray.util (#27005) 2022-07-27 14:24:19 +01:00
__init__.py [release] move release testing end to end script to main ray repo (#17070) 2021-07-14 12:39:07 -07:00
BUILD Revert "Revert "Bump pytest from 5.4.3 to 7.0.1"" (#26525) 2022-07-18 21:21:19 -07:00
README.md [Release] Remove release process doc (#19312) 2021-10-18 11:24:03 -07:00
release_tests.yaml [Serve] Remove release tests for checkpoint_path (#27194) 2022-07-28 12:30:30 -07:00
requirements.txt [Core] update protobuf to 3.19.4 (#25648) 2022-06-18 16:06:56 -07:00
requirements_buildkite.txt [Core] update protobuf to 3.19.4 (#25648) 2022-06-18 16:06:56 -07:00
run_release_test.sh [ci/release] Install local wheels in release test shell script (#25227) 2022-06-02 10:32:51 +01:00
setup.py [ci/release] Refactor release test e2e into package (#22351) 2022-02-16 17:35:02 +00:00

Release Tests

While the exact release process relies on Anyscale internal tooling, the tests we run during the releases are located at https://github.com/ray-project/ray/blob/master/release/.buildkite/build_pipeline.py