ray/release
Kai Fricke b91246a093
[air/benchmarks] Measure local training time in torch/tf benchmarks (#27902)
We currently measure end-to-end training time in our benchmarks, which includes setup overhead. This is an unequal comparison, as setup overhead for vanilla training cannot be accurately expressed and was instead just disregarded.
By comparing the raw training times in the actual training loop, we will get a more accurate expression of any potential overhead or benefit in using Ray vs. vanilla tensorflow/torch.

Signed-off-by: Kai Fricke <kai@anyscale.com>
2022-08-16 19:16:08 +02:00
..
air_tests [air/benchmarks] Measure local training time in torch/tf benchmarks (#27902) 2022-08-16 19:16:08 +02:00
benchmarks [Core] install jemalloc in Ray docker and use jemalloc in benchmark release tests (#26112) 2022-06-27 23:26:56 -07:00
cluster_tests [tune/release] Add up/down scaling release test (#25392) 2022-07-13 22:57:24 +01:00
golden_notebook_tests [release test] remove dask/modin_xgboost test completely. (#27865) 2022-08-15 16:55:33 +02:00
jobs_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
k8s_tests [Serve][Nightly] Environment for Nightly K8s Tests (#27126) 2022-08-02 23:05:47 -07:00
kubernetes_manual_tests [minor] Fix legacy OSS operator test (#23540) 2022-04-18 17:47:42 -07:00
lightgbm_tests [AIR] Remove ML code from ray.util (#27005) 2022-07-27 14:24:19 +01:00
long_running_distributed_tests [tune] Increase volume size for long running pbt failure (#27163) 2022-07-28 22:57:26 -07:00
long_running_tests [RLlib] Move learning_starts logic from buffers into training_step(). (#26032) 2022-08-11 13:07:30 +02:00
microbenchmark [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
ml_user_tests [air] fix ptl release test (#27773) 2022-08-15 14:47:33 -07:00
nightly_tests Spread the actors in data ingest benchmark, which 2x the throughput (#27620) 2022-08-11 11:47:54 -07:00
ray_release [ci/release] Fix fetching logs from staging clusters (#26515) 2022-07-13 11:15:50 +01:00
release_logs [release/1.13.0] Add release logs (#24509) 2022-06-21 23:51:25 +01:00
rllib_tests [RLlib] Move learning_starts logic from buffers into training_step(). (#26032) 2022-08-11 13:07:30 +02:00
runtime_env_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
serve_tests [Serve] Remove release tests for checkpoint_path (#27194) 2022-07-28 12:30:30 -07:00
train_tests/horovod [air] update remaining dict scaling_configs (#26856) 2022-07-21 18:55:21 -07:00
tune_tests [tune/release] Do not use spot instances in k8s tests (#27250) 2022-08-02 11:30:41 +01:00
util [release] Update download_wheels.sh to include Python 3.10 (#25508) 2022-06-06 22:42:50 +01:00
xgboost_tests [AIR] Remove ML code from ray.util (#27005) 2022-07-27 14:24:19 +01:00
__init__.py [release] move release testing end to end script to main ray repo (#17070) 2021-07-14 12:39:07 -07:00
BUILD Revert "Revert "Bump pytest from 5.4.3 to 7.0.1"" (#26525) 2022-07-18 21:21:19 -07:00
README.md [Release] Remove release process doc (#19312) 2021-10-18 11:24:03 -07:00
release_tests.yaml [air/benchmarks] Measure local training time in torch/tf benchmarks (#27902) 2022-08-16 19:16:08 +02:00
requirements.txt [Core] update protobuf to 3.19.4 (#25648) 2022-06-18 16:06:56 -07:00
requirements_buildkite.txt [Core] update protobuf to 3.19.4 (#25648) 2022-06-18 16:06:56 -07:00
run_release_test.sh [ci/release] Install local wheels in release test shell script (#25227) 2022-06-02 10:32:51 +01:00
setup.py [ci/release] Refactor release test e2e into package (#22351) 2022-02-16 17:35:02 +00:00

Release Tests

While the exact release process relies on Anyscale internal tooling, the tests we run during the releases are located at https://github.com/ray-project/ray/blob/master/release/.buildkite/build_pipeline.py