ray/release
mwtian 7013b32d15
[Release] prefer last cluster env version in release tests (#24950)
Currently the release test runner prefers the first successfully version of a cluster env, instead of the last version. But sometimes a cluster env may build successfully on Anyscale but cannot launch cluster successfully (e.g. version 2 here) or new dependencies need to be installed, so a new version needs to be built. The existing logic always picks up the 1st successful build and cannot pick up the new cluster env version.

Although this is an edge case (tweaking cluster env versions, with the same Ray wheel or cluster env name), I believe it is possible for others to run into it.

Also, avoid running most of the CI tests for changes under release/ray_release/.
2022-05-24 13:26:54 +01:00
..
air_tests/horovod [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
benchmarks [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
golden_notebook_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
jobs_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
kubernetes_manual_tests [minor] Fix legacy OSS operator test (#23540) 2022-04-18 17:47:42 -07:00
lightgbm_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
long_running_distributed_tests [RLlib] Upgrade gym 0.23 (#24171) 2022-05-23 08:18:44 +02:00
long_running_tests [RLlib] Upgrade gym 0.23 (#24171) 2022-05-23 08:18:44 +02:00
microbenchmark [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
ml_user_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
nightly_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
ray_release [Release] prefer last cluster env version in release tests (#24950) 2022-05-24 13:26:54 +01:00
release_logs [ci] Fix automatic buildkite token fetching in fetch_release_logs.py (#24606) 2022-05-10 09:24:10 +02:00
rllib_tests [RLlib] Upgrade gym 0.23 (#24171) 2022-05-23 08:18:44 +02:00
runtime_env_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
serve_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
train_tests/horovod [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
tune_tests [RLlib] Upgrade gym 0.23 (#24171) 2022-05-23 08:18:44 +02:00
util Update pip download test.sh #24997 2022-05-19 16:46:15 -07:00
xgboost_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
__init__.py [release] move release testing end to end script to main ray repo (#17070) 2021-07-14 12:39:07 -07:00
BUILD [Serve] Add serve handle graph workload nightly tests (#24435) 2022-05-04 09:07:50 -07:00
README.md [Release] Remove release process doc (#19312) 2021-10-18 11:24:03 -07:00
release_tests.yaml [Datasets] mark nightly test dataset_shuffle_random_shuffle_1tb_small_instances stable #24861 2022-05-17 09:56:05 -07:00
requirements.txt [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
requirements_buildkite.txt [ci/release] Refactor release test e2e into package (#22351) 2022-02-16 17:35:02 +00:00
run_release_test.sh [ci/release] Disable infra retries for now (#23132) 2022-03-14 11:51:11 +00:00
setup.py [ci/release] Refactor release test e2e into package (#22351) 2022-02-16 17:35:02 +00:00

Release Tests

While the exact release process relies on Anyscale internal tooling, the tests we run during the releases are located at https://github.com/ray-project/ray/blob/master/release/.buildkite/build_pipeline.py