ray/release
Kai Fricke 8a9512bf62
[ci/release] Install local wheels in release test shell script (#25227)
We're currently installing matching wheels on the fly in the python script for Ray client tests. However, we can't reload modules with changed protobuf configurations, and thus can't reload ray completely. Since the `anyscale` pacakge depends on Ray, this effectively prevents us from installing matching wheels within the python script.

There are a few possible solutions to this. First, we could separate out the local environment preparation from the test running - this will duplicate some logic and is thus a bit more involved, but should be considered in the future. For now, we adjust the `run_release_tests.sh` shell script to install any passed `--ray-wheels` wheels locally. We only do this in CI instances per default as these wheels will not be compatible with e.g. MacOS.

Link to successful build: https://buildkite.com/ray-project/release-tests-branch/builds/619#_
2022-06-02 10:32:51 +01:00
..
air_tests/horovod [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
benchmarks [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
golden_notebook_tests [release/xgboost/lightgbm] Fix app config dependency install overwriting ray (#25307) 2022-05-31 13:46:17 +02:00
jobs_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
kubernetes_manual_tests [minor] Fix legacy OSS operator test (#23540) 2022-04-18 17:47:42 -07:00
lightgbm_tests [release/xgboost/lightgbm] Fix app config dependency install overwriting ray (#25307) 2022-05-31 13:46:17 +02:00
long_running_distributed_tests [RLlib] Upgrade gym 0.23 (#24171) 2022-05-23 08:18:44 +02:00
long_running_tests [RLlib] Upgrade gym 0.23 (#24171) 2022-05-23 08:18:44 +02:00
microbenchmark [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
ml_user_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
nightly_tests Revert "Revert "Revert "[dataset] Use polars for sorting (#24523)" (#24781)" (#25173)" (#25341) 2022-06-01 10:49:12 -07:00
ray_release [ci/release] Install local wheels in release test shell script (#25227) 2022-06-02 10:32:51 +01:00
release_logs [ci] Fix automatic buildkite token fetching in fetch_release_logs.py (#24606) 2022-05-10 09:24:10 +02:00
rllib_tests [release/xgboost/lightgbm] Fix app config dependency install overwriting ray (#25307) 2022-05-31 13:46:17 +02:00
runtime_env_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
serve_tests [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
train_tests/horovod [Nightly test] Move two line downloads to one line. (#25061) 2022-05-22 00:07:03 -07:00
tune_tests [RLlib] Upgrade gym 0.23 (#24171) 2022-05-23 08:18:44 +02:00
util Update pip download test.sh #24997 2022-05-19 16:46:15 -07:00
xgboost_tests [release/xgboost/lightgbm] Fix app config dependency install overwriting ray (#25307) 2022-05-31 13:46:17 +02:00
__init__.py [release] move release testing end to end script to main ray repo (#17070) 2021-07-14 12:39:07 -07:00
BUILD [Serve] Add serve handle graph workload nightly tests (#24435) 2022-05-04 09:07:50 -07:00
README.md [Release] Remove release process doc (#19312) 2021-10-18 11:24:03 -07:00
release_tests.yaml [core] Remove more expensive shuffle tests (#25165) 2022-05-24 18:05:18 -07:00
requirements.txt [ci/release] Use 1.12.1 as base image in app configs (#25216) 2022-05-26 18:58:20 +02:00
requirements_buildkite.txt [ci/release] Use 1.12.1 as base image in app configs (#25216) 2022-05-26 18:58:20 +02:00
run_release_test.sh [ci/release] Install local wheels in release test shell script (#25227) 2022-06-02 10:32:51 +01:00
setup.py [ci/release] Refactor release test e2e into package (#22351) 2022-02-16 17:35:02 +00:00

Release Tests

While the exact release process relies on Anyscale internal tooling, the tests we run during the releases are located at https://github.com/ray-project/ray/blob/master/release/.buildkite/build_pipeline.py