ray/release
Kai Fricke 6c5229295e
[ci/release] Support running tests with different python versions (#24843)
OSS release tests currently run with hardcoded Python 3.7 base. In the future we will want to run tests on different python versions. 
This PR adds support for a new `python` field in the test configuration. The python field will determine both the base image used in the Buildkite runner docker container (for Ray client compatibility) and the base image for the Anyscale cluster environments. 

Note that in Buildkite, we will still only wait for the python 3.7 base image before kicking off tests. That is acceptable, as we can assume that most wheels finish in a similar time, so even if we wait for the 3.7 image and kick off a 3.8 test, that runner will wait maybe for 5-10 more minutes.
2022-05-17 17:03:12 +01:00
..
air_tests/horovod [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
benchmarks [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
golden_notebook_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
jobs_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
kubernetes_manual_tests [minor] Fix legacy OSS operator test (#23540) 2022-04-18 17:47:42 -07:00
lightgbm_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
long_running_distributed_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
long_running_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
microbenchmark [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
ml_user_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
nightly_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
ray_release [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
release_logs [ci] Fix automatic buildkite token fetching in fetch_release_logs.py (#24606) 2022-05-10 09:24:10 +02:00
rllib_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
runtime_env_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
serve_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
train_tests/horovod [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
tune_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
util [ci/release] Remove old OSS release test infrastructure (#23134) 2022-03-14 15:10:52 +00:00
xgboost_tests [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
__init__.py [release] move release testing end to end script to main ray repo (#17070) 2021-07-14 12:39:07 -07:00
BUILD [Serve] Add serve handle graph workload nightly tests (#24435) 2022-05-04 09:07:50 -07:00
README.md [Release] Remove release process doc (#19312) 2021-10-18 11:24:03 -07:00
release_tests.yaml [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
requirements.txt [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
requirements_buildkite.txt [ci/release] Refactor release test e2e into package (#22351) 2022-02-16 17:35:02 +00:00
run_release_test.sh [ci/release] Disable infra retries for now (#23132) 2022-03-14 11:51:11 +00:00
setup.py [ci/release] Refactor release test e2e into package (#22351) 2022-02-16 17:35:02 +00:00

Release Tests

While the exact release process relies on Anyscale internal tooling, the tests we run during the releases are located at https://github.com/ray-project/ray/blob/master/release/.buildkite/build_pipeline.py