ray/release/nightly_tests/dataset/shuffle_app_config.yaml

base_image: {{ env["RAY_IMAGE_ML_NIGHTLY_GPU"] | default("anyscale/ray-ml:nightly-py37-gpu") }}

python:
  pip_packages:
    - boto3
    - pyarrow<7.0.0
  conda_packages: []

post_build_cmds:
  - pip3 uninstall -y ray && pip3 install -U {{ env["RAY_WHEELS"] | default("ray") }}
  - pip3 install -U ray[default]
  - {{ env["RAY_WHEELS_SANITY_CHECK"] | default("echo No Ray wheels sanity check") }}
[ci/release] Support running tests with different python versions (#24843) OSS release tests currently run with hardcoded Python 3.7 base. In the future we will want to run tests on different python versions. This PR adds support for a new `python` field in the test configuration. The python field will determine both the base image used in the Buildkite runner docker container (for Ray client compatibility) and the base image for the Anyscale cluster environments. Note that in Buildkite, we will still only wait for the python 3.7 base image before kicking off tests. That is acceptable, as we can assume that most wheels finish in a similar time, so even if we wait for the 3.7 image and kick off a 3.8 test, that runner will wait maybe for 5-10 more minutes. 2022-05-17 17:03:12 +01:00			`base_image: {{ env["RAY_IMAGE_ML_NIGHTLY_GPU"] \| default("anyscale/ray-ml:nightly-py37-gpu") }}`
add dataset shuffle data loader (#17917) 2021-08-20 11:26:01 -07:00
			`python:`
[Dataset][nighlyt-test] pin pyarrow==4.0.1 for dataset related tests (#22277) * pin pyarrow==4.0.1 * address comments 2022-02-10 14:22:41 -08:00			`pip_packages:`
			`- boto3`
			`- pyarrow<7.0.0`
add dataset shuffle data loader (#17917) 2021-08-20 11:26:01 -07:00			`conda_packages: []`

			`post_build_cmds:`
[Nightly test] Move two line downloads to one line. (#25061) It fixes the mysterious error when all cluster env build is failing when pip uninstall / pip install is written in 2 lines. The root cause will be fixed later 2022-05-22 16:07:03 +09:00			`- pip3 uninstall -y ray && pip3 install -U {{ env["RAY_WHEELS"] \| default("ray") }}`
[ci/release] Add sanity check for ray wheels hash to release tests (#18489) 2021-09-10 17:50:31 +01:00			`- pip3 install -U ray[default]`
			`- {{ env["RAY_WHEELS_SANITY_CHECK"] \| default("echo No Ray wheels sanity check") }}`