ray/release/rllib_tests/app_config.yaml

base_image: {{ env["RAY_IMAGE_ML_NIGHTLY_GPU"] | default("anyscale/ray-ml:nightly-py37-gpu") }}
env_vars: {}
debian_packages:
  - unzip
  - zip

python:
  # These dependencies should be handled by requirements_rllib.txt and
  # requirements_ml_docker.txt
  pip_packages:
      - gym
  conda_packages: []

post_build_cmds:
  - pip3 uninstall -y ray || true && pip3 install -U {{ env["RAY_WHEELS"] | default("ray") }}
  # TODO(jungong): remove once nightly image gets upgraded.
  - pip install -U pybullet==3.2.0
  - {{ env["RAY_WHEELS_SANITY_CHECK"] | default("echo No Ray wheels sanity check") }}
  # Clone the rl-experiments repo for offline-RL files.
  - git clone https://github.com/ray-project/rl-experiments.git
  - cp rl-experiments/halfcheetah-sac/2021-09-06/halfcheetah_expert_sac.zip ~/.
[ci/release] Support running tests with different python versions (#24843) OSS release tests currently run with hardcoded Python 3.7 base. In the future we will want to run tests on different python versions. This PR adds support for a new `python` field in the test configuration. The python field will determine both the base image used in the Buildkite runner docker container (for Ray client compatibility) and the base image for the Anyscale cluster environments. Note that in Buildkite, we will still only wait for the python 3.7 base image before kicking off tests. That is acceptable, as we can assume that most wheels finish in a similar time, so even if we wait for the 3.7 image and kick off a 3.8 test, that runner will wait maybe for 5-10 more minutes. 2022-05-17 17:03:12 +01:00			`base_image: {{ env["RAY_IMAGE_ML_NIGHTLY_GPU"] \| default("anyscale/ray-ml:nightly-py37-gpu") }}`
[RLlib] Upgrade RLlib regression test scripts to new testing tool - RLlib release logs for 1.4. (#16080) 2021-06-01 17:39:18 +02:00			`env_vars: {}`
[RLlib Testing] Add A3C/APPO/BC/DDPPO/MARWIL/CQL/ES/ARS/TD3 to weekly learning tests. (#18381) 2021-09-07 11:48:41 +02:00			`debian_packages:`
			`- unzip`
			`- zip`
[RLlib] Upgrade RLlib regression test scripts to new testing tool - RLlib release logs for 1.4. (#16080) 2021-06-01 17:39:18 +02:00
			`python:`
[RLlib] Add multi-GPU attention net tests to nightly test suite (+ R2D2 tests for LSTM and attention nets). (#18368) 2021-09-06 17:48:05 +02:00			`# These dependencies should be handled by requirements_rllib.txt and`
			`# requirements_ml_docker.txt`
[rllib] Pin gym everywhere (#23384) This PR Pins gym in the app config.yaml's for rllib and tune so that release tests are no longer broken by the new gym version. 2022-03-22 02:44:22 -07:00			`pip_packages:`
[RLlib] Upgrade gym 0.23 (#24171) 2022-05-23 08:18:44 +02:00			`- gym`
[RLlib] Upgrade RLlib regression test scripts to new testing tool - RLlib release logs for 1.4. (#16080) 2021-06-01 17:39:18 +02:00			`conda_packages: []`

			`post_build_cmds:`
[Nightly test] Move two line downloads to one line. (#25061) It fixes the mysterious error when all cluster env build is failing when pip uninstall / pip install is written in 2 lines. The root cause will be fixed later 2022-05-22 16:07:03 +09:00			`- pip3 uninstall -y ray \|\| true && pip3 install -U {{ env["RAY_WHEELS"] \| default("ray") }}`
[rllib] Make sure json can serialize result dict (#20439) We may have fields in the result dict that are or None. Make sure our results are json serializable. 2021-11-17 10:27:00 -08:00			`# TODO(jungong): remove once nightly image gets upgraded.`
			`- pip install -U pybullet==3.2.0`
[release/xgboost/lightgbm] Fix app config dependency install overwriting ray (#25307) This line: ``` pip3 install -U --force-reinstall xgboost xgboost_ray lightgbm_ray petastorm ``` also re-installs the dependencies of these packages, and the `--force-reinstall` means we overwrite existing ones. This leads us to re-install the latest ray release, overwriting the wheels to be tested: ``` [INFO] 5/31/2022, 12:12:16 AM: Successfully installed ... ray-1.12.1 ... [INFO] 5/31/2022, 12:12:17 AM: * Executed RUN pip3 install -U --force-reinstall xgboost xgboost_ray petastorm (ff6ae9f9) ``` Instead, we should use `--no-deps` to avoid re-installing dependencies. Also, the wheels sanity check is moved to after installing additional packages in order to catch these errors earlier. 2022-05-31 13:46:17 +02:00			`- {{ env["RAY_WHEELS_SANITY_CHECK"] \| default("echo No Ray wheels sanity check") }}`
[RLlib Testing] Add A3C/APPO/BC/DDPPO/MARWIL/CQL/ES/ARS/TD3 to weekly learning tests. (#18381) 2021-09-07 11:48:41 +02:00			`# Clone the rl-experiments repo for offline-RL files.`
			`- git clone https://github.com/ray-project/rl-experiments.git`
			`- cp rl-experiments/halfcheetah-sac/2021-09-06/halfcheetah_expert_sac.zip ~/.`