[Release] Disable caching for ray_lightning (#21886)

Passing tests: https://buildkite.com/ray-project/periodic-ci/builds/2560#_

Add an echo timestamp to the post build commands of the ray lightning release tests to trigger a cluster env rebuild and get the latest versions of ray lightning. Without this, the cluster env gets cached so an outdated version is installed on the cluster that is different than the one on the driver, resulting in the below failures.

Closes #21871
Closes #21863

Also reinstalls the dependencies in the post build commands so old versions are not cached in the Docker images
This commit is contained in:
Amog Kamsetty 2022-01-27 17:56:32 -08:00 committed by GitHub
parent 97f7e3d0e6
commit bd726aab02
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 9 additions and 1 deletions

View file

@ -13,3 +13,6 @@ post_build_cmds:
- pip uninstall -y ray || true
- pip3 install -U {{ env["RAY_WHEELS"] | default("ray") }}
- {{ env["RAY_WHEELS_SANITY_CHECK"] | default("echo No Ray wheels sanity check") }}
# Upgrade the Ray Lightning version, otherwise it will be cached in the Anyscale Docker image.
- echo {{ env["TIMESTAMP"] }}
- pip3 install -U ray-lightning

View file

@ -5,11 +5,16 @@ debian_packages:
python:
pip_packages:
- git+https://github.com/ray-project/ray_lightning#ray_lightning
- tblib
# Need to have in pip_packages so it is installed on the driver.
- git+https://github.com/ray-project/ray_lightning#ray_lightning
conda_packages: []
post_build_cmds:
- pip uninstall -y ray || true
- pip3 install -U {{ env["RAY_WHEELS"] | default("ray") }}
- {{ env["RAY_WHEELS_SANITY_CHECK"] | default("echo No Ray wheels sanity check") }}
# Upgrade the Ray Lightning version in post build commands, otherwise it will be cached in the Anyscale Docker image.
- echo {{ env["TIMESTAMP"] }}
- pip uninstall ray_lightning -y # Uninstall first so pip does a reinstall.
- pip3 install -U --no-cache-dir git+https://github.com/ray-project/ray_lightning#ray_lightning