ray/python
xwjiang2010 96b44adf67
[Tune] Remove pg caching with fixes to pbt scheduler (#20403)
This reverts commit f13c2a5350.

Re-land remove PG caching logic.

As a result, pbt scheduler cannot stop and start trial within itself for weight transfer and perturbation now. So these are some changes to pbt scheduler:

1. the trial being perturbed is always left in a PAUSED state upon exiting on_trial_result. This is because instead of maintaining two separate paths for replacing a trial, we consolidate to always "stop" and "restore" and rely on reuse_actor as an optimization if available. (see 2)
2. consolidates pbt replacing a trial with reuse_actor.
3. introduces a NOOP scheduler decision to indicate that (pbt) scheduler has finished its interaction with executor and thus no decision is further needed in Tune loop.

Long term, we should control the interface between scheduler and executor. For example, on_trial_result taking in the whole runner is too much API exposure that we want to remove.
2021-11-26 15:54:45 +00:00
..
ray [Tune] Remove pg caching with fixes to pbt scheduler (#20403) 2021-11-26 15:54:45 +00:00
requirements [train][datasets] update example and remove dask (#20592) 2021-11-21 17:06:44 -08:00
asv.conf.json [docs] Move all /latest links to /master (#11897) 2020-11-10 10:53:28 -08:00
build-wheel-macos-arm64.sh [CI] [macOS] avoid installing latest setuptools (#20064) 2021-11-04 21:35:03 -07:00
build-wheel-macos.sh [CI] [macOS] avoid installing latest setuptools (#20064) 2021-11-04 21:35:03 -07:00
build-wheel-manylinux2014.sh [dashboard] Rename "new_dashboard" -> "dashboard" (#18214) 2021-09-15 11:17:15 -05:00
build-wheel-windows.sh [Dashboard] Include the dashboard in Windows wheels (#19575) 2021-10-22 17:57:36 -07:00
MANIFEST.in [Build] Another attempt at building Python 3.9 MacOS wheels (#16347) 2021-06-10 10:20:30 -07:00
README-building-wheels.md [build] Build wheels with manylinux2014 (#11621) 2020-11-03 19:36:32 -08:00
requirements.txt Add smart_open dependency to ray[default] (#20420) 2021-11-18 10:00:30 -06:00
requirements_linters.txt [Lint] Add flake8-bugbear (#19053) 2021-10-03 23:24:11 -07:00
requirements_ml_docker.txt [Deps] Bump tensorflow on Docker image and add Codeowners (#20041) 2021-11-05 00:58:34 -07:00
setup.py Pin redis back to redis >= 3.5.0 (#20661) 2021-11-23 15:51:20 -08:00