ray/python
architkulkarni 194c5e3a96
[Core] Cache workers by runtime_env in worker pool (#15782)
* pass RuntimeEnv in task spec as opaque string

* lint

* set correct empty value for json: "{}" not ""

* add comment for field in proto

* fix worker pool test by checking both "" and "{}"

* add RAY_CHECK todo

* make dict empty if all values null

* remove unnecessary ser/de

* fix

* address comments

* add WorkerCacheKey with hash function

* clean up

* add naive impl., dedicated workers never killed

* put dedicated workers in idle_of_all_languages

* pipe env hash from worker.py -> Worker

* fully pipe through hash, basic cache test passing

* use int type for runtime env hash

* convert Worker env hash type from size_t to int

* fix

* add method to MockWorker to fix cpp tests

* make compatible with java streaming test

* restore old dynamic_options code to fix java test

* address comments

* add comment about sorting before hash

* add comments for private members of WorkerCacheKey
2021-05-18 00:19:27 -07:00
..
ray [Core] Cache workers by runtime_env in worker pool (#15782) 2021-05-18 00:19:27 -07:00
requirements [tune](deps): Bump gpy from 1.9.9 to 1.10.0 in /python/requirements/tune (#15850) 2021-05-17 11:33:11 -07:00
asv.conf.json [docs] Move all /latest links to /master (#11897) 2020-11-10 10:53:28 -08:00
build-wheel-macos.sh Wheel Build macOS Python 3.6: 3.6.1 -> 3.6.2 (#15519) 2021-04-26 16:01:39 -07:00
build-wheel-manylinux2014.sh Revert "Add support for Python 3.9 (#12613)" (#15003) 2021-03-30 08:38:54 -05:00
build-wheel-windows.sh Add shellcheck support (#8574) 2020-07-30 18:39:28 -05:00
MANIFEST.in Include py.typed in MANIFEST.in to make sure it is packaged in wheels (#14492) 2021-03-15 10:43:12 -07:00
README-building-wheels.md [build] Build wheels with manylinux2014 (#11621) 2020-11-03 19:36:32 -08:00
requirements.txt [autoscaler][gcp] Migrate GCP config to available node types (#15805) 2021-05-17 15:45:47 -07:00
requirements_linters.txt [CI] Upgrade flake8 to 3.9.1 (#15527) 2021-05-03 14:23:28 -07:00
requirements_ml_docker.txt [Docker] Fix torch GPU install on Ray Docker images (#15473) 2021-04-26 16:22:25 -07:00
setup.py [Job submission] Basic job submission structure (#15103) 2021-05-12 15:08:20 +08:00