ray/doc/source/ray-core
Archit Kulkarni 78f882dbbc
[runtime env] Local uri caching for working_dir, py_modules and conda (#20273)
Previously, local files corresponding to runtime env URIs were eagerly garbage collected as soon as there were no more references to them.  In this PR, we store this data in a cache instead, so when the reference count for a URI drops to zero, instead of deleting it we simple mark it as unused in the cache.  When the cache exceeds its size limit (default 10 GB) it will delete unused URIs until the cache is back under the size limit or there are no more unused URIs.

Design doc: https://docs.google.com/document/d/1x1JAHg7c0ewcOYwhhclbuW0B0UC7l92WFkF4Su0T-dk/edit

- Adds unit tests for caching and integration tests for working_dir caching
2022-02-02 14:53:03 -06:00
..
_examples Revert "Revert "[Dataset] [DataFrame 2/n] Add pandas block format implementation (partial) (#20988) (#21661)" (#21894) 2022-01-31 12:09:51 -08:00
images [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
actors.rst [docs] integrate algolia docsearch, move to sphinx panels (#21814) 2022-01-24 17:00:41 -08:00
advanced.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
async_api.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
concurrency_group_api.rst [docs] integrate algolia docsearch, move to sphinx panels (#21814) 2022-01-24 17:00:41 -08:00
configure.rst [Doc] Remove the legacy doc (#21996) 2022-01-31 15:26:19 -08:00
cross-language.rst [docs] integrate algolia docsearch, move to sphinx panels (#21814) 2022-01-24 17:00:41 -08:00
download_zip_url.png [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
fault-tolerance.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
handling-dependencies.rst [runtime env] Local uri caching for working_dir, py_modules and conda (#20273) 2022-02-02 14:53:03 -06:00
memory-management.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
namespaces.rst [docs] integrate algolia docsearch, move to sphinx panels (#21814) 2022-01-24 17:00:41 -08:00
package-ref.rst [docs] landing page (fixes #21750) (#21859) 2022-01-26 17:14:25 -08:00
placement-group.rst [docs] integrate algolia docsearch, move to sphinx panels (#21814) 2022-01-24 17:00:41 -08:00
ray-dashboard.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
ray_repo.png [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
serialization.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
starting-ray.rst [docs] integrate algolia docsearch, move to sphinx panels (#21814) 2022-01-24 17:00:41 -08:00
troubleshooting.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
using-ray-with-gpus.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
using-ray-with-jupyter.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
using-ray-with-pytorch.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
using-ray-with-tensorflow.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
using-ray.rst [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
walkthrough.rst [docs] integrate algolia docsearch, move to sphinx panels (#21814) 2022-01-24 17:00:41 -08:00