ray/doc/source
Archit Kulkarni 78f882dbbc
[runtime env] Local uri caching for working_dir, py_modules and conda (#20273)
Previously, local files corresponding to runtime env URIs were eagerly garbage collected as soon as there were no more references to them.  In this PR, we store this data in a cache instead, so when the reference count for a URI drops to zero, instead of deleting it we simple mark it as unused in the cache.  When the cache exceeds its size limit (default 10 GB) it will delete unused URIs until the cache is back under the size limit or there are no more unused URIs.

Design doc: https://docs.google.com/document/d/1x1JAHg7c0ewcOYwhhclbuW0B0UC7l92WFkF4Su0T-dk/edit

- Adds unit tests for caching and integration tests for working_dir caching
2022-02-02 14:53:03 -06:00
..
_includes [docs] landing page (fixes #21750) (#21859) 2022-01-26 17:14:25 -08:00
_static [docs] landing page (fixes #21750) (#21859) 2022-01-26 17:14:25 -08:00
_templates [Docs] Trial Fathom analytics for doc pages (#17056) 2021-07-14 14:11:52 -07:00
cluster [CI] Format Python code with Black (#21975) 2022-01-29 18:41:57 -08:00
data [CI] Format Python code with Black (#21975) 2022-01-29 18:41:57 -08:00
images [docs] landing page (fixes #21750) (#21859) 2022-01-26 17:14:25 -08:00
ray-contribute [Doc] Correct information about code style (#21985) 2022-02-01 10:37:21 -08:00
ray-core [runtime env] Local uri caching for working_dir, py_modules and conda (#20273) 2022-02-02 14:53:03 -06:00
ray-design-patterns [docs] Make design pattern example self contained (#20981) 2021-12-09 20:19:38 -08:00
ray-more-libs [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
ray-observability [RFC] [Core] Support disabling log redirection via RAY_LOG_TO_STDERR environment variable. (#21767) 2022-01-25 10:52:53 -08:00
ray-overview [Docs] Ray Data docs target state (#21931) 2022-01-27 13:14:36 -08:00
ray-references [docs] new structure (#21776) 2022-01-21 15:42:05 -08:00
raysgd Revert "[docs] Clean up doc structure (first part) (#21667)" (#21763) 2022-01-20 15:30:56 -08:00
rllib [RLlib] Move bandits into main agents folder; Make RecSim adapter more accessible; (#21773) 2022-01-27 13:58:12 +01:00
serve [docs] landing page (fixes #21750) (#21859) 2022-01-26 17:14:25 -08:00
train [train] add a utility function to turn off TF autosharding (#21887) 2022-01-28 16:09:06 -08:00
tune [CI] Format Python code with Black (#21975) 2022-01-29 18:41:57 -08:00
workflows [docs] landing page (fixes #21750) (#21859) 2022-01-26 17:14:25 -08:00
_toc.yml [docs] Clean up long titles in TOC (#22016) 2022-02-01 22:56:49 -08:00
conf.py [CI] Format Python code with Black (#21975) 2022-01-29 18:41:57 -08:00
custom_directives.py [CI] Format Python code with Black (#21975) 2022-01-29 18:41:57 -08:00
index.md [Docs] Ray Data docs target state (#21931) 2022-01-27 13:14:36 -08:00