2018-11-10 21:52:20 -08:00
|
|
|
Redis Memory Management (Experimental)
|
2018-07-05 23:44:37 -07:00
|
|
|
======================================
|
|
|
|
|
|
|
|
Ray stores metadata associated with tasks and objects in one or more Redis
|
|
|
|
servers, as described in `An Overview of the Internals
|
|
|
|
<internals-overview.html>`_. Applications that are long-running or have high
|
|
|
|
task/object generation rate could risk high memory pressure, potentially leading
|
|
|
|
to out-of-memory (OOM) errors.
|
|
|
|
|
2018-12-09 05:48:52 -08:00
|
|
|
In Ray `0.6.1+` Redis shards can be configured to LRU evict task and object
|
|
|
|
metadata by setting ``redis_max_memory`` when starting Ray. This supercedes the
|
|
|
|
previously documented flushing functionality.
|
2018-07-05 23:44:37 -07:00
|
|
|
|
2018-12-09 05:48:52 -08:00
|
|
|
Note that profiling is disabled when ``redis_max_memory`` is set. This is because
|
|
|
|
profiling data cannot be LRU evicted.
|