ray/src
Alexey Tumanov de047daea7 [xray] raylet scheduling mechanism with a simple spillback policy (#2749)
## What do these changes do?
* distribute load and resource information on a heartbeat
* for each raylet, maintain total and available resource capacity as well as measure of current load
* this PR introduces a new notion of load, defined as a sum of all resource demand induced by queued ready tasks on the local raylet. This provides a heterogeneity-aware measure of load that supersedes legacy Ray's task count as a proxy for load.
* modify the scheduling policy to perform *capacity-based*, *load-aware*, *optimistically concurrent* resource allocation
* perform task spillover to the heartbeating node in response to a heartbeat, implementing  heterogeneity-aware late-binding/work-stealing.
2018-08-28 00:03:34 -07:00
..
common Support pluggable backend log lib with glog (#2695) 2018-08-23 09:43:38 -07:00
global_scheduler [xray] Fix valgrind crash when memory profiling raylet (#2583) 2018-08-09 15:37:17 -07:00
local_scheduler [java] Fix the logic of generating TaskID (#2747) 2018-08-27 13:11:33 -07:00
plasma Upgrade arrow to include more detailed flushing message (#2706) 2018-08-24 11:44:04 -07:00
ray [xray] raylet scheduling mechanism with a simple spillback policy (#2749) 2018-08-28 00:03:34 -07:00