mirror of
https://github.com/vale981/ray
synced 2025-03-10 13:26:39 -04:00
6e06a9e338
Summary: Able to run 1000 tasks with object dependencies on a set of distributed Raylets. Raylet Changes: Finalized ClientConnection class. Task forwarding. NM-to-NM heartbeats. NM resource accounting for tasks. Simple scheduling policy with task forwarding. Creating and maintaining NM 2 NM long-lived connections and reusing them for task forwarding. LineageCache Changes: LineageCache without cleanup of tasks committed by remote nodes. Lineage cache writeback and cleanup implementation. ObjectManager Changes: Object manager event loop/ClientConnection refactor. Multithreaded object manager (disabled in this PR). Testing Changes: Integration tests for task submission on multiple Raylets. Stress tests for object manager (with GCS and object store integration). Co-authored-by: Stephanie Wang <swang@cs.berkeley.edu> Co-authored-by: Alexey Tumanov <atumanov@gmail.com> |
||
|---|---|---|
| .. | ||
| build | ||
| format | ||
| test | ||
| CMakeLists.txt | ||
| local_scheduler.cc | ||
| local_scheduler.h | ||
| local_scheduler_algorithm.cc | ||
| local_scheduler_algorithm.h | ||
| local_scheduler_client.cc | ||
| local_scheduler_client.h | ||
| local_scheduler_extension.cc | ||
| local_scheduler_shared.h | ||