mirror of
https://github.com/vale981/ray
synced 2025-03-05 18:11:42 -05:00
679f66eeee
## Why are these changes needed? When schedule actors on pg, instead of iterating all nodes in the cluster resource, This optimize will directly queries corresponding nodes by looking at pg location index. This optimization can reduce the complexity of the algorithm from O (N) to o (1)，and N is the number of nodes. In particular, the more nodes in large-scale clusters, the better the optimization effect. **This PR only optimize schedule by gcs, I will submit a PR for raylet scheduling later.** In ant group, Now we have achieved the optimization in the GCS scheduling mode and obtained the following performance test results. 1、The average time of selecting nodes is reduced from 330us to 30us, and the performance is improved by about 11 times. 2、The total time of creating & executing 12,000 actors ranges from 271 (s) - > 225 (s) on average. Reduce time consumption by 17%. More detailed solution information is in the issue. ## Related issue number [Core/PG/Schedule]Optimize the scheduling performance of actors/tasks with PG specified #23881 |
||
|---|---|---|
| .. | ||
| mock | ||
| ray | ||
| shims/windows | ||