mirror of
https://github.com/vale981/ray
synced 2025-03-06 10:31:39 -05:00
b1308b1c8c
This fixes the previous problems from team column revert. This has 2 additional changes; alert handler receives the team argument, which was the root cause of breakage; https://github.com/ray-project/ray/pull/21289 Previously, tests without a team column were raising an exception, but I made the condition weaker (warning logs). I will eventually change it to raise an exception, but for smoother transition, we will log warning instead for a short time |
||
|---|---|---|
| .. | ||
| distributed | ||
| object_store | ||
| single_node | ||
| app_config.yaml | ||
| benchmark_tests.yaml | ||
| distributed.yaml | ||
| distributed_smoke_test.yaml | ||
| many_nodes.yaml | ||
| object_store.yaml | ||
| README.md | ||
| single_node.yaml | ||
Ray Scalability Envelope
Distributed Benchmarks
All distributed tests are run on 64 nodes with 64 cores/node. Maximum number of nodes is achieved by adding 4 core nodes.
| Dimension | Quantity |
|---|---|
| # nodes in cluster (with trivial task workload) | 250+ |
| # actors in cluster (with trivial workload) | 10k+ |
| # simultaneously running tasks | 10k+ |
| # simultaneously running placement groups | 1k+ |
Object Store Benchmarks
| Dimension | Quantity |
|---|---|
| 1 GiB object broadcast (# of nodes) | 50+ |
Single Node Benchmarks.
All single node benchmarks are run on a single m4.16xlarge.
| Dimension | Quantity |
|---|---|
| # of object arguments to a single task | 10000+ |
| # of objects returned from a single task | 3000+ |
# of plasma objects in a single ray.get call |
10000+ |
| # of tasks queued on a single node | 1,000,000+ |
Maximum ray.get numpy object size |
100GiB+ |