ray/release/benchmarks
Kai Fricke 8608b64885
[ci/release] Remove old OSS release test infrastructure (#23134)
Now that we've migrated all OSS release tests to the new infrastructure, we can remove old config files and infra scripts.
2022-03-14 15:10:52 +00:00
..
distributed [ci/release] Remove old OSS release test infrastructure (#23134) 2022-03-14 15:10:52 +00:00
object_store [Release Test] Add perf metrics for core scalability tests (#23110) 2022-03-14 10:20:39 +09:00
single_node [Release Test] Add perf metrics for core scalability tests (#23110) 2022-03-14 10:20:39 +09:00
app_config.yaml Migrate scalability tests (#22901) 2022-03-08 17:22:41 -08:00
distributed.yaml Migrate scalability tests (#22901) 2022-03-08 17:22:41 -08:00
distributed_smoke_test.yaml Migrate scalability tests (#22901) 2022-03-08 17:22:41 -08:00
many_nodes.yaml [Nightly tests] Improve k8s testing (#23108) 2022-03-14 03:49:15 -07:00
object_store.yaml [Nightly tests] Improve k8s testing (#23108) 2022-03-14 03:49:15 -07:00
README.md Migrate scalability tests (#22901) 2022-03-08 17:22:41 -08:00
scheduling.yaml Migrate scalability tests (#22901) 2022-03-08 17:22:41 -08:00
single_node.yaml Migrate scalability tests (#22901) 2022-03-08 17:22:41 -08:00

Ray Scalability Envelope

Distributed Benchmarks

All distributed tests are run on 64 nodes with 64 cores/node. Maximum number of nodes is achieved by adding 4 core nodes.

Dimension Quantity
# nodes in cluster (with trivial task workload) 250+
# actors in cluster (with trivial workload) 10k+
# simultaneously running tasks 10k+
# simultaneously running placement groups 1k+

Object Store Benchmarks

Dimension Quantity
1 GiB object broadcast (# of nodes) 50+

Single Node Benchmarks.

All single node benchmarks are run on a single m4.16xlarge.

Dimension Quantity
# of object arguments to a single task 10000+
# of objects returned from a single task 3000+
# of plasma objects in a single ray.get call 10000+
# of tasks queued on a single node 1,000,000+
Maximum ray.get numpy object size 100GiB+