mirror of
https://github.com/vale981/ray
synced 2025-03-07 02:51:39 -05:00

Adds a CI test for 100TB shuffle. There is a custom config for this nightly test to: (1) make sure each node gets 4TB of storage, (2) head node has 0 CPUs, (3) worker nodes have half their actual vCPU count. Related issue number Closes #24480.
24 lines
504 B
YAML
24 lines
504 B
YAML
cloud_id: {{env["ANYSCALE_CLOUD_ID"]}}
|
|
region: us-west-2
|
|
|
|
aws:
|
|
BlockDeviceMappings:
|
|
- DeviceName: /dev/sda1
|
|
Ebs:
|
|
VolumeSize: 2000
|
|
- DeviceName: /dev/sda2
|
|
Ebs:
|
|
VolumeSize: 2000
|
|
|
|
head_node_type:
|
|
name: head_node
|
|
instance_type: m5.8xlarge
|
|
resources: {"cpu": 0}
|
|
|
|
worker_node_types:
|
|
- name: worker_node
|
|
instance_type: m5.4xlarge
|
|
min_workers: 99
|
|
max_workers: 99
|
|
use_spot: false
|
|
resources: {"cpu": 8}
|