ray/release/nightly_tests/shuffle/100tb_shuffle_compute.yaml
Stephanie Wang a90e53b76f
[core] Add weekly test for 100TB random shuffle (#25908)
Adds a CI test for 100TB shuffle.

There is a custom config for this nightly test to: (1) make sure each node gets 4TB of storage, (2) head node has 0 CPUs, (3) worker nodes have half their actual vCPU count.

Related issue number

Closes #24480.
2022-07-01 13:30:07 -07:00

24 lines
504 B
YAML

cloud_id: {{env["ANYSCALE_CLOUD_ID"]}}
region: us-west-2
aws:
BlockDeviceMappings:
- DeviceName: /dev/sda1
Ebs:
VolumeSize: 2000
- DeviceName: /dev/sda2
Ebs:
VolumeSize: 2000
head_node_type:
name: head_node
instance_type: m5.8xlarge
resources: {"cpu": 0}
worker_node_types:
- name: worker_node
instance_type: m5.4xlarge
min_workers: 99
max_workers: 99
use_spot: false
resources: {"cpu": 8}