ray/release/benchmarks/many_nodes.yaml
SangBin Cho 2c2d96eeb1
[Nightly tests] Improve k8s testing (#23108)
This PR improves broken k8s tests.

Use exponential backoff on the unstable HTTP path (getting job status sometimes has broken connection from the server. I couldn't really find the relevant logs to figure out why this is happening, unfortunately).
Fix benchmark tests resource leak check. The existing one was broken because the job submission uses 0.001 node IP resource, which means the cluster_resources can never be the same as available resources. I fixed the issue by not checking node IP resources
K8s infra doesn't support instances < 8 CPUs. I used m5.2xlarge instead of xlarge. It will increase the cost a bit, but it wouldn't be very big.
2022-03-14 03:49:15 -07:00

24 lines
458 B
YAML

cloud_id: {{env["ANYSCALE_CLOUD_ID"]}}
region: us-west-2
max_workers: 999
head_node_type:
name: head_node
instance_type: r5dn.16xlarge # Network optimized.
resources:
cpu: 0
custom_resources:
node: 1
small: 1
worker_node_types:
- name: small_worker
instance_type: m5.2xlarge
min_workers: 249
max_workers: 249
use_spot: false
resources:
custom_resources:
node: 1