hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 02:21:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

[Nightly Tests] Readjust the concurrency limit. (#23002)

Browse source 
This PR reduces the concurrency limit. Based on the back of envelope calculation, the current concurrency limit can easily exceed the service quota.

Given large == 2048 vCPUs, it will use about 20K vCPUs, which is slightly larger than the limit.
This commit is contained in:
SangBin Cho 2022-03-11 00:19:38 +09:00 • committed by GitHub
parent 4fa294ca49
commit d192ec30fd
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 9 additions and 5 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

14
release/ray_release/buildkite/concurrency.py
View file

@ -6,15 +6,19 @@ from typing import Tuple, Optional, Dict
from ray_release.config import Test, RELEASE_PACKAGE_DIR, load_test_cluster_compute
from ray_release.logger import logger
# Keep 10% for the buffer.
limit = int(15784 * 0.9)
CONCURRENY_GROUPS = {
"small": 64,
"medium": 16,
"large": 8,
"small-gpu": 8,
"large-gpu": 4,
"small": 16,
"medium": 4,
"large": 2,
"small-gpu": 4,
"large-gpu": 2,
}
Condition = namedtuple(
"Condition", ["min_gpu", "max_gpu", "min_cpu", "max_cpu", "group"]
)