hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

[autoscaler] fix summary when tags and instance creation aren't atomic (#14286)

Browse source 
* .

* done?

* .

Co-authored-by: Alex Wu <alex@anyscale.com>
This commit is contained in:
Alex Wu 2021-02-23 13:56:11 -08:00 • committed by GitHub
parent d344e77109
commit 96fe6481ec
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 9 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

9
python/ray/autoscaler/_private/autoscaler.py
View file

@ -743,6 +743,15 @@ class StandardAutoscaler:
for node_id in all_node_ids:
ip = self.provider.internal_ip(node_id)
node_tags = self.provider.node_tags(node_id)
if not all(
tag in node_tags
for tag in (TAG_RAY_NODE_KIND, TAG_RAY_USER_NODE_TYPE,
TAG_RAY_NODE_STATUS)):
# In some node providers, creation of a node and tags is not
# atomic, so just skip it.
continue
if node_tags[TAG_RAY_NODE_KIND] == NODE_KIND_UNMANAGED:
continue
node_type = node_tags[TAG_RAY_USER_NODE_TYPE]