mirror of
https://github.com/vale981/ray
synced 2025-03-09 12:56:46 -04:00
0330852baf
## Why are these changes needed? This change adds Python publisher and subscriber in `gcs_utils.py`, and GRPC handler on GCS for publishing iva GCS. Error info is migrated to use the GCS-based pubsub, if feature flag `RAY_gcs_grpc_based_pubsub=true`. Also, add a `--gcs-address` flag to some Python processes. It is not set anywhere yet, but will be set aftering Redis-less bootstrapping work. Unit tests are added for the Python publisher and subscriber. Migrated error info publishers and subscribers are tested with existing unit tests, e.g. tests calling `ray._private.test_utils.get_error_message()` to ensure error info is published. GCS based pubsub has gaps in handling deadline, cancelled requests and GCS restarts. So 3 more unit tests are disabled in the `HA GCS` mode. They will be addressed in a separate change. ## Related issue number
6 lines
196 B
Python
6 lines
196 B
Python
NODE_STATS_UPDATE_INTERVAL_SECONDS = 1
|
|
LOG_INFO_UPDATE_INTERVAL_SECONDS = 5
|
|
UPDATE_NODES_INTERVAL_SECONDS = 5
|
|
MAX_COUNT_OF_GCS_RPC_ERROR = 10
|
|
MAX_LOGS_TO_CACHE = 10000
|
|
LOG_PRUNE_THREASHOLD = 1.25
|