ray/dashboard/modules/node
mwtian 0330852baf
[Core][Pubsub] Implement Python GCS publisher and subscriber (#20111)
## Why are these changes needed?
This change adds Python publisher and subscriber in `gcs_utils.py`, and GRPC handler on GCS for publishing iva GCS. Error info is migrated to use the GCS-based pubsub, if feature flag `RAY_gcs_grpc_based_pubsub=true`.

Also, add a `--gcs-address` flag to some Python processes. It is not set anywhere yet, but will be set aftering Redis-less bootstrapping work.

Unit tests are added for the Python publisher and subscriber. Migrated error info publishers and subscribers are tested with existing unit tests, e.g. tests calling `ray._private.test_utils.get_error_message()` to ensure error info is published.

GCS based pubsub has gaps in handling deadline, cancelled requests and GCS restarts. So 3 more unit tests are disabled in the `HA GCS` mode. They will be addressed in a separate change.

## Related issue number
2021-11-11 14:59:57 -08:00
..
tests [Dashboard] Dashboard memory improvement (#19385) 2021-10-19 19:34:42 -07:00
__init__.py [Dashboard] Reorganize dashboard modules - node (#16217) 2021-06-07 19:50:46 -07:00
node_consts.py [Core][Pubsub] Implement Python GCS publisher and subscriber (#20111) 2021-11-11 14:59:57 -08:00
node_head.py [Core][Pubsub] Implement Python GCS publisher and subscriber (#20111) 2021-11-11 14:59:57 -08:00