ray/dashboard/modules
mwtian 0330852baf
[Core][Pubsub] Implement Python GCS publisher and subscriber (#20111)
## Why are these changes needed?
This change adds Python publisher and subscriber in `gcs_utils.py`, and GRPC handler on GCS for publishing iva GCS. Error info is migrated to use the GCS-based pubsub, if feature flag `RAY_gcs_grpc_based_pubsub=true`.

Also, add a `--gcs-address` flag to some Python processes. It is not set anywhere yet, but will be set aftering Redis-less bootstrapping work.

Unit tests are added for the Python publisher and subscriber. Migrated error info publishers and subscribers are tested with existing unit tests, e.g. tests calling `ray._private.test_utils.get_error_message()` to ensure error info is published.

GCS based pubsub has gaps in handling deadline, cancelled requests and GCS restarts. So 3 more unit tests are disabled in the `HA GCS` mode. They will be addressed in a separate change.

## Related issue number
2021-11-11 14:59:57 -08:00
..
actor [Core] Add TLS/SSL support to gRPC channels (#18631) 2021-10-20 22:39:11 -07:00
event [gcs] Update all redis kv usage in python except function table (#20014) 2021-11-10 20:24:53 -08:00
job [gcs] Update all redis kv usage in python except function table (#20014) 2021-11-10 20:24:53 -08:00
log [dashboard] Rename "new_dashboard" -> "dashboard" (#18214) 2021-09-15 11:17:15 -05:00
node [Core][Pubsub] Implement Python GCS publisher and subscriber (#20111) 2021-11-11 14:59:57 -08:00
reporter [gcs] Update all redis kv usage in python except function table (#20014) 2021-11-10 20:24:53 -08:00
runtime_env [gcs] Update all redis kv usage in python except function table (#20014) 2021-11-10 20:24:53 -08:00
snapshot [gcs] Update all redis kv usage in python except function table (#20014) 2021-11-10 20:24:53 -08:00
test [dashboard] Rename "new_dashboard" -> "dashboard" (#18214) 2021-09-15 11:17:15 -05:00
tune [dashboard] Rename "new_dashboard" -> "dashboard" (#18214) 2021-09-15 11:17:15 -05:00
__init__.py [Dashboard] New dashboard skeleton (#9099) 2020-07-27 11:34:47 +08:00