ray/streaming/src
architkulkarni 194c5e3a96
[Core] Cache workers by runtime_env in worker pool (#15782)
* pass RuntimeEnv in task spec as opaque string

* lint

* set correct empty value for json: "{}" not ""

* add comment for field in proto

* fix worker pool test by checking both "" and "{}"

* add RAY_CHECK todo

* make dict empty if all values null

* remove unnecessary ser/de

* fix

* address comments

* add WorkerCacheKey with hash function

* clean up

* add naive impl., dedicated workers never killed

* put dedicated workers in idle_of_all_languages

* pipe env hash from worker.py -> Worker

* fully pipe through hash, basic cache test passing

* use int type for runtime env hash

* convert Worker env hash type from size_t to int

* fix

* add method to MockWorker to fix cpp tests

* make compatible with java streaming test

* restore old dynamic_options code to fix java test

* address comments

* add comment about sorting before hash

* add comments for private members of WorkerCacheKey
2021-05-18 00:19:27 -07:00
..
channel [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
common [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
config [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
lib/java [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
message [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
protobuf [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
queue Make use of C++14 'make_unique' (#14663) 2021-03-15 03:00:52 -07:00
reliability [Streaming] add barrier helper tests (#11107) 2020-10-13 09:55:55 +08:00
ring_buffer [Streaming] Test build fixed (#10617) 2020-09-08 14:31:54 +08:00
test [Core] Cache workers by runtime_env in worker pool (#15782) 2021-05-18 00:19:27 -07:00
util [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
data_reader.cc [Streaming] Test build fixed (#10617) 2020-09-08 14:31:54 +08:00
data_reader.h [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
data_writer.cc [Streaming] Test build fixed (#10617) 2020-09-08 14:31:54 +08:00
data_writer.h add streaming data writer unit tests (#11387) 2020-10-16 14:42:44 +08:00
event_service.cc [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
event_service.h [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
flow_control.cc [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
flow_control.h [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
reliability_helper.cc [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
reliability_helper.h [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
runtime_context.cc Bazel fixes (#9519) 2020-07-19 12:53:08 -07:00
runtime_context.h [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00