shrekris-anyscale b51d0aa8b1 [serve] Introduce context.py and client.py (#24067) ... Serve stores context state, including the `_INTERNAL_REPLICA_CONTEXT` and the `_global_client` in `api.py`. However, these data structures are referenced throughout the codebase, causing circular dependencies. This change introduces two new files: * `context.py` * Intended to expose process-wide state to internal Serve code as well as `api.py` * Stores the `_INTERNAL_REPLICA_CONTEXT` and the `_global_client` global variables * `client.py` * Stores the definition for the Serve `Client` object, now called the `ServeControllerClient`		2022-04-21 18:35:09 -05:00
..
workloads	[serve] Introduce context.py and client.py (#24067)	2022-04-21 18:35:09 -05:00
app_config.yaml	[Release] Use nightly Docker images (#20001)	2021-11-10 18:00:16 -08:00
compute_tpl_8_cpu_autoscaling.yaml	[Serve] Serve Autoscaling Release tests (#21208)	2022-01-21 12:08:25 -08:00
compute_tpl_32_cpu.yaml	[serve][release tests] Use m5.8xlarge instance types for 1k replica tests (#22918)	2022-03-08 21:34:01 -06:00
compute_tpl_single_node.yaml	[Releaes] change headnode type for serve benchmark (#18672)	2021-09-16 10:57:36 -07:00
compute_tpl_single_node_k8s.yaml	[ci/release] use s3 sync (#21626)	2022-01-15 17:53:19 -08:00