Sihan Wang
b606169cb5
[Serve] Promote autoscaling feature ( #26393 )
...
1. get rid of the private attribute
2. fix unit test
3. docs and workflows
2022-07-13 14:38:38 -05:00
ej
636105e8e2
[Docs] [Serve] Has a consistent landing page style ( #26029 )
2022-07-08 11:58:21 -07:00
brucez-anyscale
f76d7b23f2
Revert "Revert "[Dashboard][Serve] Move Serve related endpoints to dashboard agent"" ( #26336 )
2022-07-06 19:37:30 -07:00
Yi Cheng
12d147ff1f
Revert "[Dashboard][Serve] Move Serve related endpoints to dashboard agent ( #26107 )" ( #26333 )
...
This reverts commit 84166ccb04
2022-07-06 13:30:33 -07:00
brucez-anyscale
84166ccb04
[Dashboard][Serve] Move Serve related endpoints to dashboard agent ( #26107 )
...
In Ray 2.0, we want to achieve api server HA.
Originally serve endpoints are in head node.
This pr moves serve endpoints to dashboard agents, so they will be HA due to multiple replica of dashboard agent.
2022-07-06 10:58:00 -07:00
Simon Mo
88a219c7f2
Revert "Revert "[AIR][Serve] Rename ModelWrapperDeployment -> PredictorDeployment"" ( #26231 )
2022-07-05 13:26:49 -07:00
Archit Kulkarni
84be085a5a
[Doc] Fix typo in Serve doc ( #26211 )
2022-06-29 16:15:26 -07:00
Stephanie Wang
c9be251b7a
Revert "[AIR][Serve] Rename ModelWrapperDeployment -> PredictorDeployment ( #25962 )" ( #26176 )
...
This reverts commit 68692b3464
2022-06-28 17:07:07 -07:00
Simon Mo
68692b3464
[AIR][Serve] Rename ModelWrapperDeployment -> PredictorDeployment ( #25962 )
2022-06-28 10:26:10 -07:00
shrekris-anyscale
6092869ff3
[Serve] [Docs] Create end-to-end documentation example for Serve REST API and CLI ( #25936 )
2022-06-24 14:44:39 -07:00
shrekris-anyscale
97a9a20f74
[Serve] [Docs] Add Serve REST API Schema to Serve API Docs ( #25786 )
2022-06-24 14:06:26 -07:00
Sihan Wang
c0cf9b8098
[Serve][Doc] Autoscaling ( #25646 )
...
- new section of doc for autoscaling (introduction of serve autoscaling and config parameter)
- Remove the version requirement note inside the doc
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Co-authored-by: shrekris-anyscale <92341594+shrekris-anyscale@users.noreply.github.com>
Co-authored-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
2022-06-22 15:32:18 -05:00
Eric Liang
43aa2299e6
[api] Annotate as public / move ray-core APIs to _private and add enforcement rule ( #25695 )
...
Enable checking of the ray core module, excluding serve, workflows, and tune, in ./ci/lint/check_api_annotations.py. This required moving many files to ray._private and associated fixes.
2022-06-21 15:13:29 -07:00
Jiao
f6735f90c7
[Ray DAG] Move dag project folder out of experimental ( #25532 )
2022-06-16 19:15:39 -07:00
shrekris-anyscale
d944f7469c
[Serve] [Docs] Remove references to namespaces in the Serve documentation ( #25830 )
...
#25575 starts all Serve actors in the `"serve"` namespace. This change updates the Serve documentation to remove now-outdated explanations about namespaces and to specify that all Serve actors start in the `"serve"` namespace.
2022-06-16 10:50:49 -05:00
zcin
3f91cbd979
[serve][docs] Replaced term 'actor_init_options' with 'ray_actor_options' in documentation ( #25808 )
...
Replaced the term `actor_init_options` with `ray_actor_options` in [this documentation section](https://docs.ray.io/en/releases-1.13.0/serve/performance.html#choosing-the-right-hardware ) because `actor_init_options` is an outdated variable name. It's been changed to `ray_actor_options` in the [code](2546fbf99d/python/ray/serve/deployment.py (L45)
2022-06-15 15:21:24 -05:00
shrekris-anyscale
3278763dd7
[Serve] Start all Serve actors in the "serve" namespace only ( #25575 )
2022-06-13 10:31:28 -07:00
Sven Mika
ca10530a1a
[Serve; RLlib; Docs] Change terms in Serve+RLlib example (Trainer -> Algorithm). ( #25700 )
2022-06-13 11:43:38 +02:00
Simon Mo
271c7d73ac
[AIR][Serve] Add support for multi-modal array input ( #25609 )
2022-06-10 09:19:42 -07:00
Simon Mo
7471b1fa41
[Serve] [AIR] ModelWrapper improvements and docs ( #25003 )
...
* batching collation code and tests
* wip notebook for np and dataframe
* finish content
* reset ray-more-libs changes
* add comments
* run through
* Apply suggestions from code review
Co-authored-by: shrekris-anyscale <92341594+shrekris-anyscale@users.noreply.github.com>
* rename package
* lint
* richard's comment
Co-authored-by: shrekris-anyscale <92341594+shrekris-anyscale@users.noreply.github.com>
2022-06-07 08:53:10 -07:00
kimikuri
60f59bd804
[Serve] Fix misspell in Serve Doc User Guides. ( #25494 )
2022-06-06 13:00:20 -07:00
Jiao
aa965ba0a9
[Deployment Graph] Add visualization cookbook ( #25112 )
2022-06-06 11:05:58 -07:00
Sven Mika
b5bc2b93c3
[RLlib] Move all remaining algos into algorithms directory. ( #25366 )
2022-06-04 07:35:24 +02:00
Yi Cheng
fd0f967d2e
Revert "[RLlib] Move (A/DD)?PPO and IMPALA algos to algorithms dir and rename policy and trainer classes. ( #25346 )" ( #25420 )
...
This reverts commit e4ceae19ef#25346
linux://python/ray/tests:test_client_library_integration never fail before this PR.
In the CI of the reverted PR, it also fails (https://buildkite.com/ray-project/ray-builders-pr/builds/34079#01812442-c541-4145-af22-2a012655c128 ). So high likely it's because of this PR.
And test output failure seems related as well (https://buildkite.com/ray-project/ray-builders-branch/builds/7923#018125c2-4812-4ead-a42f-7fddb344105b )
2022-06-02 20:38:44 -07:00
Sihan Wang
3c9bd66485
[Serve][Doc] Add http endpoint for dag pattern doc ( #25390 )
2022-06-02 09:01:37 -07:00
Sven Mika
e4ceae19ef
[RLlib] Move (A/DD)?PPO and IMPALA algos to algorithms dir and rename policy and trainer classes. ( #25346 )
2022-06-02 16:47:05 +02:00
Yi Cheng
287892657b
Revert "[Serve][Doc] Add http endpoint for dag pattern doc ( #25243 )" ( #25388 )
...
This reverts commit 4ad75056eb
2022-06-02 02:40:09 +00:00
Sihan Wang
4ad75056eb
[Serve][Doc] Add http endpoint for dag pattern doc ( #25243 )
2022-06-01 11:30:42 -07:00
Naka Masato
897cb5d778
[Serve][Doc] Update batch.md to fix typo( #25270 )
2022-05-31 15:04:18 -07:00
Sihan Wang
4de3ce5c25
[Serve][Doc] Add deploy graph about control_flow_based_on_user_inputs pattern doc ( #24871 )
2022-05-25 15:38:23 -07:00
Sven Mika
09886d7ab8
[RLlib] Upgrade gym 0.23 ( #24171 )
2022-05-23 08:18:44 +02:00
Simon Mo
3513aa20d8
[Serve][Doc] Split core-apis to key concepts and user guide ( #24713 )
2022-05-20 10:56:34 -07:00
Simon Mo
9b2086c726
[Serve] Alias ray.serve.dag.InputNode ( #24630 )
2022-05-17 22:35:51 -07:00
Sihan Wang
830af1f14d
[Serve/Doc] Add combine nodes with same input in parallel pattern ( #24760 )
2022-05-16 11:00:54 -07:00
Edward Oakes
5685d2e0b6
[serve][docs] Rework landing page to match Tune's structure ( #24693 )
...
Updates the landing page to match the format and content of Tune's. Added some shorter quickstarts and sharpened up the messaging in our "Why choose Serve?" section, those are the main content changes.
I also moved all of the `doc_code` into one directory and added a bazel target that should run all of the examples added there. Split into a separate PR: https://github.com/ray-project/ray/pull/24736 .
2022-05-16 11:38:43 -05:00
Edward Oakes
f99aa5cb40
[serve][docs] Unify doc_code directories and add bazel target ( #24736 )
...
Split off from https://github.com/ray-project/ray/pull/24693/ , unifying the redundant directories we had and making sure all `serve/doc_code` snippets are run in CI.
2022-05-16 09:49:42 -05:00
Edward Oakes
fb71743935
[serve] Convert "End-to-end Tutorial" to "Getting Started" ( #24690 )
2022-05-12 08:44:43 -07:00
Sihan Wang
c5bfe1d694
[Serve] Add deployment graph cookbook ( #24524 )
2022-05-11 16:24:55 -07:00
Simon Mo
6760fe0121
[Serve][Doc] Convert Serve doc sources from rst to myst ( #24657 )
2022-05-10 14:04:17 -07:00
Simon Mo
21d76c4ca4
[Serve] Add short-hand for pydantic http adapter ( #24404 )
2022-05-04 09:43:18 -05:00
Archit Kulkarni
fa7a934bb9
[Doc] [Serve] Add note about relationship between serve autoscaler and ray autoscaler ( #24414 )
2022-05-03 13:54:19 -07:00
Simon Mo
3378e1924e
[Serve] Rename input_schema to http_adapter and clarify it in doc ( #24353 )
2022-04-29 16:14:04 -07:00
Simon Mo
ee528957c7
[Serve][Doc] Update docs about input schema, and json_request adapter ( #24191 )
2022-04-27 14:51:07 -07:00
Max Pumperla
553c8a85b6
[docs] [serve] Extended Gradio notebook example for Ray Serve deployments ( #23494 )
2022-04-27 10:03:28 -07:00
Edward Oakes
669b38a2d6
[serve] Make monitoring section top-level in the docs ( #23919 )
2022-04-18 14:46:41 -05:00
Archit Kulkarni
0673bde594
[Doc] [runtime env] [Serve] Update serve pip runtime_env doc ( #23792 )
2022-04-14 15:11:14 -05:00
Edward Oakes
de227ac407
[serve] Add component logger + basic access logging ( #23558 )
...
Adds a "component logger" to standardize logging across the HTTP proxy, controller, and deployment replicas.
2022-04-12 18:16:58 -05:00
shrekris-anyscale
071e1dd20f
[serve] Create deployment.py and deployment_graph.py ( #23578 )
...
`api.py` has accumulated classes and functions that aren't purely public APIs, causing circular dependencies. This change pulls `Deployment` and deployment graph-related features out of `api.py` and puts them in two new files: `deployment.py` and `deployment_graph.py`.
2022-04-01 13:40:13 -07:00
Jiao
d7e77fc9c5
[DAG] Serve Deployment Graph documentation and tutorial. ( #23512 )
2022-03-30 17:32:16 -07:00
Simon Mo
cb1919b8d0
[Doc][Serve] Add minimal docs for model wrappers and http adapters ( #23536 )
2022-03-29 11:33:14 -07:00
