Commit graph

44 commits

Author SHA1 Message Date
Edward Oakes
669b38a2d6
[serve] Make monitoring section top-level in the docs (#23919) 2022-04-18 14:46:41 -05:00
Edward Oakes
de227ac407
[serve] Add component logger + basic access logging (#23558)
Adds a "component logger" to standardize logging across the HTTP proxy, controller, and deployment replicas.
2022-04-12 18:16:58 -05:00
shrekris-anyscale
891301ff54
[serve] [docs] Add tip about serve status (#23481)
The `serve status` command allows users to get their deployments' status info through the CLI. This change adds a tip to the health-checking documentation to inform users about `serve status`.
2022-03-25 13:36:15 -05:00
Archit Kulkarni
76bb5396c7
[Doc] [jobs] Add links to Job Submission and improve doc (#23209)
- Adds links to Job Submission from existing library tutorials where `ray submit` is used.  When Jobs becomes GA, we should fully replace the uses of `ray submit` with Ray job submission and ensure this is tested.
- Adds docstrings for the Jobs SDK, which automatically show up in the API reference
- Improve the Job Submission main page
- Add a "Deployment Guide" landing page explaining when to use Ray Client vs Ray Jobs

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2022-03-18 12:52:13 -05:00
Edward Oakes
49b3e6c53c
[serve] Support user-provided health check via def check_health(self) method (#22178) 2022-02-11 12:53:37 -06:00
shrekris-anyscale
03d93ba7ee
Add a new End-to-End tutorial in Serve that walks users through deploying a model (#20765)
Currently, the docs have an [end-to-end tutorial](https://web.archive.org/web/20211122152843/https://docs.ray.io/en/latest/serve/tutorial.html) walking users through deploying a `Counter` function on Serve. This PR adds an end-to-end tutorial walking users through deploying an entire Hugging Face model using Serve, providing a better understanding of how to deploy an actual model via Serve.

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
2022-01-24 16:36:04 -06:00
xwjiang2010
9af8f11191
Revert "[docs] Clean up doc structure (first part) (#21667)" (#21763)
This reverts commit 38e46c9fb3.
2022-01-20 15:30:56 -08:00
Max Pumperla
38e46c9fb3
[docs] Clean up doc structure (first part) (#21667) 2022-01-20 16:19:04 +01:00
Hankpipi
97d3142c59
[Serve] Fix naming error and add Serve metric for HTTP error codes (#21009) 2021-12-16 09:48:03 -08:00
architkulkarni
765e8d8d53
[Serve] [Doc] fix custom metric link in serve doc (#20775) 2021-12-01 16:39:22 -07:00
Simon Mo
18d605fa7c
[Serve] Add experimental CLI for serve deploy (#20371) 2021-11-16 20:22:09 -08:00
Tricia Fu
e59c14117f
[Doc] [Serve] Add summary sub header to each page (#20231) 2021-11-12 14:18:42 -08:00
Tobias Kaymak
893f57591d
[serve] Add Google Cloud Storage as a backend (#20104) 2021-11-10 19:45:19 -08:00
Edward Oakes
082a4af3e6
[serve] Remove lingering backend/endpoint wording in docs (#20229) 2021-11-10 16:49:29 -08:00
Simon Mo
30d9f8fbae
[Doc] [Serve] Fix code cutoff and broken linkes in deployment.rst (#19573) 2021-10-21 13:47:55 -07:00
Simon Mo
32e648e5fa
[Serve][Doc] Add Failure Recovery Doc (#19166) 2021-10-21 13:32:42 -07:00
Duarte OC
5af6152e76
[Serve] [Doc] Update docs with import missing (#19469) 2021-10-19 11:23:50 -07:00
architkulkarni
1ee3b4136c
[Serve] [Doc] Serve fix tracing snippet (#19296) 2021-10-11 16:59:04 -07:00
Nikita Vemuri
a9c731edd3
[serve] Remove requirement to specify namespace for serve.start(detached=True) (#17470) 2021-08-25 10:39:32 -05:00
Edward Oakes
839ceba6db
[serve] Replace "backend" with "deployment" in metrics & logging (#17434) 2021-08-05 17:37:21 -05:00
Edward Oakes
d69e51f769
[serve] Update kubernetes docs to specify a namespace (#16786) 2021-07-01 14:36:07 -05:00
Edward Oakes
c9550a86dc
[serve] Update docs for v2 Deployments API (#15582) 2021-05-03 13:19:34 -05:00
Jayce Li
b2f9c48647
doc: Fix ray serve in Deploying on Kubernetes (#15208) 2021-04-09 09:08:05 -07:00
architkulkarni
03afaed6e1
[Serve] [Doc] Create top-level page for Calling Endpoints from HTTP and from Python (#14904) 2021-03-24 20:29:24 -05:00
Edward Oakes
aab7ccc466
[serve] Deprecate client-based API in favor of process-wide singleton (#14696) 2021-03-17 09:39:54 -05:00
Edward Oakes
d90cd545d1
[serve] Deprecate system-level batching with warning, update the docs (#14648) 2021-03-15 13:47:01 -05:00
architkulkarni
505d2b6abe
[Serve] [Doc] Add small dashboard section under Serve Monitoring (#14328) 2021-03-08 20:41:42 -06:00
architkulkarni
f9364b1d5c
[Serve] Add logger with backend and replica tags (#14251) 2021-02-26 12:46:19 -08:00
Simon Mo
af085ed8aa
[Serve] Add Perf Tuning Doc (#14334)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Co-authored-by: architkulkarni <architkulkarni@users.noreply.github.com>
2021-02-26 10:28:02 -08:00
Edward Oakes
019d84a9f3
[serve] [docs] High-level reorganization of the docs (#14120) 2021-02-16 14:07:56 -06:00
javi-redondo
b8b2d6410d
[docs] new Ray Cluster documentation (#13839)
Co-authored-by: Javier Redondo <javier@anyscale.com>
Co-authored-by: AmeerHajAli <ameerh@berkeley.edu>
2021-02-15 00:47:14 -08:00
Edward Oakes
5d882b062d
[Serve] fix k8s doc (#13713) 2021-01-26 10:09:13 -08:00
Simon Mo
39813ff6b0
[Serve] HTTPOptions for deployment modes (#13142) 2021-01-05 16:41:52 -08:00
herve-alanaai
436202bcfd
[docs] Fix typos in documentation (#11414) 2020-10-15 17:00:48 -07:00
Edward Oakes
786f12edfd
[serve] Serve client refactor (#10409) 2020-09-04 12:02:23 -05:00
Eric Liang
e5d089384b
[1.0] Ray whitepaper link and tagline update (#10455) 2020-09-01 09:48:35 -07:00
Simon Mo
6b93ad11d0
[Doc] Add Architecture Doc for Ray Serve (#10204) 2020-08-20 11:40:47 -07:00
Arya Irani
f733d2648b
[docs] fix typo in deployment.rst (#10074)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-18 00:05:18 -07:00
Richard Liaw
56d934bc18
[docs] Revised Cluster documentation (#9062)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-26 09:29:22 -07:00
Simon Mo
1a1ddc74c4
[Serve] Add package reference and links keyword to docstring (#8955) 2020-06-15 18:47:59 -07:00
Edward Oakes
5d124489a9
[serve] Require backend when creating endpoint (#8764) 2020-06-06 21:10:42 -05:00
Edward Oakes
0306e4d589
[serve] Refer to serve "instances," not "clusters" (#8746) 2020-06-02 15:16:29 -07:00
Edward Oakes
5bec951ece
[docs] [serve] Deployment as a service on k8s docs (#8663) 2020-05-29 14:53:42 -07:00
Bill Chambers
fadd47e44e
[docs] Ray Serve Documentation Overhaul (#8524) 2020-05-27 11:03:28 -05:00