2022-01-27 02:14:25 +01:00
|
|
|
Ray Serve API
|
|
|
|
|
=============
|
2020-06-15 18:47:59 -07:00
|
|
|
|
2021-03-17 09:39:54 -05:00
|
|
|
Core APIs
|
|
|
|
|
---------
|
2020-09-04 12:02:23 -05:00
|
|
|
.. autofunction:: ray.serve.start
|
2021-05-03 13:19:34 -05:00
|
|
|
.. autofunction:: ray.serve.deployment
|
|
|
|
|
.. autofunction:: ray.serve.list_deployments
|
|
|
|
|
.. autofunction:: ray.serve.get_deployment
|
|
|
|
|
.. autofunction:: ray.serve.shutdown
|
2020-06-15 18:47:59 -07:00
|
|
|
|
2021-05-03 13:19:34 -05:00
|
|
|
.. _`deployment-api`:
|
|
|
|
|
|
|
|
|
|
Deployment API
|
|
|
|
|
--------------
|
|
|
|
|
|
|
|
|
|
.. autoclass:: ray.serve.api.Deployment
|
|
|
|
|
:members: deploy, delete, options, get_handle
|
2020-06-15 18:47:59 -07:00
|
|
|
|
2020-12-28 10:19:36 -08:00
|
|
|
.. _`servehandle-api`:
|
|
|
|
|
|
|
|
|
|
ServeHandle API
|
|
|
|
|
---------------
|
2020-06-15 18:47:59 -07:00
|
|
|
.. autoclass:: ray.serve.handle.RayServeHandle
|
2020-09-04 12:02:23 -05:00
|
|
|
:members: remote, options
|
2020-06-15 18:47:59 -07:00
|
|
|
|
2020-09-04 12:02:23 -05:00
|
|
|
Batching Requests
|
|
|
|
|
-----------------
|
2021-05-11 03:23:58 -05:00
|
|
|
.. autofunction:: ray.serve.batch(max_batch_size=10, batch_wait_timeout_s=0.0)
|
2021-11-16 16:13:55 -08:00
|
|
|
|
|
|
|
|
Serve Pipeline API
|
|
|
|
|
------------------
|
|
|
|
|
|
|
|
|
|
.. autoclass:: ray.serve.pipeline.PipelineStep
|
|
|
|
|
|
|
|
|
|
.. autoclass:: ray.serve.pipeline.ExecutionMode
|
