mirror of
https://github.com/vale981/ray
synced 2025-03-10 05:16:49 -04:00
38 lines
1,004 B
ReStructuredText
38 lines
1,004 B
ReStructuredText
Package Reference
|
|
=================
|
|
|
|
Basic APIs
|
|
----------
|
|
.. autofunction:: ray.serve.init
|
|
.. autofunction:: ray.serve.shutdown
|
|
.. autofunction:: ray.serve.create_backend
|
|
.. autofunction:: ray.serve.create_endpoint
|
|
|
|
|
|
APIs for Managing Endpoints
|
|
---------------------------
|
|
.. autofunction:: ray.serve.list_endpoints
|
|
.. autofunction:: ray.serve.delete_endpoint
|
|
.. autofunction:: ray.serve.set_traffic
|
|
.. autofunction:: ray.serve.shadow_traffic
|
|
|
|
|
|
APIs for Managing Backends
|
|
--------------------------
|
|
.. autofunction:: ray.serve.list_backends
|
|
.. autofunction:: ray.serve.delete_backend
|
|
.. autofunction:: ray.serve.get_backend_config
|
|
.. autofunction:: ray.serve.update_backend_config
|
|
|
|
Advanced APIs
|
|
-------------
|
|
|
|
``serve.get_handle`` enables calling endpoints from Python.
|
|
|
|
.. autofunction:: ray.serve.get_handle
|
|
.. autoclass:: ray.serve.handle.RayServeHandle
|
|
|
|
|
|
``serve.accept_batch`` marks your backend API does accept list of input instead
|
|
of just single input.
|
|
.. autofunction:: ray.serve.accept_batch
|