ray/python
alindkhare 76e678d775 [Serve] Added deadline awareness (#6442)
* [Serve] Added deadline awareness

Added deadline awareness while enqueuing a query
Using Blist sorted-list implementation (ascending order) to get queries according to their specified deadlines. [buffer_queues]
Exposed slo_ms via handle/http request
Added slo example 
The queries in example will be executed in almost the opposite order of which they are fired
Added slo pytest
Added check for slo_ms to not be negative
Included the changes suggested

* Linting Corrections

* Adding the code changes suggested by format.sh

* Added the suggested changes

Added justification for blist
Added blist in travis/ci/install-dependencies.sh

* Fixed linting issues

* Added blist to ray/doc/requirements-doc.txt
2019-12-11 16:41:54 -08:00
..
ray [Serve] Added deadline awareness (#6442) 2019-12-11 16:41:54 -08:00
asv.conf.json [asv] Pushing to s3 (#2246) 2018-06-20 10:43:44 -07:00
build-wheel-macos.sh Build dashboard only once in the wheel build and make sure caching is working for wheel builds (#5784) 2019-10-02 16:29:11 -07:00
build-wheel-manylinux1.sh Build dashboard only once in the wheel build and make sure caching is working for wheel builds (#5784) 2019-10-02 16:29:11 -07:00
README-building-wheels.md fix wheel building doc (#4360) 2019-03-13 23:11:30 -07:00
setup.py [Serve] Added deadline awareness (#6442) 2019-12-11 16:41:54 -08:00