hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-08 19:41:38 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
ray/streaming
History
Lingxuan Zuo f995099e00
[Streaming] Support streaming flow control (#7152) 
* streaming writer use event driven model.

* add RefreshChannelInfo

* fix name

* minor changes according reviewer comments

* Fix according to reviewer's comments

* fix bazel lint

* code polished

* Add more comments

* rename Stop & Start of EventQueue to Freeze and Unfreeze.

* add override

* fix

* fix return value

* support flow control

* add flow control ut in mock transfer

* minor changes according to comments

* add java and python worker adaption

Co-authored-by: wanxing <wanxing.wwx@alibaba-inc.com>
2020-02-24 23:48:04 +08:00
..
java [Streaming] Support streaming flow control (#7152) 2020-02-24 23:48:04 +08:00
python [Streaming] Support streaming flow control (#7152) 2020-02-24 23:48:04 +08:00
src [Streaming] Support streaming flow control (#7152) 2020-02-24 23:48:04 +08:00
BUILD.bazel fix symbols conflict and add symbols check (#7227) 2020-02-20 19:31:16 +08:00
README.md [Streaming] Streaming data transfer java (#6474) 2019-12-22 10:56:05 +08:00

README.md

Ray Streaming

  1. Build streaming java

    • build ray
      • bazel build //java:gen_maven_deps
      • cd java && mvn clean install -Dmaven.test.skip=true && cd ..
    • build streaming
      • bazel build //streaming/java:gen_maven_deps
      • mvn clean install -Dmaven.test.skip=true

  2. Build ray python will build ray streaming python.

  3. Run examples

    # c++ test
cd streaming/ && bazel test ...
sh src/test/run_streaming_queue_test.sh
cd ..

# python test
pushd python/ray/streaming/
pushd examples
python simple.py --input-file toy.txt
popd
pushd tests
pytest .
popd
popd

# java test
cd streaming/java/streaming-runtime
mvn test