ray/streaming
mehrdadn a87199d240
Fix cyclic dependency between ray/util and ray/common (#7581)
* Fix cyclic dependency

Headers in ray/util should not depend on those in ray/common

* Move random generations to ray/common/test_util.h

* Add license header

Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
2020-03-14 12:44:53 -07:00
..
java [Java] Enable direct call by default. (#7408) 2020-03-13 12:25:30 +08:00
python [core] Ref counting for actor handles (#7434) 2020-03-10 17:45:07 -07:00
src Fix cyclic dependency between ray/util and ray/common (#7581) 2020-03-14 12:44:53 -07:00
BUILD.bazel Windows changes (#7315) 2020-02-27 15:14:10 -08:00
README.md [Streaming] Streaming data transfer java (#6474) 2019-12-22 10:56:05 +08:00

Ray Streaming

  1. Build streaming java

    • build ray
      • bazel build //java:gen_maven_deps
      • cd java && mvn clean install -Dmaven.test.skip=true && cd ..
    • build streaming
      • bazel build //streaming/java:gen_maven_deps
      • mvn clean install -Dmaven.test.skip=true
  2. Build ray python will build ray streaming python.

  3. Run examples

    # c++ test
    cd streaming/ && bazel test ...
    sh src/test/run_streaming_queue_test.sh
    cd ..
    
    # python test
    pushd python/ray/streaming/
    pushd examples
    python simple.py --input-file toy.txt
    popd
    pushd tests
    pytest .
    popd
    popd
    
    # java test
    cd streaming/java/streaming-runtime
    mvn test