ray/streaming
2020-12-04 14:33:45 +08:00
..
java [Java] Simplify Ray.init() by invoking ray start internally (#10762) 2020-12-04 14:33:45 +08:00
python [Streaming] refine streaming tests sleep condition (#10991) 2020-09-24 17:06:55 +08:00
src [Core] Multi-tenancy: Pass job ID from Raylet to worker via env variable (#11829) 2020-11-09 11:02:15 -08:00
BUILD.bazel add streaming data writer unit tests (#11387) 2020-10-16 14:42:44 +08:00
README.md [Streaming] Streaming data transfer java (#6474) 2019-12-22 10:56:05 +08:00

Ray Streaming

  1. Build streaming java

    • build ray
      • bazel build //java:gen_maven_deps
      • cd java && mvn clean install -Dmaven.test.skip=true && cd ..
    • build streaming
      • bazel build //streaming/java:gen_maven_deps
      • mvn clean install -Dmaven.test.skip=true
  2. Build ray python will build ray streaming python.

  3. Run examples

    # c++ test
    cd streaming/ && bazel test ...
    sh src/test/run_streaming_queue_test.sh
    cd ..
    
    # python test
    pushd python/ray/streaming/
    pushd examples
    python simple.py --input-file toy.txt
    popd
    pushd tests
    pytest .
    popd
    popd
    
    # java test
    cd streaming/java/streaming-runtime
    mvn test