mirror of
https://github.com/vale981/ray
synced 2025-03-08 19:41:38 -05:00
f995099e00
* streaming writer use event driven model. * add RefreshChannelInfo * fix name * minor changes according reviewer comments * Fix according to reviewer's comments * fix bazel lint * code polished * Add more comments * rename Stop & Start of EventQueue to Freeze and Unfreeze. * add override * fix * fix return value * support flow control * add flow control ut in mock transfer * minor changes according to comments * add java and python worker adaption Co-authored-by: wanxing <wanxing.wwx@alibaba-inc.com> |
||
|---|---|---|
| .. | ||
| examples | ||
| includes | ||
| runtime | ||
| tests | ||
| __init__.pxd | ||
| __init__.py | ||
| _streaming.pyx | ||
| communication.py | ||
| config.py | ||
| jobworker.py | ||
| operator.py | ||
| processor.py | ||
| README.rst | ||
| streaming.py | ||
Streaming Library ================= Dependencies: Install NetworkX: ``pip install networkx`` Examples: - simple.py: A simple example with stateless operators and different parallelism per stage. Run ``python simple.py --input-file toy.txt`` - wordcount.py: A streaming wordcount example with a stateful operator (rolling sum). Run ``python wordcount.py --titles-file articles.txt``