ray/streaming/python
2020-02-08 13:01:28 +08:00
..
examples Remove future imports (#6724) 2020-01-09 00:15:48 -08:00
includes [xlang] Cross language Python support (#6709) 2020-02-08 13:01:28 +08:00
runtime [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
tests [xlang] Cross language Python support (#6709) 2020-02-08 13:01:28 +08:00
__init__.pxd [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
__init__.py [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
_streaming.pyx [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
communication.py Remove future imports (#6724) 2020-01-09 00:15:48 -08:00
config.py [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
jobworker.py [xlang] Cross language Python support (#6709) 2020-02-08 13:01:28 +08:00
operator.py Remove future imports (#6724) 2020-01-09 00:15:48 -08:00
processor.py Remove future imports (#6724) 2020-01-09 00:15:48 -08:00
README.rst [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
streaming.py Remove future imports (#6724) 2020-01-09 00:15:48 -08:00

Streaming Library
=================

Dependencies:

Install NetworkX: ``pip install networkx``

Examples:

- simple.py: A simple example with stateless operators and different parallelism per stage.

Run ``python simple.py --input-file toy.txt``

- wordcount.py: A streaming wordcount example with a stateful operator (rolling sum).

Run ``python wordcount.py --titles-file articles.txt``