hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 18:41:40 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
ray/streaming/python
History
Chaokun Yang 6272907a57 [Streaming] Streaming data transfer and python integration (#6185)
2019-12-10 20:33:24 +08:00
..
examples [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
includes [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
runtime [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
tests [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
__init__.pxd [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
__init__.py [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
_streaming.pyx [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
communication.py [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
config.py [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
jobworker.py [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
operator.py [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
processor.py [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
README.rst [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00
streaming.py [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00

README.rst 

Streaming Library
=================

Dependencies:

Install NetworkX: ``pip install networkx``

Examples:

- simple.py: A simple example with stateless operators and different parallelism per stage.

Run ``python simple.py --input-file toy.txt``

- wordcount.py: A streaming wordcount example with a stateful operator (rolling sum).

Run ``python wordcount.py --titles-file articles.txt``