No description
Find a file
Stephanie Wang ee08c8274b Shard Redis. (#539)
* Implement sharding in the Ray core

* Single node Python modifications to do sharding

* Do the sharding in redis.cc

* Pipe num_redis_shards through start_ray.py and worker.py.

* Use multiple redis shards in multinode tests.

* first steps for sharding ray.global_state

* Fix problem in multinode docker test.

* fix runtest.py

* fix some tests

* fix redis shard startup

* fix redis sharding

* fix

* fix bug introduced by the map-iterator being consumed

* fix sharding bug

* shard event table

* update number of Redis clients to be 64K

* Fix object table tests by flushing shards in between unit tests

* Fix local scheduler tests

* Documentation

* Register shard locations in the primary shard

* Add plasma unit tests back to build

* lint

* lint and fix build

* Fix

* Address Robert's comments

* Refactor start_ray_processes to start Redis shard

* lint

* Fix global scheduler python tests

* Fix redis module test

* Fix plasma test

* Fix component failure test

* Fix local scheduler test

* Fix runtest.py

* Fix global scheduler test for python3

* Fix task_table_test_and_update bug, from actor task table submission race

* Fix jenkins tests.

* Retry Redis shard connections

* Fix test cases

* Convert database clients to DBClient struct

* Fix race condition when subscribing to db client table

* Remove unused lines, add APITest for sharded Ray

* Fix

* Fix memory leak

* Suppress ReconstructionTests output

* Suppress output for APITestSharded

* Reissue task table add/update commands if initial command does not publish to any subscribers.

* fix

* Fix linting.

* fix tests

* fix linting

* fix python test

* fix linting
2017-05-18 17:40:41 -07:00
.travis Run flake8 in Travis and make code PEP8 compliant. (#387) 2017-03-21 12:57:54 -07:00
cmake/Modules help cmake find right python interpreter on mac (#251) 2016-07-11 12:16:10 -07:00
doc Do not start web UI by default, and remove web UI from documentation. (#554) 2017-05-16 19:29:07 -07:00
docker Use flatbuffers for some messages from Redis. (#341) 2017-03-10 18:35:25 -08:00
examples Added python2 support and check for outdated tf (#562) 2017-05-17 20:42:17 -07:00
python Shard Redis. (#539) 2017-05-18 17:40:41 -07:00
scripts Shard Redis. (#539) 2017-05-18 17:40:41 -07:00
src Shard Redis. (#539) 2017-05-18 17:40:41 -07:00
test Shard Redis. (#539) 2017-05-18 17:40:41 -07:00
vsprojects Windows compatibility (#57) 2016-11-22 17:04:24 -08:00
webui Run flake8 in Travis and make code PEP8 compliant. (#387) 2017-03-21 12:57:54 -07:00
.clang-format Implement object table notification subscriptions and switch to using Redis modules for object table. (#134) 2016-12-18 18:19:02 -08:00
.editorconfig Update Windows support (#317) 2016-07-28 13:11:13 -07:00
.gitignore Fix segmentation fault when calling ray.put on a dictionary with object keys (#548) 2017-05-15 01:09:13 -07:00
.travis.yml Make example applications pep8 compliant. (#553) 2017-05-16 14:12:18 -07:00
build-docker.sh Fix build-docker.sh bug (#515) 2017-05-06 18:57:08 -07:00
build.sh Parallelize make in build.sh. (#371) 2017-03-27 20:55:50 -07:00
CMakeLists.txt Rename photon -> local scheduler. (#322) 2017-02-27 12:24:07 -08:00
LICENSE Change license to Apache 2 (#20) 2016-11-01 23:19:06 -07:00
pylintrc adding pylint (#233) 2016-07-08 12:39:11 -07:00
Ray.sln Windows compatibility (#57) 2016-11-22 17:04:24 -08:00
README.rst Expand API documentation. (#375) 2017-03-17 16:48:25 -07:00

Ray
===

.. image:: https://travis-ci.org/ray-project/ray.svg?branch=master
    :target: https://travis-ci.org/ray-project/ray

.. image:: https://readthedocs.org/projects/ray/badge/?version=latest
    :target: http://ray.readthedocs.io/en/latest/?badge=latest

|

Ray is a flexible, high-performance distributed execution framework.

View the `documentation`_.

.. _`documentation`: http://ray.readthedocs.io/en/latest/index.html