hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
652 commits 227 branches 67 tags 234 MiB
Commit graph

652 commits

This branch
This branch
All branches
Author SHA1 Message Date
Robert Nishihara
1b22b54cfc Merge pull request #4 from pcmoritz/python 
Python library for plasma
 2016-08-16 15:43:02 -07:00
Philipp Moritz
535f4403e4 add python client 2016-08-16 15:38:45 -07:00
Robert Nishihara
29f0489b6e Remove directories as well with make clean. 2016-08-16 15:06:29 -07:00
Robert Nishihara
88a14870df Merge pull request #5 from pcmoritz/cleanup 
Clean up and add client
 2016-08-16 15:04:30 -07:00
Philipp Moritz
7a18347b5c cleanup 2016-08-16 15:00:01 -07:00
Robert Nishihara
314bc9e980 Test blocking behavior of select. (#379) 2016-08-16 14:54:54 -07:00
Robert Nishihara
e06311d415 Automatically add relevant directories to Python paths of workers (#380) 
* Make ray.init set python paths of workers.

* Decouple starting cluster from copying user source code

* also add current directory to path

* Add comments about deallocation.

* Add test for new code path.
 2016-08-16 14:53:55 -07:00
Philipp Moritz
c01e99284a Merge pull request #1 from pcmoritz/readme 
Add readme
 2016-08-15 18:48:36 -07:00
Wapaul1
7246013008 Implement select to enable waiting for a specific number of remote objects to be ready. (#369) 2016-08-15 16:51:59 -07:00
Robert Nishihara
b29fc0c481 Use random string for worker c++ logfile. (#378) 2016-08-15 15:55:34 -07:00
Robert Nishihara
e94ed2fc97 Throw fatal error when attempting to send message on full queue. (#377) 2016-08-15 11:51:23 -07:00
Robert Nishihara
87bb7a8f67 [WIP] Large changes to make the tests pass. (#376) 
* Revert "Make tests more informative (#372)"

This reverts commit fd353250c8.

* fix bugs, in particular deactivate worker service on driver and remove condition variables

* changes to minimize the changes in this PR

* switch from faulty mutex synchronization to using atomics

* Increase the default size of the message queues, to accommodate exporting large numbers of remote functions. This is a temporary fix, but not a long term solution.

* Reorganize the scheduler export code to queue up exports. This does not solve the underlying problem yet, but sets up a solution.

* Start a separate thread on driver to print error messages by constantly querying the scheduler. This is a temporary solution because the solution based on starting a worker service for the driver which the scheduler can push error messages to is buggy.

* Fix segfault in taskcapsule destructor.

* Move tests for catching errors into a separate test file.

* Revert "roll back grpc (#368)"

This reverts commit c01ef95d04.
 2016-08-15 11:02:54 -07:00
Philipp Moritz
504044c033 Merge pull request #2 from pcmoritz/travis 
Minimal travis file
 2016-08-14 01:51:53 -07:00
Robert Nishihara
e5ecd497f3 minimal travis file 2016-08-14 01:49:58 -07:00
Robert Nishihara
ff13386659 Merge pull request #3 from pcmoritz/initial 
Initial plasma commit
 2016-08-14 01:47:38 -07:00
Philipp Moritz
97087b0791 initial version of object store 2016-08-14 01:39:44 -07:00
Robert Nishihara
81bfd8c201 add readme 2016-08-13 15:24:01 -07:00
Philipp Moritz
68056dafb1 Initial commit 2016-08-13 15:20:19 -07:00
Robert Nishihara
fd353250c8 Make tests more informative (#372) 
* Make tests more informative

* Change grpc status checks to warning instead of fatal
 2016-08-11 12:40:55 -07:00
Philipp Moritz
b0ecff69ad Check for GRPC status codes (#366) 
* check for GRPC status codes

* more checkss
 2016-08-11 11:10:00 -07:00
Wapaul1
362ffa1f3c Changing hard coded ports for objstore and workers to choose unused ports (#365) 
* let grpc choose unused worker and object store ports

* Add objstore addresses to scheduler info to bring back test
 2016-08-10 19:08:38 -07:00
Robert Nishihara
fbc49410ec properly shutdown worker service thread (#367) 2016-08-10 16:53:24 -07:00
Philipp Moritz
c01ef95d04 roll back grpc (#368) 2016-08-10 16:45:40 -07:00
Johann Schleier-Smith
d8dd9de81b remove verbose flag in tar (#363) 2016-08-09 13:43:25 -07:00
Philipp Moritz
9903fc0335 Improve error message for serialization of custom objects (#359) 
* Improve error message for serialization of custom objects

* gitignore numbuf build directory
 2016-08-09 13:38:21 -07:00
Robert Nishihara
ac36cd6dcd remove protobuf version from pip install and add instructions for adding Ray to path (#362) 2016-08-09 12:09:06 -07:00
Johann Schleier-Smith
149c13913a ignoring build output and example datasets (#360) 2016-08-09 11:30:33 -07:00
Johann Schleier-Smith
4d5f85e77c Fix Travis failure detection on Mac + testing enhancements (#358) 
* properly handle failure in continuous integration

* add stack overflow reference
 2016-08-08 18:02:52 -07:00
Philipp Moritz
7b548bddd3 gitignore build directory 2016-08-08 17:58:44 -07:00
Philipp Moritz
b6b2b03950 throw proper error if numpy array that contains object is serialized 2016-08-08 16:29:59 -07:00
Robert Nishihara
13df8302e6 enable running example apps in cluster mode (#357) 2016-08-08 16:01:13 -07:00
Robert Nishihara
feee1de56f run runtest.py in mac os x (#356) 2016-08-07 13:53:56 -07:00
Robert Nishihara
a1e4268d37 Catch errors in importing reusable variables and remote functions (#354) 
* catch errors in importing reusable variables and remote functions

* updates
 2016-08-07 13:53:33 -07:00
Robert Nishihara
a6452aca47 Command for installing example applications dependencies on cluster (#353) 2016-08-05 14:54:32 -07:00
Robert Nishihara
1454c26693 fix bug with home directory on cluster (#352) 2016-08-05 11:49:11 -07:00
Philipp Moritz
8bf877ac1e Serialize and Deserialize unicode (#349) 2016-08-04 21:06:31 -07:00
Robert Nishihara
ac363bf451 Let worker get worker address and object store address from scheduler (#350) 2016-08-04 17:47:08 -07:00
Robert Nishihara
b71f064f3e small documentation fixes (#348) 2016-08-04 17:39:14 -07:00
Philipp Moritz
8e165d43d4 Implement unicode serialization 2016-08-04 15:34:47 -07:00
Johann Schleier-Smith
3ee0fd8f34 Update cluster guide (#347) 
* clarify cluster setup instructions

* update multinode documentation, update cluster script, fix minor bug in worker.py

* clarify cluster documentation and fix update_user_code
 2016-08-04 09:14:20 -07:00
Robert Nishihara
de200ff912 better error messages when composing remote functions (#339) 
Better error messages when composing remote functions
 2016-08-03 16:47:13 -07:00
Robert Nishihara
07baf44f26 only display failed task information for new tasks, remove SHELL_MODE (#344) 2016-08-02 17:59:42 -07:00
Johann Schleier-Smith
583df08957 Docker builds on Travis (#343) 
* attempt to build on travis using docker

* run tests in foreground

* add examples to travis tests

* test from current checkout

* attempt to fix docker version issues

* try build with xenial

* attempt docker upgrade

* avoid hang on configuration files

* matrix osx and linux w/ docker

* restore non-test docker builds

* fix typo

* tuning and cleanup

* add missing file

* comment cleanup
 2016-08-02 17:03:28 -07:00
Robert Nishihara
33d03e56db update tutorial (#342) 2016-08-02 16:47:22 -07:00
Philipp Moritz
0ac4e29b1f clean up tests (#340) 2016-08-02 16:11:53 -07:00
Philipp Moritz
eae27f23ac TRPO example (#336) 2016-08-01 18:40:34 -07:00
Robert Nishihara
1d6977b2b8 add Pong example to README (#337) 2016-08-01 18:29:04 -07:00
Robert Nishihara
c27e6c076c Make sure no Python modules mutually import each other. (#334) 2016-08-01 17:55:38 -07:00
Wapaul1
96a70e1316 Changed equality to None in worker.py to use is keyword (#335) 2016-08-01 16:56:54 -07:00
Johann Schleier-Smith
79e4a5a00e Ray with Docker (#324) 
* Ray with Docker

* cleanup based on comments

* rename docker user to ray-user

* add examples docker image

* working toward reliable Docker devel image

* adjust ray-user uid for Linux builds on AWS

* update documentation

* reduced dependencies for examples

* updated Docker documentation

* experimental notice on developing with Docker
 2016-08-01 16:44:11 -07:00