hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
394 commits 227 branches 67 tags 234 MiB
Commit graph

394 commits

This branch
This branch
All branches
Author SHA1 Message Date
Richard Shin
efb61ca9c7 Return scheduler address in ray.init (#403) 2016-09-03 18:25:47 -07:00
Richard Shin
a5df45a92e Describe the object which wasn't serializable (#404) 2016-09-03 18:10:03 -07:00
Richard Shin
6f2ed775a2 Allow arbitrary bytes in types.String (#405) 2016-09-03 18:05:09 -07:00
Richard Shin
80fdfcd1a5 Check num_objstores > 0 in start_ray_local (#402) 2016-09-03 17:37:06 -07:00
Philipp Moritz
3548797202 [API] Implement get for multiple objects (#398) 
* [API] Implement get for multiple objects

* Small fixes.
 2016-09-02 18:02:44 -07:00
Stephanie Wang
b6872182bf Add hiredis to build (#395) 
* Add hiredis to build

* make hiredis build if ray has been cloned before this commit
 2016-09-01 20:15:00 -07:00
Philipp Moritz
75555ee25c Remove type information from remote decorator. (#394) 
* Remove type information from remote decorator.

* Remove typing module.

* Fix failure_test.py.

* Allow remote decorator to be used with no parentheses.

* Fix documentation.
 2016-08-30 18:34:25 -07:00
Robert Nishihara
5cf1d60cb2 Fix documentation. 2016-08-30 17:20:00 -07:00
Robert Nishihara
fb7ccef493 Allow remote decorator to be used with no parentheses. 2016-08-30 16:38:26 -07:00
Robert Nishihara
ce4e5ec544 Fix failure_test.py. 2016-08-29 22:52:13 -07:00
Robert Nishihara
b87912cb2f Remove typing module. 2016-08-29 22:16:19 -07:00
Robert Nishihara
d7f313a026 Remove type information from remote decorator. 2016-08-29 22:05:59 -07:00
Philipp Moritz
93e6c9947b update numbuf (#392) 
* update numbuf

* Augment serialization tests.
 2016-08-25 20:05:48 -07:00
Wapaul1
420bcc0477 Remote function returning non-serializable type no longer shuts worker down (#384) 
* Moved put_objects in main_loop to inside of try block

* Added test for failed serialization

* Fixed naming

* Minor
 2016-08-25 15:26:22 -07:00
Robert Nishihara
43452b9ab3 Try grpc version 1.0 (#386) 2016-08-23 19:29:18 -07:00
Robert Nishihara
b1db890cd8 Export GRPC environment variable in Python instead of in setup-env.sh (#382) 
* Export GRPC logging environment variable in Python.

* Don't wipe PYTHONPATH in setup-env.sh
 2016-08-18 15:39:19 -07:00
Robert Nishihara
314bc9e980 Test blocking behavior of select. (#379) 2016-08-16 14:54:54 -07:00
Robert Nishihara
e06311d415 Automatically add relevant directories to Python paths of workers (#380) 
* Make ray.init set python paths of workers.

* Decouple starting cluster from copying user source code

* also add current directory to path

* Add comments about deallocation.

* Add test for new code path.
 2016-08-16 14:53:55 -07:00
Wapaul1
7246013008 Implement select to enable waiting for a specific number of remote objects to be ready. (#369) 2016-08-15 16:51:59 -07:00
Robert Nishihara
b29fc0c481 Use random string for worker c++ logfile. (#378) 2016-08-15 15:55:34 -07:00
Robert Nishihara
e94ed2fc97 Throw fatal error when attempting to send message on full queue. (#377) 2016-08-15 11:51:23 -07:00
Robert Nishihara
87bb7a8f67 [WIP] Large changes to make the tests pass. (#376) 
* Revert "Make tests more informative (#372)"

This reverts commit fd353250c8.

* fix bugs, in particular deactivate worker service on driver and remove condition variables

* changes to minimize the changes in this PR

* switch from faulty mutex synchronization to using atomics

* Increase the default size of the message queues, to accommodate exporting large numbers of remote functions. This is a temporary fix, but not a long term solution.

* Reorganize the scheduler export code to queue up exports. This does not solve the underlying problem yet, but sets up a solution.

* Start a separate thread on driver to print error messages by constantly querying the scheduler. This is a temporary solution because the solution based on starting a worker service for the driver which the scheduler can push error messages to is buggy.

* Fix segfault in taskcapsule destructor.

* Move tests for catching errors into a separate test file.

* Revert "roll back grpc (#368)"

This reverts commit c01ef95d04.
 2016-08-15 11:02:54 -07:00
Robert Nishihara
fd353250c8 Make tests more informative (#372) 
* Make tests more informative

* Change grpc status checks to warning instead of fatal
 2016-08-11 12:40:55 -07:00
Philipp Moritz
b0ecff69ad Check for GRPC status codes (#366) 
* check for GRPC status codes

* more checkss
 2016-08-11 11:10:00 -07:00
Wapaul1
362ffa1f3c Changing hard coded ports for objstore and workers to choose unused ports (#365) 
* let grpc choose unused worker and object store ports

* Add objstore addresses to scheduler info to bring back test
 2016-08-10 19:08:38 -07:00
Robert Nishihara
fbc49410ec properly shutdown worker service thread (#367) 2016-08-10 16:53:24 -07:00
Philipp Moritz
c01ef95d04 roll back grpc (#368) 2016-08-10 16:45:40 -07:00
Johann Schleier-Smith
d8dd9de81b remove verbose flag in tar (#363) 2016-08-09 13:43:25 -07:00
Philipp Moritz
9903fc0335 Improve error message for serialization of custom objects (#359) 
* Improve error message for serialization of custom objects

* gitignore numbuf build directory
 2016-08-09 13:38:21 -07:00
Robert Nishihara
ac36cd6dcd remove protobuf version from pip install and add instructions for adding Ray to path (#362) 2016-08-09 12:09:06 -07:00
Johann Schleier-Smith
149c13913a ignoring build output and example datasets (#360) 2016-08-09 11:30:33 -07:00
Johann Schleier-Smith
4d5f85e77c Fix Travis failure detection on Mac + testing enhancements (#358) 
* properly handle failure in continuous integration

* add stack overflow reference
 2016-08-08 18:02:52 -07:00
Robert Nishihara
13df8302e6 enable running example apps in cluster mode (#357) 2016-08-08 16:01:13 -07:00
Robert Nishihara
feee1de56f run runtest.py in mac os x (#356) 2016-08-07 13:53:56 -07:00
Robert Nishihara
a1e4268d37 Catch errors in importing reusable variables and remote functions (#354) 
* catch errors in importing reusable variables and remote functions

* updates
 2016-08-07 13:53:33 -07:00
Robert Nishihara
a6452aca47 Command for installing example applications dependencies on cluster (#353) 2016-08-05 14:54:32 -07:00
Robert Nishihara
1454c26693 fix bug with home directory on cluster (#352) 2016-08-05 11:49:11 -07:00
Philipp Moritz
8bf877ac1e Serialize and Deserialize unicode (#349) 2016-08-04 21:06:31 -07:00
Robert Nishihara
ac363bf451 Let worker get worker address and object store address from scheduler (#350) 2016-08-04 17:47:08 -07:00
Robert Nishihara
b71f064f3e small documentation fixes (#348) 2016-08-04 17:39:14 -07:00
Johann Schleier-Smith
3ee0fd8f34 Update cluster guide (#347) 
* clarify cluster setup instructions

* update multinode documentation, update cluster script, fix minor bug in worker.py

* clarify cluster documentation and fix update_user_code
 2016-08-04 09:14:20 -07:00
Robert Nishihara
de200ff912 better error messages when composing remote functions (#339) 
Better error messages when composing remote functions
 2016-08-03 16:47:13 -07:00
Robert Nishihara
07baf44f26 only display failed task information for new tasks, remove SHELL_MODE (#344) 2016-08-02 17:59:42 -07:00
Johann Schleier-Smith
583df08957 Docker builds on Travis (#343) 
* attempt to build on travis using docker

* run tests in foreground

* add examples to travis tests

* test from current checkout

* attempt to fix docker version issues

* try build with xenial

* attempt docker upgrade

* avoid hang on configuration files

* matrix osx and linux w/ docker

* restore non-test docker builds

* fix typo

* tuning and cleanup

* add missing file

* comment cleanup
 2016-08-02 17:03:28 -07:00
Robert Nishihara
33d03e56db update tutorial (#342) 2016-08-02 16:47:22 -07:00
Philipp Moritz
0ac4e29b1f clean up tests (#340) 2016-08-02 16:11:53 -07:00
Philipp Moritz
eae27f23ac TRPO example (#336) 2016-08-01 18:40:34 -07:00
Robert Nishihara
1d6977b2b8 add Pong example to README (#337) 2016-08-01 18:29:04 -07:00
Robert Nishihara
c27e6c076c Make sure no Python modules mutually import each other. (#334) 2016-08-01 17:55:38 -07:00
Wapaul1
96a70e1316 Changed equality to None in worker.py to use is keyword (#335) 2016-08-01 16:56:54 -07:00