Commit graph

82 commits

Author SHA1 Message Date
Robert Nishihara
fb7ccef493 Allow remote decorator to be used with no parentheses. 2016-08-30 16:38:26 -07:00
Robert Nishihara
d7f313a026 Remove type information from remote decorator. 2016-08-29 22:05:59 -07:00
Philipp Moritz
93e6c9947b update numbuf (#392)
* update numbuf

* Augment serialization tests.
2016-08-25 20:05:48 -07:00
Robert Nishihara
314bc9e980 Test blocking behavior of select. (#379) 2016-08-16 14:54:54 -07:00
Robert Nishihara
e06311d415 Automatically add relevant directories to Python paths of workers (#380)
* Make ray.init set python paths of workers.

* Decouple starting cluster from copying user source code

* also add current directory to path

* Add comments about deallocation.

* Add test for new code path.
2016-08-16 14:53:55 -07:00
Wapaul1
7246013008 Implement select to enable waiting for a specific number of remote objects to be ready. (#369) 2016-08-15 16:51:59 -07:00
Robert Nishihara
87bb7a8f67 [WIP] Large changes to make the tests pass. (#376)
* Revert "Make tests more informative (#372)"

This reverts commit fd353250c8.

* fix bugs, in particular deactivate worker service on driver and remove condition variables

* changes to minimize the changes in this PR

* switch from faulty mutex synchronization to using atomics

* Increase the default size of the message queues, to accommodate exporting large numbers of remote functions. This is a temporary fix, but not a long term solution.

* Reorganize the scheduler export code to queue up exports. This does not solve the underlying problem yet, but sets up a solution.

* Start a separate thread on driver to print error messages by constantly querying the scheduler. This is a temporary solution because the solution based on starting a worker service for the driver which the scheduler can push error messages to is buggy.

* Fix segfault in taskcapsule destructor.

* Move tests for catching errors into a separate test file.

* Revert "roll back grpc (#368)"

This reverts commit c01ef95d04.
2016-08-15 11:02:54 -07:00
Robert Nishihara
fd353250c8 Make tests more informative (#372)
* Make tests more informative

* Change grpc status checks to warning instead of fatal
2016-08-11 12:40:55 -07:00
Wapaul1
362ffa1f3c Changing hard coded ports for objstore and workers to choose unused ports (#365)
* let grpc choose unused worker and object store ports

* Add objstore addresses to scheduler info to bring back test
2016-08-10 19:08:38 -07:00
Robert Nishihara
13df8302e6 enable running example apps in cluster mode (#357) 2016-08-08 16:01:13 -07:00
Robert Nishihara
a1e4268d37 Catch errors in importing reusable variables and remote functions (#354)
* catch errors in importing reusable variables and remote functions

* updates
2016-08-07 13:53:33 -07:00
Philipp Moritz
8bf877ac1e Serialize and Deserialize unicode (#349) 2016-08-04 21:06:31 -07:00
Robert Nishihara
ac363bf451 Let worker get worker address and object store address from scheduler (#350) 2016-08-04 17:47:08 -07:00
Philipp Moritz
0ac4e29b1f clean up tests (#340) 2016-08-02 16:11:53 -07:00
Robert Nishihara
c27e6c076c Make sure no Python modules mutually import each other. (#334) 2016-08-01 17:55:38 -07:00
Wapaul1
97b923a750 Changed how ray treats deserialization of custom classes (#333) 2016-08-01 15:38:05 -07:00
Robert Nishihara
98a508d6ca Terminology change Object Reference -> Object ID (#330) 2016-07-31 19:58:03 -07:00
Robert Nishihara
2040372084 unify starting local cluster with attaching to existing cluster (#327) 2016-07-31 19:26:35 -07:00
Robert Nishihara
0e5b858324 change remote function invocation from func() to func.remote() (#328) 2016-07-31 15:25:19 -07:00
mehrdadn
4c323d4ecf libraylib -> lib (#311) 2016-07-27 23:23:13 -07:00
Robert Nishihara
3bae6f136b export remote functions and reusable variables that were defined before connect was called (#292) 2016-07-26 11:40:09 -07:00
Robert Nishihara
03f1830cd0 implement key value store for sharing reusable variables 2016-07-22 18:43:33 -07:00
Robert Nishihara
baa4b7cae3 fix bug in reference counting None object (#286) 2016-07-22 14:15:02 -07:00
Wapaul1
b68512ec7d Added handles for python to access buffers in objstore (#282) 2016-07-20 17:36:15 -07:00
Robert Nishihara
3bf46ce5ac make remote functions pickleable (#281) 2016-07-19 16:05:45 -07:00
mehrdadn
f2c43bec87 Function serialization (#261) 2016-07-17 22:05:07 -07:00
mehrdadn
8e0ecfa1f4 assertTrue -> assertEqual (#278) 2016-07-16 22:48:39 -07:00
Robert Nishihara
5dd411546d clean up imports (#230) 2016-07-08 12:46:47 -07:00
mehrdadn
199b4efd50 int and long should be treated similarly (#220) 2016-07-06 17:31:58 -07:00
Robert Nishihara
bd586b4a57 fix error in test (#215) 2016-07-06 13:12:06 -07:00
Robert Nishihara
49decce6f6 print python backtrace in error message (#209) 2016-07-06 00:25:02 -07:00
Robert Nishihara
58b65d39a9 don't display errors when running test (#213) 2016-07-05 18:59:54 -07:00
Robert Nishihara
0947024ad9 fix bug for functions with no return values and with one return value (#211) 2016-07-05 15:57:05 -07:00
Robert Nishihara
fb6c74ecab update api for start_ray_local (#174) 2016-06-27 11:57:22 -07:00
Robert Nishihara
902cac3089 arrays -> array (#172) 2016-06-27 11:35:31 -07:00
Robert Nishihara
d97bce0d64 allow driver to run in PYTHON_MODE, which is equivalent to serial Python 2016-06-26 13:43:54 -07:00
Robert Nishihara
741f4824b1 error messages for gets (#158) 2016-06-25 09:43:57 -07:00
Robert Nishihara
c3335ed093 minor: single quote to double (#156) 2016-06-24 19:43:24 -07:00
Philipp Moritz
8a0b8e8789 Unmap segments properly to avoid memory leaks 2016-06-24 16:56:26 -07:00
Robert Nishihara
abaa4211d4 better printing of errors (#153) 2016-06-24 13:22:29 -07:00
Philipp Moritz
5ecc2ab67d Fix serialization of numpy scalars and implement more numpy types as well as empty arrays 2016-06-23 18:39:02 -07:00
Robert Nishihara
188569be37 push/pull -> put/get 2016-06-23 12:58:48 -07:00
Philipp Moritz
82a7ee5752 Fix https://github.com/amplab/ray/issues/72 2016-06-21 17:39:48 -07:00
Mehrdad
f8ab525ef0 Removing asdfasdf.txt 2016-06-20 16:51:18 -07:00
Robert Nishihara
ac65f1031e rename test_path -> worker_path (#128) 2016-06-19 22:01:31 -07:00
mehrdadn
0e5feecd65 Get failed worker information (#114) 2016-06-17 15:01:48 -07:00
Philipp Moritz
19e7f0d72d implement serialization of object references inside of python objects 2016-06-10 16:32:48 -07:00
Robert Nishihara
4cc024ae36 renaming project, halo -> ray (#95) 2016-06-10 14:12:15 -07:00
Philipp Moritz
12ca2d4422 link libraries statically and make halo work on Mac OS X 2016-06-10 13:16:07 -07:00
Philipp Moritz
dd8067def8 move testrecv.py to test_worker.py 2016-06-06 11:05:04 -07:00