Robert Nishihara
0a44145906
Fix the resetting of reusable variables on the driver and cache functions to run on all workers. ( #446 )
...
* Properly reset reusable variables on the driver when remote functions are run locally on the driver.
* Cache functions to run on all workers that occur before ray.init is called.
2016-10-12 22:17:22 -07:00
Robert Nishihara
9a6991116f
Small fix in test. ( #441 )
2016-09-25 23:08:27 -07:00
Robert Nishihara
de6ec47f9e
Add a recursion depth for serialization to prevent infinite loops. ( #440 )
2016-09-19 17:17:42 -07:00
Robert Nishihara
91f16a3df0
Migrate repositories to ray-project. ( #438 )
...
* Migrate repositories to ray-project.
* Update numbuf to the migrated version.
2016-09-17 00:52:05 -07:00
Robert Nishihara
1aa89a4ae6
Update numbuf to properly handle Python floats. ( #435 )
2016-09-15 15:44:11 -07:00
Wapaul1
d5815673a5
Changed ray.select() to ray.wait() and its functionality ( #426 )
...
* Re-implemented select, changed name to wait
* Changed tests for select to tests for wait
* Updated the hyperopt example to match wait
* Small fixes and improve example readme.
* Make tests pass.
2016-09-14 17:14:11 -07:00
Robert Nishihara
3b47a15ebd
Fix naming in tests. ( #424 )
2016-09-10 21:12:09 -07:00
Robert Nishihara
ba56b08474
Reintroduce passing arguments by value to remote functions. ( #425 )
...
* Reintroduce passing arguments by value to remote functions.
* Check size of arguments passed by value.
* Fix computation graph visualization.
2016-09-10 21:11:18 -07:00
Robert Nishihara
0191d42751
Check in runtest.py that the correct version of cloudpickle is installed. ( #421 )
2016-09-09 16:46:18 -07:00
Robert Nishihara
11a8914684
Allow users to serialize custom classes. ( #393 )
...
* Allow serialization of custom classes.
* Add documentation and test cases, also fix pickle case.
* Don't allow old-style classes.
2016-09-06 13:28:24 -07:00
Robert Nishihara
d5cb3ac090
Propagate error messages from functions that run on all workers. ( #410 )
2016-09-06 10:06:43 -07:00
Robert Nishihara
327d7ff689
Fix bug to enable calling ray.get multiple times on same ObjectID. ( #409 )
2016-09-04 13:32:55 -07:00
Philipp Moritz
68cec55a98
Refcount without modifying objects ( #407 )
...
* refcount without modifying objects
* add documentation
* Update tests and documentation.
* Remove extraneous code.
* Update numbuf version.
2016-09-04 12:07:52 -07:00
Robert Nishihara
81f40774a7
Remove ObjectID aliasing from the API. ( #406 )
...
* Remove ObjectID aliasing from the API.
* Update documentation to remove aliasing.
2016-09-03 19:34:45 -07:00
Philipp Moritz
3548797202
[API] Implement get for multiple objects ( #398 )
...
* [API] Implement get for multiple objects
* Small fixes.
2016-09-02 18:02:44 -07:00
Robert Nishihara
fb7ccef493
Allow remote decorator to be used with no parentheses.
2016-08-30 16:38:26 -07:00
Robert Nishihara
ce4e5ec544
Fix failure_test.py.
2016-08-29 22:52:13 -07:00
Robert Nishihara
d7f313a026
Remove type information from remote decorator.
2016-08-29 22:05:59 -07:00
Philipp Moritz
93e6c9947b
update numbuf ( #392 )
...
* update numbuf
* Augment serialization tests.
2016-08-25 20:05:48 -07:00
Wapaul1
420bcc0477
Remote function returning non-serializable type no longer shuts worker down ( #384 )
...
* Moved put_objects in main_loop to inside of try block
* Added test for failed serialization
* Fixed naming
* Minor
2016-08-25 15:26:22 -07:00
Robert Nishihara
314bc9e980
Test blocking behavior of select. ( #379 )
2016-08-16 14:54:54 -07:00
Robert Nishihara
e06311d415
Automatically add relevant directories to Python paths of workers ( #380 )
...
* Make ray.init set python paths of workers.
* Decouple starting cluster from copying user source code
* also add current directory to path
* Add comments about deallocation.
* Add test for new code path.
2016-08-16 14:53:55 -07:00
Wapaul1
7246013008
Implement select to enable waiting for a specific number of remote objects to be ready. ( #369 )
2016-08-15 16:51:59 -07:00
Robert Nishihara
87bb7a8f67
[WIP] Large changes to make the tests pass. ( #376 )
...
* Revert "Make tests more informative (#372 )"
This reverts commit fd353250c8
.
* fix bugs, in particular deactivate worker service on driver and remove condition variables
* changes to minimize the changes in this PR
* switch from faulty mutex synchronization to using atomics
* Increase the default size of the message queues, to accommodate exporting large numbers of remote functions. This is a temporary fix, but not a long term solution.
* Reorganize the scheduler export code to queue up exports. This does not solve the underlying problem yet, but sets up a solution.
* Start a separate thread on driver to print error messages by constantly querying the scheduler. This is a temporary solution because the solution based on starting a worker service for the driver which the scheduler can push error messages to is buggy.
* Fix segfault in taskcapsule destructor.
* Move tests for catching errors into a separate test file.
* Revert "roll back grpc (#368 )"
This reverts commit c01ef95d04
.
2016-08-15 11:02:54 -07:00
Robert Nishihara
fd353250c8
Make tests more informative ( #372 )
...
* Make tests more informative
* Change grpc status checks to warning instead of fatal
2016-08-11 12:40:55 -07:00
Wapaul1
362ffa1f3c
Changing hard coded ports for objstore and workers to choose unused ports ( #365 )
...
* let grpc choose unused worker and object store ports
* Add objstore addresses to scheduler info to bring back test
2016-08-10 19:08:38 -07:00
Johann Schleier-Smith
d8dd9de81b
remove verbose flag in tar ( #363 )
2016-08-09 13:43:25 -07:00
Johann Schleier-Smith
4d5f85e77c
Fix Travis failure detection on Mac + testing enhancements ( #358 )
...
* properly handle failure in continuous integration
* add stack overflow reference
2016-08-08 18:02:52 -07:00
Robert Nishihara
13df8302e6
enable running example apps in cluster mode ( #357 )
2016-08-08 16:01:13 -07:00
Robert Nishihara
feee1de56f
run runtest.py in mac os x ( #356 )
2016-08-07 13:53:56 -07:00
Robert Nishihara
a1e4268d37
Catch errors in importing reusable variables and remote functions ( #354 )
...
* catch errors in importing reusable variables and remote functions
* updates
2016-08-07 13:53:33 -07:00
Philipp Moritz
8bf877ac1e
Serialize and Deserialize unicode ( #349 )
2016-08-04 21:06:31 -07:00
Robert Nishihara
ac363bf451
Let worker get worker address and object store address from scheduler ( #350 )
2016-08-04 17:47:08 -07:00
Johann Schleier-Smith
583df08957
Docker builds on Travis ( #343 )
...
* attempt to build on travis using docker
* run tests in foreground
* add examples to travis tests
* test from current checkout
* attempt to fix docker version issues
* try build with xenial
* attempt docker upgrade
* avoid hang on configuration files
* matrix osx and linux w/ docker
* restore non-test docker builds
* fix typo
* tuning and cleanup
* add missing file
* comment cleanup
2016-08-02 17:03:28 -07:00
Philipp Moritz
0ac4e29b1f
clean up tests ( #340 )
2016-08-02 16:11:53 -07:00
Robert Nishihara
c27e6c076c
Make sure no Python modules mutually import each other. ( #334 )
2016-08-01 17:55:38 -07:00
Wapaul1
97b923a750
Changed how ray treats deserialization of custom classes ( #333 )
2016-08-01 15:38:05 -07:00
Robert Nishihara
98a508d6ca
Terminology change Object Reference -> Object ID ( #330 )
2016-07-31 19:58:03 -07:00
Robert Nishihara
2040372084
unify starting local cluster with attaching to existing cluster ( #327 )
2016-07-31 19:26:35 -07:00
Robert Nishihara
0e5b858324
change remote function invocation from func() to func.remote() ( #328 )
2016-07-31 15:25:19 -07:00
Robert Nishihara
a155f315e2
remove assertions from microbenchmarks and add to travis
2016-07-29 00:08:00 -07:00
mehrdadn
4c323d4ecf
libraylib -> lib ( #311 )
2016-07-27 23:23:13 -07:00
Robert Nishihara
3bae6f136b
export remote functions and reusable variables that were defined before connect was called ( #292 )
2016-07-26 11:40:09 -07:00
Robert Nishihara
03f1830cd0
implement key value store for sharing reusable variables
2016-07-22 18:43:33 -07:00
Robert Nishihara
baa4b7cae3
fix bug in reference counting None object ( #286 )
2016-07-22 14:15:02 -07:00
Wapaul1
b68512ec7d
Added handles for python to access buffers in objstore ( #282 )
2016-07-20 17:36:15 -07:00
Robert Nishihara
3bf46ce5ac
make remote functions pickleable ( #281 )
2016-07-19 16:05:45 -07:00
mehrdadn
f2c43bec87
Function serialization ( #261 )
2016-07-17 22:05:07 -07:00
mehrdadn
8e0ecfa1f4
assertTrue -> assertEqual ( #278 )
2016-07-16 22:48:39 -07:00
Robert Nishihara
ced5ce4924
raise exception if user tries to pass large object by value ( #276 )
2016-07-16 17:17:48 -07:00