hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 02:21:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
420 commits 227 branches 67 tags 234 MiB
Commit graph

420 commits

This branch
This branch
All branches
Author SHA1 Message Date
Robert Nishihara
91f16a3df0 Migrate repositories to ray-project. (#438) 
* Migrate repositories to ray-project.

* Update numbuf to the migrated version.
 2016-09-17 00:52:05 -07:00
Robert Nishihara
4fc42c3e1e Fix in documentation link. (#439) 2016-09-17 00:45:22 -07:00
Robert Nishihara
52d953bde6 Document serialization in the object store. (#436) 2016-09-16 23:49:59 -07:00
Robert Nishihara
228525eec7 Add documentation for reusable variables. (#437) 2016-09-16 23:10:34 -07:00
Robert Nishihara
4863a5155c Cleanup setting and getting of tensorflow weights. (#385) 
* Cleanup setting and getting of tensorflow weights.

* Add documentation for using TensorFlow.

* Group get_weights and set_weights in a function.

* Update readme.
 2016-09-16 23:05:14 -07:00
Robert Nishihara
1aa89a4ae6 Update numbuf to properly handle Python floats. (#435) 2016-09-15 15:44:11 -07:00
Robert Nishihara
292656013a Suppress exceptions in the error logging thread when program exits. (#432) 2016-09-15 13:48:23 -07:00
Robert Nishihara
a5c026c033 Remove unused serialize/deserialize code in raylib. (#434) 2016-09-15 13:46:38 -07:00
Robert Nishihara
9ecf72484b This solves a problem where exports were sent to workers out of order. (#430) 
* Revert queueing of exports in scheduler.

* Export each category of exports to workers in the order that they were received.

* Small fixes.
 2016-09-14 17:18:02 -07:00
Wapaul1
d5815673a5 Changed ray.select() to ray.wait() and its functionality (#426) 
* Re-implemented select, changed name to wait

* Changed tests for select to tests for wait

* Updated the hyperopt example to match wait

* Small fixes and improve example readme.

* Make tests pass.
 2016-09-14 17:14:11 -07:00
Robert Nishihara
8c6d3a88a9 Properly decrement Python reference count in PyObjectID_hash. (#429) 2016-09-14 17:09:11 -07:00
Wapaul1
feff561ca1 Added hash function for objectids (#427) 2016-09-13 18:41:18 -07:00
Robert Nishihara
3b47a15ebd Fix naming in tests. (#424) 2016-09-10 21:12:09 -07:00
Robert Nishihara
ba56b08474 Reintroduce passing arguments by value to remote functions. (#425) 
* Reintroduce passing arguments by value to remote functions.

* Check size of arguments passed by value.

* Fix computation graph visualization.
 2016-09-10 21:11:18 -07:00
Robert Nishihara
0191d42751 Check in runtest.py that the correct version of cloudpickle is installed. (#421) 2016-09-09 16:46:18 -07:00
Robert Nishihara
1ad663b689 Add more print statements to lbfgs app to help debug. (#420) 2016-09-08 11:43:26 -07:00
Robert Nishihara
987db5e725 Give better error message when no workers have been registered. (#419) 2016-09-08 11:43:04 -07:00
Robert Nishihara
d6e3a40744 Remove unused code. (#418) 2016-09-08 11:36:17 -07:00
Robert Nishihara
9abc1dd59f Make sure that pip installation of cloudpickle works. (#417) 2016-09-07 18:50:08 -07:00
Robert Nishihara
5802cab87c Fix bug in which ObjectFixture gets called at exit after raylib gets set to None. (#416) 2016-09-07 18:49:19 -07:00
Robert Nishihara
d264713ceb Work around Arrow bug by increasing metadata size. (#415) 2016-09-07 18:46:04 -07:00
Robert Nishihara
11a8914684 Allow users to serialize custom classes. (#393) 
* Allow serialization of custom classes.

* Add documentation and test cases, also fix pickle case.

* Don't allow old-style classes.
 2016-09-06 13:28:24 -07:00
Robert Nishihara
d5cb3ac090 Propagate error messages from functions that run on all workers. (#410) 2016-09-06 10:06:43 -07:00
Robert Nishihara
327d7ff689 Fix bug to enable calling ray.get multiple times on same ObjectID. (#409) 2016-09-04 13:32:55 -07:00
Philipp Moritz
68cec55a98 Refcount without modifying objects (#407) 
* refcount without modifying objects

* add documentation

* Update tests and documentation.

* Remove extraneous code.

* Update numbuf version.
 2016-09-04 12:07:52 -07:00
Robert Nishihara
81f40774a7 Remove ObjectID aliasing from the API. (#406) 
* Remove ObjectID aliasing from the API.

* Update documentation to remove aliasing.
 2016-09-03 19:34:45 -07:00
Richard Shin
efb61ca9c7 Return scheduler address in ray.init (#403) 2016-09-03 18:25:47 -07:00
Richard Shin
a5df45a92e Describe the object which wasn't serializable (#404) 2016-09-03 18:10:03 -07:00
Richard Shin
6f2ed775a2 Allow arbitrary bytes in types.String (#405) 2016-09-03 18:05:09 -07:00
Richard Shin
80fdfcd1a5 Check num_objstores > 0 in start_ray_local (#402) 2016-09-03 17:37:06 -07:00
Philipp Moritz
3548797202 [API] Implement get for multiple objects (#398) 
* [API] Implement get for multiple objects

* Small fixes.
 2016-09-02 18:02:44 -07:00
Stephanie Wang
b6872182bf Add hiredis to build (#395) 
* Add hiredis to build

* make hiredis build if ray has been cloned before this commit
 2016-09-01 20:15:00 -07:00
Philipp Moritz
75555ee25c Remove type information from remote decorator. (#394) 
* Remove type information from remote decorator.

* Remove typing module.

* Fix failure_test.py.

* Allow remote decorator to be used with no parentheses.

* Fix documentation.
 2016-08-30 18:34:25 -07:00
Robert Nishihara
5cf1d60cb2 Fix documentation. 2016-08-30 17:20:00 -07:00
Robert Nishihara
fb7ccef493 Allow remote decorator to be used with no parentheses. 2016-08-30 16:38:26 -07:00
Robert Nishihara
ce4e5ec544 Fix failure_test.py. 2016-08-29 22:52:13 -07:00
Robert Nishihara
b87912cb2f Remove typing module. 2016-08-29 22:16:19 -07:00
Robert Nishihara
d7f313a026 Remove type information from remote decorator. 2016-08-29 22:05:59 -07:00
Philipp Moritz
93e6c9947b update numbuf (#392) 
* update numbuf

* Augment serialization tests.
 2016-08-25 20:05:48 -07:00
Wapaul1
420bcc0477 Remote function returning non-serializable type no longer shuts worker down (#384) 
* Moved put_objects in main_loop to inside of try block

* Added test for failed serialization

* Fixed naming

* Minor
 2016-08-25 15:26:22 -07:00
Robert Nishihara
43452b9ab3 Try grpc version 1.0 (#386) 2016-08-23 19:29:18 -07:00
Robert Nishihara
b1db890cd8 Export GRPC environment variable in Python instead of in setup-env.sh (#382) 
* Export GRPC logging environment variable in Python.

* Don't wipe PYTHONPATH in setup-env.sh
 2016-08-18 15:39:19 -07:00
Robert Nishihara
314bc9e980 Test blocking behavior of select. (#379) 2016-08-16 14:54:54 -07:00
Robert Nishihara
e06311d415 Automatically add relevant directories to Python paths of workers (#380) 
* Make ray.init set python paths of workers.

* Decouple starting cluster from copying user source code

* also add current directory to path

* Add comments about deallocation.

* Add test for new code path.
 2016-08-16 14:53:55 -07:00
Wapaul1
7246013008 Implement select to enable waiting for a specific number of remote objects to be ready. (#369) 2016-08-15 16:51:59 -07:00
Robert Nishihara
b29fc0c481 Use random string for worker c++ logfile. (#378) 2016-08-15 15:55:34 -07:00
Robert Nishihara
e94ed2fc97 Throw fatal error when attempting to send message on full queue. (#377) 2016-08-15 11:51:23 -07:00
Robert Nishihara
87bb7a8f67 [WIP] Large changes to make the tests pass. (#376) 
* Revert "Make tests more informative (#372)"

This reverts commit fd353250c8.

* fix bugs, in particular deactivate worker service on driver and remove condition variables

* changes to minimize the changes in this PR

* switch from faulty mutex synchronization to using atomics

* Increase the default size of the message queues, to accommodate exporting large numbers of remote functions. This is a temporary fix, but not a long term solution.

* Reorganize the scheduler export code to queue up exports. This does not solve the underlying problem yet, but sets up a solution.

* Start a separate thread on driver to print error messages by constantly querying the scheduler. This is a temporary solution because the solution based on starting a worker service for the driver which the scheduler can push error messages to is buggy.

* Fix segfault in taskcapsule destructor.

* Move tests for catching errors into a separate test file.

* Revert "roll back grpc (#368)"

This reverts commit c01ef95d04.
 2016-08-15 11:02:54 -07:00
Robert Nishihara
fd353250c8 Make tests more informative (#372) 
* Make tests more informative

* Change grpc status checks to warning instead of fatal
 2016-08-11 12:40:55 -07:00
Philipp Moritz
b0ecff69ad Check for GRPC status codes (#366) 
* check for GRPC status codes

* more checkss
 2016-08-11 11:10:00 -07:00