hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
1638 commits 227 branches 67 tags 234 MiB
Commit graph

1638 commits

This branch
This branch
All branches
Author SHA1 Message Date
Kunal Gosar
eba73449cc fix unused lambda capture (#2102) 2018-05-19 13:27:10 -07:00
Melih Elibol
f1da721522
[xray] Use pubsub instead of timeout for ObjectManager Pull. (#2079) 
Use pubsub instead of timeout for Pull.
 2018-05-18 21:35:12 -07:00
Peter Schafhalter
9e46de9830 [DataFrame] Update _inherit_docstrings (#2085) 
* Update _inherit_docstrings

* Add groupby __init__
 2018-05-18 17:50:41 -10:00
Yujie Liu
5918776dd4 [JavaWorker] Changes to the build system for support java worker (#2092) 
* Changes to the build system for support java worker
--------------------------
This commit includes changes to the build system, which is part of the java worker support of Ray.
It consists of the following changes:
 - the changes of CMakeLists.txt files
 - the changes of the python setup.py and init files for the adaptation of the changed build system
 - move the location of local_scheduler_extension.cc for the adaptation of the changed build system which maybe better support multi-language worker

* minor whitespace

* Linting
 2018-05-18 19:09:23 -07:00
Stephanie Wang
71e5cca59f
[xray] Fix bug in updating actor execution dependencies (#2064) 
* [xray] FIX: bugs in actor execution

* comments

* Stronger check
 2018-05-18 12:45:17 -07:00
Simon Mo
0b07602c89 [DataFrame] Refactor __delitem__ (#2080) 
* Implement the bug fix

* Fix flake8
 2018-05-18 08:58:20 -10:00
Melih Elibol
25e7aa1e79 [xray] Better error messaging when pulling from self. (#2068) 
* complain more loudly when object pulls from self.

* Add checks for node manager, and internal checks for object manager.

* linting
 2018-05-18 10:26:47 -07:00
Adam Gleave
57419f9132 Use source code in hash where possible (fix #2089) (#2090) 2018-05-18 09:05:33 -07:00
Robert Nishihara
78e4b021ab Functions for flushing done tasks and evicted objects. (#2033) 2018-05-18 01:59:58 -07:00
Robert Nishihara
15b72f9893 Fix compilation error for RAY_USE_NEW_GCS with latest clang. (#2086) 2018-05-17 23:10:02 -07:00
Melih Elibol
3c245f66d4 [xray] Corrects Error Handling During Push and Pull. (#2059) 
* Makes bad status during Pull non-fatal.
Makes a bad status during Push fatal.

* pretty logs

* Stephanie's feedback.
 2018-05-17 17:51:55 -07:00
Stephanie Wang
6ca122f723 [xray] Sophisticated task dependency management (#2035) 2018-05-17 17:18:30 -07:00
Adam Gleave
470887c2ad Support calling positional arguments by keyword (fix #998) (#2081) 2018-05-17 16:10:26 -07:00
Kunal Gosar
afbb260ca4 [DataFrame] Improve performance of iteration methods (#2026) 
* fix iterrows

* make iteration methods performant

* resolving comments

* remove indexing from iterator

* switch to iterator syntax
 2018-05-17 11:45:21 -10:00
Peter Schafhalter
ae17ebd032 [DataFrame] Implement to_csv (#2014) 
* Add map, reduce, merge_dtypes

bug fixes

Unify dtypes on DataFrame creation

Formatting and comments

Cache dtypes

Fix bug in _merge_dtypes

Fix bug

Changed caching logic

Fix dtypes issue in read_csv

Invalidate dtypes cache when inserting column

Simplify unifying dtypes and improve caching

Fix typo

Better caching of dtypes

Fix merge conflicts

Implemented some to_csv functions

Support read_csv from buffers

Expose date_range, NaT, Timedelta from pandas

Add testing utils

Redirect imports to Pandas

Fix imports

Fix read_csv when index_col is specified

Update imports from Pandas

Fix bugs

Use util API

Fix nasty bug

Add missing import

Don't distribute reading of compressed files

Add test utilities for Pandas tests

Add test for to_csv

Add warnings

Fix rebase artifacts

* Fix rebase artifacts

* Fix bugs in read_csv indexing

* Fix bugs in read_csv

* Fix bug for IndexMetadata with _length 1

Remove testing imports

* Rebase artifacts and formatting

* Start to_csv without CSV formatter

* Fix bug in _map_partitions

* Initial implementation for improved to_csv

* Fix bug with insert

* Bugfixes

* Remove CSV Formatter

* Formatting

* Fix python2 bug

* Fix additional python2 issue
 2018-05-17 11:35:17 -10:00
Stephanie Wang
796864d887
[xray] Lineage cache only requests notifications about remote parent tasks (#2066) 
* Only request notifications about a parent task that is remote

* Fix typo

* Fix lineage cache test
 2018-05-17 13:01:40 -07:00
Alok Singh
c0e4c9d3d1 [rllib] Add magic methods for rollouts (#2024) 2018-05-16 22:59:46 -07:00
Kunal Gosar
7549209aea [DataFrame] Allows DataFrame constructor to take in another DataFrame (#2072) 
* allow constructor to take in other DataFrame

* rename _data to _frame_data
 2018-05-16 16:17:20 -10:00
Peter Schafhalter
78bb887dd4 Pin Pandas version for Travis to 0.22 (#2075) 2018-05-16 15:05:37 -07:00
Melih Elibol
bea97b425b Fix python linting (#2076) 2018-05-16 15:04:31 -07:00
Stephanie Wang
88fa98e851
[xray] Fix GCS table prefixes (#2065) 
* Fix GCS table prefixes

* More explicit documentation
 2018-05-16 13:15:03 -07:00
Robert Nishihara
570c3153cd Some tests for _submit API. (#2062) 2018-05-16 00:26:25 -07:00
alexbao
68bec0f6fb [rllib] Queue lib for python 2.7 (#2057) 
* Queue lib for python 2.7

* use six.moves.queue instead
 2018-05-15 15:27:52 -07:00
Eric Liang
3f1dd29eab
[autoscaler] Remove faulty assert that breaks during downscaling, pull configs from env (#2006) 
* fixes

* coment out test

* Update ray_constants.py

* Update autoscaler_test.py

* Update ray_constants.py

* lint

* lint
 2018-05-15 12:47:11 -07:00
Simon Mo
825c227c2b [DataFrame] Refactor indexers and implement setitem (#2020) 
* Reset to_pandas change; update current

* Fix pd_df bug
 2018-05-15 12:27:28 -07:00
SunYiran
79b45c6cfd [rllib]Update bc/policy.py (#2012) 2018-05-15 11:52:24 -07:00
Robert Nishihara
8fbb88485b Create RemoteFunction class, remove FunctionProperties, simplify worker Python code. (#2052) 
* Cleaning up worker and actor code. Create remote function class. Remove FunctionProperties object.

* Remove register_actor_signatures function.

* Small cleanups.

* Fix linting.

* Support @ray.method syntax for actor methods.

* Fix pickling bug.

* Fix linting.

* Shorten testBlockingTasks.

* Small fixes.

* Call get_global_worker().
 2018-05-14 14:35:23 -07:00
Stephanie Wang
ad48e47120 Don't crash on duplicate actor notifications (#2043) 2018-05-14 14:26:37 -07:00
Ken Fehling
19b743c84b Fixed attribute name in code example (#2054) 
hyperparam_mutations
 2018-05-14 01:05:06 -07:00
Robert Nishihara
52b0f3734a [xray] Add Travis build for testing xray on Linux. (#2047) 
* Run xray tests in travis.

* Comment out TaskTests.testSubmittingManyTasks.

* Comment out failing tests.

* Comment out hanging test.

* Linting

* Comment out failing test.

* Comment out failing test.

* Ignore test_dataframe.py for now.

* Comment out testDriverExitingQuickly.
 2018-05-13 21:22:01 -07:00
Ken Fehling
4ff900e131 Added missing comma to code example (#2050) 2018-05-13 19:01:01 -07:00
Robert Nishihara
18071d95a7 Use more CPUs for testMultipleWaitsAndGets. (#2051) 2018-05-13 15:35:02 -07:00
Melih Elibol
3ac0c08daa use jobid_nil (#2044) 2018-05-13 14:22:09 -07:00
Alok Singh
c7f3b8c4d3 Fix typo in tune. (#2046) 
Fix typo in tune.
 2018-05-12 09:36:45 -07:00
Aris L
041c37506e Fix error in api.rst. (#2048) 
Fix error in api.rst.
 2018-05-12 09:35:45 -07:00
eric-jj
71997a481b Improve shared_ptr usage (#2030) 
[xray] Improve shared_ptr usage
 2018-05-11 20:05:04 -07:00
Stephanie Wang
a292d7ba32
[xray] Fix UniqueID hashing for object and task IDs. (#2017) 
* Skip object prefix in UniqueIDHasher, choose shard based on hash

* lint
 2018-05-10 21:56:12 -07:00
Devin Petersohn
89e2eef3f3 [DataFrame] Fixing bugs in groupby (#2031) 2018-05-10 11:44:19 -07:00
Kunal Gosar
b79912ec74 [DataFrame] Fixes dropna subset bug (#2018) 
* fix dropna

* resolve comment
 2018-05-10 08:25:24 -07:00
Devin Petersohn
72a3a6cb02 [DataFrame] Implement where (#1989) 2018-05-09 14:05:52 -07:00
Kunal Gosar
d2c193ed2c [DataFrame] Add direct pandas imports for MVP (#1960) 
* Add direct pandas imports for MVP

* rebase artifact
 2018-05-08 19:19:32 -07:00
Robert Nishihara
77c8aa7627 Make ActorHandles pickleable, also make proper ActorHandle and ActorC… (#2007) 
* Make ActorHandles pickleable, also make proper ActorHandle and ActorClass classes.

* Fix bug.

* Fix actor test bug.

* Update __ray_terminate__ usage.

* Fix most linting, add documentation, and small cleanups.

* Handle forking and pickling differently for actor handles. Fix linting.

* Fixes for named actors via pickling.

* Generate actor handle IDs deterministically in the pickling case.
 2018-05-08 19:19:07 -07:00
Kristian Hartikainen
2048b546ff Expand local_dir in Trial init (#2013) 
* Fix the case where Trial logs into wrong paths when `local_dir`
argument starts with tilde (~), by expanding the `local_dir` argument
* Add test case for checking that the tilde gets expanded
 2018-05-07 21:44:28 -07:00
Devin Petersohn
b1e32ca6c2 Fixing ascii error for Python2 (#2009) 2018-05-07 11:56:40 -07:00
Peter Veerman
1f82a46473 [DataFrame] Implements df.update (#1997) 
* Working on fixing update

* Fixing update implementation

* Adding test

* Addressing comments
 2018-05-07 08:55:40 -07:00
Peter Veerman
12da021717 [DataFrame] Implements df.as_matrix (#2001) 
* Implement df.as_matrix

* Addressing comments

* Addressing comments
 2018-05-06 23:36:39 -07:00
Rohan Singh
1848745223 [DataFrame] Implement quantile (#1992) 
* added quantile method

* updated init for datetime signatures

* updated documentation for _map_partitions return type

* removed extraneous print call

* updated for simplicity

* fixed dtyping issues and error raising

* updated datetime dtype checking

* Fixing quantile implementation

* Fix minor bug

* Fixing diff
 2018-05-06 18:25:13 -07:00
Devin Petersohn
ad1afeb268 [DataFrame] Impement sort_values and sort_index (#1977) 2018-05-06 09:53:29 -07:00
Rohan Singh
9f28529e2c [DataFrame] Implement rank (#1991) 
* rank method completed

* added sanity checks

* flake8

* updated sanity checks

* flake8

* updated sanity checks and style

* updated dtype logic

* Fixing test
 2018-05-06 09:32:33 -07:00
Hari Subbaraj
857458c37c [DataFrame] Implemented prod, product, added test suite (#1994) 
* implemented prod/product, modified declaration for sum, added pandas test suite

* fixed tests

* removed test_analytics file

* implemented nunique, skew

* fixed requested changes

* added nunique, skew

* fixed tests in request

* added newline back

* fixed newlines hopefully

* fixed flake8 issues

* more flake8 issues

* fixed test for prod
 2018-05-05 21:25:42 -07:00