Commit graph

1568 commits

Author SHA1 Message Date
gehring
b520f6141e [rllib] Adds eager support with a generic TFEagerPolicy class (#5436) 2019-08-23 14:21:11 +08:00
Richard Liaw
cdc9227f1b
[tune] ASHA xgboost and lightgbm examples (#5500) 2019-08-22 10:37:59 -07:00
Eric Liang
e2e30ca507 Ray, Tune, and RLlib support for memory, object_store_memory options (#5226) 2019-08-21 23:01:10 -07:00
Philipp Moritz
c852213b83
[projects] Project examples and documentation (#5407) 2019-08-20 20:49:15 -07:00
Robert Nishihara
851c5b2dae Add a script for benchmarking performance for Ray developers. (#5472) 2019-08-19 23:41:23 -07:00
Philipp Moritz
cf98b1bb13
[autoscaler] Fix ssh control path length issue (#5476) 2019-08-19 16:18:08 -07:00
Simon Mo
341c6926e7 [Project] Add Basic Session CLI Commands (#5433) 2019-08-19 10:14:45 -07:00
Edward Oakes
0440c00019 Use subprocess.check_output in tests (#5465) 2019-08-17 22:25:17 -07:00
Edward Oakes
c7ae4e5e1f Check for dead processes in blocked ray start (#5458) 2019-08-17 20:44:08 -07:00
Philipp Moritz
599cc2be60
Revert raylet to worker GRPC communication back to asio (#5450) 2019-08-17 19:11:32 -07:00
Hao Chen
03d05c8765
Fix test_logging_to_driver and test_not_logging_to_driver (#5462) 2019-08-17 18:06:08 +08:00
Hao Chen
657ce4b3c7
increase timeout for test_actor_lifetime_load_balancing (#5463) 2019-08-17 17:25:53 +08:00
Robert Nishihara
bb31620168
Add test for mutually recursive remote functions. (#5349) 2019-08-17 00:46:44 -07:00
Mitchell Stern
8ed353ad8e Fix json.loads compatibility issue for Python 3.5 (#5466) 2019-08-17 00:33:55 -07:00
Richard Liaw
d7b309223b
[tune] MLFlow Logger (#5438) 2019-08-14 15:58:18 -07:00
Richard Liaw
16acd18ce6
[tune] Quick Fix BOHB example (#5449) 2019-08-14 01:04:28 -07:00
Richard Liaw
3a1e8d06f9
[tune] Fix Travis Blocking (#5448) 2019-08-13 20:56:37 -07:00
Neil Lugovoy
1376f1ae60 [tune] Reporter crash fix (#5426)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2019-08-13 14:10:22 -07:00
Lisa Dunlap
b7d0733362 [tune] Implement BOHB (#5382) 2019-08-13 12:32:07 -07:00
Tom
3218ee389a [tune] Fix get_best_logdir behaviour (#5429)
* Fix get_best_logdir behaviour

* addtest
2019-08-12 14:28:09 -07:00
Robert Nishihara
61b23a9a70 Don't stop Jupyter notebook in ray stop. (#5387) 2019-08-11 15:18:01 -07:00
Richard Liaw
cff72d1a54
[minor][tune] update pbt docs (#5420) 2019-08-11 12:39:54 -07:00
Peng Zhenghao
983f3c83d8 [tune] Allow relative local_dir at tune.run() (#4734) 2019-08-10 16:49:34 -07:00
jichan3751
de95117e96 [sgd] Tune interface for Pytorch MultiNode SGD (#5350) 2019-08-10 13:51:44 -07:00
Eric Liang
df47bdf6c9
Allow address instead of redis_address (#5412)
* addr

* wip

* fix typo

* add to start

* switch to ray address for train

* say address

* disambiguate help

* comments 2
2019-08-10 00:18:41 -07:00
Juan Redondo Pizarro
7e8a4a62ea [tune] Add hyperopt warm start feature (#5372) 2019-08-09 12:27:57 -07:00
Simon Mo
18f1e904de Bump 0.8.0.dev2 -> 0.8.0.dev3 (#5409) 2019-08-09 11:37:19 -07:00
Simon Mo
d9b45cceec [Project] Implementing Project CLI (#5397) 2019-08-08 21:28:25 -07:00
Richard Liaw
ed89897a31
[tune,autoscaler] Test yaml, add better distributed docs (#5403) 2019-08-08 00:59:23 -07:00
Eric Liang
4a6ebe69d4
Fix setup (#5400) 2019-08-07 16:17:29 -07:00
Philipp Moritz
8d6c50c821
Fix compiler warnings and make warnings fatal (#5375) 2019-08-07 14:04:05 -07:00
Qing Wang
d372f24e3c
[ID Refactor] Refactor ActorID, TaskID and ObjectID (#5286)
* Refactor ActorID, TaskID on the Java side.

Left a TODO comment

WIP for ObjectID

ADD test

Fix

Add java part

Fix Java test

Fix

Refine test.

Enable test in CI

* Extra a helper function.

* Resolve TODOs

* Fix Python CI

* Fix Java lint

* Update .travis.yml

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Address some comments.

Address some comments.

Add id_specification.rst

Reanme id_specification.rst to id_specification.md

typo

Address zhijun's comments.

Fix test

Address comments.

Fix lint

Address comments

* Fix test

* Address comments.

* Fix build error

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Address comments

* Update src/ray/common/id.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/common/id.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/common/id.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* Address comments.

* Address comments.

* Update C++ part to make sure task id is generated determantic

* WIP

* Fix core worker

* Fix Java part

* Fix comments.

* Add Python side

* Fix python

* Address comments

* Fix linting

* Fix

* Fix C++ linting

* Add JobId() method to TaskID

* Fix linting

* Update src/ray/common/id.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/TaskId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/TaskId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/ActorId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments

* Add DriverTaskId embeding job id

* Fix tests

* Add python dor_fake_driver_id

* Address comments and fix linting

* Fix CI
2019-08-07 11:04:51 +08:00
Richard Liaw
094ec7adbc
[tune] Allow nested values in trial runner (#5346) 2019-08-06 14:36:17 -07:00
Philipp Moritz
e8d9cfc1f1
Ray projects schema and validation (#5329) 2019-08-06 14:36:04 -07:00
Matthew A. Wright
e3c9f7e83a Custom action distributions (#5164)
* custom action dist wip

* Test case for custom action dist

* ActionDistribution.get_parameter_shape_for_action_space pattern

* Edit exception message to also suggest using a custom action distribution

* Clean up ModelCatalog.get_action_dist

* Pass model config to ActionDistribution constructors

* Update custom action distribution test case

* Name fix

* Autoformatter

* parameter shape static methods for torch distributions

* Fix docstring

* Generalize fake array for graph initialization

* Fix action dist constructors

* Correct parameter shape static methods for multicategorical and gaussian

* Make suggested changes to custom action dist's

* Correct instances of not passing model config to action dist

* Autoformatter

* fix tuple distribution constructor

* bugfix
2019-08-06 11:13:16 -07:00
Eric Liang
0a3ff489fa
Send raylet error logs through the log monitor (#5351) 2019-08-05 23:35:09 -07:00
Eric Liang
5d7afe8092
[rllib] Try moving RLlib to top level dir (#5324) 2019-08-05 23:25:49 -07:00
Richard Liaw
32f275344b [tune] Pandas as soft dep 2019-08-05 18:59:08 -07:00
Eric Liang
955154a19d
Reduce Ray / RLlib startup messages (#5368) 2019-08-05 13:23:54 -07:00
Michael Gump
67f9e225cf [tune] Fix small bug in experiment_analysis (#5365)
* [tune] Fix small bug in experiment_analysis

_experiment_state was not set as an attribute of ExperimentAnalysis

* Update python/ray/tune/analysis/experiment_analysis.py

Co-Authored-By: Richard Liaw <rliaw@berkeley.edu>
2019-08-05 13:19:30 -07:00
Simon Mo
25b5bd1530 ray stop sends SIGKILL instead of SIGTERM (#5354) 2019-08-02 14:46:03 -07:00
Richard Liaw
1eaa57c98f
[tune] Distributed example + walkthrough (#5157) 2019-08-02 09:17:20 -07:00
Kristian Hartikainen
13fb9fe3db [rllib] Feature/soft actor critic v2 (#5328)
* Add base for Soft Actor-Critic

* Pick changes from old SAC branch

* Update sac.py

* First implementation of sac model

* Remove unnecessary SAC imports

* Prune unnecessary noise and exploration code

* Implement SAC model and use that in SAC policy

* runs but doesn't learn

* clear state

* fix batch size

* Add missing alpha grads and vars

* -200 by 2k timesteps

* doc

* lazy squash

* one file

* ignore tfp

* revert done
2019-08-01 23:37:36 -07:00
Xianyang Liu
3ae54a2b20 Fix log monitor read error (#5221) 2019-08-01 15:47:10 -07:00
Eric Liang
20450a4e82
[rllib] Add rock paper scissors multi-agent example (#5336) 2019-08-01 13:03:59 -07:00
jichan3751
bd6dfc994f [sgd] Replaced class Resources in sgd with use_gpu (#5252) 2019-08-01 01:03:10 -07:00
Lukas Folle
0391050daf Fixed link in tune that was not working (#5331) 2019-07-31 21:43:46 -07:00
Simon Mo
d762379904 [Asyncio] Allow Async_API to init when loop is running (#5323) 2019-07-31 15:29:42 -07:00
Kristian Hartikainen
1345802c39 [autoscaler] Change sys.exit(1) in update ssh_cmd (#5266) 2019-07-31 13:45:05 -07:00
Jaroslaw Rzepecki
b3c8091a35 Fix Tuple spaces in rollout.py (#5332)
Make sure that the initial action is also properly flattened.
2019-07-31 11:38:49 -07:00