Commit graph

3763 commits

Author SHA1 Message Date
micafan
a7e9d63979 [GCS] Add actor checkpoint related methods to accessor (#6605) 2020-01-02 12:36:52 +08:00
fangfengbin
255aa0796a Add heartbeat methods to gcs server node info handler (#6647) 2020-01-02 12:36:23 +08:00
Robert Nishihara
9baa002069
Remove deprecated global state. (#6655) 2019-12-31 22:40:47 -08:00
chenk008
4150d444a1 ray-operator support bazel build (#6639)
* support bazel build

* add bazel gazelle script in README
2019-12-31 22:28:51 -08:00
Zhijun Fu
91a98d2295 [rpc] refactor GRPC client (#6637)
* refactor RPC client

* remove unused code

* format

* fix

* resolve comments

* format

* update

* fix

* fix python pb build failure

* lint
2019-12-31 22:28:25 -08:00
mehrdadn
f4b29dae9c Perform Bazel install directly in Windows CI (#6653) 2019-12-31 20:48:08 -08:00
Robert Nishihara
480206eef8
Remove some Python 2 compatibility code. (#6624) 2019-12-31 17:14:58 -08:00
Philipp Moritz
ecddaafd94
Add actor table to global state API (#6629) 2019-12-31 15:11:59 -08:00
mehrdadn
a4d64de39a Perform LLVM install directly inside Windows CI (#6588)
* Perform LLVM install directly inside Windows CI

* Pin the LLVM download version

Co-authored-by: GitHub Web Flow <noreply@github.com>
2019-12-31 13:23:19 -08:00
Robert Nishihara
d2c6457832
Remove public facing references to --redis-address. (#6631) 2019-12-31 13:21:53 -08:00
Michael Luo
1cb335487e SAC for Mujoco Environments (#6642) 2019-12-31 00:16:54 -08:00
micafan
cdc1ce4ebf [GCS]Add heartbeat methods to NodeInfoAccessor (#6604) 2019-12-31 14:17:35 +08:00
Yunzhi Zhang
65acb54553 [Dashboard] Logical view backend for dashboard (#6590) 2019-12-30 13:08:08 -08:00
Sven
8b16847c02 Get utils ready for better Agent torch support. (#6561) 2019-12-30 12:27:32 -08:00
Philipp Moritz
735f282494
Use 0.9.0.dev0 as the version tag (#6630) 2019-12-30 10:14:07 -08:00
Richard Liaw
646643a588
[doc] remove redundant PS example (#6634) 2019-12-29 20:54:42 -08:00
Edward Oakes
2a66529fb7
Add multiprocessing.Pool API (#6194) 2019-12-29 21:40:58 -06:00
Eric Liang
e2bc489a18
Port webui nits from original pr that enables it (#6628)
* backport changes

* Update test_webui.py
2019-12-29 19:19:43 -08:00
Mitchell Stern
3e0f07468f Make JSON schema for projects more explicit (#6550) 2019-12-29 16:41:53 -08:00
Qstar
10338fde0c Ray operator: controller code and guide to use (#6501) 2019-12-29 10:14:47 -06:00
Eric Liang
7c1e0e5715
Implement wait_local for wait (#6524) 2019-12-28 17:40:49 -08:00
Eric Liang
677004ee3d
Add 'ray stat' command for debugging (#6622)
* wip

* wip

* wip

* iterate

* move

* fix thread safety
2019-12-28 14:40:32 -08:00
Robert Nishihara
92db13023c Fix unused variable compilation error. (#6625) 2019-12-28 12:50:14 -08:00
Eric Liang
022954ac09 [rllib] Tuple action dist tensors not reduced properly in eager mode (#6615) 2019-12-28 09:51:09 -08:00
fangfengbin
8a51efebfb Add gcs server object info handler (#6621) 2019-12-28 22:44:27 +08:00
Robert Nishihara
ff82613b66
Fix test_actor.py test_kill. (#6623) 2019-12-27 22:39:17 -08:00
alindkhare
a76fadb899 [Serve] Adding BackendConfig (#6541) 2019-12-27 23:34:50 -06:00
Robert Nishihara
96f2f8ff10 Stop testing Python 2.7 and building Python 2.7 wheels. (#6601) 2019-12-27 20:47:49 -08:00
Robert Nishihara
8724e5ffd5 Start WebUI by default. (#6493) 2019-12-27 13:49:07 -08:00
Zhijun Fu
088ce2d1e1 Fix hang on actor creation task failure (#6617) 2019-12-27 10:48:17 -08:00
micafan
a492333f4e [GCS] refactor the GCS Client Object Interface (#5695) 2019-12-27 15:18:54 +08:00
fangfengbin
3814b6d5f3 Add gcs server node info handler (#6595) 2019-12-27 15:08:38 +08:00
Eric Liang
3af84ada47
Revert "[rllib] remove exists call (#6168)" (#6616)
This reverts commit a68cda0a33.
2019-12-26 22:44:26 -08:00
Eric Liang
46acb02aa4
Fix verbose shutdown error and test_env_with_subprocesses (#6614) 2019-12-26 22:43:39 -08:00
Robert Nishihara
eb0813ea35
Re-enable UI tests for wheels. (#6602) 2019-12-26 22:34:56 -08:00
Eric Liang
d3db9e9c1e
By default, reconstruction should only be enabled for actor creation. (#6613)
* wip

* fix

* fix
2019-12-26 19:57:50 -08:00
Zhongxia Yan
98689bd263 Changed foreach_policy to foreach_trainable_policy (#6564)
Changed foreach_policy to foreach_trainable_policy in DQN when disabling exploration. This makes it consistent with the rest of the file
2019-12-26 19:50:48 -08:00
zhu-eric
65297e65f0 Experimental Actor Pool (#6055)
* mod_table

* Example fix for gallery

* lint

* nit

* nit

* fix

* gallery

* remove table for now

* training, object store, tune, actors, advanced

* start tf code

* first cut tf

* yapf

* pytorch

* add torch example

* torch

* parallel

* tune

* tuning

* reviewsready

* finetune

* fix

* move_code

* update conf

* compile

* init hyperparameter

* Start images

* overview

* extra

* fix

* works

* update-ps-example

* param_actor

* fix

* examples

* simple

* simplify_pong

* flake8 and run hyperopt

* add comments

* add comments

* add suggestion

* add suggestion

* suggestions

* add suggestion

* add suggestions

* fixed in wrong area

* last edit

* finish changes

* add line

* format

* reset

* tests and docs

* fix tests

* bazelify

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2019-12-26 14:35:10 -08:00
inventormc
0dd8a60679 [tune] Usability errors PBT (#5972)
* update with upstream master

* check for function args in hyperparam_mutations pbt

* fix style for pbt

* remove_checkpoint

* Update pbt.py

* Update pbt.py

* fix

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2019-12-26 14:27:07 -08:00
gehring
b40869d0e4 Wrapper for the dm_env interface (#6468) 2019-12-26 13:22:17 -08:00
micafan
b98b288ffd [GCS] Change GCS Test to cc_test (#6596) 2019-12-26 14:34:35 +08:00
Zhijun Fu
d2bba596ab Fix actor reconstruction with direct call (#6570) 2019-12-26 10:59:50 +08:00
Yuhao Yang
be23b3ac41 [sgd] show training result for examples (#6552) 2019-12-26 02:15:43 +01:00
Yuhao Yang
df4533c649 [tune] demo exporting trained models in pbt examples (#6533) 2019-12-26 02:14:49 +01:00
Richard Liaw
93e8c85e72
[tune] Avoid duplication in TrialRunner execution (#6598)
* avoid_duplication

* Update python/ray/tune/ray_trial_executor.py

Co-Authored-By: Kristian Hartikainen <kristian.hartikainen@gmail.com>

Co-authored-by: Kristian Hartikainen <kristian.hartikainen@gmail.com>
2019-12-26 02:13:55 +01:00
Yuhao Yang
8707a721d9 [tune] update params for optimizer in reset_config (#6522)
* reset config update lr

* add default

* Update pbt_dcgan_mnist.py

* Update pbt_convnet_example.py

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2019-12-26 02:10:09 +01:00
Richard Liaw
aa7b861332
[minor][tune] Support Type Hinting for py3 (#6571)
* fullargspec for new pyversion

* fi
2019-12-25 08:15:33 +01:00
Bharat Naik
cfb5934c62 Update id_specification.md (#6586)
Corrected number of bytes for actor ID.
2019-12-25 10:27:21 +08:00
Philipp Moritz
eaee672b7f
Revert "Perform Bazel install directly in Windows CI (#6529)" (#6593)
This reverts commit c5f141013b.
2019-12-24 16:39:07 -08:00
Robert Nishihara
f89d81896a Fix flaky test_gpu_ids test. (#6579) 2019-12-24 14:26:44 -08:00