Edward Oakes
1be87c7fbb
[serve] Remove global state, instead access the master actor directly ( #7914 )
...
* Move _scale() to master actor
* move create_backend
* Move set_backend_config
* Move get_backend_config
* Remove backend_table from global_state
* Remove global_state, just access master directly
* Remove accidental addition
2020-04-07 15:21:40 -05:00
Sven Mika
81314143eb
[RLlib] Use framework_iterator (add torch/eager/tf) to PPO and PG tests. ( #7915 )
2020-04-07 12:40:34 -07:00
Edward Oakes
d3c310f408
[serve] Only access backend_table in master actor ( #7913 )
2020-04-07 10:12:39 -05:00
Kai Yang
48b48cc8c2
Support multiple core workers in one process ( #7623 )
2020-04-07 11:01:47 +08:00
micafan
e91595f955
[GCS] Add ObjectLocator to gcs server ( #7557 )
2020-04-07 10:37:24 +08:00
Sven Mika
c2cb5c2214
[RLlib] MARWIL torch. ( #7836 )
...
* WIP.
* WIP.
* LINT.
* Fix MARWIL so it can run with eager-mode.
* LINT.
2020-04-06 16:38:50 -07:00
Ion
9f6cbf168e
New scheduler local node ( #7899 )
2020-04-06 14:43:42 -05:00
Richard Liaw
a67edc4051
[tune] Improve user guides and API docs ( #7716 )
...
* create guide gallery for Tune
* mods
* ok
* fix
* fix_up_gallery
* ok
* Apply suggestions from code review
Co-Authored-By: Sven Mika <sven@anyscale.io>
* Apply suggestions from code review
Co-Authored-By: Sven Mika <sven@anyscale.io>
Co-authored-by: Sven Mika <sven@anyscale.io>
2020-04-06 12:16:35 -07:00
Sven Mika
22ccc43670
[RLlib] DQN torch version. ( #7597 )
...
* Fix.
* Rollback.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* Fix.
* Fix.
* Fix.
* Fix.
* Fix.
* WIP.
* WIP.
* Fix.
* Test case fixes.
* Test case fixes and LINT.
* Test case fixes and LINT.
* Rollback.
* WIP.
* WIP.
* Test case fixes.
* Fix.
* Fix.
* Fix.
* Add regression test for DQN w/ param noise.
* Fixes and LINT.
* Fixes and LINT.
* Fixes and LINT.
* Fixes and LINT.
* Fixes and LINT.
* Comment
* Regression test case.
* WIP.
* WIP.
* LINT.
* LINT.
* WIP.
* Fix.
* Fix.
* Fix.
* LINT.
* Fix (SAC does currently not support eager).
* Fix.
* WIP.
* LINT.
* Update rllib/evaluation/sampler.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/evaluation/sampler.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/utils/exploration/exploration.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/utils/exploration/exploration.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* WIP.
* WIP.
* Fix.
* LINT.
* LINT.
* Fix and LINT.
* WIP.
* WIP.
* WIP.
* WIP.
* Fix.
* LINT.
* Fix.
* Fix and LINT.
* Update rllib/utils/exploration/exploration.py
* Update rllib/policy/dynamic_tf_policy.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/policy/dynamic_tf_policy.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/policy/dynamic_tf_policy.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Fixes.
* WIP.
* LINT.
* Fixes and LINT.
* LINT and fixes.
* LINT.
* Move action_dist back into torch extra_action_out_fn and LINT.
* Working SimpleQ learning cartpole on both torch AND tf.
* Working Rainbow learning cartpole on tf.
* Working Rainbow learning cartpole on tf.
* WIP.
* LINT.
* LINT.
* Update docs and add torch to APEX test.
* LINT.
* Fix.
* LINT.
* Fix.
* Fix.
* Fix and docstrings.
* Fix broken RLlib tests in master.
* Split BAZEL learning tests into cartpole and pendulum (reached the 60min barrier).
* Fix error_outputs option in BAZEL for RLlib regression tests.
* Fix.
* Tune param-noise tests.
* LINT.
* Fix.
* Fix.
* test
* test
* test
* Fix.
* Fix.
* WIP.
* WIP.
* WIP.
* WIP.
* LINT.
* WIP.
Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-04-06 11:56:16 -07:00
Richard Liaw
f63b4c1110
[sgd] make ddp optional ( #7875 )
...
* loosen
* devices
* tryitout
* fix
* fix
* fix
* easy
* test
* fix
* fix
* better visibility
* fix
2020-04-06 11:41:36 -07:00
mehrdadn
203c077895
Switch to Boost generic sockets ( #7656 )
...
* Use generic Boost sockets
* Un-templatize server/client connections
Co-authored-by: Mehrdad <noreply@github.com>
2020-04-05 22:26:46 -07:00
Sven Mika
82c2d9faba
[RLlib] Fix broken RLlib tests in master. ( #7894 )
2020-04-05 09:34:23 -07:00
Robert Nishihara
38fad274aa
Add links to 3.8 nightly wheels to docs. ( #7902 )
2020-04-04 21:59:45 -07:00
SangBin Cho
73fd78316d
[Dashboard] Authentication ( #7888 )
...
* Change authentication schema.
Authentication implementation.
* Formatting.
* Fix a minor style.
* Fix tests.
* Removed url validation.
2020-04-04 19:40:54 -07:00
Allen
3c91ff1f63
[autoscaler] Allowing users to provide extra configs for AWS ( #7844 )
...
* Allowing users to provide custom key names & security group inbound rules
* linting
* getting aws credentials passed in
* one more thing
* one more thing part 2
* formatting
* addressing comments
* update
* update
* update
* update
* update
* update
* remove tests
* rerun tests
Co-authored-by: Allen Yin <allenyin@anyscale.io>
2020-04-04 18:36:51 -07:00
Eric Liang
630b3b1752
[rllib] set daemon status for PolicyServerInput thread ( #7862 )
2020-04-04 16:08:51 -07:00
acxz
11c2b500b8
[bazel] Remove deprecated and now non-existent flag ( #7886 )
2020-04-03 22:36:01 -07:00
acxz
7827d2c2de
Add wheel build dependency ( #7877 )
2020-04-03 18:10:34 -07:00
ijrsvt
e03f687b84
Cleaning up remaining Local Mode Code ( #7865 )
2020-04-03 19:54:15 -05:00
micafan
185d591108
No need to send actor died signal from RedisActorInfoAccessor ( #7883 )
2020-04-03 17:45:39 -07:00
Markus Cozowicz
b853df7a3b
[autoscaler] Switch to ARM for Azure deployment ( #7717 )
...
* switch to ARM templates for config and VMs
* switch to ARM templates for config and VMs
* auto-formatting
* addressed Scotts comment
* added missing imports
* fixed gpu templates
fixed wheel reference
* added missing reference
* cleanup wording and yamls
* Update doc/source/autoscaling.rst
Co-Authored-By: Scott Graham <5720537+gramhagen@users.noreply.github.com>
Co-authored-by: Ubuntu <marcozo@marcozodev2.zqvgrdyupqrudayw1il1agipig.jx.internal.cloudapp.net>
Co-authored-by: Scott Graham <5720537+gramhagen@users.noreply.github.com>
2020-04-03 15:51:56 -07:00
Sven Mika
1d4823c0ec
[RLlib] Add testing framework_iterator. ( #7852 )
...
* Add testing framework_iterator.
* LINT.
* WIP.
* Fix and LINT.
* LINT fix.
2020-04-03 12:24:25 -07:00
Sven Mika
bb6c675231
[RLlib] Bug fix: Copy is_exploring placeholder for multi-GPU tower generation. ( #7846 )
2020-04-03 10:44:58 -07:00
Sven Mika
5537fe13b0
[RLlib] Exploration API: ParamNoise Integration into DQN; working example/test cases. ( #7814 )
2020-04-03 10:44:25 -07:00
Qing Wang
1b477c6dd0
[Streaming] Fix streaming CI failure. ( #7869 )
2020-04-03 10:45:25 +08:00
SangBin Cho
1d532d1cb8
[Dashboard ]Action Implementation. ( #7826 )
2020-04-02 18:02:37 -07:00
Simon Mo
a3181816b3
Add result from 0.8.4 release ( #7876 )
2020-04-02 15:31:03 -07:00
Edward Oakes
7f9ddfcfd8
Only access route_table and policy_table in master actor ( #7835 )
2020-04-02 14:44:53 -07:00
Edward Oakes
cbe494ab13
[flaky test] Fix flaky test_heartbeats_single ( #7857 )
2020-04-02 16:23:28 -05:00
Richard Liaw
314250d072
[docs] Make Ray slack more prominent ( #7870 )
2020-04-02 11:14:02 -07:00
Sven Mika
7b08db9f8c
[RLlib] Remove all instances of tf.contrib.layers. ... from RLlib code (deprecated). ( #7851 )
2020-04-01 18:03:14 -07:00
ijrsvt
9bfc2c4b54
Moving Local Mode to C++ ( #7670 )
2020-04-01 15:50:57 -05:00
mehrdadn
65054a2c7c
Python 3.8 compatibility ( #7754 )
2020-04-01 10:03:23 -07:00
Richard Liaw
24bf6ad607
[raysgd] Improve raysgd examples ( #7818 )
...
* better_example
* test
* improve some usability things
* submit
* fix
* flake
* Update python/ray/util/sgd/torch/training_operator.py
* trythis
* fix
* fix
* smoke
* fail
* fix
* fix
2020-04-01 08:58:39 -07:00
Edward Oakes
f4239d27fa
[serve] Create all other actors in master actor ( #7791 )
2020-04-01 10:15:04 -05:00
Robert Nishihara
b011c604d7
Remove ray.tasks() from API. ( #7807 )
2020-04-01 10:10:40 -05:00
micafan
780c1c3b08
[GCS] impl RedisStoreClient for GCS Service ( #7675 )
2020-04-01 21:18:19 +08:00
Sven Mika
e153e3179f
[RLlib] Exploration API: Policy changes needed for forward pass noisifications. ( #7798 )
...
* Rollback.
* WIP.
* WIP.
* LINT.
* WIP.
* Fix.
* Fix.
* Fix.
* LINT.
* Fix (SAC does currently not support eager).
* Fix.
* WIP.
* LINT.
* Update rllib/evaluation/sampler.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/evaluation/sampler.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/utils/exploration/exploration.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/utils/exploration/exploration.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* WIP.
* WIP.
* Fix.
* LINT.
* LINT.
* Fix and LINT.
* WIP.
* WIP.
* WIP.
* WIP.
* Fix.
* LINT.
* Fix.
* Fix and LINT.
* Update rllib/utils/exploration/exploration.py
* Update rllib/policy/dynamic_tf_policy.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/policy/dynamic_tf_policy.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Update rllib/policy/dynamic_tf_policy.py
Co-Authored-By: Eric Liang <ekhliang@gmail.com>
* Fixes.
* LINT.
* WIP.
Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-04-01 00:43:21 -07:00
Sven Mika
66df8b8c35
[RLlib] Working/learning example: PPO + torch + LSTM. ( #7797 )
2020-03-31 22:00:28 -07:00
SangBin Cho
c23e56ce9a
Metrics Export Service ( #7809 )
2020-03-30 23:28:32 -07:00
fangfengbin
bfb9248532
fix gcs server resolver error ( #7822 )
...
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-03-30 22:57:55 -07:00
mehrdadn
8958728139
Windows bug fixes ( #7740 )
2020-03-30 20:39:23 -05:00
Simon Mo
dc9b62e007
Deserialize Args in Event Loop Thread ( #7806 )
2020-03-30 18:28:13 -07:00
mehrdadn
f86e623095
Fix & improve GitHub Actions CI builds ( #7784 )
2020-03-30 16:29:54 -07:00
Sven Mika
e356e97eb2
[RLlib] Assert correct policy class being used in Worker. ( #7769 )
2020-03-30 14:03:29 -07:00
Richard Liaw
fbf02fa7f7
[Hotfix] Lint for Documentation ( #7817 )
2020-03-30 11:49:05 -07:00
Richard Liaw
18327254b6
[docs] Fix readthedocs rendering ( #7810 )
2020-03-30 11:40:08 -07:00
Richard Liaw
86cff17e7e
[tune/raysgd] Tune API for TorchTrainer + Fix State Restoration ( #7547 )
2020-03-30 12:58:49 -05:00
Edward Oakes
3a53ea60d9
[Serve] Push route table updates to HTTP proxy ( #7774 )
2020-03-30 09:53:05 -07:00
Tianyi Chen
f889f938e5
[streaming] Use enum to define resource type. ( #7813 )
2020-03-31 00:03:49 +08:00
