Kingsley Kuan
d1dd5d578e
[RLlib] Fix PyTorch A3C / A2C loss function using mixed reduced sum / mean ( #11449 )
2020-10-22 12:39:34 -07:00
Philsik Chang
ede9347127
[rllib] Add torch_distributed_backend flag for DDPPO ( #11362 ) ( #11425 )
2020-10-21 18:30:42 -07:00
Eric Liang
e8c77e2847
Remove memory quota enforcement from actors ( #11480 )
...
* wip
* fix
* deprecate
2020-10-21 14:29:03 -07:00
Sven Mika
414041c6dd
[RLlib] Do not create env on driver iff num_workers > 0. ( #11307 )
2020-10-15 18:21:30 +02:00
Sven Mika
0c0f67c14d
[RLlib] ARS/ES eval workers not working: Issue 9933. ( #11308 )
2020-10-12 13:49:48 -07:00
Sven Mika
f5e2cda68a
[RLlib] SAC: log_alpha not being learnt when on GPU. ( #11298 )
2020-10-12 13:48:44 -07:00
Julius Frost
7dcfd258cd
[RLlib] Assert LongTensor in SAC Discrete PyTorch ( #11245 )
2020-10-12 13:47:21 -07:00
Sven Mika
d3bc20b727
[RLlib] ConvTranspose2D module ( #11231 )
2020-10-12 15:00:42 +02:00
Sumanth Ratna
14d8826e43
Fix overriden typo ( #11227 )
2020-10-07 19:11:07 -07:00
Sven Mika
ce96b03b07
[RLlib] MB-MPO cleanup (comments, docstrings, type annotations). ( #11033 )
2020-10-06 20:28:16 +02:00
Sven Mika
c17169dc11
[RLlib] Fix all example scripts to run on GPUs. ( #11105 )
2020-10-02 23:07:44 +02:00
Michael Luo
47b499d899
Cartpole MAML + Discrete ( #11028 )
2020-10-02 12:56:34 +02:00
Sven Mika
36bda8432b
[RLlib] Trajectory view API: Simple List Collector (on by default for PPO); LSTM-agnostic ( #11056 )
2020-10-01 16:57:10 +02:00
Eric Liang
ecdaaffc67
add large data warning ( #10957 )
2020-09-23 15:46:06 -07:00
Michael Luo
ba5a3ae9e2
Enable vtrace by default ( #10962 )
2020-09-22 22:18:21 -07:00
mvindiola1
2b893d1bb5
fix incorrect critic loss in TD3 ( #10775 )
...
Co-authored-by: Manny Vindiola <manuel.m.vindiola.civ@mail.mil>
2020-09-20 20:01:51 -07:00
Sven Mika
805dad3bc4
[RLlib] SAC algo cleanup. ( #10825 )
2020-09-20 11:27:02 +02:00
Sumanth Ratna
9da7bdcc8e
Use master for links to docs in source ( #10866 )
2020-09-19 00:30:45 -07:00
Eric Liang
f83c588f08
[rllib] Remove broken no eager on workers mode ( #10745 )
...
* remove no eager
* Update trainer.py
2020-09-15 17:25:20 -07:00
desktable
4ccfd07a61
[RLlib] Add docstrings for agents/dqn ( #10710 )
2020-09-15 12:37:07 +02:00
maxco2
b8436f0f00
[rllib] Fix SAC and DDPG tensorflow policy can't do grad_clip ( #10499 )
...
* Fix sac_tf_policy clip_by_norm missing argument
* Fix ddpg_tf_policy clip_by_norm missing argument
* Fix format
2020-09-11 12:04:44 -07:00
Julius Frost
e72838c03d
[RLLib] Add missing .to() for MARWIL on PyTorch ( #10685 )
...
There was a missing .to() that caused a device mismatch error on PyTorch with MARWIL.
2020-09-09 18:52:55 -07:00
desktable
799318d7d7
[RLlib] Add type annotations for agents/dqn ( #10626 )
2020-09-09 18:55:26 +02:00
Sven Mika
4b278c36fc
[RLlib] Behavioral Cloning (from MARWIL). ( #10619 )
2020-09-09 17:33:21 +02:00
Michael Luo
8e613652af
[RLLib] MBMPO Fixes ( #10296 )
2020-09-09 09:34:34 +02:00
Sven Mika
28ab797cf5
[RLlib] Deprecate old classes, methods, functions, config keys (in prep for RLlib 1.0). ( #10544 )
2020-09-06 10:58:00 +02:00
Sven Mika
8a891b3c30
[RLlib] SAC n_step > 1. ( #10567 )
2020-09-05 22:26:42 +02:00
Sven Mika
244aafdcf8
[RLlib] Curiosity enhancements. ( #10373 )
2020-09-05 13:14:24 +02:00
Sven Mika
715ee8dfc9
[RLlib] Issue 10469: Callbacks should receive env idx ... ( #10477 )
2020-09-03 17:27:05 +02:00
Sven Mika
ef18893fb5
[RLlib] PPO, APPO, and DD-PPO code cleanup. ( #10420 )
2020-09-02 14:03:01 +02:00
Michael Luo
4e9888ce2f
[RLlib] Dreamer ( #10172 )
2020-08-26 13:24:05 +02:00
Olli Huotari
0dae50b5eb
Fixed num_atoms>1 in pytorch ( #10330 )
2020-08-25 23:10:20 -07:00
Eric Liang
deea1861ab
[rllib] Try fixing torch GPU and masking errors ( #10168 )
2020-08-25 18:34:19 -07:00
krfricke
c31876002d
[tune/rllib] made wandb compatible with rllib trainables ( #10252 )
2020-08-21 17:25:52 -07:00
Sven Mika
e968b52cb7
[RLlib] Trajectory view API - 03 Fast LSTM + prev actions/rewards ( #9950 )
2020-08-21 12:35:16 +02:00
Sven Mika
d14b501692
[RLlib] First attempt at cleaning up algo code in RLlib: PG. ( #10115 )
2020-08-20 17:05:57 +02:00
Raphael Avalos
8b704eb419
Small fix for Cuda Torch DQN. ( #10177 )
2020-08-19 13:28:05 -07:00
Sven Mika
2cbe29a7fa
[RLlib] Curiosity minor fixes, do-overs, and testing. ( #10143 )
2020-08-19 17:49:50 +02:00
Tomasz Wrona
aff7f19360
[tune] Added logger_config field ( #8521 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-18 11:10:22 -07:00
Sven Mika
2256047876
[RLlib] Rename rllib.utils.types into typing to match built-in python module's name. ( #10114 )
2020-08-15 13:24:22 +02:00
Chua Cheow Huan
ea51e94729
[rllib] Learning rate schedule for DDPPO. ( #10006 )
...
* Get shared metrics, increment counter & set global vars for remote workers.
* Add unit test to test lr_schedule for DDPPO.
* Broadcast the local set of global vars to remote workers instead of independently setting the global vars on each rollout worker.
2020-08-15 00:51:45 -07:00
Sven Mika
66d204e078
[RLlib] Model documentation enhancements. ( #10011 )
2020-08-13 13:36:40 +02:00
Barak Michener
8e76796fd0
ci: Redo format.sh --all script & backfill lint fixes ( #9956 )
2020-08-07 16:49:49 -07:00
Sven Mika
57690a3a9f
[RLlib] Trajectory view API - 02 actual API scaffold ( #9753 )
2020-08-06 10:54:20 +02:00
Sven Mika
19d785b947
[LINT] Except RLlib from checking for flake8 error F821 ( #9946 )
2020-08-06 10:44:37 +02:00
Michael Luo
4d7bd8c892
[RLlib] Implementation of "Model-based Meta Policy Optimization" (MB MPO) ( #9409 )
2020-08-02 18:12:09 +02:00
Sven Mika
b0b0463161
[RLlib] Trajectory View API (preparatory cleanup and enhancements). ( #9678 )
2020-07-29 21:15:09 +02:00
Sven Mika
ff9c1dac88
[RLlib] Issue 9667 DDPG Torch bugs and enhancements. ( #9680 )
2020-07-28 14:15:03 +02:00
Sven Mika
5dc4b6686e
[RLlib] Implement DQN PyTorch distributional head. ( #9589 )
2020-07-25 09:29:24 +02:00
Eric Liang
590943a499
[rllib] Type annotations for model classes ( #9646 )
2020-07-24 12:01:46 -07:00
