hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
ray/rllib/agents
History
Sven Mika 3052193c9e
[RLlib] Fix CQL getting stuck when deprecated timesteps_per_iteration is used (use min_train_timesteps_per_reporting instead). (#24345) 
Fix CQL getting stuck when deprecated timesteps_per_iteration is used (use min_train_timesteps_per_reporting instead).

CQL does not perform sampling timesteps and the deprecated timesteps_per_iteration is automatically translated into the new min_sample_timesteps_per_reporting, but should be translated (only for CQL and other purely offline RL algos) into min_train_timesteps_per_reporting.

If timesteps_per_iteration, CQL lever leaves the first iteration as it thinks it's not done yet (sample timesteps always remain at 0).
2022-04-29 21:02:34 +01:00
..
a3c [RLlib][Training iteration fn] APEX conversion (#22937) 2022-04-20 17:56:18 +02:00
alpha_star [RLlib] Fix AlphaStar for tf2+tracing; smaller cleanups around avoiding to wrap a TFPolicy as_eager() or with_tracing more than once. (#24271) 2022-04-28 13:43:21 +02:00
ars [RLlib] Removed deprecated code with error=True (#23916) 2022-04-15 13:51:12 +02:00
bandit [RLlib] Removed deprecated code with error=True (#23916) 2022-04-15 13:51:12 +02:00
cql [RLlib] Fix CQL getting stuck when deprecated timesteps_per_iteration is used (use min_train_timesteps_per_reporting instead). (#24345) 2022-04-29 21:02:34 +01:00
ddpg [RLlib] Replay Buffer API and Training Iteration Fn for DQN. (#23420) 2022-04-18 12:20:12 +02:00
dqn [RLlib] SlateQ training iteration function. (#24151) 2022-04-29 18:38:17 +02:00
dreamer [spelling] Add linter rule for mis-capitalizations of RLLib -> RLlib (#23817) 2022-04-10 16:12:53 -07:00
es [spelling] Add linter rule for mis-capitalizations of RLLib -> RLlib (#23817) 2022-04-10 16:12:53 -07:00
impala [RLlib] Memory leak finding toolset using tracemalloc + CI memory leak tests. (#15412) 2022-04-12 07:50:09 +02:00
maml [CI] Replace YAPF disables with Black disables (#21982) 2022-02-08 16:29:25 -08:00
marwil [RLlib] MARWIL: Move to training_iteration API. (#23798) 2022-04-11 19:28:32 +02:00
mbmpo [CI] Replace YAPF disables with Black disables (#21982) 2022-02-08 16:29:25 -08:00
pg [RLlib] PGTrainer config object class (PGConfig). (#24295) 2022-04-28 22:25:16 +02:00
ppo [RLlib] PGTrainer config object class (PGConfig). (#24295) 2022-04-28 22:25:16 +02:00
qmix [RLlib] QMIX training iteration function and new replay buffer API. (#24164) 2022-04-27 14:24:20 +02:00
sac [RLlib] Training Iteration Function for SAC (#24157) 2022-04-26 12:37:54 +02:00
slateq [RLlib] SlateQ training iteration function. (#24151) 2022-04-29 18:38:17 +02:00
tests [RLlib] Ensure MultiCallbacks always implements all callback methods (#24254) 2022-04-29 10:30:24 +02:00
__init__.py [RLlib] POC: Config objects instead of dicts (PPO only). (#23491) 2022-03-31 18:26:12 +02:00
callbacks.py [RLlib] Fix type hints for original_batches in callbacks. (#24214) 2022-04-29 10:33:53 +02:00
mock.py [CI] Format Python code with Black (#21975) 2022-01-29 18:41:57 -08:00
registry.py [RLlib] Removed deprecated code with error=True (#23916) 2022-04-15 13:51:12 +02:00
trainer.py [RLlib] QMIX training iteration function and new replay buffer API. (#24164) 2022-04-27 14:24:20 +02:00
trainer_config.py [RLlib] PGTrainer config object class (PGConfig). (#24295) 2022-04-28 22:25:16 +02:00