hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

[RLlib] Issue 15910: APEX current learning rate not updated on local worker (#15911)

Browse source
This commit is contained in:
Antoine Galataud 2021-07-13 20:01:00 +02:00 • committed by GitHub
parent fac6045c87
commit 16f1011c07
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
rllib/agents/dqn/apex.py
View file

@ -131,6 +131,8 @@ class UpdateWorkerWeights:
self.weights = ray.put(
self.workers.local_worker().get_weights())
actor.set_weights.remote(self.weights, _get_global_vars())
# Also update global vars of the local worker.
self.workers.local_worker().set_global_vars(_get_global_vars())
self.steps_since_update[actor] = 0
# Update metrics.
metrics = _get_shared_metrics()