hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

[RLLib] Add missing .to() for MARWIL on PyTorch (#10685)

Browse source 
There was a missing .to() that caused a device mismatch error on PyTorch with MARWIL.
This commit is contained in:
Julius Frost 2020-09-09 21:52:55 -04:00 • committed by GitHub
parent f7d5aa46a3
commit e72838c03d
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
rllib/agents/marwil/marwil_torch_policy.py
View file

@ -70,7 +70,7 @@ def stats(policy, train_batch):
def setup_mixins(policy, obs_space, action_space, config):
# Create a var.
policy.ma_adv_norm = torch.tensor(
[100.0], dtype=torch.float32, requires_grad=False)
[100.0], dtype=torch.float32, requires_grad=False).to(policy.device)
# Setup Value branch of our NN.
ValueNetworkMixin.__init__(policy)