hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 02:21:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

[RLlib] RepayBuffer: _hit_counts working again. (#23586)

Browse source
This commit is contained in:
Artur Niederfahrenhorst 2022-04-07 10:56:25 +02:00 • committed by GitHub
parent 0b3a79ca41
commit 02a50f02b7
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 5 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
rllib/utils/replay_buffers/replay_buffer.py
View file

@ -280,10 +280,13 @@ class ReplayBuffer:
def _encode_sample(self, idxes: List[int]) -> SampleBatchType:
"""Fetches concatenated samples at given indeces from the storage."""
samples = [self._storage[i] for i in idxes]
samples = []
for i in idxes:
self._hit_count[i] += 1
samples.append(self._storage[i])
if samples:
# Assume all samples are of same type
# We assume all samples are of same type
sample_type = type(samples[0])
out = sample_type.concat_samples(samples)
else: