hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-05 18:11:42 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

[Datasets] Fix API breakage in Datasets nightly test.

Browse source
This commit is contained in:
Clark Zinzow 2021-10-07 15:07:19 -07:00 • committed by GitHub
parent c3e3fc7637
commit ca731d7c86
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
release/nightly_tests/dataset/dataset_shuffle_data_loader.py
View file

@ -85,7 +85,7 @@ def create_torch_iterator(split, batch_size, rank=None):
def create_dataset(filenames, repeat_times):
pipeline = ray.data.read_parquet(list(filenames))\
.repeat(times=repeat_times).random_shuffle()
.repeat(times=repeat_times).random_shuffle_each_window()
return pipeline