hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

Fix from Dask bug in Datasets (#19409)

Browse source
This commit is contained in:
Chen Shen 2021-10-15 15:04:52 -07:00 • committed by GitHub
parent 07064cddf9
commit acfbf4c170
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
python/ray/data/read_api.py
View file

@ -500,7 +500,7 @@ def from_dask(df: "dask.DataFrame") -> Dataset[ArrowRow]:
partitions = df.to_delayed() partitions = df.to_delayed()
persisted_partitions = dask.persist(*partitions, scheduler=ray_dask_get) persisted_partitions = dask.persist(*partitions, scheduler=ray_dask_get)
return from_pandas( return from_pandas_refs(
[next(iter(part.dask.values())) for part in persisted_partitions]) [next(iter(part.dask.values())) for part in persisted_partitions])