ray/python/requirements/data_processing/requirements.txt

dask[complete]==2021.03.0; python_version < '3.7'
dask[complete]==2021.9.1; python_version >= '3.7'
aioboto3==8.3.0
flask_cors
moto[s3]
s3fs
modin>=0.8.3;  python_version < '3.7'
modin>=0.11.0; python_version >= '3.7'
pytest-repeat
raydp-nightly
[Dataset] Adds JSON, CSV, Pandas, and Dask IO layers, and adds the write side of the Parquet IO layer. (#16724) 2021-07-01 13:57:40 -05:00			`dask[complete]==2021.03.0; python_version < '3.7'`
[Release] Bump up dask to latest compatible version 2021.9.1 (#19592) * Bump up dask to latest compatible version 2021.9.1 * Bump up dask to latest compatible version 2021.9.1 2021-10-22 09:16:28 -07:00			`dask[complete]==2021.9.1; python_version >= '3.7'`
[workflow] S3 support for workflow (#16993) * up * up * up * format * up * fix comment * up * update * update * move dep * bump pytest versin * use lazy_fixture explicitly * format 2021-07-13 19:14:41 -07:00			`aioboto3==8.3.0`
[workflow] workflow ci enable (#17255) * Enable workflow tests * update * Fix one bug 2021-07-22 17:59:24 -07:00			`flask_cors`
[workflow] S3 support for workflow (#16993) * up * up * up * format * up * fix comment * up * update * update * move dep * bump pytest versin * use lazy_fixture explicitly * format 2021-07-13 19:14:41 -07:00			`moto[s3]`
[Datasets] Add local and S3 filesystem test coverage for file-based datasources. (#17158) 2021-08-12 08:39:31 -07:00			`s3fs`
Dataset from modin (#18122) 2021-08-31 14:19:35 -04:00			`modin>=0.8.3; python_version < '3.7'`
Remove deprecated ray.services package (#18475) Co-authored-by: Kai Fricke <kai@anyscale.com> 2021-10-14 08:28:16 -07:00			`modin>=0.11.0; python_version >= '3.7'`
[workflow] Workflow inside virtual actor (#18066) 2021-08-30 10:40:22 -07:00			`pytest-repeat`
[Dataset] implement `from_spark`, `to_spark` and some optimizations (#17340) 2021-09-10 02:43:47 +08:00			`raydp-nightly`