ray/python
Clark Zinzow 68d4dd3a8b
[Datasets] Add explicit resource allocation option via a top-level scheduling strategy (#24438)
Instead of letting Datasets implicitly use cluster resources in the margins of explicit allocations of other libraries, such as Tune, Datasets should provide an option for explicitly allocating resources for a Datasets workload for users that want to box Datasets in. This PR adds such an explicit resource allocation option, via exposing a top-level scheduling strategy on the DatasetContext with which a placement group can be given.
2022-05-17 15:01:15 -07:00
..
ray [Datasets] Add explicit resource allocation option via a top-level scheduling strategy (#24438) 2022-05-17 15:01:15 -07:00
requirements [Datasets] Add from_huggingface for Hugging Face datasets integration (#24464) 2022-05-06 13:09:28 -07:00
asv.conf.json [docs] Move all /latest links to /master (#11897) 2020-11-10 10:53:28 -08:00
build-wheel-macos-arm64.sh [python3.10] build python310 wheels (#24829) 2022-05-16 12:36:33 -07:00
build-wheel-macos.sh [python3.10] build python310 wheels (#24829) 2022-05-16 12:36:33 -07:00
build-wheel-manylinux2014.sh [python3.10] build python310 wheels (#24829) 2022-05-16 12:36:33 -07:00
build-wheel-windows.sh [python3.10] build python310 wheels (#24829) 2022-05-16 12:36:33 -07:00
MANIFEST.in Includes .pyi files in package data. (#21247) 2021-12-27 11:50:02 -08:00
README-building-wheels.md [build] Build wheels with manylinux2014 (#11621) 2020-11-03 19:36:32 -08:00
requirements.txt Revert "[dataset] Use polars for sorting (#24523)" (#24781) 2022-05-13 12:09:12 -07:00
requirements_linters.txt Remove yapf dependency (#23656) 2022-04-04 21:50:04 -07:00
requirements_ml_docker.txt [AIR] Add distributed torch_geometric example (#23580) 2022-04-21 09:48:43 -07:00
setup.py [python3.10] build python310 wheels (#24829) 2022-05-16 12:36:33 -07:00