Kai Fricke 7eb3543e93 [tune] Chunk file transfers in cross-node checkpoint syncing (#23804) ... What: This introduces a general utility to synchronize directories between two nodes, derived from the RemoteTaskClient. This implementation uses chunked transfers for more efficient communication. Why: Transferring files over 2GB in size leads to superlinear time complexity in some setups (e.g. local macbooks). This could be due to memory limits, swapping, or gRPC limits, and is explored in a different thread. To overcome this limitation, we use chunked data transfers which show quasi-linear scalability for larger files.		2022-04-12 13:45:07 +01:00
..
ray	[tune] Chunk file transfers in cross-node checkpoint syncing (#23804)	2022-04-12 13:45:07 +01:00
requirements	[ci] Pin prometheus_client to fix current test outages (#23749)	2022-04-06 14:22:22 -07:00
asv.conf.json	[docs] Move all /latest links to /master (#11897)	2020-11-10 10:53:28 -08:00
build-wheel-macos-arm64.sh	Upgrade cython to 0.29.26 for py310 (#21244)	2021-12-26 20:26:08 -08:00
build-wheel-macos.sh	Upgrade cython to 0.29.26 for py310 (#21244)	2021-12-26 20:26:08 -08:00
build-wheel-manylinux2014.sh	Upgrade cython to 0.29.26 for py310 (#21244)	2021-12-26 20:26:08 -08:00
build-wheel-windows.sh	[CI] Migrate Windows Wheels to Buildkite (#21388)	2022-01-05 12:49:19 -08:00
MANIFEST.in	Includes .pyi files in package data. (#21247)	2021-12-27 11:50:02 -08:00
README-building-wheels.md	[build] Build wheels with manylinux2014 (#11621)	2020-11-03 19:36:32 -08:00
requirements.txt	[ci] Pin prometheus_client to fix current test outages (#23749)	2022-04-06 14:22:22 -07:00
requirements_linters.txt	Remove yapf dependency (#23656)	2022-04-04 21:50:04 -07:00
requirements_ml_docker.txt	[ci] Clean up ray-ml requirements (#23325)	2022-03-25 15:59:54 +00:00
setup.py	[ci] Pin prometheus_client to fix current test outages (#23749)	2022-04-06 14:22:22 -07:00