ray/doc/source
matthewdeng ba0a2a022a
[datasets] add Dataset.randomize_block_order (#25568)
This exposes a low-cost way to perform a pseudo global shuffle.

For extremely large datasets that span multiple nodes, contiguous blocks will often be colocated on the same node. This leads to hot spots during iteration of the dataset in which single nodes (1) must send a lot of data over the network, and (2) perform lots of disk reads if the dataset is spilled to disk.

This allows the workload to be spread across the nodes on which the dataset blocks are on.
2022-06-08 18:39:15 -07:00
..
_includes Point to latest contributing doc (#25149) 2022-05-31 10:13:20 +02:00
_static [docs] Cleanup ray init docs (#25492) 2022-06-06 13:16:32 -07:00
_templates [docs] templates and contribution guide (fixes #21753) (#23003) 2022-03-10 15:28:07 +00:00
cluster Add warning about entrpoint command in quotes (#25519) 2022-06-08 09:38:55 -07:00
data [datasets] add Dataset.randomize_block_order (#25568) 2022-06-08 18:39:15 -07:00
images [Datasets] Add basic e2e Datasets example on NYC taxi dataset (#24874) 2022-05-19 12:54:25 -07:00
ray-air [Docs] Capitalize Ray AIR (#25597) 2022-06-08 14:37:53 -07:00
ray-contribute [doc] Fix the document on how to build java from source. (#25351) 2022-06-02 12:39:54 +08:00
ray-core [docs] Add an example for simple highly parallelizable tasks. (#24885) 2022-06-08 18:10:37 -07:00
ray-more-libs [docs] Add initial AIR documentation (#24483) 2022-05-13 01:29:59 -07:00
ray-observability [docs] Document log to driver = False 2022-05-19 15:07:30 -07:00
ray-overview [Doc] Remove trailing period symbol install instruction (#25543) 2022-06-07 08:08:04 -07:00
ray-references [docs] Add initial AIR documentation (#24483) 2022-05-13 01:29:59 -07:00
rllib [RLlib]: Doubly Robust Off-Policy Evaluation. (#25056) 2022-06-07 12:52:19 +02:00
serve [Serve] [AIR] ModelWrapper improvements and docs (#25003) 2022-06-07 08:53:10 -07:00
train [Train] Clean up ray.train package (#25566) 2022-06-08 10:22:36 -07:00
tune [tune/train] Consolidate checkpoint manager 3: Ray Tune (#24430) 2022-06-08 12:05:34 +01:00
workflows [workflow] Remove workflow virtual actor (#25394) 2022-06-02 18:17:25 -07:00
_toc.yml [docs] Add an example for simple highly parallelizable tasks. (#24885) 2022-06-08 18:10:37 -07:00
conf.py [docs] Cleanup ray init docs (#25492) 2022-06-06 13:16:32 -07:00
custom_directives.py [docs] Use better method to mock ObjectRef (#25535) 2022-06-06 23:50:52 -07:00
index.md [air/docs] Update documentation structure (#25475) 2022-06-06 15:15:11 -07:00
preprocess_github_markdown.py [Docs] Automatically render latest ray_lightning docs (#23729) 2022-04-08 16:57:23 -07:00
robots.txt [docs] add robots txt (#24726) 2022-05-18 10:52:22 +01:00