mirror of
https://github.com/vale981/ray
synced 2025-03-07 02:51:39 -05:00
9b67cb5a6f
This change is needed for object fusing to see performance increases on HDD. Currently, smaller object writes are slow even with fusing since the writes are not buffered (negating the point of fusing). Benchmarks show that while the default is sufficient for fast SSDs, on a slow HDD, increasing the buffer size reduces write times by several magnitudes. ### Performance Changes A microbenchmark where 500KB objects were produced (then spilled) and consumed to observe changes in object fusing/spilling. | Run | Produce (s) | Consume (s) | Total (s) | | -- | -- | -- | -- | | Baseline (original) | 347.332281 | 355.611272 | 705.560750 | | Baseline (w/ fix) | 181.815852 | 347.692850 | 532.847759 | | No fusing (original) | 453.574554 | 525.047998 | 981.620108 | | No fusing (w/ fix) | 452.614848| 519.787698 | 975.412639 | The baseline runs should be notably faster due to object fusing reducing I/O requests. With the fix, Ray's defaults allow this microbenchmark to have a 48% time reduction with negligible impact on runtime when fusing is disabled. See [this followup](https://github.com/ray-project/ray/pull/22618#issuecomment-1054838715) for information on the differences between SSD and HDD performance with different buffer sizes. Co-authored-by: Ubuntu <ubuntu@ip-172-31-54-240.us-west-2.compute.internal> |
||
|---|---|---|
| .. | ||
| _examples | ||
| doc_code | ||
| examples | ||
| images | ||
| actors.rst | ||
| advanced.rst | ||
| async_api.rst | ||
| concurrency_group_api.rst | ||
| configure.rst | ||
| cross-language.rst | ||
| download_zip_url.png | ||
| fault-tolerance.rst | ||
| handling-dependencies.rst | ||
| memory-management.rst | ||
| namespaces.rst | ||
| package-ref.rst | ||
| placement-group.rst | ||
| ray-dashboard.rst | ||
| ray_repo.png | ||
| serialization.rst | ||
| starting-ray.rst | ||
| troubleshooting.rst | ||
| using-ray-with-gpus.rst | ||
| using-ray-with-jupyter.rst | ||
| using-ray-with-pytorch.rst | ||
| using-ray-with-tensorflow.rst | ||
| using-ray.rst | ||
| walkthrough.rst | ||
