2022-04-25 16:12:57 -07:00
|
|
|
.. _train-examples:
|
2021-08-02 01:47:14 -07:00
|
|
|
|
2021-10-18 22:27:46 -07:00
|
|
|
Ray Train Examples
|
|
|
|
==================
|
2021-08-02 01:47:14 -07:00
|
|
|
|
2021-09-14 09:07:25 -07:00
|
|
|
.. Example .rst files should be organized in the same manner as the
|
2021-10-18 22:27:46 -07:00
|
|
|
.py files in ray/python/ray/train/examples.
|
2021-09-14 09:07:25 -07:00
|
|
|
|
2021-10-18 22:27:46 -07:00
|
|
|
Below are examples for using Ray Train with a variety of models, frameworks,
|
|
|
|
and use cases.
|
2021-08-02 01:47:14 -07:00
|
|
|
|
2021-09-14 09:07:25 -07:00
|
|
|
General Examples
|
|
|
|
----------------
|
|
|
|
|
|
|
|
PyTorch
|
|
|
|
~~~~~~~
|
|
|
|
|
2022-07-07 12:28:37 -07:00
|
|
|
* :doc:`/train/examples/torch_fashion_mnist_example`:
|
2021-09-14 09:07:25 -07:00
|
|
|
End-to-end example for PyTorch.
|
|
|
|
|
2022-01-20 15:30:56 -08:00
|
|
|
* :doc:`/train/examples/transformers/transformers_example`:
|
2021-09-14 09:07:25 -07:00
|
|
|
End-to-end example for HuggingFace Transformers (PyTorch).
|
|
|
|
|
|
|
|
TensorFlow
|
|
|
|
~~~~~~~~~~
|
|
|
|
|
2022-01-20 15:30:56 -08:00
|
|
|
* :doc:`/train/examples/tensorflow_mnist_example`:
|
2021-09-14 09:07:25 -07:00
|
|
|
End-to-end example for TensorFlow
|
|
|
|
|
|
|
|
Horovod
|
2021-10-18 22:27:46 -07:00
|
|
|
~~~~~~~
|
2021-09-14 09:07:25 -07:00
|
|
|
|
2022-01-20 15:30:56 -08:00
|
|
|
* :doc:`/train/examples/horovod/horovod_example`:
|
2021-09-14 09:07:25 -07:00
|
|
|
End-to-end example for Horovod (with PyTorch)
|
|
|
|
|
|
|
|
|
2021-12-21 17:17:52 -08:00
|
|
|
Logger/Callback Examples
|
|
|
|
------------------------
|
2022-01-20 15:30:56 -08:00
|
|
|
* :doc:`/train/examples/mlflow_fashion_mnist_example`:
|
2021-12-21 17:17:52 -08:00
|
|
|
Example for logging training to MLflow via the ``MLflowLoggerCallback``
|
2021-09-14 09:07:25 -07:00
|
|
|
|
2022-03-10 21:17:00 +01:00
|
|
|
|
2021-09-14 09:07:25 -07:00
|
|
|
Ray Tune Integration Examples
|
|
|
|
-----------------------------
|
|
|
|
|
2022-01-20 15:30:56 -08:00
|
|
|
* :doc:`/train/examples/tune_tensorflow_mnist_example`:
|
2021-09-14 09:07:25 -07:00
|
|
|
End-to-end example for tuning a TensorFlow model.
|
2021-08-02 01:47:14 -07:00
|
|
|
|
2022-07-07 12:28:37 -07:00
|
|
|
* :doc:`/train/examples/tune_cifar_torch_pbt_example`:
|
2021-09-27 18:22:40 +02:00
|
|
|
End-to-end example for tuning a PyTorch model with PBT.
|
|
|
|
|
2021-09-14 09:07:25 -07:00
|
|
|
..
|
|
|
|
TODO implement these examples!
|
2021-08-02 01:47:14 -07:00
|
|
|
|
2021-09-14 09:07:25 -07:00
|
|
|
Features
|
|
|
|
--------
|
2021-08-02 01:47:14 -07:00
|
|
|
|
2021-09-14 09:07:25 -07:00
|
|
|
* Example for using a custom callback
|
|
|
|
* End-to-end example for running on an elastic cluster (elastic training)
|
2021-08-02 01:47:14 -07:00
|
|
|
|
2021-09-14 09:07:25 -07:00
|
|
|
Models
|
|
|
|
------
|
2021-08-02 01:47:14 -07:00
|
|
|
|
2021-09-14 09:07:25 -07:00
|
|
|
* Example training on Vision model.
|
2022-03-18 13:27:26 -07:00
|
|
|
|
|
|
|
Benchmarks
|
|
|
|
----------
|
|
|
|
|
|
|
|
* :doc:`/train/examples/torch_data_prefetch_benchmark/benchmark_example`:
|
|
|
|
Benchmark example for the PyTorch data transfer auto pipeline.
|
|
|
|
|