No description
Find a file
Richard Liaw aad3c50e2d
[tune] Cluster Fault Tolerance (#3309)
This PR introduces cluster-level fault tolerance for Tune by checkpointing global state. This occurs with relatively high frequency and allows users to easily resume experiments when the cluster crashes.

Note that this PR may affect automated workflows due to auto-prompting, but this is resolvable.
2018-12-29 11:42:25 +08:00
.github Add docs for contributors. (#1191) 2017-11-10 00:40:19 -08:00
.travis Update arrow to reduce plasma IPCs. (#3497) 2018-12-14 23:49:37 -05:00
cmake/Modules Upgrade flatbuffers version to 1.10.0. (#3559) 2018-12-23 14:56:34 -08:00
dev Update release documentation. (#3587) 2018-12-24 11:09:09 -08:00
doc [tune] Cluster Fault Tolerance (#3309) 2018-12-29 11:42:25 +08:00
docker Update arrow to reduce plasma IPCs. (#3497) 2018-12-14 23:49:37 -05:00
examples [rllib] Propagate model options correctly in ARS / ES, to action dist of PPO (#2974) 2018-10-01 12:49:39 -07:00
java [Java] Support calling Ray APIs from multiple threads (#3646) 2018-12-28 17:44:31 +08:00
python [tune] Cluster Fault Tolerance (#3309) 2018-12-29 11:42:25 +08:00
site Update Gemfile Jekyll version (#3140) 2018-10-25 21:43:08 -07:00
src/ray fix code issues in object manager that are reported by scanning tool (#3649) 2018-12-28 14:38:59 -08:00
test [tune] Cluster Fault Tolerance (#3309) 2018-12-29 11:42:25 +08:00
thirdparty/scripts Fix TensorFlow and PyTorch compatibility (#3574) 2018-12-22 13:25:48 -08:00
.clang-format Remove legacy Ray code. (#3121) 2018-10-26 13:36:58 -07:00
.gitignore Ship Modin with Ray. (#3109) 2018-11-29 20:05:24 +01:00
.style.yapf YAPF, take 3 (#2098) 2018-05-19 16:07:28 -07:00
.travis.yml Fix Jenkins test failures and function descriptor bug. (#3569) 2018-12-25 23:31:44 -08:00
build-docker.sh adding -x flag for better debugging during builds (#1079) 2017-10-04 13:56:14 -07:00
build.sh enable incremental builds (#3292) 2018-11-12 21:49:09 -05:00
CMakeLists.txt Convert the raylet client (the code in local_scheduler_client.cc) to proper C++. (#3511) 2018-12-13 13:39:10 -08:00
CONTRIBUTING.rst Replace special single quote with regular single quote. (#1693) 2018-03-10 20:36:01 -08:00
LICENSE [rllib] add augmented random search (#2714) 2018-08-24 22:20:02 -07:00
pylintrc adding pylint (#233) 2016-07-08 12:39:11 -07:00
README.rst Update documentation to reflect 0.6.1 release. (#3622) 2018-12-24 11:10:04 -08:00
scripts Improve yapf speed and document its usage (#2160) 2018-06-05 20:22:11 -07:00
setup_thirdparty.sh update ray cmake build process (#2853) 2018-09-12 11:19:33 -07:00

.. image:: https://github.com/ray-project/ray/raw/master/doc/source/images/ray_header_logo.png

.. image:: https://travis-ci.com/ray-project/ray.svg?branch=master
    :target: https://travis-ci.com/ray-project/ray

.. image:: https://readthedocs.org/projects/ray/badge/?version=latest
    :target: http://ray.readthedocs.io/en/latest/?badge=latest

.. image:: https://img.shields.io/badge/pypi-0.6.1-blue.svg
    :target: https://pypi.org/project/ray/

|

**Ray is a flexible, high-performance distributed execution framework.**


Ray is easy to install: ``pip install ray``

Example Use
-----------

+------------------------------------------------+----------------------------------------------------+
| **Basic Python**                               | **Distributed with Ray**                           |
+------------------------------------------------+----------------------------------------------------+
|.. code-block:: python                          |.. code-block:: python                              |
|                                                |                                                    |
|  # Execute f serially.                         |  # Execute f in parallel.                          |
|                                                |                                                    |
|                                                |  @ray.remote                                       |
|  def f():                                      |  def f():                                          |
|      time.sleep(1)                             |      time.sleep(1)                                 |
|      return 1                                  |      return 1                                      |
|                                                |                                                    |
|                                                |                                                    |
|                                                |  ray.init()                                        |
|  results = [f() for i in range(4)]             |  results = ray.get([f.remote() for i in range(4)]) |
+------------------------------------------------+----------------------------------------------------+


Ray comes with libraries that accelerate deep learning and reinforcement learning development:

- `Tune`_: Hyperparameter Optimization Framework
- `RLlib`_: Scalable Reinforcement Learning
- `Distributed Training <http://ray.readthedocs.io/en/latest/distributed_sgd.html>`__

.. _`Tune`: http://ray.readthedocs.io/en/latest/tune.html
.. _`RLlib`: http://ray.readthedocs.io/en/latest/rllib.html

Installation
------------

Ray can be installed on Linux and Mac with ``pip install ray``.

To build Ray from source or to install the nightly versions, see the `installation documentation`_.

.. _`installation documentation`: http://ray.readthedocs.io/en/latest/installation.html

More Information
----------------

- `Documentation`_
- `Tutorial`_
- `Blog`_
- `Ray paper`_
- `Ray HotOS paper`_

.. _`Documentation`: http://ray.readthedocs.io/en/latest/index.html
.. _`Tutorial`: https://github.com/ray-project/tutorial
.. _`Blog`: https://ray-project.github.io/
.. _`Ray paper`: https://arxiv.org/abs/1712.05889
.. _`Ray HotOS paper`: https://arxiv.org/abs/1703.03924

Getting Involved
----------------

- Ask questions on our mailing list `ray-dev@googlegroups.com`_.
- Please report bugs by submitting a `GitHub issue`_.
- Submit contributions using `pull requests`_.

.. _`ray-dev@googlegroups.com`: https://groups.google.com/forum/#!forum/ray-dev
.. _`GitHub issue`: https://github.com/ray-project/ray/issues
.. _`pull requests`: https://github.com/ray-project/ray/pulls