mirror of
https://github.com/vale981/ray
synced 2025-03-07 02:51:39 -05:00
4dd221f848
Preview: [docs](https://ray--21931.org.readthedocs.build/en/21931/data/dataset.html) The Ray Data project's docs now have a clearer structure and have partly been rewritten/modified. In particular we have - [x] A Getting Started Guide - [x] An explicit User / How-To Guide - [x] A dedicated Key Concepts page - [x] A consistent naming convention in `Ray Data` whenever is is referred to the project. This surfaces quite clearly that, apart from the "Getting Started" sections, we really only have one real example. Once we have more, we can create an "Example" section like many other sub-projects have. This will be addressed in https://github.com/ray-project/ray/issues/21838.
58 lines
1.5 KiB
ReStructuredText
58 lines
1.5 KiB
ReStructuredText
.. _mars-on-ray:
|
|
|
|
Using Mars on Ray
|
|
=================
|
|
|
|
.. _`issue on GitHub`: https://github.com/mars-project/mars/issues
|
|
|
|
|
|
`Mars`_ is a tensor-based unified framework for large-scale data computation which scales Numpy, Pandas and Scikit-learn.
|
|
Mars on Ray makes it easy to scale your programs with a Ray cluster.
|
|
|
|
.. note::
|
|
|
|
This API is experimental in Mars. If you encounter any bugs, please file an `issue on GitHub`_.
|
|
|
|
|
|
.. _`Mars`: https://docs.pymars.org
|
|
|
|
|
|
Installation
|
|
-------------
|
|
You can simply install Mars via pip:
|
|
|
|
.. code-block:: bash
|
|
|
|
pip install pymars>=0.6.0a1
|
|
|
|
|
|
Getting started
|
|
----------------
|
|
|
|
It's easy to run Mars jobs on a Ray cluster. Use ``from mars.session import new_session``
|
|
and run ``new_session(backend='ray').as_default()``; this will create
|
|
a Mars session for Ray as the default session, and then all Mars tasks will be
|
|
submitted to Ray. Arguments will be passed to ``ray.init()`` when
|
|
creating a Mars session like this:
|
|
``new_session(backend='ray', address=<address>, num_cpus=<num_cpus>)``.
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
from mars.session import new_session
|
|
ray_session = new_session(backend='ray').as_default()
|
|
|
|
import mars.dataframe as md
|
|
import mars.tensor as mt
|
|
|
|
t = mt.random.rand(100, 4, chunk_size=30)
|
|
df = md.DataFrame(t, columns=list('abcd'))
|
|
print(df.describe().execute())
|
|
|
|
|
|
.. warning::
|
|
|
|
`Mars remote API`_ is not available for now.
|
|
|
|
|
|
.. _`Mars remote API`: https://docs.pymars.org/en/latest/getting_started/remote.html
|