mirror of
https://github.com/vale981/ray
synced 2025-03-06 02:21:39 -05:00
parent
2120d3ea09
commit
8e7e89a178
1 changed files with 1 additions and 1 deletions
|
@ -226,7 +226,7 @@ will instead reinterpret those data partitions directly as its blocks.
|
|||
.. tabbed:: Spark
|
||||
|
||||
Create a ``Dataset`` from a `Spark DataFrame
|
||||
<https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.sql.DataFrame.html>`__.
|
||||
<https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/dataframe.html>`__.
|
||||
This constructs a ``Dataset`` backed by the distributed Spark DataFrame partitions
|
||||
that underly the Spark DataFrame. When this conversion happens, Spark-on-Ray (RayDP)
|
||||
will save the Spark DataFrame partitions to Ray's object store in the Arrow format,
|
||||
|
|
Loading…
Add table
Reference in a new issue