Richard Liaw
169e422937
[docs] Make Jobs more prominent in documentation ( #21575 )
2022-01-13 23:49:34 -08:00
Max Pumperla
703c161034
[doc] Fix sklearn doc error, introduce MyST markdown parser ( #21527 )
2022-01-12 15:17:28 -08:00
Linsong Chu
61bbecdb7d
[Workflow]add doc for metadata ( #20156 )
...
This PR adds documentation for Workflow Metadata, which we recently added support in https://github.com/ray-project/ray/pull/19372 .
Co-authored-by: Yi Cheng <74173148+iycheng@users.noreply.github.com>
2021-12-20 17:24:07 -08:00
Clark Zinzow
b872fdaaac
[Datasets] Last-mile preprocessing docs. ( #20712 )
...
Datasets docs for last-mile preprocessing, particularly geared towards ML ingest. This gives groupby, aggregations, and random shuffling examples in the overview page (not present previously), adds some concreteness to our last-mile preprocessing positioning, and provides some preprocessing recipes for a few common transformations.
2021-11-29 23:23:27 -08:00
Jiao
12c11894e8
[Jobs] Add documentation for ray job submission ( #20530 )
2021-11-19 16:59:05 -08:00
Sven Mika
9d5c4a9d21
[RLlib] API reference pages: rllib/env package only. ( #20486 )
2021-11-19 10:06:40 +01:00
Simon Mo
5fccad4cc9
[Serve] Add experimental pipeline docs ( #20292 )
2021-11-16 16:13:55 -08:00
Eric Liang
460cf86858
Split blocks automatically into 500MB chunks on file read and transformation ( #20235 )
...
This PR adds support for automatic block splitting on read and map transforms, to keep block size bounded to ~500MiB. This avoids potential OOM situations where a map task may consume too much intermediate Python heap memory, or too much object store shared memory for one block.
2021-11-15 22:25:11 -08:00
Siyuan (Ryans) Zhuang
3b62388a9a
[Workflow] Workflow tail recursion optimization ( #19928 )
...
* tail recursion optimization
2021-11-12 09:13:40 -08:00
Sven Mika
ebd56b57db
[RLlib; documentation] "RLlib in 60sec" overhaul. ( #20215 )
2021-11-10 22:20:06 +01:00
Alex Wu
36a214386f
[docs] PyData ray dataset talk ( #20038 )
2021-11-04 10:33:18 -07:00
Philipp Moritz
0a5942d8b0
[Documentation] Fix quotes for windows installations ( #19859 )
...
* [Documentation] Fix quotes for windows installations
* update
* formatting
2021-10-29 10:54:38 -07:00
Alex Wu
31d89be926
[Workflow] Basic event support ( #19239 )
...
* basics
* .
* .
* a test
* a test
* tests
* cleanup
* concepts page
* docs
* polish
* fix sleep
* fix yi things
* lint
* fix
* .
* .
* .
* fix?
* .
Co-authored-by: Alex Wu <alex@anyscale.com>
2021-10-22 15:27:33 -07:00
matthewdeng
4674c78050
[Train] Rename Ray SGD v2 to Ray Train ( #19436 )
2021-10-18 22:27:46 -07:00
Eric Liang
9f1cd9e867
[docs] Document fake multi-node autoscaler ( #19329 )
2021-10-12 15:59:07 -07:00
Chen Shen
c740aae54c
[Core][Dataset] adding example for large scale data ingestion ( #18998 )
2021-10-11 15:37:09 -07:00
Eric Liang
86cbe3e833
[data] Add support for repeating and re-windowing a DatasetPipeline ( #19091 )
2021-10-06 20:13:43 -07:00
Amog Kamsetty
98ac3f601c
[SGD] v1 to v2 Migration Guide ( #18887 )
...
* wip
* add guide
* fix test
* address comments
* add to docs
* fix
* remove markdown
* add warning to all pages
* formatting
* fix
* links
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* address comments
* address comments
* fix
* address comments
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
2021-09-30 09:15:21 -07:00
Guyang Song
337005d5a5
[C++ API][hotfix] fix C++ worker dynamic library loading issue on macOS ( #18877 )
...
* fix C++ worker in macox
* fix
2021-09-24 23:39:00 +08:00
Eric Liang
85aaca8d45
Update the contribution guide / style guide ( #18753 )
2021-09-19 20:14:51 -07:00
matthewdeng
380a653787
[SGD] update SGDv2 user guide docs ( #18270 )
...
* [SGD] update SGDv2 user guide docs
* Update doc/source/raysgd/v2/user_guide.rst
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
* add new line
* update docs
* fix header line length
* lint
* lint
* lint
* lint
* fix remaining lint issues
* Update doc/source/raysgd/v2/user_guide.rst
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
* Update doc/source/raysgd/v2/user_guide.rst
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
* address comments
* address comments
* add TODO for iterator API
* Update doc/source/raysgd/v2/user_guide.rst
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
* address comments
* address comments
* add tune doc
* restructure table of contents
* add examples; rename example files to include example suffix
* add quick start, porting code
* address comments
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2021-09-14 09:07:25 -07:00
Clark Zinzow
b30c41759d
[Datasets] Adds tensor column support (tensors-in-tables) via Pandas/Arrow extension types/arrays. ( #18301 )
2021-09-08 10:09:01 -07:00
Amog Kamsetty
3b77840c1b
PyTorch Lightning Updates ( #17876 )
2021-08-27 23:15:51 -07:00
Eric Liang
95b5ad12ba
Initial version of workflow documentation ( #18138 )
2021-08-27 16:20:48 -07:00
qicosmos
a2a1c46c83
[C++ Worker]Fix for mac ( #17633 )
...
* linkopts shared
* replace gflags with absl flags
* fix
* add test option
* fix
* add cpp worker to mac ci
* fix
* support empty redis password;mod arc argv
* add encoding
* test
* ignore example test on mac
* support mac
* fix
* fix and update doc
* fix
* fix run.sh
* fix init
* fix typo
* fix run.sh
* fix lint
Co-authored-by: 久龙 <guyang.sgy@antfin.com>
2021-08-13 12:22:37 +08:00
SongGuyang
93094e567b
[C++ API] C++ API doc update ( #17538 )
2021-08-05 16:24:07 +08:00
Eric Liang
e812691909
Support top-level tensor values in dataset ( #17439 )
2021-08-01 22:45:21 -07:00
Eric Liang
7ed62ea0ad
Initial implementation of Dataset pipelining and docs ( #17309 )
2021-07-28 21:12:01 -07:00
Antoni Baum
5e9b680e39
[docs] Add LightGBM-Ray docs, update XGBoost-Ray docs ( #17188 )
2021-07-20 16:06:47 +01:00
SongGuyang
21b464ae9d
[C++ API] support get ray address from env ( #17144 )
2021-07-16 17:17:43 +08:00
SongGuyang
dcb1baabd7
[C++ API] support loading C++ dynamic libraries from code search path ( #16828 )
2021-07-16 13:02:45 +08:00
Michael Galarnyk
880aa7d8a8
Update index.rst ( #17123 )
2021-07-15 13:11:42 -07:00
Eric Liang
38bddc3f2b
First cut at dataset documentation ( #16956 )
2021-07-14 23:27:13 -07:00
SongGuyang
560fd15568
[C++ worker] support build and add C++ worker to python wheel ( #16496 )
2021-07-08 14:42:26 +08:00
Kai Yang
e925051ce4
[Core] Get node to connect for driver in global state accessor ( #16810 )
2021-07-08 11:21:12 +08:00
SongGuyang
1d5c72ebde
[C++ API] rename 'ray_redis_address' to 'ray_address' ( #16772 )
2021-06-30 20:50:28 +08:00
SongGuyang
41b9a5102b
[C++ worker] support build C++ worker during python setup ( #16636 )
2021-06-29 10:29:47 +08:00
Alex Wu
197dab0e2f
[docs] Deploying Ray ( #16538 )
...
Co-authored-by: Alex Wu <alex@anyscale.com>
2021-06-19 10:07:15 -07:00
Ian Rodney
16d762aed0
[DocSprint] Ray Client Docs ( #16497 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-06-19 10:05:37 -07:00
Hao Zhang
f47a0e1f27
[Collective] generate ray.util.collective doc ( #16521 )
2021-06-17 18:41:57 -07:00
Kai Fricke
5352b786b3
[docs] Add ray desig patterns and antipatterns to docs ( #16478 )
2021-06-17 19:56:44 +01:00
qicosmos
0f87eca3e9
[C++ Worker]Generate a template project for users ( #16337 )
2021-06-16 17:45:45 +08:00
SongGuyang
331ea6b72d
[C++ worker] fix doc ( #16239 )
2021-06-04 13:41:47 +08:00
SongGuyang
17b5f4dcaa
[C++ worker] support config from RayConfig and command line(gflag) ( #16086 )
2021-05-31 11:56:02 +08:00
Michael Galarnyk
cedd348650
[DOCS] Added link to ray pulse community survey ( #15891 )
2021-05-18 15:25:36 -07:00
Edward Oakes
c9550a86dc
[serve] Update docs for v2 Deployments API ( #15582 )
2021-05-03 13:19:34 -05:00
Kathryn Zhou
38b64e4fb4
Add tracing to Ray ( #14872 )
2021-04-30 22:16:47 -07:00
architkulkarni
03afaed6e1
[Serve] [Doc] Create top-level page for Calling Endpoints from HTTP and from Python ( #14904 )
2021-03-24 20:29:24 -05:00
SongGuyang
134152937a
fix doc ( #14555 )
2021-03-09 18:57:03 +08:00
Eric Liang
dbaa28f81e
Add links to new rllib paper ( #14432 )
2021-03-01 20:11:40 -08:00
