Kai Fricke
77ba30d34e
[tune] Docs for custom command based syncer (awscli / gsutil) ( #26879 )
...
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
2022-07-22 15:28:53 -07:00
Siyuan (Ryans) Zhuang
4b50ef6a28
[Workflow] Rename the argument of "workflow.get_output" ( #26876 )
...
* rename get_output
Signed-off-by: Siyuan Zhuang <suquark@gmail.com>
* update doc
Signed-off-by: Siyuan Zhuang <suquark@gmail.com>
2022-07-22 12:06:19 -07:00
Clark Zinzow
a29baf93c8
[Datasets] Add .iter_torch_batches() and .iter_tf_batches() APIs. ( #26689 )
...
This PR adds .iter_torch_batches() and .iter_tf_batches() convenience APIs, which takes care of ML framework tensor conversion, the narrow tensor waste for the .iter_batches() call ("numpy" format), and unifies batch formats around two options: a single tensor for simple/pure-tensor/single-column datasets, and a dictionary of tensors for multi-column datasets.
2022-07-22 10:09:36 -07:00
Eric Liang
9272bcbbca
[docs] Add ecosystem map to AIR guide ( #26859 )
2022-07-21 19:06:47 -07:00
matthewdeng
14e2b2548c
[air] update remaining dict scaling_configs ( #26856 )
2022-07-21 18:55:21 -07:00
Jiao
db027d86af
[P0][AIR] Fix train to serve notebooks ( #26821 )
...
Co-authored-by: Simon Mo <simon.mo@hey.com>
2022-07-21 18:04:13 -07:00
Sihan Wang
27f1532a15
[Serve] Promote graceful shutdown and health check ( #26682 )
2022-07-21 17:37:10 -05:00
Jules S. Damji
6db2536971
[RayAIR] Minor tweaks to the why ray air for clarity ( #26680 )
2022-07-21 10:21:26 -07:00
Balaji Veeramani
ac1d21027d
[AIR] Add framework-specific checkpoints ( #26777 )
2022-07-20 19:33:27 -07:00
Richard Liaw
9f0d35b97c
[air/docs] add tensorflow benchmarks into table ( #26800 )
2022-07-20 17:12:40 -07:00
Eric Liang
d6f29eb9ca
[docs] Mark pipelined prediction as experimental for now ( #26792 )
2022-07-20 15:31:19 -07:00
xwjiang2010
e7957f4a3e
[air] update offline/online rl example and enable them. ( #26786 )
2022-07-20 14:06:03 -07:00
Siyuan (Ryans) Zhuang
0063d94166
[Core] Make "GetTimeoutError" a subclass of "TimeoutError" ( #26771 )
...
I am surprised by the fact that `GetTimeoutError` is not a subclass of `TimeoutError`, which is counter-intuitive and may discourage users from trying the timeout feature in `ray.get`, because you have to "guess" the correct error type. For most people, I believe the first error type in their mind would be `TimeoutError`.
This PR fixes this.
2022-07-20 14:37:39 -05:00
tomsunelite
d915529e9e
Add doc for custom lifetime of java actor ( #26706 )
...
Custom lifetime of java Actor is already supported, but the related document is not updated
Co-authored-by: sunkunjian1 <sunkunjian1@jd.com>
2022-07-20 22:19:44 +08:00
Tao Wang
4f2747f12a
[Core][C++ worker] Add GetNamespace api ( #26509 )
2022-07-20 11:17:14 +08:00
Tao Wang
cd521ed132
[Doc][namespaces][C++ worker]add document for c++ worker namespace and specifying namespace while creating/getting named actors ( #26498 )
...
We've supported namespace in c++ worker in https://github.com/ray-project/ray/pull/26327 . Here we add doc for usage and also reinforce the documents of Java and Python, like adding explanation of specifying namespace while creating named actors.
- [x] add doc for basic c++ worker namespace usage
- [x] add explanation for specifying namespace while creating named actors, in Python, Java and C++
2022-07-20 10:58:41 +08:00
Dmitri Gekhtman
fdd5c53bfd
[KubeRay] Documentation structure and skeleton ( #26589 )
...
Adds outline and structure for new KubeRay-based Ray-on-Kubernetes docs.
2022-07-19 13:28:04 -07:00
Richard Liaw
6563c2762d
[air] add pytorch benchmark number ( #26719 )
2022-07-19 09:51:13 -07:00
Richard Liaw
7e62e1187c
[air/benchmark] Torch benchmarks for 4x4 ( #26692 )
...
Add benchmark data for 4x4 GPU setup.
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Jimmy Yao <jiahaoyao.math@gmail.com>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2022-07-19 17:06:37 +01:00
Siyuan (Ryans) Zhuang
5b937167d3
[Workflow] Fix typo in workflow event doc ( #26686 )
...
Signed-off-by: Siyuan Zhuang <suquark@gmail.com>
2022-07-18 23:26:50 -07:00
Siyuan (Ryans) Zhuang
eb4ed49c1f
[Workflow] Unify the semantics of max_retries of workflow task and Ray task ( #26350 )
...
* workflow task retry
Signed-off-by: Siyuan Zhuang <suquark@gmail.com>
* move and enhance tests
Signed-off-by: Siyuan Zhuang <suquark@gmail.com>
* use "max_retries" of Ray task
Signed-off-by: Siyuan Zhuang <suquark@gmail.com>
* add test for disabling lineage reconstruction in workflow
Signed-off-by: Siyuan Zhuang <suquark@gmail.com>
2022-07-18 23:25:44 -07:00
Sumanth Ratna
759966781f
[air] Allow users to use instances of ScalingConfig ( #25712 )
...
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
2022-07-18 15:46:58 -07:00
matthewdeng
6670708010
[air] add placement group max CPU to data benchmark ( #26649 )
...
Set experimental `_max_cpu_fraction_per_node` to prevent deadlock.
This should technically be a no-op with the SPREAD strategy.
2022-07-18 10:34:40 -07:00
Chen Shen
b20f5f51df
[Air][Data] Don't promote locality_hints for split ( #26647 )
...
Why are these changes needed?
Since locality_hints is an experimental feature, we stop promoting it in doc and don't enable it in AIR. See #26641 for more context
2022-07-17 22:18:30 -07:00
Jiao
98a07920d3
[AIR][CUJ] Make distributing training benchmark at silver tier ( #26640 )
2022-07-17 22:07:09 -07:00
Jules S. Damji
55368402ee
added summary why and when to use bulk vs streaming data ingest ( #26637 )
2022-07-17 18:46:58 -07:00
Eric Liang
12825fc5aa
[air] Add a warning if no CPUs are reserved for dataset execution ( #26643 )
2022-07-17 16:33:51 -07:00
Clark Zinzow
864af14f41
[Datasets] [Local Shuffle - 1/N] Add local shuffling option. ( #26094 )
...
Co-authored-by: Eric Liang <ekhliang@gmail.com>
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
Co-authored-by: Matthew Deng <matt@anyscale.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2022-07-17 16:21:14 -07:00
Eric Liang
400330e9c0
[air] Add _max_cpu_fraction_per_node to ScalingConfig and documentation ( #26634 )
2022-07-16 21:55:51 -07:00
Amog Kamsetty
3a345a470c
[AIR/Docs] Add Predictor Docs ( #25833 )
2022-07-16 21:14:21 -07:00
Jiao
77e2ef2eb6
[AIR] Update Torch benchmarks with documentation ( #26631 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2022-07-16 17:58:21 -07:00
Eric Liang
0855bcb77e
[air] Use SPREAD strategy by default and don't special case it in benchmarks ( #26633 )
2022-07-16 17:37:06 -07:00
M Waleed Kadous
7c32993c15
[core/docs]Add a new section under Ray Core called Ray Gotchas ( #26624 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2022-07-16 16:53:01 -07:00
Antoni Baum
fb6f3cf708
[AIR/Docs] Small improvements to Train user guide ( #26577 )
...
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
2022-07-16 16:51:17 -07:00
Eric Liang
6217138eb0
[docs] Move AIR benchmarks to top level ( #26632 )
2022-07-16 15:34:31 -07:00
Philipp Moritz
081bbfbff1
[Examples] Test OCR example in documentation tests ( #26482 )
...
Make sure the OCR example is tested in documentation after we discovered that example notebooks are not tested in CI.
Signed-off-by: Philipp Moritz <pcmoritz@gmail.com>
2022-07-16 10:51:28 -07:00
Richard Liaw
799311b2f7
[air/docs] update examples to remove pandas again ( #26598 )
2022-07-16 08:40:44 -07:00
Balaji Veeramani
34cf1f17ea
[Datasets] Add ImageFolderDatasource ( #24641 )
...
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2022-07-15 22:43:23 -07:00
matthewdeng
e3a096f412
[air] add bulk ingest benchmarks ( #26618 )
2022-07-15 22:01:23 -07:00
Richard Liaw
5ad4e75831
[air] Add initial benchmark section ( #26608 )
2022-07-15 15:33:48 -07:00
Jiao
647e12b6c7
[AIR] Fix convert_existing_pytorch_code_to_ray_air notebook ( #26523 )
2022-07-14 14:30:55 -07:00
Tim Gates
e42dc7943e
docs: Fix a few typos ( #26556 )
...
There are small typos in:
- doc/source/data/faq.rst
- python/ray/serve/replica.py
Fixes:
- Should read `successfully` rather than `succssifully`.
- Should read `pseudo` rather than `psuedo`.
2022-07-14 12:38:33 -07:00
Jiajun Yao
60dd77a2d3
Enable usage stats collection for ray.init iff nightly wheels ( #26461 )
...
For nightly wheels, we want to collect usage stats for local clusters started via ray.init() as well.
2022-07-14 12:14:01 -07:00
Amog Kamsetty
6595bd6e2d
[AIR] Introduce better scoring API for BatchPredictor ( #26451 )
...
Signed-off-by: Amog Kamsetty <amogkamsetty@yahoo.com>
As discussed offline, allow configurability for feature columns and keep columns in BatchPredictor for better scoring UX on test datasets.
2022-07-14 11:26:12 -07:00
Richard Liaw
a0ce3c111b
[air/data] Concatenator preprocessor ( #26526 )
2022-07-14 10:26:14 -07:00
Eric Liang
5f18c67ba3
Fix LINT ( #26554 )
...
Signed-off-by: Eric Liang <ekhliang@gmail.com>
2022-07-13 23:28:02 -07:00
Jiao
15dbc0362a
[AIR][Docs] Fix torch_image_example ( #26453 )
2022-07-13 21:59:24 -07:00
Scott Cheng
1bc44c13fb
Update Python3.10 in docs ( #26463 )
...
Make it clear to users that ray supports Python 3.10
2022-07-13 20:08:56 -07:00
Eric Liang
31c8c908f9
[docs] Improve AIR API ref organization ( #26530 )
2022-07-13 18:05:17 -07:00
Sihan Wang
b606169cb5
[Serve] Promote autoscaling feature ( #26393 )
...
1. get rid of the private attribute
2. fix unit test
3. docs and workflows
2022-07-13 14:38:38 -05:00
