Chen Shen
02042e1305
[Core] Revert "[Core] Batch PinObjectIDs requests from Raylet client ( #24322 )" and "[Core] rename PinObjectIDs to PinObjectID ( #24451 )" ( #24741 )
...
we noticed performance regression for nightly test shuffle_1tb_5000_partitions. concretely the test previously takes 1h10m to finish but now it takes more than 2h30minutes.
after investigation we believe mostly likely 5a826405a82640https://console.anyscale.com/o/anyscale-internal/projects/prj_SVFGM5yBqK6DHCfLtRMryXHM/clusters/ses_1ejykCYq9BnkC5v8ZJjrqc2b?command-history-section=command_history
here is the run after 5a82640https://console.anyscale.com/o/anyscale-internal/projects/prj_SVFGM5yBqK6DHCfLtRMryXHM/clusters/ses_Lr5N8jVRdHCWJWYA2SRaUkzZ?command-history-section=command_history
2022-05-12 16:17:40 -07:00
Jiajun Yao
0a0c52e351
[Doc] Improve doc for task locality aware scheduling ( #24717 )
2022-05-12 13:42:48 -07:00
Patrick Ames
e2ee2140f9
[Datasets] Add documentation for bulk parquet read API and file metadata providers. ( #24354 )
...
API doc updates for #23179 and #24094 . All data docs related to #23179 should be up-to-date once this PR and #24203 are merged.
2022-05-12 10:19:33 -07:00
Max Pumperla
42e877d2f7
[docs] full results on enter, fixes #24519 ( #24722 )
...
Signed-off-by: Max Pumperla <max.pumperla@googlemail.com>
2022-05-12 10:00:35 -07:00
Amog Kamsetty
c4bf38daa6
[AIR] Add AIR install extra ( #24701 )
...
Closes #23439
2022-05-12 09:25:52 -07:00
Edward Oakes
fb71743935
[serve] Convert "End-to-end Tutorial" to "Getting Started" ( #24690 )
2022-05-12 08:44:43 -07:00
Guilherme
bb0bcbace0
[docs] Fix example in ray-get-loop.rst ( #24609 )
2022-05-12 00:05:57 -07:00
Sihan Wang
c5bfe1d694
[Serve] Add deployment graph cookbook ( #24524 )
2022-05-11 16:24:55 -07:00
Sebastián Ramírez
2842b074bb
📝 Update structure in development docs ( #24377 )
...
This is a small update for the structure of the docs about building Ray from source.
My idea was to isolate steps that are shared and then steps required per platform/system. Also consolidating the instructions to clone with git, install, directory structure, etc.
I'm still figuring out the building steps (installing the dependencies for docs in an M1), but I wanted to start the draft right away.
2022-05-11 15:47:54 -05:00
Eric Liang
2b598ca440
[doc] Improve the object reference documentation ( #24636 )
2022-05-10 18:39:16 -07:00
Jiajun Yao
1daad65568
[Doc] Add doc for usage stats collection ( #24522 )
2022-05-10 17:18:49 -07:00
Zhe Zhang
909d463552
[docs] Fix import error in Ray Data "getting started" ( #24424 )
...
We did `import pandas as pd` but here we are using it as `pandas`
2022-05-10 15:46:15 -07:00
Simon Mo
6760fe0121
[Serve][Doc] Convert Serve doc sources from rst to myst ( #24657 )
2022-05-10 14:04:17 -07:00
Antoni Baum
04e16f70a3
[Datasets] [Docs] Add a warning about from_huggingface ( #24608 )
...
Adds a warning to docs about the intended use of from_huggingface.
2022-05-10 13:08:25 -07:00
Amog Kamsetty
a36e2a8f51
[Tune] Deprecate DistributedTrainableCreator ( #24453 )
...
Fully deprecate DistributedTrainableCreator for Ray 2.0
Closes #24453
2022-05-10 11:06:43 -07:00
Chen Shen
f1f8ad6ca3
[Doc][Data] fix big-data-ingestion broken links ( #24631 )
...
The links were broken. Fixed it.
2022-05-10 09:04:41 -07:00
Chen Shen
00a0f81090
[Doc][xgboost] fix broken download links #24632
...
The yaml file download link is missing, fixed it in this pr.
2022-05-10 09:03:26 -07:00
Jiajun Yao
d462172be7
Add doc for actor spread scheduling ( #24552 )
...
grant_or_reject for raylet based actor scheduling is implemented as part of #23829 , so spread scheduling now works for actors just like tasks.
2022-05-06 21:36:47 -07:00
Antoni Baum
668049492c
[Datasets] Add from_huggingface for Hugging Face datasets integration ( #24464 )
...
Adds a from_huggingface method to Datasets, which allows the conversion of a Hugging Face Dataset to a Ray Dataset. As a Hugging Face Dataset is backed by an Arrow table, the conversion is trivial.
2022-05-06 13:09:28 -07:00
kourosh hakhamaneshi
69055f556d
[RLlib] Move agents.ars to algorithms.ars. ( #24516 )
2022-05-06 19:11:15 +02:00
kourosh hakhamaneshi
f48f1b252c
[RLlib] Moved agents.es to algorithms.es ( #24511 )
2022-05-06 14:54:22 +02:00
Sven Mika
7ab19ddc32
[RLlib] MADDPG: Move into agents folder (from contrib) and use training_iteration method. ( #24502 )
2022-05-06 12:35:21 +02:00
Siyuan (Ryans) Zhuang
417b72efdc
[workflow] Update workflow docs ( #24249 )
...
* update workflow docs
* rename "step" to "task"
2022-05-05 22:22:51 -07:00
Stephanie Wang
2931a23760
[doc] Add docs for push-based shuffle in Datasets ( #24486 )
...
Adds recommendations, example, and brief benchmark results for push-based shuffle in Datasets.
2022-05-05 14:59:33 -07:00
Christy Bergman
76eb47e226
[RLlib; docs] Rename UCB -> LinUCB. ( #24348 )
2022-05-05 10:20:16 +02:00
mwtian
e00c611807
[Core] rename PinObjectIDs to PinObjectID ( #24451 )
...
As discussed in #24322 , rename so the function name matches its signature for PinObjectID(). Also rename the RPC request/reply/method names, to keep them consistent.
2022-05-04 10:08:32 -07:00
Simon Mo
21d76c4ca4
[Serve] Add short-hand for pydantic http adapter ( #24404 )
2022-05-04 09:43:18 -05:00
Sven Mika
5b61a00792
[RLlib] Feed all values in COMMON_CONFIG directly from TrainerConfig() (removes duplicate values and comments). ( #24433 )
2022-05-04 16:28:12 +02:00
Jiajun Yao
b8e61bc4d8
Add actor out-of-band communication doc ( #24185 )
...
Add typical use cases for actor out-of-band communication.
2022-05-03 21:36:26 -07:00
Archit Kulkarni
fa7a934bb9
[Doc] [Serve] Add note about relationship between serve autoscaler and ray autoscaler ( #24414 )
2022-05-03 13:54:19 -07:00
Eric Liang
d178645f18
[docs] Add documentation on how to handle read-only arrays and actor reprs ( #24410 )
2022-05-02 23:52:54 -07:00
Antoni Baum
cf1c5f2ccf
[docs] Restore external markdown stubs ( #24357 )
...
This PR introduces a modification to the external markdown logic in doc build to restore the original file content after build is finished. This ensures that the files are not accidentally committed.
2022-05-02 15:37:40 +01:00
fede
9a6e0538ea
Pythonic assert for initialization ( #24378 )
2022-05-01 22:01:10 -07:00
Simon Mo
3378e1924e
[Serve] Rename input_schema to http_adapter and clarify it in doc ( #24353 )
2022-04-29 16:14:04 -07:00
Antoni Baum
ff0ced1a64
[AIR] HuggingFaceTrainer&Predictor implementation ( #23876 )
...
Implements HuggingFaceTrainer & HuggingFacePredictor.
2022-04-29 14:31:54 -07:00
Balaji Veeramani
2190f7ff25
[Datsets] Add SimpleTensorFlowDatasource ( #24022 )
...
This PR makes it easier to use TensorFlow datasets with Ray Datasets.
2022-04-29 12:15:30 -07:00
Shawn
43ed78f6fd
[Datasets] Integrate Mars-on-Ray with Datasets; improve docs and add tests ( #23402 )
...
Add Mars-on-Ray + Datasets integration; improve Mars-on-Ray docs and add tests.
2022-04-29 09:43:52 -07:00
Sven Mika
ba14f0a41b
[RLlib] PGTrainer config object class (PGConfig). ( #24295 )
2022-04-28 22:25:16 +02:00
Balaji Veeramani
2fdea6e24f
[Datasets] Add SimpleTorchDatasource ( #23926 )
...
It's difficult to use torchvision datasets with Ray ML. This PR makes it easier to use Torch datasets with Ray Data.
2022-04-28 11:56:45 -07:00
Dmitri Gekhtman
d68c1ecaf9
[kuberay] Test Ray client and update autoscaler image ( #24195 )
...
This PR adds KubeRay e2e testing for Ray client and updates the suggested autoscaler image to one running the merge commit of PR #23883 .
2022-04-27 18:02:12 -07:00
Simon Mo
ee528957c7
[Serve][Doc] Update docs about input schema, and json_request adapter ( #24191 )
2022-04-27 14:51:07 -07:00
Max Pumperla
553c8a85b6
[docs] [serve] Extended Gradio notebook example for Ray Serve deployments ( #23494 )
2022-04-27 10:03:28 -07:00
Kai Fricke
61a9de732f
[docs/tune] Small fixes to tune-distributed for new restore modes ( #24220 )
...
We've updated restore modes, so we should reflect that in the docs.
2022-04-26 22:19:49 +01:00
Kai Fricke
c0ec20dc3a
[tune] Next deprecation cycle ( #24076 )
...
Rolling out next deprecation cycle:
- DeprecationWarnings that were `warnings.warn` or `logger.warn` before are now raised errors
- Raised Deprecation warnings are now removed
- Notably, this involves deprecating the TrialCheckpoint functionality and associated cloud tests
- Added annotations to deprecation warning for when to fully remove
2022-04-26 09:30:15 +01:00
Amog Kamsetty
ae9c68e75f
[Train] Fully deprecate Ray SGD v1 ( #24038 )
...
Ray SGD v1 has been denoted as a deprecated API for a while. This PR fully deprecates Ray SGD v1. An error will be raised if ray.util.sgd package is attempted to be imported.
Closes #16435
2022-04-25 16:12:57 -07:00
matthewdeng
cc08c01ade
[ml] add more preprocessors ( #23904 )
...
Adding some more common preprocessors:
* MaxAbsScaler
* RobustScaler
* PowerTransformer
* Normalizer
* FeatureHasher
* Tokenizer
* HashingVectorizer
* CountVectorizer
API docs: https://ray--23904.org.readthedocs.build/en/23904/ray-air/getting-started.html
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
2022-04-25 21:12:59 +01:00
Chen Shen
cb8d216e62
[Doc][Ray collectives] fix example in the doc. #24162
...
the example is broken. this pr fixes it.
2022-04-25 11:20:51 -07:00
Brett Göhre
9e0a59d94a
[docs] search algorithm notebook examples ( #23924 )
...
Co-authored-by: brettskymind <brett@pathmind.com>
Co-authored-by: Max Pumperla <max.pumperla@googlemail.com>
2022-04-25 11:10:58 -07:00
Jeroen Bédorf
1263015931
[RLlib] Add support for writing env 'info' dicts to output datasets for TFPolicies (for TorchPolicies, these are part of the view-requirements by default and thus written either way). ( #24041 )
2022-04-25 11:17:50 +02:00
Chen Shen
1d981e0cf1
[doc] fix /cluster/config.html #23720
...
closes #23560
2022-04-22 10:13:12 -07:00
