Commit graph

9694 commits

Author SHA1 Message Date
matthewdeng
83a28cc901
[client] update documentation with AWS security_group (#18905)
* [client] update documentation with AWS security_group

* Update doc/source/cluster/ray-client.rst

Co-authored-by: Ian Rodney <ian.rodney@gmail.com>

* lint

Co-authored-by: Ian Rodney <ian.rodney@gmail.com>
2021-09-28 16:47:46 -07:00
Eric Liang
4d763d3ffd
Increase metrics fetch timeout in autoscaler for large clusters 2021-09-28 15:24:44 -07:00
Edward Oakes
73b8936aa8
[runtime_env] Unify rpc::RuntimeEnv with serialized_runtime_env field (#18641) 2021-09-28 15:13:15 -05:00
Yi Cheng
4af07a8917
[rpc] cpu improvement of protobuf in gcs (#17933) 2021-09-28 11:47:19 -07:00
SangBin Cho
a0a02f4982
[Placement Group] Fix placement group high cpu usage part 1 (#18652) 2021-09-28 11:14:59 -07:00
Edward Oakes
96054953cc
[serve] Remove python_methods logic and raise an error dynamically instead (#18927) 2021-09-28 09:51:46 -07:00
Chris K. W
191af472ac
[client] remove ray_trace_ctx from kwargs if tracing disabled (#18926) 2021-09-28 09:47:43 -07:00
Ian Rodney
0d3544588e
[AutoRun] Fix Auto-Run for Client (#18457)
* remove old version

* auto init first attempt

* arg for fn decorator

* default to True

* ray.method should not autostart

* comments

* no auto init on global state fns

* tiny test fix

* quick tests

* respond to comments

* explain func

* fix comments

* forgot to save

* fix again

* fix reconnect tests

* fix medium tests

* fix workflows test

* Better fix for workflows
2021-09-28 08:00:26 -07:00
Yi Cheng
e3dd1e3751
Revert "Revert "[test] add unit test for PR #17634 (#18585)" (#18830)" (#18871)
* Revert "Revert "[test] add unit test for PR #17634 (#18585)" (#18830)"

This reverts commit 8dd3057644.

* up
2021-09-28 05:53:52 -07:00
Richard Liaw
227aa9e89b
[tune] change delimiter for results (#16573)
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2021-09-28 10:03:00 +01:00
Kai Fricke
6be87a3453
[tune] fix tune list-trials metric (#18914) 2021-09-28 09:59:32 +01:00
Chen Shen
057c425122
[Core][CoreWorker] call shutdown in the correct thread (#18910) 2021-09-28 01:29:47 -07:00
Chen Shen
62a73f4ce8
[nightly test][event] enable event logs in nightly tests (#18936) 2021-09-28 01:29:26 -07:00
Yi Cheng
e4f4c79252
Revert "[Serve] [doc] Improve runtime env doc (#18782)" (#18935)
This reverts commit d4d71985d5.
2021-09-27 21:52:13 -07:00
matthewdeng
d2caa00be8
[SGD] add SGDv2 survey link to docs (#18934) 2021-09-27 19:15:37 -07:00
Chen Shen
25d14cb4de
Ensure task_execution_service_ is destructed first (#18913) 2021-09-27 18:31:56 -07:00
Eric Liang
caf34a452c
Unify ArrowTensorType tables and Tensor blocks (#18867) 2021-09-27 16:24:09 -07:00
Maxim Egorushkin
be0133da1d
[Autoscaler][GCP] Allow Google Compute Engine instance templates. (#18620)
Co-authored-by: Maxim Egorushkin <maxim.egorushkin@gmail.com>
Co-authored-by: Ian <ian.rodney@gmail.com>
2021-09-27 16:08:41 -07:00
architkulkarni
d4d71985d5
[Serve] [doc] Improve runtime env doc (#18782) 2021-09-27 16:12:03 -05:00
Yi Cheng
994d156a0d
[doc] Mark multi-client as an experimental feature 2021-09-27 14:08:49 -07:00
Edward Oakes
627e475cc1
[docs] Don't recommend SignalActor from test_utils 2021-09-27 12:08:37 -07:00
Chen Shen
cbd7dc749c
[Core][CoreWorker] fix data race of exiting_ 2021-09-27 10:55:03 -07:00
Antoni Baum
72cc0c9bda
[SGDv2] Add Tune-Cifar-PyTorch-PBT example (#18860)
* [SGDv2] Add Tune-Cifar-PyTorch-PBT example

* Update python/ray/util/sgd/v2/BUILD

* Lint

* Update example

* Update docs
2021-09-27 09:22:40 -07:00
Jernej Makovsek
d6758ff92a
[tune] Fix HEBOSearch installation docs (#18861)
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
2021-09-27 09:06:14 +01:00
Qing Wang
90d2456ec7
[Java] Support userloggers. (#18846)
Co-authored-by: Kai Yang <kfstorm@outlook.com>
2021-09-26 16:53:06 +08:00
Chen Shen
aaae8c122b
Fix pid None in logs (#18898) 2021-09-25 17:07:32 -07:00
Eric Liang
1ffec66cd5
[CI] Disable test_reference_counting on Windows build 2021-09-25 13:40:00 -07:00
mwtian
66aac2e219
[C++] Use RayConfig to read internal environment variables only once (#18869)
* store environ on first access

* fix

* Use RayConfig

* fix

* fix

* Revert removal of headers. They are actually used.

* rename

* fix lint

* format

* use std::getenv()

* fix
2021-09-25 12:27:42 -07:00
Yi Cheng
65fa740c3b
Fix minor doc error (#18896) 2021-09-24 22:21:10 -07:00
Jiajun Yao
e79f271b05
Fix nil redis array element (#18813) 2021-09-24 20:11:43 -07:00
Yi Cheng
3d9c973861
[doc] Update ray client documentation to include multi-client. (#18891) 2021-09-24 18:35:52 -07:00
mwtian
43ac18bbc0
[Build] include minimal debug info in C++ build; upgrade clang-format to 12 (#18888)
* Revert "Revert "[Build] include minimal debug info in C++ build; upgrade clang-format to 12 (#18840)" (#18886)"

This reverts commit f851a072f3.

* use gcc 8
2021-09-24 17:59:05 -07:00
Chris K. W
0669e651b9
[client] Bump client proto version (#18866) 2021-09-24 14:35:59 -07:00
Jiajun Yao
18bdde1918
Install the test wheel last (#18881) 2021-09-24 20:56:53 +01:00
Chen Shen
f851a072f3
Revert "[Build] include minimal debug info in C++ build; upgrade clang-format to 12 (#18840)" (#18886)
This reverts commit 07e1366383.
2021-09-24 12:55:08 -07:00
mwtian
07e1366383
[Build] include minimal debug info in C++ build; upgrade clang-format to 12 (#18840)
* debug info and clang-format

* doc

* fix

* no clang-format on all files

* gcc

* keep gcc 7
2021-09-24 12:26:33 -07:00
Eric Liang
11a2dfcaab
Improve unschedulable task warning messages by integrating with the autoscaler (#18724) 2021-09-24 12:19:58 -07:00
architkulkarni
fbf5f5d56b
[runtime env] [Serve] Fix error when uris field is None (#18874) 2021-09-24 14:07:17 -05:00
dependabot[bot]
98ecc1c657
[RLlib](deps): Bump mlagents from 0.26.0 to 0.27.0 in /python/requirements/rllib (#17860)
* [RLlib](deps): Bump mlagents in /python/requirements/rllib

Bumps [mlagents](https://github.com/Unity-Technologies/ml-agents) from 0.26.0 to 0.27.0.
- [Release notes](https://github.com/Unity-Technologies/ml-agents/releases)
- [Commits](https://github.com/Unity-Technologies/ml-agents/compare/python-packages_0.26.0...python-packages_0.27.0)

---
updated-dependencies:
- dependency-name: mlagents
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* wip.

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: sven1977 <svenmika1977@gmail.com>
2021-09-24 19:33:39 +02:00
dependabot[bot]
40aec916d7
[RLlib](deps): Bump pyglet from 1.5.0 to 1.5.18 in /python/requirements/rllib (#16687)
* [RLlib](deps): Bump pyglet in /python/requirements/rllib

Bumps [pyglet](https://github.com/pyglet/pyglet) from 1.5.0 to 1.5.18.
- [Release notes](https://github.com/pyglet/pyglet/releases)
- [Changelog](https://github.com/pyglet/pyglet/blob/v1.5.18/RELEASE_NOTES)
- [Commits](https://github.com/pyglet/pyglet/compare/v1.5.0...v1.5.18)

---
updated-dependencies:
- dependency-name: pyglet
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com>
Co-authored-by: sven1977 <svenmika1977@gmail.com>
2021-09-24 19:32:55 +02:00
Chu Xiangyang
2220fe8a78
[Dashboard] Keep Job timestamp as millisecond (#18806)
* [Dashboard] Keep Job timestamp as millisecond

Current the `timestamp` is already millisecond, 13 digits long,
so no need to * 1000 in the dashboard UI.

* Fix format wih prettier

* use Number to convert timestamp
2021-09-24 10:31:54 -07:00
Guyang Song
337005d5a5
[C++ API][hotfix] fix C++ worker dynamic library loading issue on macOS (#18877)
* fix C++ worker in macox

* fix
2021-09-24 23:39:00 +08:00
Kai Fricke
e08d4253cf
[ci/release] Start cluster before connecting via anyscale connect (#18878) 2021-09-24 16:17:06 +01:00
Kai Fricke
d52203ee03
[ci/release] Fix long running serve test result fetching (#18880) 2021-09-24 16:16:01 +01:00
mvindiola1
62f5da0b65
[RLlib] Add unit tests for updating episode data in base_env (#17137) 2021-09-24 16:08:11 +02:00
dependabot[bot]
e3470d7149
[RLlib](deps): Bump atari-py in /python/requirements/rllib (#15994) 2021-09-24 15:55:02 +02:00
Julius Frost
8b8b447fd7
[RLlib] Fix train.py input config patching (#18747) 2021-09-24 14:41:33 +02:00
o0olele
ff6730f903
[RLlib] Attention Nets + MultiDiscrete spaces: Fix range() takes no keyword args error! (#17502) 2021-09-24 13:43:58 +02:00
Kai Fricke
9b0d804eed
[tune] Add documentation for reproducible runs (setting seeds) (#18849)
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
2021-09-24 10:57:31 +01:00
Chen Shen
7c99aae033
[dataset][nightly-test] add pipelined ingestion/training nightly test 2021-09-23 20:39:03 -07:00