mwtian
cb8dc5c94e
Fix unused import warning in streaming.proto ( #19912 )
...
## Why are these changes needed?
This generates a warning when calling `protoc` on the proto.
## Related issue number
2021-10-31 13:29:51 -07:00
architkulkarni
702bffe072
[runtime env] [test] Enable runtime env nightly test with working_dir reconnection ( #19906 )
2021-10-31 10:48:48 -05:00
architkulkarni
de8a9b5151
[runtime env] Always print package pushing logs regardless of size ( #19897 )
2021-10-31 10:47:37 -05:00
Edward Oakes
e507b7ba6e
[serve] Rename BackendVersion -> DeploymentVersion ( #19798 )
2021-10-31 10:27:19 -05:00
Chen Shen
961742f8e7
[Core] deflake windows test failure (test_task_retry_mini_integration) #19916
2021-10-30 15:13:38 -07:00
xwjiang2010
4d293c4cee
Increase horovod_test disk space. ( #19917 )
2021-10-30 14:41:31 -07:00
Sven Mika
4d945fe651
[RLlib] Issue 19878: Re-instate bare_metal_policy example script ( #19881 )
2021-10-30 12:50:39 -07:00
Stephanie Wang
630a8cacb3
Revert "[core] Fail objects when pull/reconstruction hangs ( #19789 )" ( #19904 )
...
This reverts commit e6d60d7376
2021-10-30 10:54:39 -07:00
Kim Pevey
3ff4fde0f5
[Doc] Update newsreader example ( #19893 )
2021-10-29 22:25:40 -07:00
Kim Pevey
8aa61566fa
[Doc] Example docs minor wording fixes ( #19890 )
2021-10-29 22:15:35 -07:00
Kim Pevey
96480d97d6
[DOC] Minor typos/fixes to Tips for First Timers ( #19887 )
...
* fix typos
* some more fixes
Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
2021-10-29 22:13:15 -07:00
mwtian
7afdfdc6dd
[CI] narrow down tests that run when files change ( #19656 )
2021-10-29 16:47:54 -07:00
mwtian
d32facdef8
[Doc][Bazel] add comment to not use Bazel test result cache ( #19842 )
...
To avoid confusions in future, add a comment about why Ray is not using Bazel test result cache.
2021-10-29 16:46:22 -07:00
chenk008
57363995f3
[runtime env] Move container related code to runtime env ( #19067 )
2021-10-29 16:31:11 -07:00
Jiao
bb0ebb7903
[job submission] Temporarily make pydantic imports conditional ( #19827 )
2021-10-29 18:09:18 -05:00
Gagandeep Singh
f549e528c7
Bumped time limit in test_cancel::test_comprehensive ( #19871 )
2021-10-29 15:51:49 -07:00
SangBin Cho
99b5932d06
Add a simple node failure integration test + clean up spammy logs upon node failures ( #19695 )
...
* .
* Done
* clean up
* lint
* fix a bug
* lint
* fix issue
* Remove no-op from StartRayLog
* Addressed code review.
2021-10-29 18:42:35 -04:00
architkulkarni
16d3afc665
[serve] Base autoscaling decisions on target num replicas, not current num replicas ( #19869 )
2021-10-29 17:03:53 -05:00
Eric Liang
456d73754a
[data] Initial pass at support multiple-block returns for read and transform tasks ( #19660 )
2021-10-29 14:21:56 -07:00
SangBin Cho
f2b831f50f
[Placement Group] Fix the implicit value change from uint32_t -> uint64_t for pg scheduling retry ( #19882 )
...
* .
* done
* done
2021-10-29 12:16:53 -07:00
Philipp Moritz
0a5942d8b0
[Documentation] Fix quotes for windows installations ( #19859 )
...
* [Documentation] Fix quotes for windows installations
* update
* formatting
2021-10-29 10:54:38 -07:00
Lixin Wei
1fe9f3372e
[Nightly Test] Remove duplicate printing code ( #19874 )
...
## Why are these changes needed?
Remove duplicate printing code
2021-10-29 10:19:19 -07:00
Lixin Wei
56301e34b2
[Refactor] Remove ServiceBased Abstraction ( #19694 )
...
## Why are these changes needed?
Prior to this PR, we have:
```cpp
class XxxAccessor {}
class ServiceBasedXxxAccessor : public XxxAccessor{}
class GcsClient {}
class ServiceBasedGcsClient : public GcsClient{}
```
However, XxxAccessor has only one implementation: ServiceBasedXxxAccessor. And GcsClient has only one implementation: ServiceBasedGcsClient.
I think this abstraction is not necessary and will make development hard(I have to modify two files every time).
This PR removes all ServiceBasedXxx and moves its implementations to the base class.
Now we only have:
```cpp
class XxxAccessor {}
class GcsClient {}
```
2021-10-29 10:16:14 -07:00
Gagandeep Singh
9460a5375b
Added retry logic in test_basic::test_ray_options ( #19832 )
...
* Added retry logic in test_ray_options
* Applied linting format
* Made test consistent
2021-10-29 10:15:12 -07:00
architkulkarni
fdefd875c3
[Doc] [runtime env] Move runtime env section up one level, add inbound links ( #19863 )
2021-10-29 12:02:39 -05:00
SangBin Cho
4586ced5e4
Limit the max number of resource usage print ( #19828 )
...
* done
* done
* addressed code review
* done
2021-10-29 07:24:14 -07:00
Edward Oakes
bf23a31017
[job submission] Always generate and return job_id ( #19851 )
2021-10-29 09:09:54 -05:00
SangBin Cho
16dcff4091
[Core/RuntimeEnv] Fix runtime environment hanging issues. ( #19823 )
...
* done
* Add a right test
* Fix unit tests
* fix issues
2021-10-29 07:01:56 -07:00
Kai Fricke
fa0158abe5
[tune] Cloud checkpointing release tests ( #19638 )
2021-10-29 12:12:01 +02:00
Sven Mika
9c73871da0
[RLlib; Docs overhaul] Docstring cleanup: Evaluation ( #19783 )
2021-10-29 12:03:56 +02:00
Antoni Baum
f2773267c7
[docs] Tune doc fixes ( #19791 )
2021-10-29 11:45:29 +02:00
qicosmos
246a901aea
[C++ API] Support object ref args ( #19550 )
2021-10-29 17:36:53 +08:00
Kai Fricke
a13f738a10
[ci/release] Fix cloud search query ( #19876 )
2021-10-29 11:30:34 +02:00
Rohan138
b9c9cc5946
[RLlib] Updated PettingZoo+RLlib tutorial; Removed pettingzoo example script ( #19069 )
...
* Updated PettingZoo+RLlib tutorial
Updated the tutorial and added link to the blog post by the PettingZoo team.
* Ran linting
* Converted link to tinyurl for linting
* fixed line lengths
* Decrease num_workers to 1
* Added comments
* Decreased num_workers
* Decreased timesteps
* Increased num_workers
* Update links and remove pettingzoo_env.py
* remove pettingzoo.py script from tests
Co-authored-by: sven1977 <svenmika1977@gmail.com>
2021-10-29 10:57:10 +02:00
Sven Mika
902e854af2
[RLlib; Docs overhaul] Docstring cleanup: Environments. ( #19784 )
...
* wip.
* Test: Make a change in tune to trigger tune tests, which are not run otherwise, but seem to fail nevertheless with this PR's changes.
* remove bare_metal_policy_with_custom_view_reqs from tests
2021-10-29 10:46:52 +02:00
Stephanie Wang
e6d60d7376
[core] Fail objects when pull/reconstruction hangs ( #19789 )
2021-10-28 23:34:51 -07:00
Yi Cheng
68ec652be7
[gcs] New option to increase gcs grpc client threads and fix issues in hybrid scheduling ( #19663 )
...
## Why are these changes needed?
- Since broadcasting is moving to grpc, introducing the option to increase the client side thread number
- For hybrid schedule, ignore the threshold if gcs based actor scheduler is enabled
With these fixing, actor creation rate > 600actor/s vs ~ 140 actor/s
## Related issue number
2021-10-28 22:40:18 -07:00
Chris K. W
bd4ad84ead
[Client] Add deprecation warnings for direct ray.client().connect() calls ( #18783 )
...
* add deprecation warning
* Update wording
* add test
* actually connect
* add env var tests
* fix message and test
* skip on windows
* add _LocalBuilder case, update test_namespace
* better variable name
2021-10-28 22:06:11 -07:00
Eric Liang
1ba07439fc
Reduce log level of concurrent actor creation
2021-10-28 20:44:14 -07:00
qicosmos
efef38f240
[C++ Worker] Add basic ref counting test cases ( #17768 )
2021-10-29 11:22:19 +08:00
Jiajun Yao
760878f950
Handle empty dataset for sort and groupby ( #19849 )
2021-10-28 18:49:33 -07:00
Simon Mo
0433281ec8
[CI] Bump Serve test_regression to medium for windows ( #19844 )
2021-10-28 17:49:50 -07:00
Philipp Moritz
0633ae45e9
[Documentation] Remove note about windows wheels needing dev runtime ( #19847 )
2021-10-28 16:59:58 -07:00
Kai Fricke
564d8551ed
[ci/release] only check alert if test succeeded before ( #19857 )
2021-10-28 16:09:10 -07:00
Edward Oakes
42ac906313
[job submission] Support passing metadata to the JobConfig ( #19845 )
2021-10-28 16:40:03 -05:00
SangBin Cho
9126810c41
[Usabiilty] Improve the serialization failure message ( #19691 )
...
* Done
* done
* Done
* fix test
* Adressed code review.
* done
* done
* fix mistake
* Skip tests on windows
2021-10-28 14:25:51 -07:00
matthewdeng
bfb0ef1b08
move jsonschema to core dependencies and update default AutoscalerPrometheusMetrics ( #19831 )
2021-10-28 13:04:22 -07:00
SangBin Cho
96fc875a89
[Core] Improve scheduling observability and fix wrong resource deadlock report message. ( #19746 )
2021-10-28 11:42:21 -07:00
SangBin Cho
39486ef08c
[Core] Fix the resource leak if custom resources don't exist. #19837
...
Why are these changes needed?
The current logic can cause resource leak if AllocateTaskResourceInstances is requested with the custom resources that don't exist in the local node. The original assumption was the caller will free resources when it returns false, but it is an error prone API, and it actually turns out that we don't do this anywhere.
Related issue number
Closes #17044
2021-10-28 11:00:34 -07:00
Amog Kamsetty
1803d88943
[Train] Simplify single worker training ( #19814 )
...
* wip
* update
* fix
* fix
* fix
* fix
2021-10-28 10:54:35 -07:00
