Commit graph

9400 commits

Author SHA1 Message Date
Chen Shen
5f57079041
use clang for C++ debug testing (#18343) 2021-09-09 15:48:36 -07:00
Amog Kamsetty
d3d8120db3
[SGD] Fix shutdown hang on macOS Python 3.7 (#18473) 2021-09-09 15:32:52 -07:00
Eric Liang
4d2065352b
Increase dataset read parallelism by default (#18420) 2021-09-09 15:07:49 -07:00
Yi Cheng
ccc16a46bb
[cpp] Upgrade cpp from 14 -> 17 (#18455) 2021-09-09 12:09:21 -07:00
Kai Fricke
395976c8a1
[tune] Never block for results (#18391)
* [tune] Never block for results

* Fix tests

* Block in tests

* Add comment to test
2021-09-09 12:08:00 -07:00
architkulkarni
0126837868
[ray client] [runtime env] Print error logs in driver upon connection failure (#18451) 2021-09-09 13:50:55 -05:00
Simon Mo
d477fd7205
[Serve] Make @ingress accept any ASGI app (#15464) 2021-09-09 13:49:37 -05:00
Simon Mo
51bb7c6da8
[Serve] Allow method redefinition for FastAPI (#18453) 2021-09-09 13:48:58 -05:00
Edward Oakes
791abd4f04
[serve] Remove root_url from start docstring (#18472) 2021-09-09 13:46:56 -05:00
Zhi Lin
2fcd1bcb4b
[Dataset] implement from_spark, to_spark and some optimizations (#17340) 2021-09-09 11:43:47 -07:00
SangBin Cho
fdd52106bf
[Placement group] Do not report ready task demand (#18463) 2021-09-09 11:42:12 -07:00
Nikita Vemuri
0f562874b9
[serve] Use environment variable for root_url from runtime env (#18269) 2021-09-09 12:12:35 -05:00
Dominic Ming
97f71e15d4
[Dashboard] new dashboard event page for API Server event module (#18330) 2021-09-09 19:43:48 +08:00
mwtian
26fd10c9e8
[CI] Add clang-tidy to lint (#18124)
* clang-tidy

* fix

* fix script

* test clang compiler

* fix clang-tidy rules

* Fix windows and other issues.

* Fix

* Improve information when running check-git-clang-tidy-output.sh on different OS
2021-09-09 00:41:53 -07:00
Sven Mika
8a066474d4
[RLlib] No Preprocessors; preparatory PR #1 (#18367) 2021-09-09 08:10:42 +02:00
Sven Mika
1520c3d147
[RLlib] Deepcopy env_ctx for vectorized sub-envs AND add eval-worker-option to Trainer.add_policy() (#18428) 2021-09-09 07:10:06 +02:00
qicosmos
ba0084e9c7
[C++ Worker]Add gcs global state accessor (#17976) 2021-09-09 12:08:08 +08:00
Lixin Wei
df803cee98
Revert "Revert "[Core] Fix ServerCall Leaking (#17863)" (#18410)" (#18424) 2021-09-08 19:55:06 -07:00
architkulkarni
5affb074aa
[Test] deflake test_runtime_env.py::test_no_spurious_worker_startup (#17809) 2021-09-08 16:35:08 -07:00
Clark Zinzow
c0ea2755a0
Fix iter_batches dropping batches when prefetching. (#18441) 2021-09-08 15:37:38 -07:00
Clark Zinzow
6fc91fd47e
Create directory on write if it doesn't exist. (#18435) 2021-09-08 15:31:06 -07:00
Simon Mo
6d24214085
[Release] Make sure to uninstall ray for rllib_tests (#18448) 2021-09-08 23:29:40 +01:00
Edward Oakes
f0555f88d6
[runtime_env] Move worker process startup logic to context (#18341) 2021-09-08 17:08:27 -05:00
Antoni Baum
dd6abed6ce
[tune] Fix an edge case where DurableTrainable would not delete checkpoints in remote storage (#18318)
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
2021-09-08 15:00:09 -07:00
Sven Mika
cd22a7d1bb
[RLlib] Add locking to PolicyMap in case it is accessed by a RolloutWorker and the same worker's AsyncSampler or the main LearnerThread. (#18444) 2021-09-08 23:32:23 +02:00
gjoliver
50cdf551ce
[RLlib] Fix test name typo. (#18423)
Co-authored-by: Jun Gong <jungong@mbpro.local>
2021-09-08 23:30:37 +02:00
gjoliver
808b683f81
[RLlib] Add a unittest for learning rate schedule used with APEX agent. (#18389) 2021-09-08 23:29:40 +02:00
Ian Rodney
c91e0eb065
[Dashboard] Increase Actor Snapshot Size (#18433) 2021-09-08 12:06:33 -07:00
Lixin Wei
052ed115e7
[Core] Make It Easier to Grep Debug State Dump (#18382)
* add keyword to debug dump

* fix
2021-09-08 12:03:54 -07:00
Yi Cheng
6011d4197f
Open [nightly] Add many_nodes_actor_test to nightly test (#18406) 2021-09-08 11:15:48 -07:00
Yi Cheng
7126d01c91
[core] upgrade gtest (#18288)
* up

* up

* format

* up

* flaky fix

* format

* up

* up

* format

* add debug

* up

* up

* up

* up

* up

* format

* fix

* format

* up

* up

* format
2021-09-08 11:15:34 -07:00
Sven Mika
45f60e51a9
[RLlib] DDPPO fixes and benchmarks. (#18390) 2021-09-08 19:39:01 +02:00
Sasha Sobol
f76f14fedf
[client] pass _credentials down from init (#18425) 2021-09-08 10:30:26 -07:00
Clark Zinzow
b30c41759d
[Datasets] Adds tensor column support (tensors-in-tables) via Pandas/Arrow extension types/arrays. (#18301) 2021-09-08 10:09:01 -07:00
mwtian
e427e4a467
Fix flakiness in test_proxy_manager_internal_kv (#18416) 2021-09-08 15:46:45 +03:00
Kai Fricke
dac3a8bc8e
[setup] Upstream conda patches (#17575)
Co-authored-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
2021-09-08 10:37:17 +01:00
Lingxuan Zuo
46b941b702
[Streaming] Support streaming metric reporter (#17981)
* Streaming support metric reporter

* fix lint

* fix bazel format lint

* fix lint

* metric deps lint

* lint

* and comments for runtime reporter

* unordered_map instead

* comments

* fix visibility flag

* deps local .so target

* make stats public visibility

* stats lib in public

* add antgroup team tag
2021-09-08 14:36:00 +08:00
Chen Shen
df9c6aa863
[plasma] Check if the get request is removed (#18401) 2021-09-07 21:01:08 -07:00
Edward Oakes
56adaa32f1
[serve] Better logging for exceptions in backend_state.update() (#18402) 2021-09-07 21:40:41 -05:00
Simon Mo
a29da81cfc
Revert "Revert "Fix tracing bug when actors are defined before connecting to …" (#16122) 2021-09-07 16:19:49 -07:00
Edward Oakes
f2afb08125
[runtime_env] Don't modify passed runtime_env dictionary when validating (#18404) 2021-09-07 16:14:28 -07:00
Chen Shen
d65d291579
Revert "[Core] Fix ServerCall Leaking (#17863)" (#18410)
This reverts commit 4f6b50dc46.
2021-09-07 15:47:58 -07:00
Lada Kunc
1a72c49009
[serve] Fix get_handle execution from threads (#18198) 2021-09-07 14:49:36 -07:00
Guyang Song
f104a5aad7
[docs] Fix cpp wheel description (#18386) 2021-09-07 15:45:04 -05:00
Lixin Wei
4f6b50dc46
[Core] Fix ServerCall Leaking (#17863)
* fix backpressure bug

* update comments

* stash

* add test

* add basic tests

* add fixture

* stash

* fix

* draft

* fix

* test added

* fixed

* fixed

* lint

* Update src/ray/rpc/test/grpc_server_test.cc

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* add copyright

* move test service to saperate file

* add ClientCallManager timeout tests

* fix

* lint

* lint

* lint

* test windows CI

* fix

* lint

* lint

* retry windows

* retry windows

* fix mac

* lint

* lint

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
2021-09-07 12:15:43 -07:00
xwjiang2010
64c2f86a22
[Tune] Respect default_resources during Trial.reset(). (#18209) 2021-09-07 19:14:44 +01:00
Clark Zinzow
26b2720915
Add test coverage for writing to fsspec filesystems. (#18394) 2021-09-07 10:16:59 -07:00
Ian Rodney
ec2110e470
[Codeowners] Add Chris & Mingwei to Ray Client proto (#18395) 2021-09-07 09:17:23 -07:00
Jiajun Yao
2740d28fad
[client] Increase timeout for ProxyManager.get_channel (#18350) 2021-09-07 11:06:17 -05:00
Qing Wang
d87441cda7
[Java] ConcurrencyGroup in Java local mode. (#18241)
* WIP

* Fix

* Fix test

* Refine

* Fix lint,

* WIP2

* WIP2

* Refine

* Put a default concurrency group.

* Fix submitting task with concurrency group name.

* Remove unnecessary changes.

* Update java/runtime/src/main/java/io/ray/runtime/task/LocalModeTaskSubmitter.java

Co-authored-by: Kai Yang <kfstorm@outlook.com>

Co-authored-by: Kai Yang <kfstorm@outlook.com>
2021-09-07 20:43:31 +08:00