hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 18:41:40 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
6087 commits 227 branches 67 tags 234 MiB
Commit graph

6087 commits

This branch
This branch
All branches
Author SHA1 Message Date
Richard Liaw
0d93b1de93
[autoscaler] rsync to node (#11122) 2020-10-01 01:42:49 -07:00
Eric Liang
8f73014291
[autoscaler] Make it more clear NodeProvider and CommandRunner are private APIs (#11086) 2020-09-30 16:24:37 -07:00
Simon Mo
a518fb1031
[Doc] Use different pygments_style (#11143) 2020-09-30 16:16:55 -07:00
Eric Liang
090002b0ce
Blocking asyncio get warning should be logger.warn not logger.debug (#11141) 2020-09-30 16:16:35 -07:00
Benjamin Black
4445f32798
[rllib] Fixed pettingzoo wrapper (#11060) 
* fixed PettingZooEnv, relevant docs, examples

* fixed linting error

* pettingzoo wrapper fix

* fixed linting issue
 2020-09-30 15:34:47 -07:00
Kai Fricke
c77cfaa5ad
[tune] use dated experiment dir per default (#11104) 2020-09-30 14:43:59 -07:00
Siyuan (Ryans) Zhuang
f0dba6bd2b
Code cleanup about python3 asyncio compat (#11134) 
* cleanup python3 compat and others
 2020-09-30 14:22:25 -07:00
Tao Wang
0dcfa9ed6c
Add light heartbeat flag in python and use it in load metrics (#11032) 2020-09-30 11:39:28 -07:00
SangBin Cho
e44828d928
[Test] Make the test size bigger for tune to fix timeout. (#11138) 2020-09-30 11:35:31 -07:00
fangfengbin
138d6cced9
[GCS]Optimizing actor info query interface (#11067) 
* add part code

* add part code

* fix review comment

* fix review comment

* fix review comment

* fix crash bug

* fix ut bug

* fix bug

* fix ut bug

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-30 11:34:42 -07:00
SangBin Cho
474af36591
[Core] Fix random bugs found. (#11128) 2020-09-30 00:11:57 -07:00
Kai Yang
3504391fd2
[Core] Multi-tenancy: enable multi-tenancy by default (#10570) 
* Add new job in Travis to enable multi-tenancy

* fix

* Update .bazelrc

* Update .travis.yml

* fix test_job_gc_with_detached_actor

* fix test_multiple_downstream_tasks

* fix lint

* Enable multi-tenancy by default

* Kill idle workers in FIFO order

* Update test

* minor update

* Address comments

* fix some cases

* fix test_remote_cancel

* Address comments

* fix after merge

* remove kill

* fix worker_pool_test

* fix java test timeout

* fix test_two_custom_resources

* Add a delay when killing idle workers

* fix test_worker_failure

* fix test_worker_failed again

* fix DisconnectWorker

* update test_worker_failed

* Revert some python tests

* lint

* address comments
 2020-09-29 23:54:53 -07:00
SangBin Cho
f54f7b23f6
[Object Spilling] Name IO workers properly. (#11097) 
* Fix.

* Addressed code review.
 2020-09-29 23:48:31 -07:00
Kai Yang
0c254878db
[Java] Upgrade TestNG to 7.3.0 (#11135) 2020-09-30 14:38:52 +08:00
Tao Wang
15ae8816f7
[GCS]Remove useless / heavy heartbeat pub (#11132) 2020-09-29 23:38:17 -07:00
Max Fitton
03c11d3b85
[Dashboard] Add Ray Config API to Reporter Head (#11010) 
* Add Ray Config API to the backend for fetching config

* Address PR comments.

* Make reporter cache whole payload

* lint

Co-authored-by: Max Fitton <max@semprehealth.com>
 2020-09-29 17:57:49 -07:00
Maksim Smolin
94494c43d6
[cli] Updates (#10777) 2020-09-29 16:55:07 -07:00
Ameer Haj Ali
f17ad5d060
[autoscaler] resource demand scheduler get_nodes_to_launch should return Dict not List (#11118) 2020-09-29 15:32:56 -07:00
Kai Fricke
b8f344f695
[tune] add faq entry for reproducing experiments (setting seeds etc) (#11106) 2020-09-29 14:48:39 -07:00
architkulkarni
3ad670efa6
auto-update copyright year in docs (#11114) 2020-09-29 13:57:06 -07:00
Max Fitton
825737adc5
[Dashboard] Add old dashboard front end to new dir so we can get a diff going. (#11113) 
Co-authored-by: Max Fitton <max@semprehealth.com>
 2020-09-29 13:46:42 -07:00
Kai Fricke
10015e60fb
[tune] fix flaky callback test (#11102) 2020-09-29 09:44:32 -07:00
Tao Wang
1db83764bf
[GCS]Use new getting all available resources interface instead of pub-sub … (#10914) 
* Use new all available resources getting interface instead of pub-sub in state.py

* add missing server handler and test cases, fix comments

* add fine grained test assert

* per comments

* involve new added function _available_resources_per_node

* change  ClientID to NodeID

* fix compile

* fix client id and lint

* robust tests check

* robust tests
 2020-09-29 09:41:10 -07:00
Sven Mika
47eb6613b5
[RLlib] Remove unnecessary copies in compute_advantages. (#10897) 2020-09-29 12:25:20 +02:00
Sven Mika
f91c455527
[RLlib] Curiosity documentation. (#11066) 2020-09-29 09:39:22 +02:00
Ameer Haj Ali
0d36e4c025
[autoscaler] Support min_workers for multi node type (#11041) 
* prepare for head node

* move command runner interface outside _private

* remove space

* Eric

* flake

* min_workers in multi node type

* fixing edge cases

* eric not idle

* fix target_workers to consider min_workers of node types

* idle timeout

* minor

* minor fix

* test

* lint

* eric v2

* eric 3

* min_workers constraint before bin packing

* Update resource_demand_scheduler.py

* Revert "Update resource_demand_scheduler.py"

This reverts commit 818a63a2c86d8437b3ef21c5035d701c1d1127b5.

* reducing diff

Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
Co-authored-by: Alex Wu <alex@anyscale.io>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
 2020-09-28 22:02:01 -07:00
SangBin Cho
0a6164ab15
[Core] Improve logging messages. (#11082) 2020-09-28 21:07:45 -07:00
Simon Mo
6cfc1a16a0
[Serve] Fix resource checking (#11084) 2020-09-28 18:10:43 -07:00
SangBin Cho
cef263a333
[Custom Metrics] Improve ray runtime context. (#10981) 
* done.

* Addressed code review.

* Addressed code review.
 2020-09-28 16:18:19 -07:00
fangfengbin
872219940b
[GCS]Fix miss PollOwnerForActorOutOfScope after gcs restarts bug (#11054) 
* fix_RemoveActorFromOwner_crash_bug

* fix review comment

* fix review comment

* rm unused ut

* add testcase

* fix review comment

* rm unused import

* fix code style

* fix ut bug

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-28 10:06:40 -07:00
Kai Yang
79c6a6fa02
[Java] Enable retry in TestNG (#11065) 
* Enable retry in Java test

* lint

* update
 2020-09-28 22:16:06 +08:00
Lingxuan Zuo
27e1f513e3
[Log] make glog flush and RAY_LOG thread-safe (#11002) 
* make glog flush and RAY_LOG thread-safe

* dump error log to console

* mapping all levels to destination

* hack glog for exporting message to stdout if no base name given

* patch lint

* use stdout logger by default

* add raylet std/err pytest checker

* add worker logs file check

* fix asan check

* loop in glog enums

* fix python lint

* lint for autoindent

* fix indent lint

* make raylet.err is not empty
 2020-09-28 22:15:15 +08:00
fangfengbin
dd97f0c30d
[Java]Fix testSetResource bug (#11064) 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-28 17:53:08 +08:00
Tao Wang
25ac8f9aa5
[GCS]Use new flag to indicate whether resources are updated and update realtime resources view (#10906) 
* Handle resources turning empty and update realtime view

* add up missing flag

* per comments

* use flag instead of special key to represent if resource changed

* Update src/ray/protobuf/gcs.proto

Co-authored-by: fangfengbin <869218239a@zju.edu.cn>

* fix lint in gcs.proto

* fix embarrassed mistake

Co-authored-by: fangfengbin <869218239a@zju.edu.cn>
 2020-09-28 01:57:27 -07:00
fangfengbin
2e41a29c8f
[Placement Group]Support placement group request processing idempotent in raylet (#10998) 
* add part code

* fix review comment

* fix review comment

* fix review comment

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-28 01:56:43 -07:00
fang yeqing
0765d989ae
[Core] Simplify logic in node manager class. (#11063) 
Co-authored-by: 逗角 <yeqing.fyq@antfin.com>
 2020-09-28 01:54:06 -07:00
fangfengbin
142234cbcb
[GCS]Fix ServiceBasedGcsClientTest bug (#11031) 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-28 14:50:36 +08:00
fangfengbin
86e5db4d59
[GCS]Fix GCS actor manager idempotent bug (#11003) 
* [GCS]Fix GCS actor manager idempotent bug

* fix review comment

* fix review comment

* fix review comments

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-27 21:12:42 -07:00
SangBin Cho
1e39c40370
[Placement Group] Capture child tasks by default. (#11025) 
* In progress.

* Finished up.

* Improve comment.

* Addressed code review.

* Fix test failure.

* Fix ci failures.

* Fix CI issues.
 2020-09-27 19:33:00 -07:00
fangfengbin
f0787a63da
[GCS] fix rpc port bug (#11055) 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-27 19:08:48 -07:00
Kai Fricke
e7315b0856
[tune] Callbacks for tune runs (#11001) 2020-09-27 16:50:07 -07:00
Christian Kasim Loan
4285bee517
[Doc] Added John Snow Lab's NLU reference to community integration page (#10985) 
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
 2020-09-27 13:07:12 -07:00
DK.Pino
db7097fb1f
[Refactor] Rename ClientId to NodeId (#10992) 
* rename ClientId to NodeId

* format lint

* format lint

* fix conflicts

* rename new ClientId to NodeId

* update lint

* make same version of clang-format with travis ci
 2020-09-27 10:24:21 -07:00
Tao Wang
f69b390755
[BUILD]ignore pyenv version file in git (#11053) 2020-09-27 09:26:26 -07:00
Eric Liang
b5ecdd088b
Deflake object manager test (#11052) 2020-09-26 18:33:02 -07:00
Richard Liaw
51038f2197
confirm (#11049) 
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
 2020-09-26 13:48:13 -07:00
Stephanie Wang
552ebdbeda
[Core] Announce worker port at end of constructor (#11036) 2020-09-25 21:56:00 -07:00
SangBin Cho
29663d89f1
[Placement Group] Remove warning msg for placement groups. (#11034) 
* Done.

* Addressed code review.

* Fixed typo.

* Addressed code review.
 2020-09-25 20:53:42 -07:00
Eric Liang
8f79b4e45e
[rllib] Replay buffer size inaccurate with replay_seq_len option (#10988) 
* support replay seq len

* update

* fix warn

* add test

* test
 2020-09-25 13:47:23 -07:00
SangBin Cho
8abe13023f
[Metric] Fix issue 10634 (#10940) 
* Fix.

* Revert "Fix."

This reverts commit 52c9c1ee646b551a4dd2b639c78be67683db2b1c.

* ADdressed code review.

* Addressed code review.
 2020-09-25 09:11:05 -07:00