hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-11-06 01:11:49 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
10,377 commits 227 branches 67 tags 235 MiB
Commit graph

10,377 commits

Author SHA1 Message Date
SangBin Cho
474af36591
 		[Core] Fix random bugs found. () 2020-09-30 00:11:57 -07:00
Kai Yang
3504391fd2
 		[Core] Multi-tenancy: enable multi-tenancy by default () 
* Add new job in Travis to enable multi-tenancy

* fix

* Update .bazelrc

* Update .travis.yml

* fix test_job_gc_with_detached_actor

* fix test_multiple_downstream_tasks

* fix lint

* Enable multi-tenancy by default

* Kill idle workers in FIFO order

* Update test

* minor update

* Address comments

* fix some cases

* fix test_remote_cancel

* Address comments

* fix after merge

* remove kill

* fix worker_pool_test

* fix java test timeout

* fix test_two_custom_resources

* Add a delay when killing idle workers

* fix test_worker_failure

* fix test_worker_failed again

* fix DisconnectWorker

* update test_worker_failed

* Revert some python tests

* lint

* address comments
 2020-09-29 23:54:53 -07:00
SangBin Cho
f54f7b23f6
 		[Object Spilling] Name IO workers properly. () 
* Fix.

* Addressed code review.
 2020-09-29 23:48:31 -07:00
Kai Yang
0c254878db
 		[Java] Upgrade TestNG to 7.3.0 () 2020-09-30 14:38:52 +08:00
Tao Wang
15ae8816f7
 		[GCS]Remove useless / heavy heartbeat pub () 2020-09-29 23:38:17 -07:00
Max Fitton
03c11d3b85
 		[Dashboard] Add Ray Config API to Reporter Head () 
* Add Ray Config API to the backend for fetching config

* Address PR comments.

* Make reporter cache whole payload

* lint

Co-authored-by: Max Fitton <max@semprehealth.com>
 2020-09-29 17:57:49 -07:00
Maksim Smolin
94494c43d6
 		[cli] Updates () 2020-09-29 16:55:07 -07:00
Ameer Haj Ali
f17ad5d060
 		[autoscaler] resource demand scheduler get_nodes_to_launch should return Dict not List () 2020-09-29 15:32:56 -07:00
Kai Fricke
b8f344f695
 		[tune] add faq entry for reproducing experiments (setting seeds etc) () 2020-09-29 14:48:39 -07:00
architkulkarni
3ad670efa6
 		auto-update copyright year in docs () 2020-09-29 13:57:06 -07:00
Max Fitton
825737adc5
 		[Dashboard] Add old dashboard front end to new dir so we can get a diff going. () 
Co-authored-by: Max Fitton <max@semprehealth.com>
 2020-09-29 13:46:42 -07:00
Kai Fricke
10015e60fb
 		[tune] fix flaky callback test () 2020-09-29 09:44:32 -07:00
Tao Wang
1db83764bf
 		[GCS]Use new getting all available resources interface instead of pub-sub … () 
* Use new all available resources getting interface instead of pub-sub in state.py

* add missing server handler and test cases, fix comments

* add fine grained test assert

* per comments

* involve new added function _available_resources_per_node

* change  ClientID to NodeID

* fix compile

* fix client id and lint

* robust tests check

* robust tests
 2020-09-29 09:41:10 -07:00
Sven Mika
47eb6613b5
 		[RLlib] Remove unnecessary copies in compute_advantages. () 2020-09-29 12:25:20 +02:00
Sven Mika
f91c455527
 		[RLlib] Curiosity documentation. () 2020-09-29 09:39:22 +02:00
Ameer Haj Ali
0d36e4c025
 		[autoscaler] Support min_workers for multi node type () 
* prepare for head node

* move command runner interface outside _private

* remove space

* Eric

* flake

* min_workers in multi node type

* fixing edge cases

* eric not idle

* fix target_workers to consider min_workers of node types

* idle timeout

* minor

* minor fix

* test

* lint

* eric v2

* eric 3

* min_workers constraint before bin packing

* Update resource_demand_scheduler.py

* Revert "Update resource_demand_scheduler.py"

This reverts commit 818a63a2c86d8437b3ef21c5035d701c1d1127b5.

* reducing diff

Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
Co-authored-by: Alex Wu <alex@anyscale.io>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
 2020-09-28 22:02:01 -07:00
SangBin Cho
0a6164ab15
 		[Core] Improve logging messages. () 2020-09-28 21:07:45 -07:00
Simon Mo
6cfc1a16a0
 		[Serve] Fix resource checking () 2020-09-28 18:10:43 -07:00
SangBin Cho
cef263a333
 		[Custom Metrics] Improve ray runtime context. () 
* done.

* Addressed code review.

* Addressed code review.
 2020-09-28 16:18:19 -07:00
fangfengbin
872219940b
 		[GCS]Fix miss PollOwnerForActorOutOfScope after gcs restarts bug () 
* fix_RemoveActorFromOwner_crash_bug

* fix review comment

* fix review comment

* rm unused ut

* add testcase

* fix review comment

* rm unused import

* fix code style

* fix ut bug

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-28 10:06:40 -07:00
Kai Yang
79c6a6fa02
 		[Java] Enable retry in TestNG () 
* Enable retry in Java test

* lint

* update
 2020-09-28 22:16:06 +08:00
Lingxuan Zuo
27e1f513e3
 		[Log] make glog flush and RAY_LOG thread-safe () 
* make glog flush and RAY_LOG thread-safe

* dump error log to console

* mapping all levels to destination

* hack glog for exporting message to stdout if no base name given

* patch lint

* use stdout logger by default

* add raylet std/err pytest checker

* add worker logs file check

* fix asan check

* loop in glog enums

* fix python lint

* lint for autoindent

* fix indent lint

* make raylet.err is not empty
 2020-09-28 22:15:15 +08:00
fangfengbin
dd97f0c30d
 		[Java]Fix testSetResource bug () 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-28 17:53:08 +08:00
Tao Wang
25ac8f9aa5
 		[GCS]Use new flag to indicate whether resources are updated and update realtime resources view () 
* Handle resources turning empty and update realtime view

* add up missing flag

* per comments

* use flag instead of special key to represent if resource changed

* Update src/ray/protobuf/gcs.proto

Co-authored-by: fangfengbin <869218239a@zju.edu.cn>

* fix lint in gcs.proto

* fix embarrassed mistake

Co-authored-by: fangfengbin <869218239a@zju.edu.cn>
 2020-09-28 01:57:27 -07:00
fangfengbin
2e41a29c8f
 		[Placement Group]Support placement group request processing idempotent in raylet () 
* add part code

* fix review comment

* fix review comment

* fix review comment

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-28 01:56:43 -07:00
fang yeqing
0765d989ae
 		[Core] Simplify logic in node manager class. () 
Co-authored-by: 逗角 <yeqing.fyq@antfin.com>
 2020-09-28 01:54:06 -07:00
fangfengbin
142234cbcb
 		[GCS]Fix ServiceBasedGcsClientTest bug () 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-28 14:50:36 +08:00
fangfengbin
86e5db4d59
 		[GCS]Fix GCS actor manager idempotent bug () 
* [GCS]Fix GCS actor manager idempotent bug

* fix review comment

* fix review comment

* fix review comments

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-27 21:12:42 -07:00
SangBin Cho
1e39c40370
 		[Placement Group] Capture child tasks by default. () 
* In progress.

* Finished up.

* Improve comment.

* Addressed code review.

* Fix test failure.

* Fix ci failures.

* Fix CI issues.
 2020-09-27 19:33:00 -07:00
fangfengbin
f0787a63da
 		[GCS] fix rpc port bug () 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-09-27 19:08:48 -07:00
Kai Fricke
e7315b0856
 		[tune] Callbacks for tune runs () 2020-09-27 16:50:07 -07:00
Christian Kasim Loan
4285bee517
 		[Doc] Added John Snow Lab's NLU reference to community integration page () 
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
 2020-09-27 13:07:12 -07:00
DK.Pino
db7097fb1f
 		[Refactor] Rename ClientId to NodeId () 
* rename ClientId to NodeId

* format lint

* format lint

* fix conflicts

* rename new ClientId to NodeId

* update lint

* make same version of clang-format with travis ci
 2020-09-27 10:24:21 -07:00
Tao Wang
f69b390755
 		[BUILD]ignore pyenv version file in git () 2020-09-27 09:26:26 -07:00
Eric Liang
b5ecdd088b
 		Deflake object manager test () 2020-09-26 18:33:02 -07:00
Richard Liaw
51038f2197
 		confirm () 
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
 2020-09-26 13:48:13 -07:00
Stephanie Wang
552ebdbeda
 		[Core] Announce worker port at end of constructor () 2020-09-25 21:56:00 -07:00
SangBin Cho
29663d89f1
 		[Placement Group] Remove warning msg for placement groups. () 
* Done.

* Addressed code review.

* Fixed typo.

* Addressed code review.
 2020-09-25 20:53:42 -07:00
Eric Liang
8f79b4e45e
 		[rllib] Replay buffer size inaccurate with replay_seq_len option () 
* support replay seq len

* update

* fix warn

* add test

* test
 2020-09-25 13:47:23 -07:00
SangBin Cho
8abe13023f
 		[Metric] Fix issue 10634 () 
* Fix.

* Revert "Fix."

This reverts commit 52c9c1ee646b551a4dd2b639c78be67683db2b1c.

* ADdressed code review.

* Addressed code review.
 2020-09-25 09:11:05 -07:00
SangBin Cho
109481afd9
 		[Metric] custom metrics refinement () 
* In progress

* In Progress.

* Addressed code review.

* Add unit tests.

* Add a simple doc.

* Fixed test failure.

* Fix all test failures from serve.

* Addressed code review.
 2020-09-25 09:10:28 -07:00
Eric Liang
609c1b8acd
 		Start moving ray internal files to _private module () 2020-09-24 22:46:35 -07:00
Ameer Haj Ali
3b6fe72029
 		Make the command runner interface public () 2020-09-24 22:45:17 -07:00
Amog Kamsetty
ee85cb31a5
 		[Tune] Fix Memory Leak () 
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
 2020-09-24 20:26:55 -07:00
Eric Liang
a26394d184
 		[tests] Blacklist failing win32 tests () 2020-09-24 20:15:28 -07:00
Richard Liaw
a563344bc2
 		[docs] remove ref to google groups -> github discussions () 2020-09-24 18:09:51 -07:00
Simon Mo
4f6e218a3d
 		Add a new _available_resources_per_node for state API () 2020-09-24 17:25:15 -07:00
Alex Wu
0f168bf2ef
 		[hotfix] Use ref in WorkerPool::TryKillingIdleWorkers () 2020-09-24 17:23:56 -07:00
Amog Kamsetty
3716fb1ca9
 		[Ray SGD] Fix hotfix test () 2020-09-24 14:14:03 -07:00
Amog Kamsetty
07bdf062b9
 		[Ray SGD] [Hotfix] Worker group hotfix () 2020-09-24 12:21:30 -07:00