SangBin Cho
f6eb47fc1f
[Stats] metrics agent exporter ( #9361 )
2020-07-14 11:49:16 -05:00
Siyuan (Ryans) Zhuang
d57ff5e2af
Remove legacy C++ code ( #9459 )
2020-07-14 00:57:42 -07:00
kisuke95
276fe109c5
change error code name of boost timer ( #9417 )
2020-07-14 11:50:58 +08:00
fangfengbin
3c90f960fb
Fix gcs_pubsub_test bug( #9438 )
...
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-07-14 11:34:50 +08:00
Siyuan (Ryans) Zhuang
4da97a7c99
[Core] Build raylet client as an independent component ( #9434 )
2020-07-13 16:00:32 -07:00
Hao Chen
e6225bdfa1
[GCS] Fix the bug about raylet receiving duplicate actor creation tasks ( #9422 )
2020-07-13 11:34:02 -07:00
Siyuan (Ryans) Zhuang
381c242f6b
[Core] Simplify Raylet Client ( #9420 )
2020-07-12 12:42:54 -07:00
Siyuan (Ryans) Zhuang
1798deae94
[Core] Plasma RAII support ( #9370 )
2020-07-10 09:22:29 -07:00
SangBin Cho
d8a0d76d02
Fix macos compliation bug ( #9391 )
...
* Fix.
2020-07-10 09:18:09 -07:00
Kai Yang
c89b59cf48
Remove the RAY_CHECK in Worker::Port() ( #9348 )
2020-07-10 18:06:25 +08:00
Kai Yang
a98cd0670e
[Java] Improve JNI performance when submitting and executing tasks ( #9032 )
2020-07-10 17:51:07 +08:00
Hao Chen
d49dadf891
Change Python's ObjectID to ObjectRef ( #9353 )
2020-07-10 17:49:04 +08:00
Tao Wang
6311e5a947
[HOTFIX] Fix compile direct_actor_transport_test on mac ( #9403 )
2020-07-10 17:19:34 +08:00
fangfengbin
35861f17a3
Fix gcs_table_storage testcase bug ( #9393 )
...
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-07-10 16:16:28 +08:00
mehrdadn
dd2cc6eb48
Update hiredis and remove Windows patches ( #9289 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-09 18:45:44 -07:00
Zhuohan Li
8a76f4cbb5
[Core] put small objects in memory store ( #8972 )
...
* remove the put in memory store
* put small objects directly in memory store
* cast data type
* fix another place that uses Put to spill to plasma store
* fix multiple tests related to memory limits
* partially fix test_metrics
* remove not functioning codes
* fix core_worker_test
* refactor put to plasma codes
* add a flag for the new feature
* add flag to more places
* do a warmup round for the plasma store
* lint
* lint again
* fix warmup store
* Update _raylet.pyx
Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-07-09 15:39:40 -07:00
Alex Wu
34b85659d4
[Core] New scheduler fixes ( #9186 )
...
* .
* test_args passes
* .
* test_basic.py::test_many_fractional_resources causes ray to hang
* test_basic.py::test_many_fractional_resources causes ray to hang
* .
* .
* useful
* test_many_fractional_resources fails instead of hanging now :)
* Passes test_fractional_resources
* .
* .
* Some cleanup
* git is hard
* cleanup
* Fixed scheduling tests
* .
* .
2020-07-09 15:37:51 -07:00
Alisa
f0a72ad985
[Core] Add placement group scheduler and some api in resource scheduler ( #9039 )
...
* Add placement group scheduler and some api of resource scheduler.
Merge fix cv hang in multithread variables race (#8984 ).
* change the bundle id and delete unit count in bundle
change vector<bundle_spec> to vector<shared_ptr<bundle_spec>>
Add placement group scheduler and some api of resource scheduler.
Merge fix cv hang in multithread variables race (#8984 ).
change the bundle id and delete unit count in bundle
remove CheckIfSchedulable()
add comments and fix the bug in resource
* fix placement group schedule
* add placement group scheduler and change some api in resource scheduler
* fix by the comments
* fix conflict
* fix lint
* fix lint
* fix bug in merge
* fix lint
Co-authored-by: Lingxuan Zuo <skyzlxuan@gmail.com>
2020-07-09 15:37:18 -07:00
Stephanie Wang
0389735d7a
[core] Pass owner address from the workers to the raylet ( #9299 )
...
* Add intended worker ID to GetObjectStatus, tests
* Remove TaskID owner_id
* lint
* Add owner address to task args
* Make TaskArg a virtual class, remove multi args
* Set owner address for task args
* merge
* Fix tests
* Add ObjectRefs to task dependency manager, pass from task spec args
* tmp
* tmp
* Fix
* Add ownership info for task arguments
* Convert WaitForDirectActorCallArgs
* lint
* build
* update
* build
* java
* Move code
* build
* Revert "Fix Google log directory again (#9063 )"
This reverts commit 275da2e400
2020-07-09 14:35:54 -07:00
mehrdadn
4687b807c4
Combine different severities into the same log files ( #9230 )
...
* Combine different severities into the same log files
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-09 14:14:28 -07:00
Siyuan (Ryans) Zhuang
7e1326c0f6
[Core] Enhance common client connection ( #9367 )
...
* enhance client connection
* add write buffer async
* read message
* add test
2020-07-09 08:59:37 -07:00
fangfengbin
b97b474ae9
Fix GcsActorManagerTest multi-thread bug ( #9358 )
2020-07-09 20:03:46 +08:00
fangfengbin
62fe403a57
Fix the bug that PollOwnerForActorOutOfScope's reply may be missing ( #9330 )
2020-07-09 17:33:52 +08:00
Lingxuan Zuo
0562236533
[Stats] Make aggeration window and report interval configurable. ( #9235 )
2020-07-09 12:44:38 +08:00
SangBin Cho
9f8ff2e3b1
[Core] GCS Actor Management Race Condition ( #9215 )
...
* GCS Actor management on by default.
* Fix travis config.
* Change condition.
* Finish the initial race condition fix.
* Lint.
* Refine the codebase.
* Finish the initial version
* Improve logic.
* Remove unnecessary log messages.
* Address code review.
* Add tests
* Revert the second race condition that doesn't happen anymore, handle some edge cases. add tests.
* Address the second race condition found.
* Addressed code review.
* Addressed code review.
* Run a new unit test only when gcs actor management is on.
2020-07-08 10:56:52 -07:00
SangBin Cho
c5aa1eb042
[GCS Actor Management] Fix a dashboard doesn't show the correct actor state. ( #9275 )
...
* Fix a bug.
* Address code review.
* Remove an unnecessary comment.
2020-07-08 10:55:47 -07:00
Ian Rodney
9172f8c3a6
[core] Store Internal Config in GCS ( #8921 )
2020-07-08 11:22:08 -05:00
ZhuSenlin
42f8f16c04
[GCS] Fix detached actor with empty name ( #9283 )
2020-07-08 12:21:24 +08:00
yncxcw
4ba4110dec
[Core] Make worker_register_timeout_seconds configurable ( #9221 )
2020-07-07 18:27:15 -05:00
SangBin Cho
8f19f1eafb
[Core] Actor handle refactoring ( #8895 )
...
* Marking needed changes.
* Resolve basic dependencies.
* In progress.
* linting.
* In progress 2.
* Linting.
* Refactor done. Cleanup needed.
* Linting.
* Recover kill actor in core worker because it is used inside raylet
* Cleanup.
* Use unique pointer instead. Unit tests are broken now.
* Fix the upstream change.
* Addressed code review 1.
* Lint.
* Addressed code review 2.
* Fix weird github history.
* Lint.
* Linting using clang 7.0.
* Use a better check message.
* Revert cpp stuff.
* Fix weird linting errors.
* Manuall fix all lint issues.
* Update a newline.
* Refactor some interface.
* Addressed all code review.
* Addressed code review
2020-07-07 11:11:41 -07:00
Ian Rodney
a1e14380ce
[core] Switch Async Callback to C++ [WIP] ( #9228 )
...
Co-authored-by: simon-mo <simon.mo@hey.com>
2020-07-07 09:47:25 -07:00
fangfengbin
8391f66086
Fix gcs actor manager destroy actor crash bug ( #9329 )
2020-07-07 21:12:30 +08:00
Stephanie Wang
b42d6a1ddc
[core] Refactor task arguments and attach owner address ( #9152 )
...
* Add intended worker ID to GetObjectStatus, tests
* Remove TaskID owner_id
* lint
* Add owner address to task args
* Make TaskArg a virtual class, remove multi args
* Set owner address for task args
* merge
* Fix tests
* Fix
* build
* update
* build
* java
* Move code
* build
* Revert "Fix Google log directory again (#9063 )"
This reverts commit 275da2e400#9063 )""
This reverts commit 4a326fcb148ca09a35bc7de11d89df10edbb56e7.
* lint
2020-07-06 21:25:14 -07:00
ChenZhilei
6f3d993681
GCS server use worker table to handle RegisterWorker instead of redis accessor ( #9168 )
2020-07-06 10:37:25 +08:00
Tao Wang
f7ac495a68
[Core] Use map instead of list to represent resources in heartbeat message ( #9294 )
2020-07-05 10:59:25 +08:00
Lingxuan Zuo
7a2d7964d8
Bool config string stream must be in true or 1 ( #9292 )
2020-07-03 20:37:19 +08:00
ZhuSenlin
726c4cd6d4
fix actor accessor initialize inside redis gcs client ( #9284 )
...
Co-authored-by: senlin.zsl <senlin.zsl@antfin.com>
2020-07-03 15:48:32 +08:00
mehrdadn
29acf272b7
Build with Visual C++ ( #9190 )
...
Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Simon Mo <xmo@berkeley.edu>
2020-07-02 09:34:24 -07:00
Lingxuan Zuo
8a1cc7f8f9
Reset bool config by checking type first ( #9247 )
2020-07-02 18:32:41 +08:00
fangfengbin
8fcfcc4100
GCS server error handling for actor creation ( #8899 )
2020-07-02 16:27:32 +08:00
fangfengbin
a7a7bef622
Fix Java test crash due to incorrect destruction order ( #9236 )
2020-07-02 15:44:08 +08:00
Tao Wang
d35776e92d
[Core] Do not heartbeat resources if no update ( #9182 )
2020-07-02 13:56:49 +08:00
Lingxuan Zuo
1491508859
[Metrics] Stats supports metric exporters ( #8941 )
2020-07-01 10:54:55 -05:00
ChenZhilei
c11855728a
Remove raylet monitor after use GCS service ( #9179 )
2020-07-01 20:01:52 +08:00
chaokunyang
ab8df7afa3
Refine GetNamedActorHandle acync rpc wait ( #9078 )
2020-06-29 10:52:38 +08:00
Alex Wu
f8ecf6de71
Small fix ( #9149 )
...
Fixes some basic test cases
2020-06-28 13:43:03 -07:00
fangfengbin
1dc018d0bb
Add gcs service discovery to automatically detect GCS server restart ( #8735 )
2020-06-28 16:50:06 +08:00
Zhilei Chen
d78128a69c
Refactor GcsJobInfoHandle to GcsJobManager and filename ( #9112 )
2020-06-28 16:10:13 +08:00
mehrdadn
aac40af948
Fix some nonstandard code ( #9172 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-28 00:22:52 -07:00
Siyuan (Ryans) Zhuang
d7549d6184
Replace arrow::Status with ray::Status in Plasma ( #9154 )
...
* add object store status
* replace arrow status with ray status
* cleanup
* remove plasma common.cc
2020-06-26 14:06:34 -07:00
