Commit graph

57 commits

Author SHA1 Message Date
qicosmos
0f87eca3e9
[C++ Worker]Generate a template project for users (#16337) 2021-06-16 17:45:45 +08:00
SongGuyang
379c87dbbb
[C++ worker] bugfix of incorrect flag name "redis_password" and add test to support connecting to external cluster (#16219) 2021-06-11 11:49:13 +08:00
SongGuyang
09eebf0cc7
[C++ worker] use gflags to parse arguments in default worker (#16350)
* remove id.h dependence for c++ worker headers

* delete unuseful test

* fix lint

* [C++ worker] support config from RayConfig and command line(gflag)

* check password

* fix

* fix some comments

* optimization

* add files

* default to run cluster mode

* fix

* add node-ip-address params to C++ worker

* fix lint

* use gflags in c++ default_worker
2021-06-11 00:46:12 +08:00
SongGuyang
67761a4fc5
[C++ worker] add node-ip-address params to C++ worker (#16253) 2021-06-10 11:10:56 +08:00
qicosmos
45d2331d5a
[C++ Woker] Remove ray core dependency completely (#16108) 2021-05-31 15:39:18 +08:00
SongGuyang
17b5f4dcaa
[C++ worker] support config from RayConfig and command line(gflag) (#16086) 2021-05-31 11:56:02 +08:00
SongGuyang
a4c108e5f6
[C++ worker] delete unuseful test (#16082) 2021-05-27 11:23:59 +08:00
qicosmos
bbb61d0c00
[C++ Worker] remove core.h in api (#16079)
* remove core.h in api

* remove unused code and header

* remove core.h and some depencencies

* fix
2021-05-26 20:52:21 +08:00
qicosmos
498da13944
[C++ worker] Impove cpp worker (#15907) 2021-05-26 16:45:56 +08:00
qicosmos
d8f58e683f
[C++ worker] Add c++ worker log (#16015) 2021-05-26 16:13:02 +08:00
SongGuyang
7c3874b38e
remove id.h dependence for c++ worker headers (#16055) 2021-05-26 11:56:24 +08:00
qicosmos
1b3df53ab8
[C++ worker] Remove some api dependencies on ray core (#16011) 2021-05-25 20:19:25 +08:00
SongGuyang
4ea7719416
[C++ worker] don't expose ObjectID to users (#15966) 2021-05-25 16:36:34 +08:00
qicosmos
8790bb465b
[C++ worker] Remove func ptr offset (#15809) 2021-05-19 18:03:39 +08:00
Frank Luan
0dc34566fe
Refactor raylet to allocate+write+seal one return object at a time (#15757)
* Refactor raylet to allocate+write+seal one return object at a time

* Fix build

* Fix C++ and Java runtime

* Skip Windows testing

* Fix java and cpp runtime

* Fix warnings

* Fix cpp and java tests

* Fix cpp and java runtime

Co-authored-by: Stephanie Wang <swang@cs.berkeley.edu>
2021-05-17 20:06:08 -07:00
qicosmos
e4fb1c163e
[C++ Worker] Support overload functions for REAY_REMOTE (#14981)
Co-authored-by: qicosmos <chufeng.qy@antgroup.com>
2021-05-12 11:19:39 +08:00
qicosmos
4795048f1b
[C++ Worker] Support ray remote in one line (#14979)
Co-authored-by: qicosmos <chufeng.qy@antgroup.com>
Co-authored-by: Ian Rodney <ian.rodney@gmail.com>
2021-05-11 16:29:21 +08:00
qicosmos
e54dfd8cc5
[C++ worker] Ray actor task for RAY_REMOTE (#15039) 2021-04-12 15:40:35 +08:00
qicosmos
4c53c6ed1a
[C++ Worker] Improve normal task remote interface (#14978) 2021-03-29 19:55:16 +08:00
qicosmos
de7ee75d27
[C++ worker] Ray normal task for RAY_REMOTE (#14599) 2021-03-27 09:56:40 +08:00
Lixin Wei
72d87093b9
[Core] Make Actor DEAD and Save Exceptions in GCS When Error Happens in Constructor (#14211) 2021-03-17 12:50:28 -07:00
Siyuan (Ryans) Zhuang
b92531918e
Make use of C++14 'make_unique' (#14663) 2021-03-15 03:00:52 -07:00
qicosmos
f2348a5456
[C++ worker] Add ray register part1 (#14436) 2021-03-09 13:57:17 +08:00
qicosmos
d77e25b4b1
[C++ worker] Avoid recursive inclusion of API header files (#14414) 2021-03-04 18:51:02 +08:00
qicosmos
277b6f5d3c
Support arbitrary arguments for c++ worker normal tasks and actor tasks (#14233) 2021-03-01 16:27:03 +08:00
fyrestone
5e76a51d56
[Dashboard] Select port in dashboard (#13763)
* Dashboard select port; Fix dashboard may hangs when exit

* Add test case

* Fix

* Fix test_stats_collector.py::test_get_all_node_details

* Refine dashboard error messages

* Refine code

* Refine code

* Show last 10 lines of dashboard log if start dashboard failed

* Fix ValueError: too many values to unpack (expected 2) when getsockname

* Fix test_multi_node_3.py::test_calling_start_ray_head may fail

* Fix Windows CI

* Disable dashboard in C++ test

* Refine code

* Fix issue 7084

Co-authored-by: 刘宝 <po.lb@antfin.com>
2021-02-23 16:27:48 -08:00
Kai Yang
e75b143faf
[Core] Some small fixes and improvements (#14210) 2021-02-22 12:02:30 +08:00
qicosmos
bc46fc5fce
Cpp worker refactor serializer (#14027) 2021-02-18 15:37:58 +08:00
qicosmos
2307f54e88
[C++ API] simplify code of Arguments; avoid memory copy (#13978) 2021-02-18 10:33:18 +08:00
SongGuyang
09242e6d31
random a job id in c++ worker (#13982) 2021-02-08 12:57:25 -08:00
Eric Liang
26beb3b67b
Revert "Revert "Enable Ray client server by default (#13350)" (#13429)" (#13442)
* Revert "Revert "Enable Ray client server by default (#13350)" (#13429)"

This reverts commit 560299972c.

* fix job id collision with ray client server
2021-02-02 00:17:29 -08:00
SongGuyang
361e5f0bef
support dynamic library loading in C++ worker (#13734) 2021-02-01 19:24:33 +08:00
Ameer Haj Ali
710615c228
[docs] Documentation + example for the C++ language API (#13138) 2021-01-01 18:18:41 -08:00
Alind Khare
2059a2090d
[C++ API] Added reference counting to ObjectRef (#13058)
* Added reference counting to ObjectRef

* Addressed the comments
2020-12-24 09:32:52 -08:00
Philipp Moritz
73a1a232b9
Ray debugger stepping between tasks (#12075) 2020-12-06 21:50:18 -08:00
fangfengbin
084f03797b
[Placement Group]Placement Group supports gcs failover(Part3) (#12036) 2020-11-23 16:57:58 +08:00
Ameer Haj Ali
e8c018e8fc
[C++ API] tests for the C++ API. (#12076) 2020-11-17 17:07:52 -08:00
SongGuyang
df2c2a7ce5
[cpp worker] support pass by reference on cluster mode (#11753) 2020-11-16 14:30:35 -08:00
Kai Yang
4735c032ed
[Core] Fix C++ worker test (#11941) 2020-11-11 09:04:45 -08:00
SongGuyang
34191107a3
[cpp worker] fix crash in empty args task (#11363) 2020-10-14 16:48:34 -07:00
SangBin Cho
1e39c40370
[Placement Group] Capture child tasks by default. (#11025)
* In progress.

* Finished up.

* Improve comment.

* Addressed code review.

* Fix test failure.

* Fix ci failures.

* Fix CI issues.
2020-09-27 19:33:00 -07:00
Alex Wu
9a07c7b963
[1.0] Remove args from ray start (#10659) 2020-09-18 16:41:23 -07:00
SongGuyang
5cbc411e38
[cpp worker] support cluster mode (#9977) 2020-09-18 11:08:18 +08:00
kisuke95
b7003839bd
[Core] Use core worker options to initialize (#10467)
* fix

* fix

* .
2020-09-07 16:36:43 -07:00
Clark Zinzow
0c0b0d0a73
[Core] Added support for submission-time task names. (#10449)
* Added support for submission-time task names.

* Suggestions from code review: add missing consts

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Add num_returns arg to actor method options docstring example.

* Add process name line and proctitle assertion to submission-time task name section of advanced docs.

* Add submission-time task name --> proctitle test for Python worker.

* Added Python actor options tests for num_returns and name.

* Added Java test for submission-time task names.

* Add dashboard image to task name docs section.

* Move to fstrings.

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
2020-09-03 11:45:24 -07:00
SongGuyang
cb70864c04
[cpp worker] support cluster mode and object Put/Get works (#9682) 2020-08-28 13:53:36 +08:00
Clark Zinzow
0178d6318e
[Core] Expand job ID to 4 bytes by removing object flag bytes. (#10187) 2020-08-27 14:08:17 -05:00
SangBin Cho
224933b5e4
[Placement Group] Remove API part 2 (#10215)
* Initial progress done.

* Fix mistake.

* Addressed code review.

* Fix cpp build issue.

* Addressed code review.
2020-08-20 09:50:13 -07:00
Barak Michener
13f62b74f3
cpp: Fix include order in the cpp api.h for generated files (#10161) 2020-08-17 22:02:57 -07:00
Barak Michener
8e76796fd0
ci: Redo format.sh --all script & backfill lint fixes (#9956) 2020-08-07 16:49:49 -07:00