Commit graph

332 commits

Author SHA1 Message Date
Kai Yang
90f1e408de
[Java] Add fetchLocal parameter in Ray.wait() (#13604) 2021-01-22 17:55:00 +08:00
Kai Yang
92f1e0902e
[Java] Fix return of java doc (#13601) 2021-01-21 23:57:20 +08:00
Qing Wang
d3dd5b87ce
[Java] Support wasCurrentActorRestarted in actor task. (#13120)
* Remove check.

* Add test

* fix lint

* lint

* Fix spotless lint

* Address comments.

* Fix lint

Co-authored-by: Qing Wang <jovany.wq@antgroup.com>
2021-01-02 11:31:08 +08:00
Qing Wang
f5412c0417
[Java] Avoid failure of serializing a user-defined unserializable exception. (#13119) 2020-12-31 19:47:35 +08:00
chaokunyang
d1dd3410c8
[Java] Format ray java code (#13056) 2020-12-29 10:36:16 +08:00
ZhuSenlin
85f1716a1f
speed up local mode object store get (#13052)
Co-authored-by: senlin.zsl <senlin.zsl@antfin.com>
2020-12-24 14:59:14 +08:00
Eric Liang
03a5b90ed6
Revert "Revert "Increase the number of unique bits for actors to avoi… (#12990) 2020-12-21 15:16:42 -08:00
Kai Yang
5a6801dde7
[Core] Remove delete_creating_tasks (#12962) 2020-12-22 00:01:27 +08:00
Eric Liang
5d987f5988
Revert "Increase the number of unique bits for actors to avoid handle collisions (#12894)" (#12988)
This reverts commit 3e492a79ec.
2020-12-18 23:51:44 -08:00
Kai Yang
ac5ea2c13d
[Java] Fix output parsing in RunManager (#12968)
* Fix output parsing in RunManager

* change log level

Co-authored-by: 灵洵 <fengbin.ffb@antgroup.com>
2020-12-18 18:22:12 -08:00
Eric Liang
3e492a79ec
Increase the number of unique bits for actors to avoid handle collisions (#12894) 2020-12-18 15:59:03 -08:00
fangfengbin
91878d18b5
[PlacementGroup]Fix placement group wait api disorder bug (#12827)
* [PlacementGroup]Fix placment group wait api disorder bug

* fix review comment

* fix review comment

* fix review comment

* fix review comments

* increase num_heartbeats_timeout

Co-authored-by: 灵洵 <fengbin.ffb@antgroup.com>
2020-12-16 18:45:53 +08:00
Kai Yang
e3b5deb741
[Multi-tenancy] Delete flag enable_multi_tenancy and remove old code path (#10573) 2020-12-10 19:01:40 +08:00
fangfengbin
260b07cf0c
[PlacementGroup]Add PlacementGroup wait java api (#12499)
* add part code

* add part code

* add part code

* add part code

* fix review comments

* fix compile bug

* fix compile bug

* fix review comments

* fix review comments

* fix code style

* add part code

* fix review comments

* fix review comments

* fix code style

* rebase master

* fix bug

* fix lint error

* fix compile bug

* fix newline issue

Co-authored-by: 灵洵 <fengbin.ffb@antgroup.com>
2020-12-05 16:40:04 +08:00
Kai Yang
21fcee28f9
[Java] Simplify Ray.init() by invoking ray start internally (#10762) 2020-12-04 14:33:45 +08:00
SangBin Cho
f6f3cc9af1
[Core]Remove checkpoint table (#12235)
* Delete an actor entry from node manager.

* Remove checkpoint table

* remote checkpoint interface

* remove checkpoint interface

* fix ExitActorTest

Co-authored-by: chaokunyang <shawn.ck.yang@gmail.com>
2020-12-01 08:58:36 -08:00
Philipp Moritz
cf73ccddae
Allow more fields for object metadata (#12484) 2020-11-29 21:50:18 -08:00
Ian Rodney
7f1f16d99e
[Core] Force get_actor(name)'s name to be non-empty string (#12218) 2020-11-23 12:38:16 -08:00
chaokunyang
9d133e874c
[Java] support java actor class inheritance (#12001) 2020-11-23 14:07:10 +08:00
DK.Pino
0f9e2fec12
[Placement Group] Add get / get all / remove interface for Placement Group Java api. (#11821)
* add placement group java get/get all interface

* add remove placement group api

* fix some issue like: Placement Group -> placement group

* extract dumplicate code to placement group utils

* specify running mode for placement group ut

* update checkGlobalStateAccessorPointerValid -> validateGlobalStateAccessorPointer

* use THROW_EXCEPTION_AND_RETURN_IF_NOT_OK

* update pg log print
2020-11-17 12:32:39 +08:00
Barak Michener
de6df51bd2
[redis, docs]: Bump redis and docs/Pillow dependencies (#11371) 2020-11-11 18:15:27 -08:00
DK.Pino
50110b934c
[Placement Group]Enhance create placement group java api (#11702)
* enhance create pg java api

* add state for PlacementGroup

* fix comment

* move default pg

* make default pg name private

* add bundle size and bundle resource size check when placement group create
2020-11-05 09:59:36 +08:00
Kai Yang
cbc5dac6c4
[Java] fix shutdown lock typo (#11410) 2020-10-20 22:31:27 +08:00
Kai Yang
abc6126814
[Java] Release actor instance reference when Ray.exitActor() is invoked (#11324) 2020-10-14 13:12:59 +08:00
Kai Yang
3504391fd2
[Core] Multi-tenancy: enable multi-tenancy by default (#10570)
* Add new job in Travis to enable multi-tenancy

* fix

* Update .bazelrc

* Update .travis.yml

* fix test_job_gc_with_detached_actor

* fix test_multiple_downstream_tasks

* fix lint

* Enable multi-tenancy by default

* Kill idle workers in FIFO order

* Update test

* minor update

* Address comments

* fix some cases

* fix test_remote_cancel

* Address comments

* fix after merge

* remove kill

* fix worker_pool_test

* fix java test timeout

* fix test_two_custom_resources

* Add a delay when killing idle workers

* fix test_worker_failure

* fix test_worker_failed again

* fix DisconnectWorker

* update test_worker_failed

* Revert some python tests

* lint

* address comments
2020-09-29 23:54:53 -07:00
Kai Yang
0c254878db
[Java] Upgrade TestNG to 7.3.0 (#11135) 2020-09-30 14:38:52 +08:00
fangfengbin
1d06e025ae
[Java]Add actor id when throw RayActorException (#10886) 2020-09-20 16:51:14 +08:00
Alex Wu
9a07c7b963
[1.0] Remove args from ray start (#10659) 2020-09-18 16:41:23 -07:00
chaokunyang
322f12600f
bump java version to 1.1.0 (#10795) 2020-09-16 12:05:11 +08:00
chaokunyang
34bb61dabc
[Java] Refine java driver log (#10794) 2020-09-15 17:03:03 +08:00
Hao Chen
1a5cfe0b79
[Java] rename config ray.redis.address to ray.address (#10772) 2020-09-15 11:13:19 +08:00
Kai Yang
a43817f34b
[Java] Attach owner address for pass-by-reference task arguments (#9634) 2020-09-14 11:46:59 +08:00
Xianyang Liu
8166d71bde
[Java] Support exchange ObjectRef between processes (#10729) 2020-09-13 11:54:45 +08:00
chaokunyang
72ac85c19e
[Java] remove resetLibraryPath (#10671) 2020-09-09 15:46:37 +08:00
chaokunyang
bbfbc98a41
[Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
Kai Yang
ca8792e4ff
[Java] Disable the multi-worker feature by default (#10593) 2020-09-08 13:10:46 +08:00
fyrestone
226a1824b8
Improve cross language serialization (#10490) 2020-09-08 12:18:13 +08:00
fyrestone
77efad8616
Fix Java exception serialization (#10568) 2020-09-05 11:06:14 +08:00
Kai Yang
6a78ba9752
Java doc: "Starting Ray" page (#10062) 2020-09-05 10:15:52 +08:00
chaokunyang
7ee0fdba3d
[Java] Throw exception if Ray.init() is not called and users try to access ray API (#10497) 2020-09-05 10:09:19 +08:00
chaokunyang
cf3875bd8c
[Java] add exitActor API for java (#10496) 2020-09-04 10:11:42 +08:00
chaokunyang
553a93c5cc
[Java] fix Checkstyle violation (#10524) 2020-09-03 16:45:21 +08:00
chaokunyang
f10a5a40b0
[Java] Simplify ray cmd params (#10394) 2020-09-02 19:47:52 +08:00
fyrestone
b04222dbd9
[xlang] Cross language serialization for ActorHandle (#10335) 2020-09-02 10:11:53 +08:00
fyrestone
08adbb371f
Cross language exception (#10023) 2020-08-26 10:46:05 +08:00
fangfengbin
b61a79efd7
[Placement Group]Fix SigSegv bug (#10262)
* fix SigSegv bug

* fix review comments

* fix ut bug

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-08-23 11:33:40 -07:00
Kai Yang
37821f0b4c
Support unlimited JVM options (#9910) 2020-08-10 16:08:33 +08:00
Lingxuan Zuo
9b5b16ef11
[GCS] fix gcs table get all nodes npe (#9927) 2020-08-05 10:36:06 -07:00
kisuke95
3f1e3bc354
Fix wrong java pattern of DateTimeFormatter (#9902) 2020-08-04 21:19:54 +08:00
Kai Yang
27cd323ce1
[Core] Multi-tenancy: Job isolation & implement per job config (except for env variables) (#9500) 2020-08-04 15:51:29 +08:00