Commit graph

199 commits

Author SHA1 Message Date
chaokunyang
72ac85c19e
[Java] remove resetLibraryPath (#10671) 2020-09-09 15:46:37 +08:00
chaokunyang
bbfbc98a41
[Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
Kai Yang
ca8792e4ff
[Java] Disable the multi-worker feature by default (#10593) 2020-09-08 13:10:46 +08:00
fyrestone
226a1824b8
Improve cross language serialization (#10490) 2020-09-08 12:18:13 +08:00
fyrestone
77efad8616
Fix Java exception serialization (#10568) 2020-09-05 11:06:14 +08:00
Kai Yang
6a78ba9752
Java doc: "Starting Ray" page (#10062) 2020-09-05 10:15:52 +08:00
chaokunyang
7ee0fdba3d
[Java] Throw exception if Ray.init() is not called and users try to access ray API (#10497) 2020-09-05 10:09:19 +08:00
chaokunyang
cf3875bd8c
[Java] add exitActor API for java (#10496) 2020-09-04 10:11:42 +08:00
chaokunyang
553a93c5cc
[Java] fix Checkstyle violation (#10524) 2020-09-03 16:45:21 +08:00
chaokunyang
f10a5a40b0
[Java] Simplify ray cmd params (#10394) 2020-09-02 19:47:52 +08:00
fyrestone
b04222dbd9
[xlang] Cross language serialization for ActorHandle (#10335) 2020-09-02 10:11:53 +08:00
fyrestone
08adbb371f
Cross language exception (#10023) 2020-08-26 10:46:05 +08:00
fangfengbin
b61a79efd7
[Placement Group]Fix SigSegv bug (#10262)
* fix SigSegv bug

* fix review comments

* fix ut bug

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-08-23 11:33:40 -07:00
Kai Yang
37821f0b4c
Support unlimited JVM options (#9910) 2020-08-10 16:08:33 +08:00
Lingxuan Zuo
9b5b16ef11
[GCS] fix gcs table get all nodes npe (#9927) 2020-08-05 10:36:06 -07:00
kisuke95
3f1e3bc354
Fix wrong java pattern of DateTimeFormatter (#9902) 2020-08-04 21:19:54 +08:00
Kai Yang
27cd323ce1
[Core] Multi-tenancy: Job isolation & implement per job config (except for env variables) (#9500) 2020-08-04 15:51:29 +08:00
chaokunyang
64d6446cf3
change version from 0.1-SNAPSHOT to 0.9.0-SNAPSHOT (#9778) 2020-08-01 22:38:22 +08:00
bermaker
88e8714bcb
Fix ray java worker metric test indentation (#9834) 2020-07-31 14:39:41 +08:00
Kai Yang
02fd950252
[Java] Local and distributed ref counting in Java (#9371) 2020-07-31 11:49:31 +08:00
bermaker
ccd6b90a42
Fix ray java worker metric registry indentation (#9780) 2020-07-30 13:20:24 +08:00
chaokunyang
6464bf55c6
[dist] Mvn deploy (#9777) 2020-07-30 11:48:31 +08:00
Hao Chen
260bc52254
Java doc: "Ray Core Walkthrough" page (#8595) 2020-07-30 11:13:38 +08:00
chaokunyang
5aba53e9b2
[dist] Fix travis deploy for java dist (#9768) 2020-07-30 10:59:11 +08:00
SangBin Cho
423dc96cc4
Revert "[dist] swap mac/linux wheel build order (#9746)" and "Fix package and upload ray jar (#9742)" (#9758)
* Revert "[dist] swap mac/linux wheel build order (#9746)"

This reverts commit a9340565ff.

* Revert "Fix package and upload ray jar (#9742)"

This reverts commit c290c308fe.
2020-07-28 15:34:29 -07:00
bermaker
6e23aff723
[Metrics]Ray java worker metric registry (#9636)
* ray worker metrics gauge init

* ray java metric mapping

* add jni source files for gauge and tagkey

* mapping all metric classes to stats object

* check non-null for tags and name

* lint

* add symbol for native metric JNI

* extern c for symbol

* add tests for all metrics

* Update Metric.java

use metricNativePointer instead.

* unify metric native stuff to one class

* fix jni file

* add comments for metric transform function in jni utils

* move metric function to native metric file

* remove unused disconnect jni

* Add a metric registry for java metircs

* Restore install-bazel.sh

* Add some comments for metric registry

* Fix thread safe problem of metrics

* Fix metric tests and remove sleep code from tests

* Fix comments of metrics

Co-authored-by: lingxuan.zlx <skyzlxuan@gmail.com>
2020-07-28 21:29:33 +08:00
chaokunyang
c290c308fe
Fix package and upload ray jar (#9742) 2020-07-28 11:53:25 +08:00
Simon Mo
7740136b93
Revert "Package and upload ray cross-platform jar (#9540)" (#9730)
This reverts commit 881032593d.
2020-07-27 10:40:21 -07:00
chaokunyang
881032593d
Package and upload ray cross-platform jar (#9540) 2020-07-27 17:20:20 +08:00
fangfengbin
28d5f9696d
Add placement group java api (#9611)
* add part code

* add part code

* add part code

* fix code style

* fix review comment

* fix review comment

* add part code

* add part code

* add part code

* add part code

* fix review comment

* fix review comment

* fix code style

* fix review comment

* fix lint error

* fix lint error

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-07-25 15:39:05 +08:00
fangfengbin
01d6edae9c
fix named actor single process mode bug (#9652) 2020-07-23 20:28:50 +08:00
Kai Yang
bfa0605282
[Java] Avoid data copy from C++ to Java for ByteBuffer type (#9033) 2020-07-22 16:25:32 +08:00
Lingxuan Zuo
cd42450fc1
[Metrics] Java metric API (#9377) 2020-07-22 10:35:08 +08:00
fangfengbin
008d973f62
fix java createActor NPE bug (#9532) 2020-07-17 11:01:51 +08:00
chaokunyang
9318e76b81
[Java] Named java actor (#9037) 2020-07-16 11:31:18 +08:00
chaokunyang
ccc1133a7a
[Java] fix redis-server binary path (#9398) 2020-07-15 10:47:16 +08:00
Kai Yang
a98cd0670e
[Java] Improve JNI performance when submitting and executing tasks (#9032) 2020-07-10 17:51:07 +08:00
Zhuohan Li
8a76f4cbb5
[Core] put small objects in memory store (#8972)
* remove the put in memory store

* put small objects directly in memory store

* cast data type

* fix another place that uses Put to spill to plasma store

* fix multiple tests related to memory limits

* partially fix test_metrics

* remove not functioning codes

* fix core_worker_test

* refactor put to plasma codes

* add a flag for the new feature

* add flag to more places

* do a warmup round for the plasma store

* lint

* lint again

* fix warmup store

* Update _raylet.pyx

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-07-09 15:39:40 -07:00
Ian Rodney
9172f8c3a6
[core] Store Internal Config in GCS (#8921) 2020-07-08 11:22:08 -05:00
Stephanie Wang
b42d6a1ddc
[core] Refactor task arguments and attach owner address (#9152)
* Add intended worker ID to GetObjectStatus, tests

* Remove TaskID owner_id

* lint

* Add owner address to task args

* Make TaskArg a virtual class, remove multi args

* Set owner address for task args

* merge

* Fix tests

* Fix

* build

* update

* build

* java

* Move code

* build

* Revert "Fix Google log directory again (#9063)"

This reverts commit 275da2e400.

* Fix free

* x

* build

* Fix java

* Revert "Revert "Fix Google log directory again (#9063)""

This reverts commit 4a326fcb148ca09a35bc7de11d89df10edbb56e7.

* lint
2020-07-06 21:25:14 -07:00
mehrdadn
7135cb2aec
Fix .exe file extensions (#9197)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-02 15:29:34 -05:00
Zhilei Chen
d8a9247448
Remove gcs_service_disabled ci jobs and code (#8854) 2020-06-19 11:32:27 +08:00
chaokunyang
cb6f337372
[Java] Refine python function (#8943) 2020-06-16 16:22:49 +08:00
chaokunyang
dfa4768fc6
[Java] Refactor java api (#8858) 2020-06-12 10:49:01 +08:00
chaokunyang
700d81fa20
[Java] Remove java api sub package from test module (#8853) 2020-06-11 14:59:45 +08:00
chaokunyang
31a4d07bc4
[Java] Rename java ObjectRef/ActorHandle (#8799) 2020-06-09 11:40:43 +08:00
chaokunyang
4a6c4003fd
[Java] fix serializer test location (#8730) 2020-06-05 15:02:08 +08:00
Hao Chen
dc3e98890f
Improve Java logging (#8640) 2020-06-02 16:15:20 +08:00
Lingxuan Zuo
4cbbc15ca7
[GCS] Global state accessor from node resource table (#8658) 2020-06-02 14:01:00 +08:00
fangfengbin
35eeec5647
Add C++ global state for actor table (#8501)
* add global state actors

* fix code style

* fix GcsActorManagerTest bug

* rebase master

* add jni code

* add get checkpoint id code

* add debug code

* add debug code

* change log level

* fix compile bug

* return null in jni

* fix crash bug

* change import seq

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-05-29 21:10:42 +08:00