Max Fitton
00325eb2b2
Rename max_reconstructions to max_restarts and use -1 for infinite ( #8274 )
...
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-05-14 10:30:29 -05:00
Kai Yang
1d5bceddf0
fix java UT about multi-threading ( #8014 )
2020-04-27 15:11:22 +08:00
ZhuSenlin
4a81793ba5
GCS-Based actor management implementation ( #6763 )
...
* add gcs actor manager
* fix test_metrics.py
* fix TestTaskInfo
* fix comment
* fix comment
* fix comment
* fix comment
* fix comment
* fix comment
* fix compile error
* fix merge error
Co-authored-by: senlin.zsl <senlin.zsl@antfin.com>
2020-04-13 09:48:48 -07:00
Qing Wang
98bfcd53bc
[Java] Rename group id and package name. ( #7864 )
...
* Initial
* Change streaming's
* Fix
* Fix
* Fix org_ray
* Fix cpp file name
* Fix streaming
* Fix
* Fix
* Fix testlistening
* Fix missing sth in python
* Fix
* Fix
* Fix SPI
* Fix
* Fix complation
* Fix
* Fix CI
* Fix checkstyle
Fix checkstyle
* Fix streaming tests
* Fix streaming CI
* Fix streaming checkstyle.
* Fix build
* Fix bazel dep
* Fix
* Fix ray checkstyle
* Fix streaming checkstyle
* Fix bazel checkstyle
2020-04-12 17:59:34 +08:00
fyrestone
fc6259a656
Cross language serialization for primitive types ( #7711 )
...
* Cross language serialization for Java and Python
* Use strict types when Python serializing
* Handle recursive objects in Python; Pin msgpack >= 0.6.0, < 1.0.0
* Disable gc for optimizing msgpack loads
* Fix merge bug
* Java call Python use returnType; Fix ClassLoaderTest
* Fix RayMethodsTest
* Fix checkstyle
* Fix lint
* prepare_args raises exception if try to transfer a non-deserializable object to another language
* Fix CrossLanguageInvocationTest.java, Python msgpack treat float as double
* Minor fixes
* Fix compile error on linux
* Fix lint in java/BUILD.bazel
* Fix test_failure
* Fix lint
* Class<?> to Class<T>; Refine metadata bytes.
* Rename FST to Fst; sort java dependencies
* Change Class<?>[] to Optional<Class<?>>; sort requirements in setup.py
* Improve CrossLanguageInvocationTest
* Refactor MessagePackSerializer.java
* Refactor MessagePackSerializer.java; Refine CrossLanguageInvocationTest.java
* Remove unnecessary dependencies for Java; Add getReturnType() for RayFunction in Java
* Fix bug
* Remove custom cross language type support
* Replace Serializer.Meta with MutableBoolean
* Remove @SuppressWarnings support from checkstyle.xml; Add null test in CrossLanguageInvocationTest.java
* Refine MessagePackSerializer.pack
* Ray.get support RayObject as input
* Improve comments and error info
* Remove classLoader argument from serializer
* Separate msgpack from pickle5 in Python
* Pair<byte[], MutableBoolean> to Pair<byte[], Boolean>
* Remove public static <T> T get(RayObject<T> object), use RayObject.get() instead
* Refine test
* small fixes
Co-authored-by: 刘宝 <po.lb@antfin.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-04-08 21:10:57 +08:00
Kai Yang
48b48cc8c2
Support multiple core workers in one process ( #7623 )
2020-04-07 11:01:47 +08:00
fangfengbin
e196fcdbaf
Add gcs_service_enabled function to avoid getting environment variable directly ( #7742 )
2020-03-26 22:02:53 +08:00
fangfengbin
bf866de6fd
Enable GCS Service by default ( #7541 )
2020-03-24 14:20:23 +08:00
fyrestone
a1ae935839
Java call Python use structured function descriptors ( #7634 )
2020-03-20 17:29:45 +08:00
Hao Chen
7678418210
[Java] Fix the issue that the cached value in RayObject is serialized ( #7613 )
2020-03-17 22:07:41 +08:00
Kai Yang
6b888b0247
[Java] Make both RayActor and RayPyActor inheriting from BaseActor ( #7462 )
2020-03-17 21:45:56 +08:00
fyrestone
7697ea2be2
Java call Python actor method use actor.call ( #7614 )
2020-03-17 14:52:43 +08:00
Kai Yang
630e48967d
[Java] Allow passing internal config from raylet to Java worker ( #7532 )
2020-03-15 12:03:38 +08:00
Kai Yang
d6e8f47065
Add a flag to disable reconstruction for a killed actor ( #7346 )
2020-03-13 19:10:21 +08:00
Qing Wang
575c89cf47
[Java] Pass large object by reference ( #7595 )
2020-03-13 18:38:03 +08:00
Qing Wang
f4656d8cc3
[Java] Enable direct call by default. ( #7408 )
...
* WIP
* Address comments.
* Linting
* Fix
* Fix
* Fix test
* Fix
* Fix single process ci
* Fix ut
* Update java/test/src/main/java/org/ray/api/test/PlasmaFreeTest.java
* Address comments
* Fix linting
* Minor update comments.
* Fix streaming CI
2020-03-13 12:25:30 +08:00
Hao Chen
fe7820fec9
[Java] New Java actor API ( #7414 )
2020-03-04 22:39:23 +08:00
chaokunyang
1ae7c03e86
fix concurrently extract file ( #7225 )
2020-02-20 20:38:51 +08:00
fyrestone
a6b8bd47b0
[xlang] Cross language serialize ActorHandle ( #7134 )
2020-02-17 20:44:56 +08:00
Qing Wang
f3703bafa3
[Java] Support concurrent actor calls API. ( #7022 )
...
* WIP
Temp change
Attach native thread to jvm
* Fix run mode
* Address comments.
2020-02-14 13:02:39 +08:00
Qing Wang
94a286ef1d
[Java] Add session_dir as temp_dir for logs, socket files like Python ( #7044 )
...
* Support
* Add gcs_server support
* Fix ut
* Fix
* Remove unused py code
* Fix linting
* Fix cross language ci
* Fix CI
* Add docstring
* Fix
* Fix linting
* Add a singleton for config
* Refine
* fix
* Fix
* linting
* Remove FileUnit
* Fix
* Fix
* Fix
* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Fix streaming singleprocess CI
* Fix checkstyle
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-02-13 17:49:52 +08:00
fangfengbin
694c0f2867
[Java] Enable GCS server when running java unit tests ( #7041 )
...
* enable gcs service when run java testcase
* fix ci bug
* fix windows compile bug
* fix ci bug
* restart ci job
* enable java testcase
* restart ci job
* restart ci job
* add debug log
* add debug log
* restart ci job
* add debug log
* restart ci
* add debug log
* fix java testcase bug
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
2020-02-10 09:39:14 +08:00
fyrestone
0648bd28ef
[xlang] Cross language Python support ( #6709 )
2020-02-08 13:01:28 +08:00
Hao Chen
b53d00b659
[Java] Fix Java test issues ( #7000 )
2020-02-03 19:21:25 +08:00
Qing Wang
cfbde39ba8
[Java] Generate head redis port randomly ( #6879 )
...
* Random head port
* address comments.
2020-01-23 23:37:41 +08:00
chaokunyang
289e5e8aff
enable maven checkstyle ( #6829 )
2020-01-20 23:41:54 -08:00
Qing Wang
ad90693ca8
[Java] Enhancement single process mode ( #6795 )
...
* enhancement
* Add ut
* Update java/runtime/src/main/java/org/ray/runtime/task/LocalModeTaskSubmitter.java
Co-Authored-By: Kai Yang <kfstorm@outlook.com>
* Update java/test/src/main/java/org/ray/api/test/RunModeTest.java
Co-Authored-By: Kai Yang <kfstorm@outlook.com>
* Address comments
* Use ExecutorSerivce to replace raw thread
Co-authored-by: Kai Yang <kfstorm@outlook.com>
2020-01-15 21:38:53 +08:00
Kai Yang
cd5fc81bdd
Show the exit code if RunManager failed to start a process ( #6797 )
2020-01-15 19:31:56 +08:00
Kai Yang
ddd4c42fe5
[Java] Add killActor API in Java ( #6728 )
...
* Add killActor API in Java
* fix javadoc
* update test case
* Address comments
2020-01-14 17:12:00 +08:00
chaokunyang
36b2634479
[Java] Remove singleton exceptions ( #6765 )
2020-01-13 10:28:06 +08:00
Chaokun Yang
7bbfa85c66
[Streaming] Streaming data transfer java ( #6474 )
2019-12-22 10:56:05 +08:00
Chaokun Yang
eca4cc7c00
Fix plasma_store_server path ( #6499 )
2019-12-20 14:45:51 +08:00
Kai Yang
af9f76359a
Fix crash caused by unit test testWaitAndCrash ( #6549 )
2019-12-20 11:06:53 +08:00
Kai Yang
3bb680a719
[Java] Add getAsyncContext and setAsyncContext API ( #6439 )
...
* Add getAsyncContext and setAsyncContext API
* address comment
* fix bug
* Add test case
2019-12-19 18:08:58 +08:00
Kai Yang
03c37c7825
[Java] Add the default redis password for Java ( #6528 )
2019-12-19 10:53:53 +08:00
Kai Yang
b7d5c8f220
[Java] Fix multiple FunctionManagers creating multiple ClassLoader s ( #6434 )
2019-12-16 14:04:44 +08:00
Hao Chen
5cc3e1341a
[Java] Cache result in RayObjectImpl ( #6414 )
2019-12-11 11:26:01 +08:00
Kai Yang
eb912b68b1
[Java] Fix instanceof RayPyActor ( #6377 )
2019-12-07 16:28:29 +08:00
Kai Yang
7e9fddf3ed
[Java] Add java exception check in JNI ( #6378 )
2019-12-07 16:25:17 +08:00
Zhijun Fu
b88b8202cc
fix java build failure ( #6062 )
2019-12-06 14:38:43 +08:00
ashione
a1744f67fe
Add hostname to nodeinfo( #6156 )
2019-11-19 15:03:46 +08:00
Kai Yang
c580955840
[Java] Fix some potential bugs about Ray.shutdown() ( #5693 )
2019-09-24 10:44:17 +08:00
Kai Yang
1b880191b0
Replace NotImplementedException with UnsupportedOperationException ( #5694 )
2019-09-12 00:40:26 -07:00
Kai Yang
ed761900f6
[Java] Support direct actor call in Java worker ( #5504 )
2019-09-09 14:29:20 +08:00
Kai Yang
d8f5804690
Support metadata for passing by value task arguments ( #5527 )
2019-09-08 11:07:48 +08:00
Kai Yang
732336fc4f
[Java] Support multiple workers in Java worker process ( #5505 )
2019-09-07 22:52:05 +08:00
Hao Chen
fab5ae64c4
[Java] Automatically clean up temp files. ( #5507 )
...
* Remove unused code
* Auto clean up temp files
* refine
* fix
* print warning
* fix
2019-08-24 17:20:27 +08:00
Kai Yang
53fd66f6d6
[Java] Destroy native core worker before killing ray processes ( #5516 )
2019-08-24 11:10:02 +08:00
Hao Chen
239c177fe8
[Java] Support calling functions returning void ( #5494 )
2019-08-23 21:10:15 +08:00
Kai Yang
b1aae0e398
[Java worker] Migrate task execution and submission on top of core worker ( #5370 )
2019-08-16 13:52:13 +08:00
