fyrestone
7697ea2be2
Java call Python actor method use actor.call ( #7614 )
2020-03-17 14:52:43 +08:00
Kai Yang
d6e8f47065
Add a flag to disable reconstruction for a killed actor ( #7346 )
2020-03-13 19:10:21 +08:00
Qing Wang
f4656d8cc3
[Java] Enable direct call by default. ( #7408 )
...
* WIP
* Address comments.
* Linting
* Fix
* Fix
* Fix test
* Fix
* Fix single process ci
* Fix ut
* Update java/test/src/main/java/org/ray/api/test/PlasmaFreeTest.java
* Address comments
* Fix linting
* Minor update comments.
* Fix streaming CI
2020-03-13 12:25:30 +08:00
Hao Chen
fe7820fec9
[Java] New Java actor API ( #7414 )
2020-03-04 22:39:23 +08:00
Kai Yang
007333b960
[Java] Support direct call for normal tasks ( #7193 )
2020-02-21 10:03:34 +08:00
Qing Wang
f3703bafa3
[Java] Support concurrent actor calls API. ( #7022 )
...
* WIP
Temp change
Attach native thread to jvm
* Fix run mode
* Address comments.
2020-02-14 13:02:39 +08:00
chaokunyang
289e5e8aff
enable maven checkstyle ( #6829 )
2020-01-20 23:41:54 -08:00
Kai Yang
ddd4c42fe5
[Java] Add killActor API in Java ( #6728 )
...
* Add killActor API in Java
* fix javadoc
* update test case
* Address comments
2020-01-14 17:12:00 +08:00
chaokunyang
36b2634479
[Java] Remove singleton exceptions ( #6765 )
2020-01-13 10:28:06 +08:00
Robert Nishihara
5e43b25e8c
Document fault tolerance behavior. ( #6698 )
2020-01-06 22:34:06 -08:00
Kai Yang
3bb680a719
[Java] Add getAsyncContext and setAsyncContext API ( #6439 )
...
* Add getAsyncContext and setAsyncContext API
* address comment
* fix bug
* Add test case
2019-12-19 18:08:58 +08:00
Kai Yang
cd250ba0bc
[Java] ID length fix ( #6454 )
2019-12-15 16:01:05 +08:00
Zhijun Fu
b88b8202cc
fix java build failure ( #6062 )
2019-12-06 14:38:43 +08:00
ashione
a1744f67fe
Add hostname to nodeinfo( #6156 )
2019-11-19 15:03:46 +08:00
Kai Yang
ed761900f6
[Java] Support direct actor call in Java worker ( #5504 )
2019-09-09 14:29:20 +08:00
Kai Yang
732336fc4f
[Java] Support multiple workers in Java worker process ( #5505 )
2019-09-07 22:52:05 +08:00
Kai Yang
fadfa5f30b
[Java] ObjectID::fromRandom sets proper flags ( #5548 )
2019-08-28 11:31:06 +08:00
Hao Chen
239c177fe8
[Java] Support calling functions returning void ( #5494 )
2019-08-23 21:10:15 +08:00
Kai Yang
b1aae0e398
[Java worker] Migrate task execution and submission on top of core worker ( #5370 )
2019-08-16 13:52:13 +08:00
Qing Wang
d372f24e3c
[ID Refactor] Refactor ActorID, TaskID and ObjectID ( #5286 )
...
* Refactor ActorID, TaskID on the Java side.
Left a TODO comment
WIP for ObjectID
ADD test
Fix
Add java part
Fix Java test
Fix
Refine test.
Enable test in CI
* Extra a helper function.
* Resolve TODOs
* Fix Python CI
* Fix Java lint
* Update .travis.yml
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Address some comments.
Address some comments.
Add id_specification.rst
Reanme id_specification.rst to id_specification.md
typo
Address zhijun's comments.
Fix test
Address comments.
Fix lint
Address comments
* Fix test
* Address comments.
* Fix build error
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Address comments
* Update src/ray/common/id.h
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Update src/ray/common/id.h
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Update src/ray/common/id.h
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Address comments.
* Address comments.
* Address comments.
* Update C++ part to make sure task id is generated determantic
* WIP
* Fix core worker
* Fix Java part
* Fix comments.
* Add Python side
* Fix python
* Address comments
* Fix linting
* Fix
* Fix C++ linting
* Add JobId() method to TaskID
* Fix linting
* Update src/ray/common/id.h
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Update java/api/src/main/java/org/ray/api/id/TaskId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Update java/api/src/main/java/org/ray/api/id/TaskId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Update java/api/src/main/java/org/ray/api/id/ActorId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Address comments
* Add DriverTaskId embeding job id
* Fix tests
* Add python dor_fake_driver_id
* Address comments and fix linting
* Fix CI
2019-08-07 11:04:51 +08:00
Qing Wang
f2293243cc
[ID Refactor] Shorten the length of JobID to 4 bytes ( #5110 )
...
* WIP
* Fix
* Add jobid test
* Fix
* Add python part
* Fix
* Fix tes
* Remove TODOs
* Fix C++ tests
* Lint
* Fix
* Fix exporting functions in multiple ray.init
* Fix java test
* Fix lint
* Fix linting
* Address comments.
* FIx
* Address and fix linting
* Refine and fix
* Fix
* address
* Address comments.
* Fix linting
* Fix
* Address
* Address comments.
* Address
* Address
* Fix
* Fix
* Fix
* Fix lint
* Fix
* Fix linting
* Address comments.
* Fix linting
* Address comments.
* Fix linting
* address comments.
* Fix
2019-07-11 14:25:16 +08:00
Qing Wang
62e4b591e3
[ID Refactor] Rename DriverID to JobID ( #5004 )
...
* WIP
WIP
WIP
Rename Driver -> Job
Fix complition
Fix
Rename in Java
In py
WIP
Fix
WIP
Fix
Fix test
Fix
Fix C++ linting
Fix
* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Update src/ray/core_worker/core_worker.cc
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>
* Address comments
* Fix
* Fix CI
* Fix cpp linting
* Fix py lint
* FIx
* Address comments and fix
* Address comments
* Address
* Fix import_threading
2019-06-28 00:44:51 +08:00
Qing Wang
e33d0eac68
Add dynamic worker options for worker command. ( #4970 )
...
* Add fields for fbs
* WIP
* Fix complition errors
* Add java part
* FIx
* Fix
* Fix
* Fix lint
* Refine API
* address comments and add test
* Fix
* Address comment.
* Address comments.
* Fix linting
* Refine
* Fix lint
* WIP: address comment.
* Fix java
* Fix py
* Refin
* Fix
* Fix
* Fix linting
* Fix lint
* Address comments
* WIP
* Fix
* Fix
* minor refine
* Fix lint
* Fix raylet test.
* Fix lint
* Update src/ray/raylet/worker_pool.h
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Update java/runtime/src/main/java/org/ray/runtime/AbstractRayRuntime.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Address comments.
* Address comments.
* Fix test.
* Update src/ray/raylet/worker_pool.h
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Address comments.
* Address comments.
* Fix
* Fix lint
* Fix lint
* Fix
* Address comments.
* Fix linting
2019-06-23 18:08:33 +08:00
Qing Wang
7bda5edc16
Fix Java CI failure ( #4995 )
2019-06-19 11:36:21 +08:00
Qing Wang
ef1af49efd
[Java] Fix bug of BaseID in multi-threading case. ( #4974 )
2019-06-13 20:52:41 +08:00
Qing Wang
e6baffba56
[Java] Add inner class Builder to build call options. ( #4956 )
...
* Add Builder class
* format
* Refactor by IDE
* Remove uncessary dependency
2019-06-10 23:52:08 +08:00
Yuhong Guo
1a39fee9c6
Refactor ID Serial 1: Separate ObjectID and TaskID from UniqueID ( #4776 )
...
* Enable BaseId.
* Change TaskID and make python test pass
* Remove unnecessary functions and fix test failure and change TaskID to
16 bytes.
* Java code change draft
* Refine
* Lint
* Update java/api/src/main/java/org/ray/api/id/TaskId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Update java/api/src/main/java/org/ray/api/id/BaseId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Update java/api/src/main/java/org/ray/api/id/BaseId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Update java/api/src/main/java/org/ray/api/id/ObjectId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Address comment
* Lint
* Fix SINGLE_PROCESS
* Fix comments
* Refine code
* Refine test
* Resolve conflict
2019-05-22 14:46:30 +08:00
Qing Wang
081708bdef
[Java] Dynamic resource API in Java ( #4824 )
2019-05-21 17:13:48 +08:00
Hao Chen
643f62dc43
[Java][Bazel] Refine auto-generated pom files ( #4780 )
2019-05-16 11:19:31 +08:00
Ruifang Chen
c578be23a5
[Bazel] Modifying WORKSPACE file, so that you can make the project used as a thirdparty project ( #4711 )
...
* Modifying WORKSPACE file, so that you can make the project used as a thirdparty
* Modifying WORKSPACE file, so that you can make the project used as a thirdparty
* add some files
* modify some repositories
* modify the name of 'ray_deps_build_all'
2019-04-28 22:02:49 -07:00
Qing Wang
4dd628a837
[Java] Do not expose GcsClient to normal users ( #4675 )
2019-04-24 10:50:35 +08:00
Hao Chen
d52b080081
[Java] Avoid unnecessary memory copy and addd a benchmark ( #4611 )
2019-04-14 00:17:04 +08:00
Romil Bhardwaj
0f42f87ebc
Updating zero capacity resource semantics ( #4555 )
2019-04-12 16:53:57 -07:00
Wang Qing
5cfbfe5df6
[Java] Implement GcsClient ( #4601 )
2019-04-12 22:44:47 +08:00
Wang Qing
fe07a5b4b1
Add delete_creating_tasks option for internal.free() ( #4588 )
...
* add delete creating task objects.
* format code style
* Fix lint
* add tests add address comments.
* Refine test
* Refine java test
* Fix CI
* Refine
* Fix lint
* Fix CI
2019-04-12 13:38:31 +08:00
Hao Chen
d03999d01e
Cross-language invocation Part 1: Java calling Python functions and actors ( #4166 )
2019-03-21 13:34:21 +08:00
Hao Chen
a6a5b344b9
[Java] Upgrade checkstyle plugin ( #4375 )
2019-03-15 11:36:09 -07:00
Wang Qing
a116b7f646
[Java] Add runtime context ( #4194 )
2019-03-05 20:25:29 +08:00
Hao Chen
a99676e39b
[Java] lint unused imports ( #4100 )
2019-02-20 12:37:04 -08:00
Hao Chen
de17443dc2
Propagate backend error to worker ( #4039 )
2019-02-16 11:39:15 +08:00
Hao Chen
f31a79f3f7
Implement actor checkpointing ( #3839 )
...
* Implement Actor checkpointing
* docs
* fix
* fix
* fix
* move restore-from-checkpoint to HandleActorStateTransition
* Revert "move restore-from-checkpoint to HandleActorStateTransition"
This reverts commit 9aa4447c1e3e321f42a1d895d72f17098b72de12.
* resubmit waiting tasks when actor frontier restored
* add doc about num_actor_checkpoints_to_keep=1
* add num_actor_checkpoints_to_keep to Cython
* add checkpoint_expired api
* check if actor class is abstract
* change checkpoint_ids to long string
* implement java
* Refactor to delay actor creation publish until checkpoint is resumed
* debug, lint
* Erase from checkpoints to restore if task fails
* fix lint
* update comments
* avoid duplicated actor notification log
* fix unintended change
* add actor_id to checkpoint_expired
* small java updates
* make checkpoint info per actor
* lint
* Remove logging
* Remove old actor checkpointing Python code, move new checkpointing code to FunctionActionManager
* Replace old actor checkpointing tests
* Fix test and lint
* address comments
* consolidate kill_actor
* Remove __ray_checkpoint__
* fix non-ascii char
* Loosen test checks
* fix java
* fix sphinx-build
2019-02-13 19:39:02 +08:00
Wang Qing
dcb744518e
Implement actor dummy object gc in java ( #3822 )
...
* Add dummy object gc in java
* Fix
* Address comments.
* Refine
* Address comments.
2019-01-23 11:56:25 -08:00
ggdupont
a237b4a6a1
[Java] Fix package jaxb not exist when JDK11 ( #3738 )
2019-01-16 14:15:00 +08:00
Wang Qing
692fdc6bc3
[Java] Allow actor handle to be serialized without forking ( #3686 )
2019-01-06 00:29:08 +08:00
Hao Chen
e7b51cbd1b
[xray] Implement Actor Reconstruction ( #3332 )
...
* Implement Actor Reconstruction
* fix
* fix actor handle __del__
* fix lint
* add comment
* Remove actorCreationDummyObjectId
* address comments
* fix
* address comments
* avoid copy
* change log to debug
* fix error name
2018-12-13 21:28:58 -08:00
Wang Qing
9d4847ad2d
[hot-fix] Fix error when calling Ray.init() twice. ( #3314 )
2018-11-13 21:21:54 -05:00
Wang Qing
b410ee0d29
[Java] Support dynamically defining resources when submitting task. ( #3070 )
...
## What do these changes do?
Before this PR, if we want to specify some resources, we must do as following codes:
```java
@RayRemote(Resources={ResourceItem("CPU", 10)})
public static void f1() {
// do sth
}
@RayRemote(Resources={ResourceItem("CPU", 10)})
class Demo {
// sth
}
```
Unfortunately, it's no way for us to create another actor or task with different resources required.
After this PR, the thing will be:
```java
ActorCreationOptions option = new ActorCreationOptions();
option.resources.put("CPU", 4.0);
RayActor<Echo> echo1 = Ray.createActor(Echo::new, option);
option.resources.put("Res-A", 4.0);
RayActor<Echo> echo2 = Ray.createActor(Echo::new, option);
//if we don't specify resource, the resources will be `{"cpu":0.0}` by default.
Ray.call(Echo::echo, echo2, 100);
```
## Related issue number
N/A
2018-10-19 06:22:32 -07:00
Wang Qing
ef1f2fde95
Fix the uniqueId toString format. ( #3035 )
2018-10-08 13:12:14 -07:00
Wang Qing
8e8e123777
[Java] Simplify Java worker configuration ( #2938 )
...
## What do these changes do?
Previously, Java worker configuration is complicated, because it requires setting environment variables as well as command-line arguments.
This PR aims to simplify Java worker's configuration.
1) Configuration management is now migrated to [lightbend config](https://github.com/lightbend/config ), thus doesn't require setting environment variables.
2) Many unused config items are removed.
3) Provide a simple `example.conf` file, so users can get started quickly.
4) All possible options and their default values are declared and documented in `ray.default.conf` file.
This PR also simplifies and refines the following code:
1) The process of `Ray.init()`.
2) `RunManager`.
3) `WorkerContext`.
### How to use this configuration?
1. Copy `example.conf` into your classpath and rename it to `ray.conf`.
2. Modify/add your configuration items. The all items are declared in `ray.default.conf`.
3. You can also set the items in java system prosperities.
Note: configuration is read in this priority:
System properties > `ray.conf` > `ray.default.conf`
## Related issue number
N/A
2018-09-26 20:14:22 +08:00
Wang Qing
0e552fbb22
[Java] Update maven version to 0.1-SNAPSHOT
...
Update the version in maven from 0.1 to 0.1-SNAPSHOT, because SNAPSHOT is the conventional version name in dev process. Non-snapshot versions are only used for release.
2018-09-26 18:08:46 +08:00
