hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
10330 commits 227 branches 67 tags 234 MiB
Commit graph

252 commits

Author SHA1 Message Date
Qing Wang
7500f7d88a
Remove deprecated Java PG APIs. (#20219) 
These APIs were deprecated at least 7+ months and 4+ versions, it's the time and very necessary to remove them.
 2021-11-12 09:29:48 +08:00
Qing Wang
6d8a7291ab
Add getNamespace API for Java worker (#20057) 
[Java API] Add getNamespace API for Java worker.
 2021-11-08 15:51:14 +08:00
Qing Wang
4373aa1e3b
Support generating a UUID string as the anonymous namespace for Java worker. (#19986) 
Why are these changes needed?
For Java worker, we generate a UUID string as the namespace if a job is not specified a namespace by user.

Related issue number
#16474
 2021-11-04 11:40:17 +08:00
Jiajun Yao
5de4a38948
[CI] Run Java CI on Mac (#19757) 
Why are these changes needed?
Enable Java tests on Mac CI to avoid more breakages.

Related issue number
Closes #19700
 2021-11-03 23:40:05 +08:00
Qing Wang
da6894848d
Support Java namespace APIs (#19468) 
## Why are these changes needed?

## Related issue number
#16474
 2021-11-02 11:05:40 +08:00
Qing Wang
7647ea3512
[Java] Add helper method to build driver process. (#19740) 
We make the buildDriver() process as a helpful util to avoid duplicate code.
 2021-10-27 10:17:37 +08:00
Jiajun Yao
805ce453dd
[Java] Remove auto-generated pom.xml files. (#19475) 2021-10-19 17:35:37 +08:00
Gagandeep Singh
d226cbf21a
Added StartupToken to idenitfy a process at startup (#19014) 
* Added StartupToken to idenitfy a process at startup

* Applied linting formats

* Addressed reviews

* Fixing worker_pool_test

* Fixed worker_pool_test

* Applied linting formatting

* Added documentation for StartupToken

* Fixed linting

* Reordered initialisation of WorkerPool members

* Fixed Python docs

* Fixing bugs in cluster_mode_test

* Fixing Java tests

* Create and set shim process after verifying startup_token

* shim_process.GetId() -> worker_shim_pid

* Improvements in startup token and modifying java files

* update io_ray_runtime_RayNativeRuntime.h

* Fixed java tests by adding startup-token to conf

* Applied linting

* Increased arg count for startup_token

* Attempt to fix streaming tests

* Type correction

* applied linting

* Corrected index of startup token arg

* Modified, mock_worker.cc to accept startup tokens

* Applied linting

* Applied linting changes from CI

* Removed override from worker.h

* Applied linting from scripts/format.sh

* Addressed reviews and applied scripts/format.sh

* Applied linting script from ci/travis

* Removed unrequired methods from public scope

* Applied linting
 2021-10-15 15:13:13 -07:00
hazeone
c2f0035fd2
[Java]Support getGpuIds API (#19031) 
Add java getGpuIds() API which is the same as get_gpu_ids in python. We can get deviceId if we've allocated a GPU to a worker.
 2021-10-13 23:40:26 +08:00
Qing Wang
90d2456ec7
[Java] Support userloggers. (#18846) 
Co-authored-by: Kai Yang <kfstorm@outlook.com>
 2021-09-26 16:53:06 +08:00
Qing Wang
371f03fa48
Remove dynamic resource from client side. (#18514) 2021-09-11 10:39:59 -07:00
Qing Wang
d87441cda7
[Java] ConcurrencyGroup in Java local mode. (#18241) 
* WIP

* Fix

* Fix test

* Refine

* Fix lint,

* WIP2

* WIP2

* Refine

* Put a default concurrency group.

* Fix submitting task with concurrency group name.

* Remove unnecessary changes.

* Update java/runtime/src/main/java/io/ray/runtime/task/LocalModeTaskSubmitter.java

Co-authored-by: Kai Yang <kfstorm@outlook.com>

Co-authored-by: Kai Yang <kfstorm@outlook.com>
 2021-09-07 20:43:31 +08:00
Stephanie Wang
8e06db7280
Revert "[Core] revert: revert Unified worker starter (#18008)" (#18228) 
This reverts commit b9978dd02b.
 2021-08-30 17:28:41 -07:00
Zhi Lin
d3786ac131
Bump Java version to 2.0.0-SNAPSHOT (#15394) 
* bump java version to 2.0.0-SNAPSHOT

* update
 2021-08-30 12:25:30 +08:00
Tao Wang
0b5f5890f7
[Named Actor] Throw RayException when getting named actor timed out (#17998) 
* [Named Actor]throw RayException when getting named actor timed out

* lint

* correct the message

* lint

* nice catch
 2021-08-25 13:50:53 +08:00
chenk008
b9978dd02b
[Core] revert: revert Unified worker starter (#18008) 2021-08-23 13:34:32 -07:00
Eric Liang
a9073d16f4
Revert "[Core] Unified worker initiators (#17401)" (#17935) 
This reverts commit c3764ffd7d.
 2021-08-18 18:06:24 -07:00
chenk008
c3764ffd7d
[Core] Unified worker initiators (#17401) 
* use setup_worker as starter

* use setup_worker as starter

* add java test

* fix

* fix

* lint

* sleep in ci

* sleep in ci

* fix ut

* fix

* fix

* fix

* fix

* fix

* fix

* change test size

* test

* fix

* fix

* fix ut

* restore sgd test

* change test size

* fix merge confict

* restore cpp worker flag

* fix

* fix

* add worker-languange in setup_runtime_env.py

* lint

* fix java command

Co-authored-by: root <chenk008>
 2021-08-17 19:37:26 +08:00
Lingxuan Zuo
f2a3085ce2
[Metric]Java metric api enhancement (#17811) 
* Java metric api enhancement:
make tagkey transparent for upper level users

* add java metric tags test

* mark Deprecated
 2021-08-16 22:38:27 +08:00
Qing Wang
9d5c68ff55
[Java] Better log message when failed to invoke task. (#17737) 2021-08-13 17:31:58 +08:00
Kai Yang
ab53c5fc93
[Java] Update rolling logging configuration (#17741) 2021-08-12 10:15:27 +08:00
Qing Wang
6d6a1ea43e
Support reading system configs from native in Java. (#17703) 
* Support reading system configs from native in Java.

* Fix lint

* Lint cpp

* Fix Java cases.

* Address comments.

* Address comments.
 2021-08-12 10:06:01 +08:00
Qing Wang
4cc34588db
[Core] Support ConcurrentGroup part1 (#16795) 
* Core change and Java change.

* Fix void call.

* Address comments and fix cases.

* Fix asyncio
 2021-08-07 22:41:33 +08:00
Kai Yang
9b3c0ad35b
Fix “argument type mismatch” when an exception occurs in chained tasks (#17636) 2021-08-07 17:47:43 +08:00
Zhi Lin
82123123c4
[object store] Java API for Assign the object owner in Ray.put() (#17237) 
Co-authored-by: Qing Wang <kingchin1218@126.com>
Co-authored-by: Kai Yang <kfstorm@outlook.com>
 2021-08-06 15:26:59 +08:00
Qing Wang
4bde71ca86
[Java][Core] Support get current actor handle. (#14900) 2021-07-12 15:27:54 -07:00
Qing Wang
89b07572da
[Java] Upgrade log4j (#16657) 2021-06-24 21:01:27 -07:00
Qing Wang
3272997b0d
[Java] Upgrade some deps to fix CVEs (#16650) 2021-06-24 10:56:20 -07:00
Qing Wang
d6d27e9d34
[Java] Enable concurrent calls in local mode. (#14896) 
* Enable concurrent calls in local mode.

* Fix submitting actor tasks before actor creation task executed.

Co-authored-by: Qing Wang <jovany.wq@antgroup.com>
 2021-06-10 23:21:11 +08:00
mwtian
dce13d3a81
Explicitly set protobuf dependency version to allow building ray with bazel 4.0.0 (#15756) 
Java protobuf dependency version is made to be consistent as well.
 2021-05-13 10:34:09 -07:00
Kai Yang
b0ea947fa3
[Java] Support getCurrentActorId in local mode (#14890) 2021-03-31 21:39:39 +08:00
Kai Yang
6278df8604
[Java] refine generation of jvm options (#14931) 2021-03-31 21:04:52 +08:00
DK.Pino
374d166f6d
[JAVA] [Doc] Improve java doc for PG (#14671) 2021-03-29 11:21:20 +08:00
DK.Pino
ef59c145e2
[Java][Placement Group] Move related API of Placement Group from Ray to PlacementGroups. (#14729) 2021-03-23 12:34:12 +08:00
Lixin Wei
72d87093b9
[Core] Make Actor DEAD and Save Exceptions in GCS When Error Happens in Constructor (#14211) 2021-03-17 12:50:28 -07:00
Kai Yang
f60bd3afee
[Java] some small improvements (#14565) 2021-03-12 12:26:55 +08:00
DK.Pino
26907b7708
Support placement group for normal task in Java API (#14342) 
* support pg for normal task

* fix lint

* fix comment

* fix comment

* update comment

* fix java typo
 2021-03-05 10:21:37 +08:00
Kai Yang
d653394c7f
[Java] Some bug fixes about Java UT workflow (#14444) 2021-03-03 19:32:14 +08:00
Kai Yang
c53c909130
[Java] Quit worker process after RunTaskExecutionLoop to avoid orphan Java worker processses (#14442) 2021-03-03 16:47:17 +08:00
fangfengbin
1054613da1
[Core]Fix ray.kill doesn't cancel pending actor bug (#14154) 
Co-authored-by: 灵洵 <fengbin.ffb@antgroup.com>
 2021-03-03 16:12:32 +08:00
DK.Pino
7647d60fa9
[Placement Group] Support named placement group java api & Refactor construct method (#13821) 2021-02-22 20:12:09 +08:00
Kai Yang
d8c32be449
[Core] Simplify system config passing from Raylet to workers (#13860) 2021-02-20 20:20:13 +08:00
Kai Yang
9eb45fd1c4
[Java] Simplify Java unit test configuration (#12823) 2021-02-19 21:42:31 +08:00
chaokunyang
f8a36eb350
[Java] Add java api overload doc and test (#14204) 2021-02-19 19:46:35 +08:00
Kai Yang
66f6c3944d
[Java] Re-enable remaining skipped Java test cases (#13979) 
Co-authored-by: loushang.ls <loushang.ls@antfin.com>
 2021-02-19 10:57:28 +08:00
architkulkarni
d9124e9329
Revert "[Core]Fix ray.kill doesn't cancel pending actor bug (#14025)" (#14146) 
This reverts commit 1754359281.
 2021-02-16 17:22:25 -08:00
fangfengbin
1754359281
[Core]Fix ray.kill doesn't cancel pending actor bug (#14025) 2021-02-10 15:30:21 +08:00
Kai Yang
e0b81796c5
Revert "Revert "[Java] fix test hang occasionally when running FailureTest (#13934)" (#13992)" (#14008) 2021-02-09 12:43:26 -08:00
Simon Mo
f51c26bae6
Revert "[Core]Fix ray.kill doesn't cancel pending actor bug (#13254)" (#14013) 
This reverts commit 2092b097ea.
 2021-02-09 11:36:38 -08:00
fangfengbin
2092b097ea
[Core]Fix ray.kill doesn't cancel pending actor bug (#13254) 2021-02-09 10:59:14 +08:00