Commit graph

164 commits

Author SHA1 Message Date
Tao Wang
d98ec7fc4d
Remove libray_redis_module (#17283) 2021-07-25 23:15:29 -07:00
lantian-xu
daf37b7621
[Streaming] Fix illegal cast when rollbacking. (#17195)
Co-authored-by: yz54123 <57480840+yz54123@users.noreply.github.com>
2021-07-23 13:08:34 +08:00
Siyuan (Ryans) Zhuang
8efc04a8a6
[Core] Actor namespace (#17178)
* set actor namespace in Python on creation

* get actor with namespace in Python

* update message
2021-07-19 21:51:04 -07:00
Amog Kamsetty
503b748d64
Revert "Revert "[Java] upgrade jar deps to fix cves" (#16889)" (#16899)
This reverts commit f2308a0cdf.
2021-07-06 14:00:50 -07:00
Amog Kamsetty
f2308a0cdf
Revert "[Java] upgrade jar deps to fix cves" (#16889)
This reverts commit 25666fff81.
2021-07-06 10:33:31 -07:00
chaokunyang
25666fff81
[Java] upgrade jar deps to fix cves (#16870) 2021-07-06 09:04:21 -07:00
Qing Wang
3272997b0d
[Java] Upgrade some deps to fix CVEs (#16650) 2021-06-24 10:56:20 -07:00
architkulkarni
194c5e3a96
[Core] Cache workers by runtime_env in worker pool (#15782)
* pass RuntimeEnv in task spec as opaque string

* lint

* set correct empty value for json: "{}" not ""

* add comment for field in proto

* fix worker pool test by checking both "" and "{}"

* add RAY_CHECK todo

* make dict empty if all values null

* remove unnecessary ser/de

* fix

* address comments

* add WorkerCacheKey with hash function

* clean up

* add naive impl., dedicated workers never killed

* put dedicated workers in idle_of_all_languages

* pipe env hash from worker.py -> Worker

* fully pipe through hash, basic cache test passing

* use int type for runtime env hash

* convert Worker env hash type from size_t to int

* fix

* add method to MockWorker to fix cpp tests

* make compatible with java streaming test

* restore old dynamic_options code to fix java test

* address comments

* add comment about sorting before hash

* add comments for private members of WorkerCacheKey
2021-05-18 00:19:27 -07:00
Amog Kamsetty
ebc44c3d76
[CI] Upgrade flake8 to 3.9.1 (#15527)
* formatting

* format util

* format release

* format rllib/agents

* format rllib/env

* format rllib/execution

* format rllib/evaluation

* format rllib/examples

* format rllib/policy

* format rllib utils and tests

* format streaming

* more formatting

* update requirements files

* fix rllib type checking

* updates

* update

* fix circular import

* Update python/ray/tests/test_runtime_env.py

* noqa
2021-05-03 14:23:28 -07:00
Siyuan (Ryans) Zhuang
87c79553e9
[Core] Remove code paths that contains plasma store executable (#14950)
* remove plasma store executable & never used tests

* set default behavior

* fix tests
2021-03-28 21:22:14 -07:00
Siyuan (Ryans) Zhuang
b92531918e
Make use of C++14 'make_unique' (#14663) 2021-03-15 03:00:52 -07:00
Kai Yang
92f1e0902e
[Java] Fix return of java doc (#13601) 2021-01-21 23:57:20 +08:00
chaokunyang
33089c44e2
Fix streaming ci failure (#12830) 2020-12-30 10:45:52 +08:00
chaokunyang
d1dd3410c8
[Java] Format ray java code (#13056) 2020-12-29 10:36:16 +08:00
Yi Cheng
40032541dc
[core] Introduce fetch_local to ray.wait (#12526) 2020-12-16 23:44:28 -08:00
Lixin Wei
867d2a8aa3
[Streaming] Add more documents. (#12746)
* add doc

draft

draft

draft

draft

draft

fix

fix

fix

fix

fix

fix

fix

Update README.md

fix

fix

fix

* md to rst

* fix

* fix

* fix

* jpg modified

* add getting envolved

* jpg modified

* Update README.rst

* fix

* fix
2020-12-11 20:36:17 +08:00
Sumanth Ratna
932837eb4c
[streaming] Remove unused imports in streaming CI tests (#12722) 2020-12-10 16:27:06 -06:00
Kai Yang
e3b5deb741
[Multi-tenancy] Delete flag enable_multi_tenancy and remove old code path (#10573) 2020-12-10 19:01:40 +08:00
Philipp Moritz
73a1a232b9
Ray debugger stepping between tasks (#12075) 2020-12-06 21:50:18 -08:00
Kai Yang
21fcee28f9
[Java] Simplify Ray.init() by invoking ray start internally (#10762) 2020-12-04 14:33:45 +08:00
chaokunyang
bea0031491
fix linux wheel build (#9896) 2020-11-17 15:49:42 +08:00
chaokunyang
1979ea9c0a
fix disable javadoc lint (#11907) 2020-11-11 13:40:50 +08:00
Kai Yang
904f48ebd9
[Core] Multi-tenancy: Pass job ID from Raylet to worker via env variable (#11829)
* Pass job ID from Raylet to worker via env variable

* fix

* fix

* fix

* lint

* fix

* fix test_object_spilling

* address comments

* lint

* fix
2020-11-09 11:02:15 -08:00
Lingxuan Zuo
2f3ec4ef75
add streaming data writer unit tests (#11387) 2020-10-16 14:42:44 +08:00
Lingxuan Zuo
c84a9b457c
[Streaming] add barrier helper tests (#11107) 2020-10-13 09:55:55 +08:00
chaokunyang
0737e78445
[Java] upgrade common-collections version (#10613) 2020-10-10 11:16:12 +08:00
Kai Yang
0c254878db
[Java] Upgrade TestNG to 7.3.0 (#11135) 2020-09-30 14:38:52 +08:00
chaokunyang
842861b4fc
[Streaming] refine streaming tests sleep condition (#10991) 2020-09-24 17:06:55 +08:00
Alex Wu
9a07c7b963
[1.0] Remove args from ray start (#10659) 2020-09-18 16:41:23 -07:00
chaokunyang
322f12600f
bump java version to 1.1.0 (#10795) 2020-09-16 12:05:11 +08:00
Hao Chen
1a5cfe0b79
[Java] rename config ray.redis.address to ray.address (#10772) 2020-09-15 11:13:19 +08:00
chaokunyang
1aad8aa39c
[Java] Fix java doc building error (#10757) 2020-09-14 17:44:45 +08:00
Kai Yang
afa0216280
Remove the '--include-java' option (#10594) 2020-09-09 17:01:17 +08:00
chaokunyang
ccf27a9ad2
[Streaming] Fix streaming ci (#10665) 2020-09-09 16:53:43 +08:00
chaokunyang
a96af94e56
[Java] add developer section (#10670) 2020-09-09 15:45:49 +08:00
SangBin Cho
b7040f1310
Revert "[Streaming] fix streaming ci (#9675)" (#10656)
This reverts commit 3645a05644.
2020-09-08 19:07:21 -07:00
chaokunyang
3645a05644
[Streaming] fix streaming ci (#9675) 2020-09-08 22:20:58 +08:00
Lixin Wei
2b95e71dac
[Streaming] Test build fixed (#10617) 2020-09-08 14:31:54 +08:00
Lixin Wei
66e125d6e6
[Streaming] Remove useless generated protobuf directory to fix CI. (#10616) 2020-09-08 12:19:59 +08:00
kisuke95
b7003839bd
[Core] Use core worker options to initialize (#10467)
* fix

* fix

* .
2020-09-07 16:36:43 -07:00
Lixin Wei
f31ee84bfd
[Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
chaokunyang
7ee0fdba3d
[Java] Throw exception if Ray.init() is not called and users try to access ray API (#10497) 2020-09-05 10:09:19 +08:00
SangBin Cho
cb919c5e5c
Revert "[Streaming] Fault Tolerance Implementation (#10008)" (#10582)
This reverts commit 1b1466748f.
2020-09-04 13:21:18 -07:00
Lixin Wei
1b1466748f
[Streaming] Fault Tolerance Implementation (#10008) 2020-09-04 20:44:34 +08:00
Clark Zinzow
0c0b0d0a73
[Core] Added support for submission-time task names. (#10449)
* Added support for submission-time task names.

* Suggestions from code review: add missing consts

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Add num_returns arg to actor method options docstring example.

* Add process name line and proctitle assertion to submission-time task name section of advanced docs.

* Add submission-time task name --> proctitle test for Python worker.

* Added Python actor options tests for num_returns and name.

* Added Java test for submission-time task names.

* Add dashboard image to task name docs section.

* Move to fstrings.

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
2020-09-03 11:45:24 -07:00
Lixin Wei
d8ac4bc719
[Streaming] Remove is_direct_call param (#10525) 2020-09-03 17:13:18 +08:00
Lixin Wei
2597b56f48
[Streaming] Change ID caption (#10523) 2020-09-03 14:15:33 +08:00
Lixin Wei
2f03bb5100
Fix streaming py test for 1.0 APIs (#10520) 2020-09-03 14:15:09 +08:00
chaokunyang
f10a5a40b0
[Java] Simplify ray cmd params (#10394) 2020-09-02 19:47:52 +08:00
Lixin Wei
6bde6b493e
[Streaming]Format java code using IDEA (#10440) 2020-08-31 19:45:00 +08:00