hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 18:41:40 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
8433 commits 227 branches 67 tags 234 MiB
Commit graph

8433 commits

This branch
This branch
All branches
Author SHA1 Message Date
Simon Mo
6763e95079
Revert "Revert "[Buildkite] cleanup artifacts directory between builds"" (#16385) 2021-06-14 11:30:55 -07:00
SangBin Cho
b4e2ca39f9
[Pubsub] Using OBOD command batch for both reference counting and wait for object eviction (#16334) 
* In progress/

* Basic implementation for wait for object eviction done

* Port ref count

* Fixing tests.

* Fix unit testse and remove unnecessary code

* In progress with ref count test

* Command batch done.

* done.

* Add a implementation note

* Fix all issues.

* Addressed the first batch of code review.

* one last thing; fix unit test

* Fix all issues.

* Fix a type issue.

* Fix the type issue
 2021-06-14 10:10:35 -07:00
Eric Liang
f93ca2b673
Make it much simpler to turn on event stats (#16401) 2021-06-14 09:51:24 -07:00
Amog Kamsetty
f9936c4252
[Dask] Dask Example Tests (#16346) 
* add examples

* update dask docs

* add build file

* formatting

* fix ci command

* fix

* Update python/ray/util/dask/BUILD

* newline

* fix pytest fixtures

* fixes

* formatting

* fix shuffle example
 2021-06-12 20:25:45 -07:00
Eric Liang
acb439e8f2
Prioritize get requests over wait request, and disallow overcommit of wait requests in unlimited allocation mode (#16351) 2021-06-12 14:06:43 -07:00
Qingyun Wu
dae3ac1def
[Tune] Add new searchers from FLAML (#16329) 2021-06-12 02:10:51 -07:00
Xianyang Liu
59f639f9db
[core] Fixes connect from worker node failed (#16045) 
* fixes connect from worker node

* add UT

* fixes

* address comments
 2021-06-11 18:51:46 -07:00
SangBin Cho
eb7344069b
[Test] Improving tests (#16368) 
* Improve testing

* Fix tsets.
 2021-06-11 18:29:22 -07:00
Chen Shen
24e409f948
[spilled object push optimization 3/3] ObjectManager Push from Spilled Object (#16364) 2021-06-11 15:57:51 -07:00
Philipp Moritz
ab092d901f
Increase redis connection timeout (#16384) 2021-06-11 15:57:35 -07:00
architkulkarni
be1129e04f
[Serve] Add tests for Serve quickstart with ray client (#16344) 2021-06-11 15:43:47 -07:00
Chris K. W
3fa9f2e5d6
[Modin] Add tests for modin (#16260) 
Adds modin tests that run with and without ray client.
 2021-06-11 12:23:33 -07:00
Simon Mo
2cdaf132b5
Revert "[Buildkite] cleanup artifacts directory between builds (#16307)" (#16372) 2021-06-11 08:33:26 -07:00
Kai Fricke
e8f8e9f328
[tune] Adjust searcher sample bounds to match Tune API (#15899) 2021-06-11 14:31:08 +01:00
matthewdeng
9c36ff81fa
[release] add golden notebook tests for dask/xgboost and modin/xgboost (#16231) 
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
 2021-06-11 10:03:04 +01:00
Qing Wang
9a58e6a2e0
Remove unintended introduced words in comment. (#16367) 2021-06-11 13:35:42 +08:00
SongGuyang
379c87dbbb
[C++ worker] bugfix of incorrect flag name "redis_password" and add test to support connecting to external cluster (#16219) 2021-06-11 11:49:13 +08:00
Eric Liang
47bbca04be
Add fallback allocator stats to "ray memory" (#16362) 2021-06-10 18:33:59 -07:00
Simon Mo
8d56a36d28
[Buildkite] cleanup artifacts directory between builds (#16307) 2021-06-10 17:59:52 -07:00
Chen Shen
dd677f367e
[spilled object push optimization 2/3] Refactor ObjectManager's Push for integrating with SpilledObject (#16352) 2021-06-10 16:29:19 -07:00
Eric Liang
af11ec079a
update serve verbiage (#16360) 2021-06-10 16:23:38 -07:00
Eric Liang
b0b160b701
Make fallback directory for plasma configurable based on tempdir (#16361) 2021-06-10 14:55:10 -07:00
Alex Wu
83a458dbf2
[core] Resource broadcast cleanup (#16261) 
* .

* use new protobuf

* .

* .

* add todo

* .

* comments

* lint

Co-authored-by: Alex Wu <alex@anyscale.com>
 2021-06-10 10:27:28 -07:00
mwtian
2e8d8fba02
[Build] Another attempt at building Python 3.9 MacOS wheels (#16347) 
* Test rollforward python 3.9

* Upgrade setproctitle in thirdparty

* Update cython requirement to match those in wheel build scripts.

* Fix MANIFEST.in

* Fix file copying in setup.py
 2021-06-10 10:20:30 -07:00
SangBin Cho
a3f82112d8
Fix test_reference_count_2 (#16353) 2021-06-10 10:12:39 -07:00
Chen Shen
54f9aef35b
[spilled object push optimization 1/3] create a SpilledObject that reads data in chunks. 2021-06-10 10:08:51 -07:00
architkulkarni
378b0e8ca7
[runtime_env] [doc] Add experimental warning (#16358) 2021-06-10 12:00:46 -05:00
SongGuyang
09eebf0cc7
[C++ worker] use gflags to parse arguments in default worker (#16350) 
* remove id.h dependence for c++ worker headers

* delete unuseful test

* fix lint

* [C++ worker] support config from RayConfig and command line(gflag)

* check password

* fix

* fix some comments

* optimization

* add files

* default to run cluster mode

* fix

* add node-ip-address params to C++ worker

* fix lint

* use gflags in c++ default_worker
 2021-06-11 00:46:12 +08:00
Eric Liang
ae0e38b86d
Remove legacy feature flags / features (#16349) 2021-06-10 09:31:38 -07:00
Chris Bamford
fd1a97e39f
[RLlib] Memory leak docs (#15908) 2021-06-10 18:10:21 +02:00
Qing Wang
d6d27e9d34
[Java] Enable concurrent calls in local mode. (#14896) 
* Enable concurrent calls in local mode.

* Fix submitting actor tasks before actor creation task executed.

Co-authored-by: Qing Wang <jovany.wq@antgroup.com>
 2021-06-10 23:21:11 +08:00
Tao Wang
9741bc00c9
[Core]Limit job error message size (#16336) 2021-06-10 19:28:00 +08:00
Sven Mika
3d4dc60e2e
[RLlib] CQL iteration count fixes: Remove dummy buffer and unnecessary store op from exec_plan. (#16332) 2021-06-10 07:49:17 +02:00
SangBin Cho
c8a5d7ba85
[TEST] Additional data processing nightly test (#16078) 
* in progress

* in progress

* almost done

* Lint

* almost done

* All tests are available now

* Change the test a little more stressful

* Modify paramter to make tests a little more stressful
 2021-06-09 22:38:53 -07:00
Eric Liang
d390344a8f
Enable plasma fallback allocations by default (#16244) 2021-06-09 22:05:52 -07:00
SongGuyang
67761a4fc5
[C++ worker] add node-ip-address params to C++ worker (#16253) 2021-06-10 11:10:56 +08:00
architkulkarni
7d029f8e71
[Doc] [Core] [runtime env] Add runtime env doc (#16290) 2021-06-09 20:02:16 -05:00
Siyuan (Ryans) Zhuang
8aee4e5634
[Workflow] Workflow API extension (#16276) 2021-06-09 14:55:01 -07:00
Chen Shen
5fe03667b9
[RFC] add ray.util.get_locations() to look up objects' location. (#16130) 
* Implement GetLocationFromOwner at CoreWorker that looks up the locations
for a list of object ids

* plumbing GetLocationAPI to CoWorker

* introduce primary_node_id in refcounter

* add python tests

* address comments

* fix linit

* remove C++ tests

* more tests

* add more tests

* linter

* lint

* lint

* address comments

* fix merge issue

* nits
 2021-06-09 11:30:42 -07:00
Eric Liang
6c7147dc97
Fix active RPC tracking in event tracker 2021-06-09 10:53:30 -07:00
matthewdeng
138b273136
[rllib] Add tests for examples using ray client (#16271) 
* [rllib] add tests for examples using ray client

* rename test_client to test_ray_client
 2021-06-09 10:39:14 -07:00
SongGuyang
874e947d6f
[runtime env] support create or delete runtime envs in agent (#15904) 2021-06-09 20:22:25 +08:00
SangBin Cho
1795e73cf2
Revert "Batch the AddSpilledURLs RPC (#16303)" (#16331) 
This reverts commit deda35fb4a.
 2021-06-09 00:33:57 -07:00
SangBin Cho
d9227d8506
[Pubsub] Pubsub module command batch part 1 (#16167) 
* Basic command batch implemented.

* working.

* fix bugs.

* Improve a protobuf message.

* Update description of protobuf.

* Addressed code review.
 2021-06-09 00:27:06 -07:00
Ian Rodney
c2f5ca399f
[Cleanup] Use Constant instead of "RAY_ADDRESS" in code (#16257) 2021-06-08 22:53:56 -07:00
Tao Wang
1c94906efc
[Test][Tiny]Check argv in right way (#16325) 2021-06-09 13:18:27 +08:00
Kai Yang
81be461ba2
[Core] Limit starting workers with maximum_startup_concurrency per worker type (#16214) 2021-06-09 13:11:53 +08:00
Simon Mo
4c0069edc2
[CI] Fix determine_tests_to_run logic (#16320) 
We recently had two master breakages due to determine_tests_to_run
script bug.
https://github.com/ray-project/ray/pull/16120
https://github.com/ray-project/ray/pull/15981

This PR fix both of them.
 2021-06-08 19:59:03 -07:00
Kathryn Zhou
2394ab2d2e
Update versioning for tracing in Ray docs (#16041) 
Co-authored-by: Kathryn Zhou <kathrynzhou@kathryns-mbp.lan>
 2021-06-08 19:23:19 -07:00
Dmitri Gekhtman
41b2e569fb
[autoscaler] Don't rsync cluster state with local node provider (#16281) 2021-06-08 12:27:06 -07:00