Commit graph

5194 commits

Author SHA1 Message Date
Philipp Moritz
a5f4659d9f
Support ray task type checking (#9574) 2020-07-21 19:05:42 -07:00
Simon Mo
997d1162e3
[CI] Do not run jenkins test on GHA (#9621) 2020-07-21 17:05:52 -07:00
Simon Mo
d8fd74d528
[Serve] Document Metric Infrastructure (#9389) 2020-07-21 14:52:18 -07:00
mehrdadn
4f470c3fc1
Shellcheck comments (#9595) 2020-07-21 16:47:09 -05:00
mehrdadn
a2f31195c6
Fix Lint in setup.py (#9618)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-21 14:24:24 -07:00
mehrdadn
c5cde65bc6
Add bazel to the PATH in setup.py (#9590)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-21 13:35:29 -07:00
Arne Sachtler
4a36f72ce1
Use UTF-8 for encoding of python code for collision hashing (#9586)
Co-authored-by: Arne Sachtler <arne.sachtler@dlr.de>
Co-authored-by: simon-mo <simon.mo@hey.com>
2020-07-21 13:16:54 -07:00
Sven Mika
75592e664f
Issue 9568: rllib train framework in config gets overridden with tf. (#9572) 2020-07-21 22:02:24 +02:00
Robert Nishihara
1fa305cf8b
[doc] [minor] Make API docs easier to find. (#9604) 2020-07-21 11:40:06 -07:00
mehrdadn
980ade01c8
Rename path variable due to zsh conflict (#9610) 2020-07-21 10:17:50 -07:00
Lingxuan Zuo
9c4cf0f961
fix tag key typo (#9606) 2020-07-21 19:50:54 +08:00
Clark Zinzow
9b1772253f
Ensure unique log file names across same-node raylets. (#9561) 2020-07-20 16:03:11 -05:00
kisuke95
4e2e3bd348
[New scheduler] Fix new scheduler bug (#9467)
* fix new scheduler bug

* add testcase for soft resource allocation

* modify RemoveNode
2020-07-20 13:09:53 -07:00
mehrdadn
f3ef9060e4
Handle warnings in core (#9575) 2020-07-20 12:55:07 -07:00
Ian Rodney
b8fc259796
[serve] Rename to Controller (#9566) 2020-07-20 12:50:29 -07:00
mehrdadn
3d0a3c47a8
Fix Windows CI (#9588)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-20 12:47:27 -07:00
mehrdadn
02cbd4fb7e
Skip uneeded steps on CI (#9582)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-20 12:41:57 -07:00
William Falcon
150880e5e9
Add PTL to README.rst (#9594)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-07-20 11:30:01 -07:00
Ian Rodney
bad7e4c821
[docker] run Ubuntu 20.04 as base image (#9556) 2020-07-20 11:16:57 -07:00
mehrdadn
dcec26ac7b
Fix log losses (#9559)
* Close log on shutdown

* Disable log buffering

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-20 11:03:58 -07:00
Max Fitton
fca1fb18f3
Dashboard next-version API support in backend (#9345) 2020-07-20 12:54:11 -05:00
Max Fitton
051973ad23
Add dashboard dependencies to default ray installation (#9447) 2020-07-20 12:53:08 -05:00
Simon Mo
d0398bf7e1
[Serve] Serialize Query object directly (#9490) 2020-07-20 10:10:07 -07:00
mehrdadn
bc842a7888
Fix setup.py bug (#9581)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-20 15:04:35 +02:00
fangfengbin
8605b594f1
Fix Java named actor bug (#9580) 2020-07-20 19:51:00 +08:00
Siyuan (Ryans) Zhuang
4accc16995
[Core] Replace the Plasma eventloop with boost::asio (#9431) 2020-07-20 02:52:51 -07:00
Raphael Avalos
440c9c42be
[RLlib] Fix combination of lockstep and multiple agnts controlled by the same policy. (#9521)
* Change aggregation when lockstep is activated.

Modification of MultiAgentBatch.timeslices to support the combination of lockstep and multiple agents controlled by the same policy.

fix ray-project/ray#9295

* Line too long.
2020-07-19 23:03:12 -07:00
fangfengbin
0cee75c86a
GCS client add fetch operation before subscribe (#9564) 2020-07-20 10:16:42 +08:00
mehrdadn
2554a1a997
Bazel fixes (#9519) 2020-07-19 12:53:08 -07:00
Lingxuan Zuo
ce3f542739
[Metric] new cython interface for python worker metric (#9469) 2020-07-19 10:43:21 +08:00
Siyuan (Ryans) Zhuang
7edd1e6694
[Core] Remove socket pair exchange in Plasma Store (#9565)
* try use boost::asio for notification processing
2020-07-18 15:47:52 -07:00
krfricke
ad0219b80d
[tune] fix pbt checkpoint_freq (#9517)
* Only delete old checkpoint if it is not the same as the new one

* Return early if old checkpoint value coincides with new checkpoint value

Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-07-18 00:58:16 -07:00
fangfengbin
b12b8e1324
[GCS]Fix lease worker leak bug when gcs server restarts (#9315)
* add part code

* fix compile bug

* fix review comments

* fix review comments

* fix review comments

* fix review comments

* fix review comment

* fix ut bug

* fix lint error

* fix review comment

* fix review comments

* add testcase

* add testcase

* fix bug

* fix review comments

* fix review comment

* fix review comment

* refine comments

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-07-18 15:49:41 +08:00
jerrylee.io
4c18463fb7
[cli] ray memory: added redis_password (#9492) 2020-07-18 00:08:41 -07:00
Richard Liaw
7e3ded7439
[tune] pin tune-sklearn (#9498) 2020-07-17 21:25:12 -07:00
Richard Liaw
ed476be4ad
quickfix (#9552) 2020-07-17 20:54:03 -07:00
Tom
cf719dd470
[Tune] Copy default_columns in new ProgressReporter instances (#9537) 2020-07-17 15:44:38 -07:00
Siyuan (Ryans) Zhuang
cba9545266
Add plasma store benchmark for small objects (#9549) 2020-07-17 14:20:59 -07:00
krfricke
87630cf024
[tune] Unflattened lookup for ProgressReporter (#9525)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-07-17 13:52:54 -07:00
fangfengbin
5881417ec4
Fix bug that test_multi_node.py::test_multi_driver_logging hangs when GCS actor management is turned on (#9539)
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-07-17 11:53:29 -07:00
mehrdadn
ffb88cda6f
Fix Bazel in Docker (#9530)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-17 11:39:38 -07:00
Sven Mika
887cf5eca7
MADDPG learning confirmation test. (#9538) 2020-07-17 20:18:02 +02:00
Simon Mo
e78945db96
[Serve] Add internal instruction for running benchmarks (#9531) 2020-07-17 11:17:37 -07:00
Alex Wu
a78c5d5ef2
[New scheduler] Queueing refactor (#9491)
* .

* test_args passes

* .

* test_basic.py::test_many_fractional_resources causes ray to hang

* test_basic.py::test_many_fractional_resources causes ray to hang

* .

* .

* useful

* test_many_fractional_resources fails instead of hanging now :)

* Passes test_fractional_resources

* .

* .

* Some cleanup

* git is hard

* cleanup

* .

* .

* .

* .

* .

* .

* .

* cleanup

* address reviews

* address reviews

* more refactor

* :)

* travis pls

* .

* travis pls

* .
2020-07-17 11:08:03 -07:00
Gabriele Oliaro
026c009086
Pipelining task submission to workers (#9363)
* first step of pipelining

* pipelining tests & default configs
- added pipelining unit tests in direct_task_transport_test.cc
- added an entry in ray_config_def.h, ray_config.pxi, and ray_config.pxd to configure the parameter controlling the maximum number of tasks that can be in fligh to each worker
- consolidated worker_to_lease_client_ and worker_to_lease_client_ hash maps in direct_task_transport.h into a single one called worker_to_lease_entry_

* post-review revisions

* linting, following naming/style convention

* linting
2020-07-17 10:45:13 -07:00
Stephanie Wang
b351d13940
[core] Add flag to enable object reconstruction during ray start (#9488)
* Add flag

* doc

* Fix tests
2020-07-17 10:13:14 -07:00
Alisa
f080aa6ce3
Add placement group manager and some code in core_worker (#9120)
Co-authored-by: Lingxuan Zuo <skyzlxuan@gmail.com>
2020-07-17 20:49:51 +08:00
Sven Mika
78dfed2683
[RLlib] Issue 8384: QMIX doesn't learn anything. (#9527) 2020-07-17 12:14:34 +02:00
mehrdadn
37942ea1e7
Windows cleanup (#9508)
* Remove unneeded code for Windows

* Get rid of usleep()

* Make platform_shims includes non-transitive

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-17 02:08:15 -07:00
Simon Mo
22a5c3d3ee
Hotfix Lint for Serve (#9535) 2020-07-17 00:40:33 -07:00