Commit graph

5381 commits

Author SHA1 Message Date
SangBin Cho
326a470bc2
[Test] Reduce the wait for condition timeout. (#9971) 2020-08-07 11:44:53 -07:00
Tao Wang
8bea875673
[TEST]Check if port is free before start up redis (#9974)
* [TEST]Check if port is free before start up redis

* per comment
2020-08-07 10:15:12 -07:00
SangBin Cho
22934619df
[Release] Fix release tests (#9976)
* In Progress.

* Fix torch version.

* Fix asan run.sh

* Addressed code review.
2020-08-07 10:06:13 -07:00
Sven Mika
5d5643e633
[RLlib] Add informative error message when bad Conv2D stack is used with fixed num_outputs (no flattening at end). (#9966) 2020-08-07 12:04:17 +02:00
Alex Wu
84b7240c4b
[Core] Read resources from an environment variable (#9831) 2020-08-06 18:32:01 -07:00
Eric Liang
668f555755
[rllib] Clean up outdated docs #9915 2020-08-06 18:29:04 -07:00
Richard Liaw
b91c9ba085
[k8s] fix import for commandrunner (#9968) 2020-08-06 17:30:06 -07:00
SangBin Cho
44826878ff
[Core] Remove Legacy Raylet Code (#9936)
* Remove a flag and some methods in node manager including HandleDisconnectedActor, ResubmitTask, and HandleTaskReconstruction

* Make actor creator always required + remove raylet transport

* Remove actor reporter + remove FinishAssignedActorCreationTask

* Remove actor tasks.

* Remove finishactortask and switched it to finishactorcreation task

* Remove reconstruction policy.

* Remove lineage cache.

* Formatting.

* Remove actor frontier code.

* Removed build error.

* Revert "Remove reconstruction policy."

This reverts commit 9d25c9bced4da5fbcac5d484d51013345f16513b.

* Recover HandleReconstruction to mark expired objects as failed.
2020-08-06 16:37:50 -07:00
SangBin Cho
ec2f1a225e
[Stats] Metrics Export User Interface Part 1 (#9913)
* Metrics export port expose done.

* Support exposing metrics port + metrics agent service discovery through ray.nodes()

* Formatting.

* Added a doc.

* Linting.

* Change the location of metrics agent port.

* Addressed code review.

* Addressed code review.
2020-08-06 16:16:29 -07:00
Maksim Smolin
eace94d2dc
[cli] Fix issues with logging unescaped strings (#9960) 2020-08-06 14:44:39 -07:00
Max Fitton
fc9fc342cf
Make dashboard disk stat not break on non-Unix machines (note it will not correctly report stat still) (#9962)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 15:00:26 -05:00
Max Fitton
3f7eb64063
The required resources field is not always present, leading the logical view to crash when it is not present. (#9959)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 14:59:52 -05:00
Simon Mo
c8da5555ab
[Serve] Add preliminary middleware support (#9940) 2020-08-06 12:49:31 -07:00
Barak Michener
21994c594b
python/test: Faster tests and better BUILD (#9791) 2020-08-06 10:58:42 -07:00
Max Fitton
6a1acce791
[Dashboard] Fix Bug in Machine View when Unsorted with Multiple Machines (#9938)
* Patch issue where when the Machine view was unsorted and grouped, it would crash.

* lint

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 10:38:01 -07:00
Sven Mika
57690a3a9f
[RLlib] Trajectory view API - 02 actual API scaffold (#9753) 2020-08-06 10:54:20 +02:00
Sven Mika
19d785b947
[LINT] Except RLlib from checking for flake8 error F821 (#9946) 2020-08-06 10:44:37 +02:00
SongGuyang
17ddcd8691
[cpp worker] support Ray::Get() static method (#9809) 2020-08-06 16:20:05 +08:00
Eric Liang
7d4f204aa8
[Placement Group] Allow scheduling a task on any bundle (-1, default) (#9885)
* wip

* wip

* fix tests

* wip

* wip

* wip

* wip

* wip

* add test

* update

* update

* remov debug

* comments
2020-08-06 00:05:21 -07:00
Ian Rodney
45597e3158
Fixing basic messup (#9947) 2020-08-05 22:09:21 -07:00
Richard Liaw
51bad84423
[cli] Maintain "old-style" for abort (#9943) 2020-08-05 20:37:29 -07:00
Sven Mika
9b90f7db67
[RLlib] Missing type annotations policy templates. (#9846) 2020-08-06 05:33:24 +02:00
Edward Oakes
38408574c4
[serve] Basic autoscaling policy (#9845) 2020-08-05 21:11:35 -05:00
Tao Wang
1760586628
[GCS]Use an asynchronous PING to avoid blocking other operations (#9871)
* Use separate redis client to avoid its sync command blocking other operations

* use redis_failure_detector_client_

* use async command to ping redis

* format log
2020-08-05 19:10:53 -07:00
Alex Wu
12d75784a4
[Core] test_advanced_3.py::test_logging_to_driver (round 2) (#9916) 2020-08-05 15:04:36 -05:00
Ian Rodney
b6da7dcef9
Upgrade to v30 and 18.04 on default yamls (#9917) 2020-08-05 13:01:14 -07:00
SangBin Cho
68899e2f8e
[GCS Actor Management] Fix race condition for DEPENDENCIES_UNREADY states. (#9883)
* Fix issues.

* Address code review.

* Addressed code review 2.

* Fix formatting.

* Addressed code review 3/

* Addressed code review.
2020-08-05 12:22:12 -07:00
Lingxuan Zuo
9b5b16ef11
[GCS] fix gcs table get all nodes npe (#9927) 2020-08-05 10:36:06 -07:00
Max Fitton
538ad04e96
[Dashboard] Update ActorState in dashboard to support new actor states (#9855)
* Update ActorState in dashboard to support new actor states

* Update dashboard documentation for new states

* Add missing state to doc

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-05 10:35:18 -07:00
Ian Rodney
dba999b6f6
[docker] Fix rsyncs & filesync for docker (#9920) 2020-08-05 10:13:03 -07:00
SangBin Cho
685182923c
[Core] Fix detached actor local mode when gcs actor management is on. (#9839)
* Fix local mode detached actor.

* Revert changes.
2020-08-05 09:04:24 -07:00
kisuke95
ddc1e483fb
Fix actor table Delete bug (#9499) 2020-08-05 18:05:51 +08:00
kisuke95
80d2544f6b
Fix vector<bool> for loop (#9907) 2020-08-05 17:49:37 +08:00
fangfengbin
193d11ab8b
Optimize placement group log (#9891) 2020-08-05 14:41:32 +08:00
Amog Kamsetty
5af7d24f66
[Tune] Transformer blog example (#9789)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-04 22:05:01 -07:00
Henk Tillman
ead8b86372
Create ~/.ssh if it doesn't already exist (#9880) 2020-08-04 14:55:15 -07:00
Edward Oakes
55146d222f
[serve] Detect node updates (#9828) 2020-08-04 15:57:21 -05:00
Max Fitton
ef190f358b
[Dashboard] Fix Memory Page Crash with Front-end Pagination (#9593) 2020-08-04 14:16:07 -05:00
Clark Zinzow
6fded582ff
[Dask] Dask-Ray scheduler MVP. (#9857) 2020-08-04 11:45:25 -07:00
Ameer Haj Ali
65a2886b0a
Docs For on Prem Cluster manager (#9873) 2020-08-04 11:31:09 -07:00
krfricke
ef717ecda6
[tune] Prevent leak of magic keys in trial config (#9903)
Co-authored-by: Kai Fricke <kai@anyscale.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-04 11:24:01 -07:00
Simon Mo
bdc42f8dab
[CI] Bring back suppress_output (#9888) 2020-08-04 11:21:20 -07:00
chaokunyang
3323ad9d59
[HOTFIX] Fix master build with missing placement group argument (#9868)
* fix common task submit default placement group

* fix java_function
2020-08-04 11:19:15 -07:00
Barak Michener
c16e1b9524
src/ray/protobuf: Break proto rules into a proper BUILD file (#9792) 2020-08-04 11:12:45 -07:00
Ameer Haj Ali
6c9ec10540
Support not specifying an SSH key in local node provider (#9864) 2020-08-04 10:23:43 -05:00
kisuke95
3f1e3bc354
Fix wrong java pattern of DateTimeFormatter (#9902) 2020-08-04 21:19:54 +08:00
Kai Yang
27cd323ce1
[Core] Multi-tenancy: Job isolation & implement per job config (except for env variables) (#9500) 2020-08-04 15:51:29 +08:00
kisuke95
28b1f7710c
[Core] Error info pubsub (Remove ray.errors API) (#9665) 2020-08-04 14:04:29 +08:00
fangfengbin
8c3fc1db76
Optimize actor creation log (#9781) 2020-08-04 10:29:30 +08:00
Simon Mo
b4fb390219
Fix LINT for build-docker-images.sh (#9882) 2020-08-03 18:32:58 -07:00