Commit graph

3112 commits

Author SHA1 Message Date
Kai Fricke
f7120d2a18
[tune] Make metrics parameter optional in pytorch lightning integration (#11402) 2020-10-14 17:50:34 -07:00
SangBin Cho
666fcde8ca
[Placement group] Input validation (#11152)
* Add a basic input validation.

* Addressed code review.
2020-10-14 13:56:41 -07:00
Ameer Haj Ali
a10e36ca04
Make the logging of gc.collect() freed refs appear in DEBUG not INFO (#11353) 2020-10-14 13:14:35 -07:00
Alex Wu
7466ce82df
[Autoscaler] Placement group autoscaling (#11243) 2020-10-14 13:11:46 -07:00
Kai Yang
abc6126814
[Java] Release actor instance reference when Ray.exitActor() is invoked (#11324) 2020-10-14 13:12:59 +08:00
Simon Mo
866193b01c
Fix cluster yaml for serve benchmarks (#11383)
- Separate out single node and multiple node yamls
- Remove cluster_synced_files, somehow it breaks for me
2020-10-13 19:30:18 -07:00
Max Fitton
cd9dcfca0d
[Dashboard] CPU/GPU usage details in actor pane (#11269) 2020-10-13 20:23:23 -05:00
Amog Kamsetty
933cf6675c
[Tune] Changes for Pytorch Lightning 1.0 (#11375) 2020-10-13 15:50:11 -07:00
J Seppänen
63fa0a53a3
[k8s] Fix kubernetes cloud cluster example configuration (#11364) 2020-10-13 12:28:55 -07:00
SangBin Cho
56f69543d0
Try to deflake test_failure (#11293) 2020-10-12 12:03:36 -05:00
Ameer Haj Ali
06fe690682
[autoscaler] Limit max launch concurrency per node type (#11242) 2020-10-12 09:45:52 -07:00
Alex Wu
175fc41fbc
[Autoscaler] Account for resource backlog size (#11261) 2020-10-12 09:43:48 -07:00
Simon Mo
0d09a17c64
Skip set_result if the future is done (#11256) 2020-10-11 22:33:58 -07:00
Richard Liaw
56f858ed1a
[tune][docs/util] gputil check, docs (#11260)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-10-10 00:54:31 -07:00
Gekho457
48db6f8858
[autoscaler/k8s] namespace permissions problem (#11270) 2020-10-09 19:22:20 -05:00
Gekho457
92b4059cad
Replace read_namespaced_pod_status with read_namespaced_pod (#11278) 2020-10-09 19:21:39 -05:00
Ian Rodney
5ef1784024
[Autoscaler] Fix sdk (#11314)
* Use

* [Hotfix] Make Optional[str] default to None

* Fix TempFile

* context manager (with statement)

* use throughout

* drop try/finally
2020-10-09 12:34:29 -07:00
Kai Fricke
b450cb030a
[tune] reuse actors for function API (#11230)
Co-authored-by: Kristian Hartikainen <kristian.hartikainen@gmail.com>
2020-10-08 16:15:02 -07:00
Thomas Tumiel
587319debc
[tune] move _SCHEDULERS to tune.schedulers and add all available schedulers (#11218)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-08 16:10:23 -07:00
SangBin Cho
6cb00208f7
[Placement Group] Export bundle reservation check method only once. (#11153)
* Export bundle reservation check method only once.

* Addressed code review.
2020-10-08 16:08:28 -07:00
Richard Liaw
74e9647ec3
[tune] deactivate flaky test for now (#11284) 2020-10-08 15:40:04 -07:00
Amog Kamsetty
1027bfd4b8
[Tune, Ray SGD] Update PTL integrations (#11271) 2020-10-08 13:43:07 -07:00
Lee moon soo
bd9619e207
include staroid/example-full.yaml in whl package (#11194) 2020-10-08 11:29:07 -07:00
scottwedge
732cd9901b
Fix spelling of occurred (#10792) 2020-10-08 10:55:52 -07:00
SangBin Cho
174bef56d4
[Core] Publish gcs server failure to drivers. (#11265)
* Done.

* Fixed.
2020-10-08 08:59:31 -07:00
Siyuan (Ryans) Zhuang
47b7b76a5a
[Example] commands need to be quoted (#11224) 2020-10-07 19:12:42 -07:00
Sumanth Ratna
14d8826e43
Fix overriden typo (#11227) 2020-10-07 19:11:07 -07:00
Ian Rodney
b6314dd15c
[metrics] Cleanup unused item in Docstring (#11254)
* Use

* remove unused tag
2020-10-07 11:39:38 -07:00
architkulkarni
6676b30eef
[Serve] Serve multi node tests (#10980) 2020-10-07 10:57:40 -07:00
Simon Mo
68106425db
[Serve] Disable serialization for client and print helpful msg (#11181) 2020-10-07 10:50:30 -07:00
Kai Fricke
e58613b5e5
[tune/dashboard] Fix Tune dashboard to work with all trainables (#11232) 2020-10-06 14:03:31 -07:00
Sven Mika
ce96b03b07
[RLlib] MB-MPO cleanup (comments, docstrings, type annotations). (#11033) 2020-10-06 20:28:16 +02:00
Gekho457
66e265fdb9
Type annotations added to node_provider.py (#11221) 2020-10-05 22:03:04 -07:00
Alex Wu
8ec044f1f5
[Autoscaler] Remove extra print statement (#11222) 2020-10-05 22:02:23 -07:00
Alex Wu
dc7c2a70b8
[Core] Report worker backlog in GCS heartbeat (#11039) 2020-10-05 22:00:44 -07:00
Ameer Haj Ali
518876ef20
Remove test_autoscaler_yaml from windows tests (#11197)
Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
Co-authored-by: Alex Wu <alex@anyscale.io>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-10-05 17:07:00 -07:00
Ian Rodney
ab30940e50
Use 'mkdir -p' in manylinux (#11219) 2020-10-05 16:18:18 -07:00
Sumanth Ratna
0630242522
[Metrics] Use isinstance for type-checking keys of tags for metrics (#11202)
* Use isinstance instead of type for type-checking keys of tags for metrics

* Fix lint error
2020-10-05 14:24:22 -07:00
Gekho457
aaa8147acb
[CI] Add mypy to ci (#11117)
* Add mypy check to format.sh

* format_all() runs mypy check only on specified files
2020-10-05 11:20:45 -07:00
SangBin Cho
80cc161f3e
[Placement Group] Report placement group load through heartbeat. (#11129)
* In progress.

* Fix a minor issue.

* Removed unnecessary comments.

* Addressed code review.

* Fix build failure.

* remove stray logs.

* Move global state to a med size test to avoid windows CI breakage.
2020-10-04 16:47:22 -07:00
Ian Rodney
035a4ad0a2
[autoscaler] Update Autoscaler SDK (#11185)
* small sdk addition

* create RAY_AUTOSCALER_CONSTANTS

* better name

* move to private

* better naming
2020-10-03 13:18:01 -07:00
Amog Kamsetty
6325a973a2
[Ray SGD] Support num_steps continue training (#11142) 2020-10-02 23:43:26 -07:00
Ameer Haj Ali
6b86d4d280
Automatically detect CPU, GPU, accelerator_type for AWS (#11147) 2020-10-02 21:16:43 -07:00
Sumanth Ratna
6288d954b5
[tune] Use isinstance instead of type in PBT (#11175) 2020-10-02 18:32:14 -07:00
SangBin Cho
ee71fecd9e
[Test] Make test_serialization a medium size test. (#11183) 2020-10-02 17:53:46 -07:00
Stephanie Wang
ada58abcd9
[Object spilling] Update object directory and reload spilled objects automatically (#11021)
* Fix pytest...

* Release objects that have been spilled

* GCS object table interface refactor

* Add spilled URL to object location info

* refactor to include spilled URL in notifications

* improve tests

* Add spilled URL to object directory results

* Remove force restore call

* Merge spilled URL and location

* fix

* CI

* build

* osx

* Fix multitenancy issues

* Skip windows tests
2020-10-02 15:52:42 -07:00
Amog Kamsetty
874da9a25f
[Ray SGD] LightningModule integration + MNIST Example (#11042)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-01 20:07:32 -07:00
Richard Liaw
9dc7b7b11d
[tune] enable ax test (#11165)
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-01 17:25:29 -07:00
Richard Liaw
f60d77d78e
[tune] Fix GPU thread leakage 2020-10-01 17:07:13 -07:00
Ian Rodney
0d5b09f426
[Docker] Automagically add "runtime=nvidia" (#11125) 2020-10-01 17:04:19 -07:00