Commit graph

2735 commits

Author SHA1 Message Date
architkulkarni
fe5fcb6b9c
[serve] backend and endpoint validation (#9954) 2020-08-13 11:56:50 -05:00
Richard Liaw
7a56c3b71a
[cli] create_or_update_cluster fix (#10085) 2020-08-13 00:54:45 -07:00
SangBin Cho
86b1db3f11
[Stats] Make metrics report time configurable (#10036)
* Done.

* Lint.

* Address code review.

* Address code review.

* Remove wrong commit.

* Fix a test error.
2020-08-13 00:30:24 -07:00
fyrestone
739933e5b8
[Dashboard] Start the new dashboard (#9860) 2020-08-13 11:01:46 +08:00
krfricke
16486a8df3
[tune] Add OptunaSearcher wrapper around Optuna samplers (#10044)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-12 16:13:22 -07:00
Richard Liaw
7a8b922841
[tune] hotfix log_once (#10069) 2020-08-12 12:40:22 -07:00
SangBin Cho
2cb79632e4
Revert "[Core] Add cached memory to available memory (#10020)" (#10064)
This reverts commit 71d2bde458.
2020-08-12 11:24:16 -05:00
Richard Liaw
5560272556
[cli] install nightly wheels via ray install-nightly (#10054) 2020-08-11 20:08:22 -07:00
Simon Mo
f1ede1099f
[Hotfix] Pin opencv-python-headless==4.3.0.36 (#10049) 2020-08-11 15:58:18 -07:00
Ameer Haj Ali
82cdcff898
Removing kwargs & SSHOptions args from command runners (#10014) 2020-08-11 15:09:49 -07:00
Lixin Wei
71d2bde458
[Core] Add cached memory to available memory (#10020)
* add cached memory to available memory

* format

* bug fixed
2020-08-11 15:07:00 -07:00
Zhuohan Li
a6fed4820e
[Core] Preliminary implementation of ownership-based object directory (#9735) 2020-08-11 15:04:13 -07:00
krfricke
221fdc0774
[tune] fix flaky PBT replay test (#10047)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-11 14:17:31 -07:00
yncxcw
32cd94b750
[Core] Do not convert gpu id to int (#9744)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-11 12:09:46 -07:00
Maksim Smolin
d6226b80bb
[cli] CliLogger typing (#10027) 2020-08-11 12:00:57 -07:00
Ian Rodney
98126a84af
[docker] Remove port flags (#9992) 2020-08-11 11:43:56 -07:00
Simon Mo
4c52adddfa
[Core] Type check ObjectRef (#9856)
* Type check ObjectRef

* Bug fix

* Port typing tests to bazel test
2020-08-11 10:38:29 -07:00
Richard Liaw
98df612010
[tune] option to raise on error (#10030) 2020-08-11 09:59:04 -07:00
Maksim Smolin
40b8e35d61
[cli] New logging for the rest of the ray commands (#9984)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-11 09:58:23 -07:00
Kai Yang
3bc17fa62a
[Core] Multi-tenancy: Pass env variables from job config to worker processes (#10022) 2020-08-10 14:31:37 -07:00
Amog Kamsetty
856d4a0533
[Tune] Better error when using checkpoint_freq (#9998) 2020-08-10 13:52:46 -07:00
Richard Liaw
be8e63d477
[tune] support resume for search algorithms (#9972) 2020-08-10 13:43:14 -07:00
krfricke
7301733a1f
[tune] Close logfile contexts (#10026)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-10 12:40:40 -07:00
PidgeyBE
6ad2fc4831
[autoscaler] Service and Ingress per worker pod (#9359) 2020-08-10 14:13:52 -05:00
SangBin Cho
10baecb8c2
Try to fix. (#10005) 2020-08-10 10:05:43 -07:00
Maksim Smolin
0392bb7a72
[Autoscaler] Command Output Improvement (#9699)
* cross-platform prototype

* checkpoint

* Address PR comments

* format

* prepare to push

* format

* PR comments

* fixes

* fixtest

* Revert "fixtest"

This reverts commit d6f54353e1b891c784417bb8d0304c18cc5bcdd8.

* return-result

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-10 09:49:24 -07:00
Kai Yang
37821f0b4c
Support unlimited JVM options (#9910) 2020-08-10 16:08:33 +08:00
Ian Rodney
7b87da7f03
Properly call mkdir on rsync (#9995) 2020-08-09 21:31:28 -07:00
Alan Guo
646835d292
[autoscaler] Throw error with missing cluster_synced_files. (#9965)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-07 23:07:09 -07:00
SangBin Cho
39088ab6f2
[Stats] Metrics Export User Interface Part 2 (Prometheus Service Discovery) (#9970)
* In progress.

* In Progress.

* Finish the working version.

* Write a documentation.

* Addressed code review.

* Fix lint error.

* Lint.

* Addressed code review. Make test less flaky.

* Use a random port for ray start.

* Modify doc.

* Make write atomic.
2020-08-07 21:59:24 -07:00
Richard Liaw
d3cde16163
hotfix (#9996) 2020-08-07 21:44:10 -07:00
Max Fitton
d9822e04d4
[Dashboard] Switch to using the correct actor ID as a react key for each actor entry in the actors list in the logical view. This fixes a bug where duplicate actor entries were being rendered in the UI (#9991)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-07 20:46:06 -07:00
Richard Liaw
a438cbd1e8
[tune] reorder transformer example save (#9994)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-08-07 20:29:04 -07:00
Barak Michener
8e76796fd0
ci: Redo format.sh --all script & backfill lint fixes (#9956) 2020-08-07 16:49:49 -07:00
Alex Wu
a54d3a1cee
[Autoscaler] Run resource demand scheduler in CI (#9945)
* .

* .
2020-08-07 13:30:39 -07:00
Edward Oakes
ca37accc07
[serve] Add min and max limits to autoscaling (#9955) 2020-08-07 15:30:14 -05:00
krfricke
0ef8224446
[tune] PBT replay utility scheduler (#9953)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-07 12:41:49 -07:00
SangBin Cho
326a470bc2
[Test] Reduce the wait for condition timeout. (#9971) 2020-08-07 11:44:53 -07:00
Alex Wu
84b7240c4b
[Core] Read resources from an environment variable (#9831) 2020-08-06 18:32:01 -07:00
Richard Liaw
b91c9ba085
[k8s] fix import for commandrunner (#9968) 2020-08-06 17:30:06 -07:00
SangBin Cho
44826878ff
[Core] Remove Legacy Raylet Code (#9936)
* Remove a flag and some methods in node manager including HandleDisconnectedActor, ResubmitTask, and HandleTaskReconstruction

* Make actor creator always required + remove raylet transport

* Remove actor reporter + remove FinishAssignedActorCreationTask

* Remove actor tasks.

* Remove finishactortask and switched it to finishactorcreation task

* Remove reconstruction policy.

* Remove lineage cache.

* Formatting.

* Remove actor frontier code.

* Removed build error.

* Revert "Remove reconstruction policy."

This reverts commit 9d25c9bced4da5fbcac5d484d51013345f16513b.

* Recover HandleReconstruction to mark expired objects as failed.
2020-08-06 16:37:50 -07:00
SangBin Cho
ec2f1a225e
[Stats] Metrics Export User Interface Part 1 (#9913)
* Metrics export port expose done.

* Support exposing metrics port + metrics agent service discovery through ray.nodes()

* Formatting.

* Added a doc.

* Linting.

* Change the location of metrics agent port.

* Addressed code review.

* Addressed code review.
2020-08-06 16:16:29 -07:00
Maksim Smolin
eace94d2dc
[cli] Fix issues with logging unescaped strings (#9960) 2020-08-06 14:44:39 -07:00
Max Fitton
fc9fc342cf
Make dashboard disk stat not break on non-Unix machines (note it will not correctly report stat still) (#9962)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 15:00:26 -05:00
Max Fitton
3f7eb64063
The required resources field is not always present, leading the logical view to crash when it is not present. (#9959)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 14:59:52 -05:00
Simon Mo
c8da5555ab
[Serve] Add preliminary middleware support (#9940) 2020-08-06 12:49:31 -07:00
Barak Michener
21994c594b
python/test: Faster tests and better BUILD (#9791) 2020-08-06 10:58:42 -07:00
Max Fitton
6a1acce791
[Dashboard] Fix Bug in Machine View when Unsorted with Multiple Machines (#9938)
* Patch issue where when the Machine view was unsorted and grouped, it would crash.

* lint

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 10:38:01 -07:00
Eric Liang
7d4f204aa8
[Placement Group] Allow scheduling a task on any bundle (-1, default) (#9885)
* wip

* wip

* fix tests

* wip

* wip

* wip

* wip

* wip

* add test

* update

* update

* remov debug

* comments
2020-08-06 00:05:21 -07:00
Ian Rodney
45597e3158
Fixing basic messup (#9947) 2020-08-05 22:09:21 -07:00