Amog Kamsetty
856d4a0533
[Tune] Better error when using checkpoint_freq ( #9998 )
2020-08-10 13:52:46 -07:00
Richard Liaw
be8e63d477
[tune] support resume for search algorithms ( #9972 )
2020-08-10 13:43:14 -07:00
krfricke
7301733a1f
[tune] Close logfile contexts ( #10026 )
...
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-10 12:40:40 -07:00
PidgeyBE
6ad2fc4831
[autoscaler] Service and Ingress per worker pod ( #9359 )
2020-08-10 14:13:52 -05:00
SangBin Cho
10baecb8c2
Try to fix. ( #10005 )
2020-08-10 10:05:43 -07:00
Maksim Smolin
0392bb7a72
[Autoscaler] Command Output Improvement ( #9699 )
...
* cross-platform prototype
* checkpoint
* Address PR comments
* format
* prepare to push
* format
* PR comments
* fixes
* fixtest
* Revert "fixtest"
This reverts commit d6f54353e1b891c784417bb8d0304c18cc5bcdd8.
* return-result
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-10 09:49:24 -07:00
Kai Yang
37821f0b4c
Support unlimited JVM options ( #9910 )
2020-08-10 16:08:33 +08:00
Ian Rodney
7b87da7f03
Properly call mkdir on rsync ( #9995 )
2020-08-09 21:31:28 -07:00
Alan Guo
646835d292
[autoscaler] Throw error with missing cluster_synced_files. ( #9965 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-07 23:07:09 -07:00
SangBin Cho
39088ab6f2
[Stats] Metrics Export User Interface Part 2 (Prometheus Service Discovery) ( #9970 )
...
* In progress.
* In Progress.
* Finish the working version.
* Write a documentation.
* Addressed code review.
* Fix lint error.
* Lint.
* Addressed code review. Make test less flaky.
* Use a random port for ray start.
* Modify doc.
* Make write atomic.
2020-08-07 21:59:24 -07:00
Richard Liaw
d3cde16163
hotfix ( #9996 )
2020-08-07 21:44:10 -07:00
Max Fitton
d9822e04d4
[Dashboard] Switch to using the correct actor ID as a react key for each actor entry in the actors list in the logical view. This fixes a bug where duplicate actor entries were being rendered in the UI ( #9991 )
...
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-07 20:46:06 -07:00
Richard Liaw
a438cbd1e8
[tune] reorder transformer example save ( #9994 )
...
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-08-07 20:29:04 -07:00
Barak Michener
8e76796fd0
ci: Redo format.sh --all script & backfill lint fixes ( #9956 )
2020-08-07 16:49:49 -07:00
Alex Wu
a54d3a1cee
[Autoscaler] Run resource demand scheduler in CI ( #9945 )
...
* .
* .
2020-08-07 13:30:39 -07:00
Edward Oakes
ca37accc07
[serve] Add min and max limits to autoscaling ( #9955 )
2020-08-07 15:30:14 -05:00
krfricke
0ef8224446
[tune] PBT replay utility scheduler ( #9953 )
...
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-07 12:41:49 -07:00
SangBin Cho
326a470bc2
[Test] Reduce the wait for condition timeout. ( #9971 )
2020-08-07 11:44:53 -07:00
Alex Wu
84b7240c4b
[Core] Read resources from an environment variable ( #9831 )
2020-08-06 18:32:01 -07:00
Richard Liaw
b91c9ba085
[k8s] fix import for commandrunner ( #9968 )
2020-08-06 17:30:06 -07:00
SangBin Cho
44826878ff
[Core] Remove Legacy Raylet Code ( #9936 )
...
* Remove a flag and some methods in node manager including HandleDisconnectedActor, ResubmitTask, and HandleTaskReconstruction
* Make actor creator always required + remove raylet transport
* Remove actor reporter + remove FinishAssignedActorCreationTask
* Remove actor tasks.
* Remove finishactortask and switched it to finishactorcreation task
* Remove reconstruction policy.
* Remove lineage cache.
* Formatting.
* Remove actor frontier code.
* Removed build error.
* Revert "Remove reconstruction policy."
This reverts commit 9d25c9bced4da5fbcac5d484d51013345f16513b.
* Recover HandleReconstruction to mark expired objects as failed.
2020-08-06 16:37:50 -07:00
SangBin Cho
ec2f1a225e
[Stats] Metrics Export User Interface Part 1 ( #9913 )
...
* Metrics export port expose done.
* Support exposing metrics port + metrics agent service discovery through ray.nodes()
* Formatting.
* Added a doc.
* Linting.
* Change the location of metrics agent port.
* Addressed code review.
* Addressed code review.
2020-08-06 16:16:29 -07:00
Maksim Smolin
eace94d2dc
[cli] Fix issues with logging unescaped strings ( #9960 )
2020-08-06 14:44:39 -07:00
Max Fitton
fc9fc342cf
Make dashboard disk stat not break on non-Unix machines (note it will not correctly report stat still) ( #9962 )
...
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 15:00:26 -05:00
Max Fitton
3f7eb64063
The required resources field is not always present, leading the logical view to crash when it is not present. ( #9959 )
...
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 14:59:52 -05:00
Simon Mo
c8da5555ab
[Serve] Add preliminary middleware support ( #9940 )
2020-08-06 12:49:31 -07:00
Barak Michener
21994c594b
python/test: Faster tests and better BUILD ( #9791 )
2020-08-06 10:58:42 -07:00
Max Fitton
6a1acce791
[Dashboard] Fix Bug in Machine View when Unsorted with Multiple Machines ( #9938 )
...
* Patch issue where when the Machine view was unsorted and grouped, it would crash.
* lint
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 10:38:01 -07:00
Eric Liang
7d4f204aa8
[Placement Group] Allow scheduling a task on any bundle (-1, default) ( #9885 )
...
* wip
* wip
* fix tests
* wip
* wip
* wip
* wip
* wip
* add test
* update
* update
* remov debug
* comments
2020-08-06 00:05:21 -07:00
Ian Rodney
45597e3158
Fixing basic messup ( #9947 )
2020-08-05 22:09:21 -07:00
Richard Liaw
51bad84423
[cli] Maintain "old-style" for abort ( #9943 )
2020-08-05 20:37:29 -07:00
Edward Oakes
38408574c4
[serve] Basic autoscaling policy ( #9845 )
2020-08-05 21:11:35 -05:00
Alex Wu
12d75784a4
[Core] test_advanced_3.py::test_logging_to_driver (round 2) ( #9916 )
2020-08-05 15:04:36 -05:00
Ian Rodney
b6da7dcef9
Upgrade to v30 and 18.04 on default yamls ( #9917 )
2020-08-05 13:01:14 -07:00
Max Fitton
538ad04e96
[Dashboard] Update ActorState in dashboard to support new actor states ( #9855 )
...
* Update ActorState in dashboard to support new actor states
* Update dashboard documentation for new states
* Add missing state to doc
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-05 10:35:18 -07:00
Ian Rodney
dba999b6f6
[docker] Fix rsyncs & filesync for docker ( #9920 )
2020-08-05 10:13:03 -07:00
SangBin Cho
685182923c
[Core] Fix detached actor local mode when gcs actor management is on. ( #9839 )
...
* Fix local mode detached actor.
* Revert changes.
2020-08-05 09:04:24 -07:00
Amog Kamsetty
5af7d24f66
[Tune] Transformer blog example ( #9789 )
...
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-04 22:05:01 -07:00
Henk Tillman
ead8b86372
Create ~/.ssh if it doesn't already exist ( #9880 )
2020-08-04 14:55:15 -07:00
Edward Oakes
55146d222f
[serve] Detect node updates ( #9828 )
2020-08-04 15:57:21 -05:00
Max Fitton
ef190f358b
[Dashboard] Fix Memory Page Crash with Front-end Pagination ( #9593 )
2020-08-04 14:16:07 -05:00
Clark Zinzow
6fded582ff
[Dask] Dask-Ray scheduler MVP. ( #9857 )
2020-08-04 11:45:25 -07:00
krfricke
ef717ecda6
[tune] Prevent leak of magic keys in trial config ( #9903 )
...
Co-authored-by: Kai Fricke <kai@anyscale.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-04 11:24:01 -07:00
chaokunyang
3323ad9d59
[HOTFIX] Fix master build with missing placement group argument ( #9868 )
...
* fix common task submit default placement group
* fix java_function
2020-08-04 11:19:15 -07:00
Ameer Haj Ali
6c9ec10540
Support not specifying an SSH key in local node provider ( #9864 )
2020-08-04 10:23:43 -05:00
Kai Yang
27cd323ce1
[Core] Multi-tenancy: Job isolation & implement per job config (except for env variables) ( #9500 )
2020-08-04 15:51:29 +08:00
kisuke95
28b1f7710c
[Core] Error info pubsub (Remove ray.errors API) ( #9665 )
2020-08-04 14:04:29 +08:00
Richard Liaw
c6404e8cf6
[tune] Search alg checkpointing during training ( #9803 )
...
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-08-03 15:07:31 -07:00
Alex Wu
20671bdc12
[Core] Fix test_logging_to_driver ( #9829 )
...
* Fixed
* .
* .
Co-authored-by: Ubuntu <ubuntu@ip-172-31-7-236.us-west-2.compute.internal>
2020-08-03 12:52:24 -07:00
Richard Liaw
b5068d08bf
[tune] Fix restoration for function API PBT ( #9853 )
2020-08-03 12:36:17 -07:00
