Commit graph

3033 commits

Author SHA1 Message Date
Richard Liaw
51038f2197
confirm (#11049)
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-26 13:48:13 -07:00
SangBin Cho
29663d89f1
[Placement Group] Remove warning msg for placement groups. (#11034)
* Done.

* Addressed code review.

* Fixed typo.

* Addressed code review.
2020-09-25 20:53:42 -07:00
SangBin Cho
109481afd9
[Metric] custom metrics refinement (#10861)
* In progress

* In Progress.

* Addressed code review.

* Add unit tests.

* Add a simple doc.

* Fixed test failure.

* Fix all test failures from serve.

* Addressed code review.
2020-09-25 09:10:28 -07:00
Eric Liang
609c1b8acd
Start moving ray internal files to _private module (#10994) 2020-09-24 22:46:35 -07:00
Ameer Haj Ali
3b6fe72029
Make the command runner interface public (#11022) 2020-09-24 22:45:17 -07:00
Amog Kamsetty
ee85cb31a5
[Tune] Fix Memory Leak (#10989)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-24 20:26:55 -07:00
Eric Liang
a26394d184
[tests] Blacklist failing win32 tests (#10935) 2020-09-24 20:15:28 -07:00
Simon Mo
4f6e218a3d
Add a new _available_resources_per_node for state API (#11014) 2020-09-24 17:25:15 -07:00
Amog Kamsetty
3716fb1ca9
[Ray SGD] Fix hotfix test (#11015) 2020-09-24 14:14:03 -07:00
Amog Kamsetty
07bdf062b9
[Ray SGD] [Hotfix] Worker group hotfix (#11008) 2020-09-24 12:21:30 -07:00
SangBin Cho
8c241d5f1d
[Core] Use node ip address properly in ray.init (#10829)
* Fix.

* Addressed code review.

* Addressed code review.
2020-09-24 11:44:52 -07:00
Ameer Haj Ali
4ac58d54d6
prepare for head node (#10997)
Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
2020-09-24 11:18:38 -07:00
Kai Fricke
d9c4dea7cf
[tune] strict metric checking (#10972) 2020-09-24 10:00:48 -07:00
SangBin Cho
5e6b887f2d
[Placement Group] Capture Child Task Part 1 (#10968)
* In progress.

* In progers.

* Done.

* Addressed code review.

* Increase timeout to make a test less flaky.

* Addressed code review.

* Addressed code review.
2020-09-24 09:02:03 -07:00
Keqiu Hu
46a560e876
[cli][ray] ray start should error by default if there's already an instance running (#10826) 2020-09-24 10:29:59 -05:00
SongGuyang
f9b040db52
add log-dir to new dashboard (#10885) 2020-09-24 13:40:37 +08:00
Amog Kamsetty
52e1495e30
[Ray SGD] TorchTrainable pre 0.8.7 deprecation warning (#10984)
* torch trainable add pre 0.8.7 backwards compat

* raise instead

* Update python/ray/util/sgd/torch/torch_trainer.py
2020-09-23 18:19:43 -07:00
Ian Rodney
4c3f09094a
[docs] redis-port -> port (#10937) 2020-09-23 17:04:13 -07:00
Alex Wu
295782d411
[New Scheduler] Refactor cluster resource scheduler (#10938) 2020-09-23 15:46:31 -07:00
Allen
567009d5fd
[Autoscaler] Fix k8s command runner when command fails (#10966)
Co-authored-by: Allen Yin <allenyin@anyscale.io>
2020-09-23 13:25:49 -07:00
Kai Fricke
5921e87ecd
[tune] Only add new trial when there is no pending trial (#10979) 2020-09-23 11:08:12 -07:00
Amog Kamsetty
7dbd0ff824
fix example (#10964) 2020-09-23 10:33:19 -07:00
SangBin Cho
390107b6cb
[Core] Allow to pass node ip address to gcs server. (#10946)
* Allow to pass node ip address to gcs server.

* Fix.

* Addressed code review.

* Fixed an error.

* Addressed code review.
2020-09-23 01:52:26 -07:00
Lee moon soo
df4c3abe30
[autoscaler] Staroid node provider (#10956) 2020-09-22 21:25:29 -07:00
Simon Mo
7fbe076813
[Serve] Unwrap Flask Request from ServeHandle (#10845) 2020-09-22 12:44:23 -07:00
Kai Yang
864d1d2b59
[Core] Multi-tenancy: Kill idle workers in FIFO order (#10597)
* Kill idle workers in FIFO order

* Update test

* minor update

* Address comments

* fix after merge

* fix worker_pool_test
2020-09-22 10:59:11 -07:00
architkulkarni
67c653c053
[Serve] Only install dataclasses on Python 3.6 (#10936) 2020-09-22 09:39:39 -07:00
Kai Fricke
2d16ab2e16
[tune] Remove unnecessary wandb group parameter (#10950) 2020-09-22 09:36:51 -07:00
Sumanth Ratna
770c3633f0
Update max_failures kwarg docstring (#10953) 2020-09-22 09:02:15 -07:00
SangBin Cho
9d205cda86
[Tests] Fix flaky test_failures by using semaphore instead of sleep (#10942)
* Use semaphore to avoid timing issues.

* Addressed code review.
2020-09-21 23:39:49 -07:00
Kai Fricke
6247740b94
[tune] sort running trials to top in status table (#10926)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-21 13:39:51 -07:00
Kai Fricke
50d63b8077
[tune] update pt tutorial docs (#10925)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-21 13:33:37 -07:00
Amog Kamsetty
d1d4743702
[Ray SGD] FP16 Hotfix (#10931) 2020-09-21 13:10:10 -07:00
Sumanth Ratna
9da7bdcc8e
Use master for links to docs in source (#10866) 2020-09-19 00:30:45 -07:00
Eric Liang
6a227ae501
[autoscaler] Split autoscaler interface public private (#10898) 2020-09-18 18:16:23 -07:00
Alex Wu
9a07c7b963
[1.0] Remove args from ray start (#10659) 2020-09-18 16:41:23 -07:00
Alex Wu
e56f2b8586
[autoscaler] hotfix calculate_node_resources (#10874) 2020-09-18 13:39:00 -07:00
architkulkarni
102c498653
[Doc] Fix RayServeHandle doc (#10896) 2020-09-18 10:29:21 -07:00
Kai Fricke
508cfa3540
[tune] Support yield and return statements (#10857)
* Support `yield` and `return` statements in Tune trainable functions

* Support anonymous metric with ``tune.report(value)``

* Raise on invalid return/yield value

* Fix end to end reporter test
2020-09-17 20:18:35 -07:00
SongGuyang
5cbc411e38
[cpp worker] support cluster mode (#9977) 2020-09-18 11:08:18 +08:00
Eric Liang
1b295a17cb
Add accelerator-type to multi node type example YAML (#10871) 2020-09-17 17:09:35 -07:00
Ian Rodney
a159ae72b3
[autoscaler] Ensure run_init happens in all cases (#10820)
* taking a stab at the horror that is NodeUpdaterThread

* added tests
2020-09-17 11:23:56 -07:00
Ian Rodney
47d7d83b6f
[docker] Fix GPU support for tensorflow (#10779) 2020-09-17 10:56:58 -07:00
fyrestone
269e1f0b98
Fix push_error_to_driver_through_redis (#10848)
Co-authored-by: 刘宝 <po.lb@antfin.com>
2020-09-17 10:50:44 -07:00
Keqiu Hu
8a77cf925a
[cli][ray] update ray cli message (#10823) 2020-09-17 09:26:55 -07:00
Kai Fricke
ee99c919e3
[tune] lazy trials (#10802)
* Lazily fill trial queue

* Update interface

* Update end to end reporter test

* Removed `next_trials()` method

* Lint

* Print total number of samples to be generated in progress reporter. Allow infinite samples.

* Nit check
2020-09-17 08:51:46 -07:00
SangBin Cho
fe4c6ab778
[Core] Remove unused credis related code. (#10849)
* Done.

* Lint.
2020-09-16 23:34:54 -07:00
Alex Wu
6f479d4697
[hotfix] CPU Detection (#10821) 2020-09-16 21:02:52 -07:00
Richard Liaw
d3feb83053
[tune] check for running session (#10840) 2020-09-16 18:55:11 -07:00
Ameer Haj Ali
54c616e9f3
[autoscaler] Enforce CommandRunnerInterface abstractions (#10822)
Co-authored-by: root <root@ip-172-31-28-155.us-west-2.compute.internal>
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
2020-09-16 16:56:03 -07:00