Commit graph

3033 commits

Author SHA1 Message Date
Kai Fricke
87c4f36f02
[tune] Added timeout parameter to tune.run(), (#10642) 2020-09-08 15:38:28 -07:00
Amog Kamsetty
415be78cc0
[RaySGD] Simplify Builder Process (#10321)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 15:19:40 -07:00
Kai Fricke
69c1a9dd08
[tune] clean up logs before logging to wandb (#10654)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 14:48:18 -07:00
SangBin Cho
dcb9e03fde
[Placement Group] Atomic Creation using 2 phase protocol part 2. (#10599)
* In progress.

* In Progress

* Basic done.

* Fix build issues.

* Addressed code review.

* Change the confusing test name.

* Fix comments.

* Addressed code review.
2020-09-08 13:11:11 -07:00
Clark Zinzow
36e1f20e9c
Add Dask-Ray scheduler callbacks. (#10519)
Improve Dask-on-Ray documentation.

Move to RayCallback(s) namedtuples, and use top-level CBS tuple as source-of-truth for callback methods.
2020-09-08 13:00:58 -07:00
Simon Mo
fdd3acd492
Promote ray.experimental.queue to ray.util (#10624) 2020-09-08 12:56:53 -07:00
Simon Mo
8d5b8b2956
[Serve] Fix handle args data type issue (#10629) 2020-09-08 12:32:42 -07:00
Richard Liaw
5851e893ee
[tune] More robust resolution/detection of signature (#10365)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-09-08 11:38:16 -07:00
Ian Rodney
39c598bab0
[docker] No Docker CP if File Mount (#10633) 2020-09-08 10:25:24 -07:00
chaokunyang
bbfbc98a41
[Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
fyrestone
d2614d222c
[Doc] Cross language page (#10471) 2020-09-08 16:51:40 +08:00
Kai Yang
ca8792e4ff
[Java] Disable the multi-worker feature by default (#10593) 2020-09-08 13:10:46 +08:00
Richard Liaw
41bf5f3de0
[tune] change trial dir default to include name (#10608) 2020-09-07 19:45:13 -07:00
Edward Oakes
8db1f16f25
[tune] wandb - api_key_file clarification (#10614)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-07 16:31:50 -07:00
Kai Fricke
088f8ebb69
[tune] Add algorithms for search space conversion (#10621) 2020-09-07 13:44:16 -07:00
Richard Liaw
169c3a46de
[k8s] Broken Command Interactivity (#10297)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-07 09:56:41 -07:00
fyrestone
47c1a3c0c0
Fix ray.cross_language.java_function() missing accelerator_type arg (#10620) 2020-09-07 20:50:33 +08:00
Alex Wu
d6a9f0e2e4
[Core] Accelerator type API (#10561) 2020-09-06 20:58:40 -07:00
Alex Wu
a699f6a4d8
[Core] Fix override memory and object_store_memory in decorator (#10563) 2020-09-06 20:56:48 -07:00
Alex Wu
8906c1a59f
[Autoscaler] Demand autoscaler take into account utilized resources (#10464) 2020-09-06 20:54:44 -07:00
Kai Fricke
c5e9bafe15
[tune] Fix flaky test in test_sample (#10602) 2020-09-06 10:29:48 -07:00
Maksim Smolin
f38dba09b2
[cli] Support non-interactive logging (#10203)
* add non-interactive logging

* logger

* add formatter support, add flag

* checkpoint

* format

* fix-interactive

* fixup

* fomrmat

* fix

* revert

* fix

* fix

* fix

* fix

* fx

* fix-test

* fix-commands

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 15:41:35 -07:00
Richard Liaw
551c597312
[tune] API revamp fix (#10518) 2020-09-05 15:34:53 -07:00
Stephanie Wang
4f02ad4ef9
[core] Disable GCS reconnect (#10579)
* Set default GCS retries to 1

* Fix cc test
2020-09-05 13:14:07 -07:00
Sumanth Ratna
54215ff287
[tune] implement shim instantiation (#10456)
* Create ray.tune.suggest.create.create_scheduler

* Update __init__.py

* Resolve conflict in __init__.py

* Create ray.tune.schedulers.create.create_scheduler

* Update __init__.py

* Move create_scheduler to tune.schedulers.__init__

* Move create_searcher to tune.suggest.__init__

* Delete tune.suggest.create

* Delete tune.schedulers.create

* Update imports for shim functions in tune.__init__

* Remove shim from tune.suggest.__init__.__all__

* Remove shim from tune.schedulers.__init__.__all__

* Add ShimCreationTest

* Move ShimCreationTest to test_api

* Delete test_shim.py

* Add docstring for ray.tune.create_scheduler

* Add docstring to ray.tune.create_searcher

* Fix typo in ray.tune.create_scheduler docstring

* Fix lint errors in tune.schedulers.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.schedulers.__init__

* Fix imports in test_api

* Fix lint errors in test_api

* Fix kwargs in create_searcher

* Fix kwargs in create_scheduler

* Merge branch 'master' into shim-instantiation

* Update use-case in docs in tune.create_scheduler

* Update use-case in docs in tune.create_searcher

* Remove duplicate pytest run from test_api

* Add check to create_searcher


Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add check to create_scheduler

* lint

* Compare types of instances in test_api

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add tune.create_searcher to docs

* Fix doc build

* Fix tests

* Add tune.create_scheduler to docs

* Fix tests

* Fix lint errors

* Update Ax search for master

* Fix metric kwarg for Ax in test_api

* Fix doc build

* Fix HyperOptSearch import in test_api

* Fix HyperOptSearch import in create_searcher

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 09:36:42 -07:00
Max Fitton
31f8ce4768
[Dashboard] Plasma Memory Usage in Machine View (#10552)
* wip

* lint

* more lint

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-09-05 00:34:26 -07:00
Eric Liang
8ee7c182f5
[1.0] move placement groups from experimental to util. Note they are still undocumented. (#10554)
* move files

* Update __init__.py

* remove

* Update __init__.py
2020-09-04 19:01:24 -07:00
Richard Liaw
4b3b46e09f
[docs] Tips for testing Ray applications (#10583) 2020-09-04 18:40:48 -07:00
Kai Fricke
2fac66650d
[tune] extend search space api docs (#10576)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 18:39:51 -07:00
architkulkarni
c4c0857107
[Serve] Parametrize tests for pydantic backend (#10559) 2020-09-04 17:24:24 -07:00
Eric Liang
2e5e9b291b
[ray 1.0] Make private a few more things (#10551)
* reomve some more stuff

* no underscore
2020-09-04 17:19:27 -07:00
Simon Mo
55b6c19d98
[Serve] Implement ServeHandle refactoring (#10527) 2020-09-04 15:50:56 -07:00
Kai Fricke
6b6780a108
[tune] Allow trials to remain paused in BOHB (#10531)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 15:29:33 -07:00
Eric Liang
da83bbd764
[1.0] Move dask scheduler from experimental to util (#10553)
* move dask

* fix dask
2020-09-04 12:16:32 -07:00
Edward Oakes
b1bd58581b
Print "Connecting to existing cluster" message to stderr instead of stdout (#10575) 2020-09-04 12:51:59 -05:00
Maksim Smolin
02efa2549d
[cli] Fix colors on light themes (#10577) 2020-09-04 10:45:27 -07:00
Edward Oakes
786f12edfd
[serve] Serve client refactor (#10409) 2020-09-04 12:02:23 -05:00
Kai Fricke
2e49e22f21
[tune] Add test_sample to bazel BUILD (#10566) 2020-09-04 09:09:02 -07:00
Kai Yang
5f5160ead9
[Core] Multi-tenancy: Worker capping (#10500) 2020-09-04 20:34:06 +08:00
PidgeyBE
51df0820de
[autoscaler] Fix ingress manifest bug (#10536) 2020-09-04 01:09:16 -05:00
Kai Fricke
5c3d4a6670
[tune] added MXNet integration callbacks (#10533) 2020-09-03 18:06:44 -07:00
Edward Oakes
ead30ca655
[Core] fix named actor bug (#10550) 2020-09-03 17:48:31 -07:00
Simon Mo
94374e1dd9
[Serve] Add Latency and Queue Size Metrics (#10535) 2020-09-03 17:33:37 -07:00
Simon Mo
eff4375c3d
[Serve] Produtionize Starlette Middlewares (#10529) 2020-09-03 17:31:38 -07:00
architkulkarni
0d93e92720
[Serve] Reimplement BackendConfig as pydantic model (#10389) 2020-09-03 19:16:17 -05:00
Richard Liaw
43a7a64b30
[tune] horovod trainable (#10304) 2020-09-03 16:53:35 -07:00
Clark Zinzow
7068c63dd8
Set Ray task name to Dask key for Dask tasks. (#10547) 2020-09-03 15:37:55 -07:00
Ian Rodney
c54853d45b
[Autoscaler] Actually try to catch when docker does not exist (#10549) 2020-09-03 14:00:06 -07:00
Ian Rodney
a13c83d7f0
Add WorkerCrashedError to cancel docs (#10534) 2020-09-03 13:23:04 -07:00
Clark Zinzow
0c0b0d0a73
[Core] Added support for submission-time task names. (#10449)
* Added support for submission-time task names.

* Suggestions from code review: add missing consts

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Add num_returns arg to actor method options docstring example.

* Add process name line and proctitle assertion to submission-time task name section of advanced docs.

* Add submission-time task name --> proctitle test for Python worker.

* Added Python actor options tests for num_returns and name.

* Added Java test for submission-time task names.

* Add dashboard image to task name docs section.

* Move to fstrings.

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
2020-09-03 11:45:24 -07:00