Commit graph

972 commits

Author SHA1 Message Date
Alex Wu
d0b73647b4
[Autoscaler] Unmanaged nodes (#10513) 2020-09-13 11:58:47 -07:00
Simon Mo
9e8e34240f
[Doc] Add section for threaded actor (#10751) 2020-09-11 16:34:10 -07:00
Eric Liang
3eed3eca09
Move meta-learning algorithms into their own section in the TOC (#10727) 2020-09-11 12:26:16 -07:00
Hao Chen
f7558ed2a5
Remove outdated Java doc and run demo code in CI (#10698) 2020-09-11 19:15:52 +08:00
Kai Fricke
7eaf063f29
[tune] wrapper function to pass arbitrary objects through the object store to trainables (#10679) 2020-09-10 17:39:44 -07:00
Barak Michener
c6b1ed7f8f
release process: bump version number to 1.1.0.dev0 everywhere (#10686) 2020-09-10 16:00:21 -07:00
Max Fitton
e3aee6b434
[Dashboard] Refresh documentation 1.0.0 (#10684) 2020-09-10 15:51:26 -07:00
chaokunyang
bf71c0b9f6
[Java] Deploy snapshort jars to maven repository in travis ci (#10701) 2020-09-10 15:40:16 -07:00
Eric Liang
f7d5aa46a3
[hotfix] Fix table formatting (#10687) 2020-09-09 16:08:54 -07:00
Justin Terry
8a1caf6279
rename centralized critic to shared critic (#10610) 2020-09-09 15:49:32 -07:00
Richard Liaw
153813936b
[tune] auto infer metrics (#10663)
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-09-09 09:53:47 -07:00
Sven Mika
4b278c36fc
[RLlib] Behavioral Cloning (from MARWIL). (#10619) 2020-09-09 17:33:21 +02:00
Michael Luo
8e613652af
[RLLib] MBMPO Fixes (#10296) 2020-09-09 09:34:34 +02:00
Kai Fricke
d7c7aba99c
[tune] Tune experiment analysis improvements (#10645)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 21:00:52 -07:00
Kai Fricke
756a9ea641
[tune] add mode/metric parameters to tune.run (#10627)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 17:06:21 -07:00
Richard Liaw
edce7a05e6
[docs] fix warning -> tip (#10661)
Co-authored-by: simon-mo <simon.mo@hey.com>
2020-09-08 17:00:09 -07:00
Simon Mo
5a38a76c83
[Doc] Use sphinx_book_theme (#10379) 2020-09-08 16:25:23 -07:00
Amog Kamsetty
415be78cc0
[RaySGD] Simplify Builder Process (#10321)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 15:19:40 -07:00
Clark Zinzow
36e1f20e9c
Add Dask-Ray scheduler callbacks. (#10519)
Improve Dask-on-Ray documentation.

Move to RayCallback(s) namedtuples, and use top-level CBS tuple as source-of-truth for callback methods.
2020-09-08 13:00:58 -07:00
Simon Mo
fdd3acd492
Promote ray.experimental.queue to ray.util (#10624) 2020-09-08 12:56:53 -07:00
chaokunyang
bbfbc98a41
[Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
Hao Chen
f9098fe631
[Java doc] index and introduction page (#10646) 2020-09-08 22:00:46 +08:00
fyrestone
d2614d222c
[Doc] Cross language page (#10471) 2020-09-08 16:51:40 +08:00
Kai Fricke
088f8ebb69
[tune] Add algorithms for search space conversion (#10621) 2020-09-07 13:44:16 -07:00
Alex Wu
d6a9f0e2e4
[Core] Accelerator type API (#10561) 2020-09-06 20:58:40 -07:00
Richard Liaw
551c597312
[tune] API revamp fix (#10518) 2020-09-05 15:34:53 -07:00
Sumanth Ratna
54215ff287
[tune] implement shim instantiation (#10456)
* Create ray.tune.suggest.create.create_scheduler

* Update __init__.py

* Resolve conflict in __init__.py

* Create ray.tune.schedulers.create.create_scheduler

* Update __init__.py

* Move create_scheduler to tune.schedulers.__init__

* Move create_searcher to tune.suggest.__init__

* Delete tune.suggest.create

* Delete tune.schedulers.create

* Update imports for shim functions in tune.__init__

* Remove shim from tune.suggest.__init__.__all__

* Remove shim from tune.schedulers.__init__.__all__

* Add ShimCreationTest

* Move ShimCreationTest to test_api

* Delete test_shim.py

* Add docstring for ray.tune.create_scheduler

* Add docstring to ray.tune.create_searcher

* Fix typo in ray.tune.create_scheduler docstring

* Fix lint errors in tune.schedulers.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.schedulers.__init__

* Fix imports in test_api

* Fix lint errors in test_api

* Fix kwargs in create_searcher

* Fix kwargs in create_scheduler

* Merge branch 'master' into shim-instantiation

* Update use-case in docs in tune.create_scheduler

* Update use-case in docs in tune.create_searcher

* Remove duplicate pytest run from test_api

* Add check to create_searcher


Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add check to create_scheduler

* lint

* Compare types of instances in test_api

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add tune.create_searcher to docs

* Fix doc build

* Fix tests

* Add tune.create_scheduler to docs

* Fix tests

* Fix lint errors

* Update Ax search for master

* Fix metric kwarg for Ax in test_api

* Fix doc build

* Fix HyperOptSearch import in test_api

* Fix HyperOptSearch import in create_searcher

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 09:36:42 -07:00
Kai Yang
f03e91788a
Java doc: "Using Actors" page (#10438) 2020-09-05 23:28:03 +08:00
Richard Liaw
4d4b262069
[docs] Tips for first-time users (copy from blog) (#10578)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-04 21:44:22 -07:00
Kai Yang
6a78ba9752
Java doc: "Starting Ray" page (#10062) 2020-09-05 10:15:52 +08:00
Kai Fricke
2fac66650d
[tune] extend search space api docs (#10576)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 18:39:51 -07:00
Eric Liang
2e5e9b291b
[ray 1.0] Make private a few more things (#10551)
* reomve some more stuff

* no underscore
2020-09-04 17:19:27 -07:00
Edward Oakes
34bda32054
[tune/serve] Fix tune/serve integration script broken by serve API change (#10586) 2020-09-04 17:11:58 -07:00
Simon Mo
40cd572d79
[Doc] Add a section for synchronization primitives in Ray (#10581)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 17:09:15 -07:00
Simon Mo
55b6c19d98
[Serve] Implement ServeHandle refactoring (#10527) 2020-09-04 15:50:56 -07:00
Eric Liang
30911960c8
[1.0] Simple, universal instead of Simple and universal (#10587) 2020-09-04 14:04:29 -07:00
Eric Liang
da83bbd764
[1.0] Move dask scheduler from experimental to util (#10553)
* move dask

* fix dask
2020-09-04 12:16:32 -07:00
Edward Oakes
786f12edfd
[serve] Serve client refactor (#10409) 2020-09-04 12:02:23 -05:00
Justin Terry
352718610d
Multi-agent Algorithm Documentation Updates (#9722) 2020-09-03 22:37:46 -07:00
Kai Fricke
5c3d4a6670
[tune] added MXNet integration callbacks (#10533) 2020-09-03 18:06:44 -07:00
Simon Mo
eff4375c3d
[Serve] Produtionize Starlette Middlewares (#10529) 2020-09-03 17:31:38 -07:00
architkulkarni
0d93e92720
[Serve] Reimplement BackendConfig as pydantic model (#10389) 2020-09-03 19:16:17 -05:00
Richard Liaw
43a7a64b30
[tune] horovod trainable (#10304) 2020-09-03 16:53:35 -07:00
Sumanth Ratna
89bf262130
[tune] Fix lr typo in FAQ (#10548) 2020-09-03 13:37:39 -07:00
Clark Zinzow
0c0b0d0a73
[Core] Added support for submission-time task names. (#10449)
* Added support for submission-time task names.

* Suggestions from code review: add missing consts

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Add num_returns arg to actor method options docstring example.

* Add process name line and proctitle assertion to submission-time task name section of advanced docs.

* Add submission-time task name --> proctitle test for Python worker.

* Added Python actor options tests for num_returns and name.

* Added Java test for submission-time task names.

* Add dashboard image to task name docs section.

* Move to fstrings.

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
2020-09-03 11:45:24 -07:00
krfricke
91535e9102
[tune] Refactored Keras integration callbacks (#10509) 2020-09-03 10:16:08 -07:00
He Kaisheng
2bca5fd663
Add documentation for Mars on Ray (#10468)
* Add documentation for Mars on Ray

* Update mars_on_ray.rst

* refine according to comments

Co-authored-by: hekaisheng <kaisheng.hks@alibaba-inc.com>
Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-09-03 09:07:33 -07:00
krfricke
06af62ba91
[tune] refactor tune search space (#10444)
* Added basic functionality and tests

* Feature parity with old tune search space config

* Convert Optuna search spaces

* Introduced quantized values

* Updated Optuna resolving

* Added HyperOpt search space conversion

* Convert search spaces to AxSearch

* Convert search spaces to BayesOpt

* Added basic functionality and tests

* Feature parity with old tune search space config

* Convert Optuna search spaces

* Introduced quantized values

* Updated Optuna resolving

* Added HyperOpt search space conversion

* Convert search spaces to AxSearch

* Convert search spaces to BayesOpt

* Re-factored samplers into domain classes

* Re-added base classes

* Re-factored into list comprehensions

* Added `from_config` classmethod for config conversion

* Applied suggestions from code review

* Removed truncated normal distribution

* Set search properties in tune.run

* Added test for tune.run search properties

* Move sampler initializers to base classes

* Add tune API sampling test, fixed includes, fixed resampling bug

* Add to API docs

* Fix docs

* Update metric and mode only when set. Set default metric and mode to experiment analysis object.

* Fix experiment analysis tests

* Raise error when delimiter is used in the config keys

* Added randint/qrandint to API docs, added additional check in tune.run

* Fix tests

* Fix linting error

* Applied suggestions from code review. Re-aded tune.function for the time being

* Fix sampling tests

* Fix experiment analysis tests

* Fix tests and linting error

* Removed unnecessary default_config attribute from OptunaSearch

* Revert to set AxSearch default metric

* fix-min-max

* fix

* nits

* Added function check, enhanced loguniform error message

* fix-print

* fix

* fix

* Raise if unresolved values are in config and search space is already set

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-03 09:06:13 -07:00
Ian Rodney
b9633a2b67
[docker] Support multiple node types (#10504) 2020-09-02 18:27:59 -07:00
krfricke
57c4183724
[tune] add xgboost callbacks to integration module (#10502) 2020-09-02 11:16:09 -07:00