Kai Fricke
e7315b0856
[tune] Callbacks for tune runs ( #11001 )
2020-09-27 16:50:07 -07:00
Kai Fricke
508cfa3540
[tune] Support yield and return statements ( #10857 )
...
* Support `yield` and `return` statements in Tune trainable functions
* Support anonymous metric with ``tune.report(value)``
* Raise on invalid return/yield value
* Fix end to end reporter test
2020-09-17 20:18:35 -07:00
Kai Fricke
7eaf063f29
[tune] wrapper function to pass arbitrary objects through the object store to trainables ( #10679 )
2020-09-10 17:39:44 -07:00
Richard Liaw
153813936b
[tune] auto infer metrics ( #10663 )
...
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-09-09 09:53:47 -07:00
Kai Fricke
d7c7aba99c
[tune] Tune experiment analysis improvements ( #10645 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 21:00:52 -07:00
Kai Fricke
088f8ebb69
[tune] Add algorithms for search space conversion ( #10621 )
2020-09-07 13:44:16 -07:00
Richard Liaw
551c597312
[tune] API revamp fix ( #10518 )
2020-09-05 15:34:53 -07:00
Sumanth Ratna
54215ff287
[tune] implement shim instantiation ( #10456 )
...
* Create ray.tune.suggest.create.create_scheduler
* Update __init__.py
* Resolve conflict in __init__.py
* Create ray.tune.schedulers.create.create_scheduler
* Update __init__.py
* Move create_scheduler to tune.schedulers.__init__
* Move create_searcher to tune.suggest.__init__
* Delete tune.suggest.create
* Delete tune.schedulers.create
* Update imports for shim functions in tune.__init__
* Remove shim from tune.suggest.__init__.__all__
* Remove shim from tune.schedulers.__init__.__all__
* Add ShimCreationTest
* Move ShimCreationTest to test_api
* Delete test_shim.py
* Add docstring for ray.tune.create_scheduler
* Add docstring to ray.tune.create_searcher
* Fix typo in ray.tune.create_scheduler docstring
* Fix lint errors in tune.schedulers.__init__
* Fix lint errors in tune.suggest.__init__
* Fix lint errors in tune.suggest.__init__
* Fix lint errors in tune.schedulers.__init__
* Fix imports in test_api
* Fix lint errors in test_api
* Fix kwargs in create_searcher
* Fix kwargs in create_scheduler
* Merge branch 'master' into shim-instantiation
* Update use-case in docs in tune.create_scheduler
* Update use-case in docs in tune.create_searcher
* Remove duplicate pytest run from test_api
* Add check to create_searcher
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
* Add check to create_scheduler
* lint
* Compare types of instances in test_api
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
* Add tune.create_searcher to docs
* Fix doc build
* Fix tests
* Add tune.create_scheduler to docs
* Fix tests
* Fix lint errors
* Update Ax search for master
* Fix metric kwarg for Ax in test_api
* Fix doc build
* Fix HyperOptSearch import in test_api
* Fix HyperOptSearch import in create_searcher
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 09:36:42 -07:00
Kai Fricke
2fac66650d
[tune] extend search space api docs ( #10576 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 18:39:51 -07:00
Kai Fricke
5c3d4a6670
[tune] added MXNet integration callbacks ( #10533 )
2020-09-03 18:06:44 -07:00
Richard Liaw
43a7a64b30
[tune] horovod trainable ( #10304 )
2020-09-03 16:53:35 -07:00
krfricke
91535e9102
[tune] Refactored Keras integration callbacks ( #10509 )
2020-09-03 10:16:08 -07:00
krfricke
06af62ba91
[tune] refactor tune search space ( #10444 )
...
* Added basic functionality and tests
* Feature parity with old tune search space config
* Convert Optuna search spaces
* Introduced quantized values
* Updated Optuna resolving
* Added HyperOpt search space conversion
* Convert search spaces to AxSearch
* Convert search spaces to BayesOpt
* Added basic functionality and tests
* Feature parity with old tune search space config
* Convert Optuna search spaces
* Introduced quantized values
* Updated Optuna resolving
* Added HyperOpt search space conversion
* Convert search spaces to AxSearch
* Convert search spaces to BayesOpt
* Re-factored samplers into domain classes
* Re-added base classes
* Re-factored into list comprehensions
* Added `from_config` classmethod for config conversion
* Applied suggestions from code review
* Removed truncated normal distribution
* Set search properties in tune.run
* Added test for tune.run search properties
* Move sampler initializers to base classes
* Add tune API sampling test, fixed includes, fixed resampling bug
* Add to API docs
* Fix docs
* Update metric and mode only when set. Set default metric and mode to experiment analysis object.
* Fix experiment analysis tests
* Raise error when delimiter is used in the config keys
* Added randint/qrandint to API docs, added additional check in tune.run
* Fix tests
* Fix linting error
* Applied suggestions from code review. Re-aded tune.function for the time being
* Fix sampling tests
* Fix experiment analysis tests
* Fix tests and linting error
* Removed unnecessary default_config attribute from OptunaSearch
* Revert to set AxSearch default metric
* fix-min-max
* fix
* nits
* Added function check, enhanced loguniform error message
* fix-print
* fix
* fix
* Raise if unresolved values are in config and search space is already set
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-03 09:06:13 -07:00
krfricke
57c4183724
[tune] add xgboost callbacks to integration module ( #10502 )
2020-09-02 11:16:09 -07:00
krfricke
f3f698816d
[tune] Added PyTorch Lightning callbacks to integrations ( #10220 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-31 15:30:48 -07:00
krfricke
5a787a8253
[tune] added FAQ to docs ( #10222 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-24 21:51:02 -07:00
krfricke
16486a8df3
[tune] Add OptunaSearcher wrapper around Optuna samplers ( #10044 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-12 16:13:22 -07:00
krfricke
0ef8224446
[tune] PBT replay utility scheduler ( #9953 )
...
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-07 12:41:49 -07:00
Richard Liaw
c6404e8cf6
[tune] Search alg checkpointing during training ( #9803 )
...
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-08-03 15:07:31 -07:00
Richard Liaw
0c3b9ebeef
[tune/sgd] Document func_trainable and add checkpoint context ( #9739 )
...
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-07-30 09:46:37 -07:00
Amog Kamsetty
03709d67cb
[Tune Docs] Logging doc fix ( #9691 )
2020-07-24 11:20:52 -07:00
Richard Liaw
a49eb1d168
[tune] survey ( #9670 )
2020-07-24 11:08:05 -07:00
Richard Liaw
a567f7977c
[tune] Put examples under proper version control ( #9427 )
...
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-07-13 18:01:10 -07:00
Richard Liaw
139d21e068
[tune] Docs for tune-sklearn ( #9129 )
...
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-07-06 15:35:10 -07:00
Richard Liaw
b71c912da7
[tune] Fix up examples ( #9201 )
2020-07-05 01:16:20 -07:00
Richard Liaw
d35f0e40d0
[tune] Use public methods for trainable ( #9184 )
2020-07-01 11:00:00 -07:00
ElektroChan89
4bc1d7c043
[docs] Update grid_random.rst ( #9102 )
2020-06-24 12:36:42 -07:00
goulou
9b4428c668
[ASHA][docs] Change default value of "brackets" ( #9101 )
...
Closes #9058
2020-06-23 14:43:27 -07:00
Richard Liaw
6c49c01837
[tune] Function API checkpointing ( #8471 )
...
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-06-15 10:42:54 -07:00
Richard Liaw
b6c4f45ae0
[tune] Fix links ( #8477 )
2020-05-18 10:08:29 -07:00
Richard Liaw
87cbf2aedd
[docs][tune] Make search algorithm, scheduler docs better! ( #8179 )
2020-05-17 12:19:44 -07:00
Richard Liaw
67c01455fe
[tune] tune.track -> tune.report ( #8388 )
2020-05-16 12:55:08 -07:00
Richard Liaw
be5235d982
[tune] Clarify Intro Tune Documentation ( #8201 )
2020-04-27 18:01:00 -07:00
Richard Liaw
87557a00fa
[tune] Refactor search algorithms ( #7037 )
...
* start refactoring of search algorithms
* format
* needs tests
* fix
* suggestions
* Fix PBT
* lint
* refactoring
* hyperopt_working
* dragonfly
* hyperopt
* change_half_of_algs
* save
* code-removed
* remove_lots_of_unneccessary
* changes
* formatting
* suggest
* reset
* rm
* tests
* search-change
* exception
* refactor-doc
* search
* py
* moredocs
* Update doc/source/tune-searchalg.rst
* concurrency
* max
* tune
* betterwarning
* bohb
* tests
* test-change
Co-authored-by: ujvl <misraujval@gmail.com>
2020-04-27 08:51:13 -07:00
Richard Liaw
b506f87117
[tune] New Doc edits, add Concepts page ( #8083 )
...
Co-Authored-By: Sven Mika <sven@anyscale.io>
2020-04-25 18:25:56 -07:00
Richard Liaw
4d8bf5635d
[hotfix] Lint formatting for new Tune optimizer ZOOpt ( #8040 )
...
* formatting
* removedill
* lint
2020-04-16 09:24:30 -07:00
Richard Liaw
a67edc4051
[tune] Improve user guides and API docs ( #7716 )
...
* create guide gallery for Tune
* mods
* ok
* fix
* fix_up_gallery
* ok
* Apply suggestions from code review
Co-Authored-By: Sven Mika <sven@anyscale.io>
* Apply suggestions from code review
Co-Authored-By: Sven Mika <sven@anyscale.io>
Co-authored-by: Sven Mika <sven@anyscale.io>
2020-04-06 12:16:35 -07:00
Richard Liaw
e311013afd
[tune] Reformat Sections of API Reference ( #7706 )
...
* moveit
* moveit
* docstrings to ref
* Update tune-usage.rst
Co-authored-by: Sven Mika <sven@anyscale.io>
2020-03-23 12:23:21 -07:00
