chaokunyang
bbfbc98a41
[Core] Allow users to specify the classpath and import path ( #10560 )
...
* move job resource path to job config
* job resource path support list
* job resource path support for python
* fix job_resource_path support
* fix worker command
* fix job config
* use jar file instead of parent path
* fix job resource path
* add test to test.sh
* lint
* Update java/runtime/src/main/resources/ray.default.conf
Co-authored-by: Kai Yang <kfstorm@outlook.com>
* fix testGetFunctionFromLocalResource
* lint
* fix rebase
* add jars in resource path to classloader
* add job_resource_path to worker
* add ray stop
* rename job_resource_path to resource_path
* fix resource_path
* refine resource_path comments
* rename job resource path to code search path
* Add instruction about starting a cross-language cluster
* fix ClassLoaderTest.java
* add code-search-path to RunManager
* refine comments for code-search-path
* rename resourcePath to codeSearchPath
* Update doc
* fix
* rename resourcePath to codeSearchPath
* update doc
* filter out empty path
* fix comments
* fix comments
* fix tests
* revert pom
* lint
* fix doc
* update doc
* Apply suggestions from code review
* lint
Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
fyrestone
d2614d222c
[Doc] Cross language page ( #10471 )
2020-09-08 16:51:40 +08:00
Kai Yang
ca8792e4ff
[Java] Disable the multi-worker feature by default ( #10593 )
2020-09-08 13:10:46 +08:00
Richard Liaw
41bf5f3de0
[tune] change trial dir default to include name ( #10608 )
2020-09-07 19:45:13 -07:00
Edward Oakes
8db1f16f25
[tune] wandb - api_key_file clarification ( #10614 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-07 16:31:50 -07:00
Kai Fricke
088f8ebb69
[tune] Add algorithms for search space conversion ( #10621 )
2020-09-07 13:44:16 -07:00
Richard Liaw
169c3a46de
[k8s] Broken Command Interactivity ( #10297 )
...
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-07 09:56:41 -07:00
fyrestone
47c1a3c0c0
Fix ray.cross_language.java_function() missing accelerator_type arg ( #10620 )
2020-09-07 20:50:33 +08:00
Alex Wu
d6a9f0e2e4
[Core] Accelerator type API ( #10561 )
2020-09-06 20:58:40 -07:00
Alex Wu
a699f6a4d8
[Core] Fix override memory and object_store_memory in decorator ( #10563 )
2020-09-06 20:56:48 -07:00
Alex Wu
8906c1a59f
[Autoscaler] Demand autoscaler take into account utilized resources ( #10464 )
2020-09-06 20:54:44 -07:00
Kai Fricke
c5e9bafe15
[tune] Fix flaky test in test_sample ( #10602 )
2020-09-06 10:29:48 -07:00
Maksim Smolin
f38dba09b2
[cli] Support non-interactive logging ( #10203 )
...
* add non-interactive logging
* logger
* add formatter support, add flag
* checkpoint
* format
* fix-interactive
* fixup
* fomrmat
* fix
* revert
* fix
* fix
* fix
* fix
* fx
* fix-test
* fix-commands
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 15:41:35 -07:00
Richard Liaw
551c597312
[tune] API revamp fix ( #10518 )
2020-09-05 15:34:53 -07:00
Stephanie Wang
4f02ad4ef9
[core] Disable GCS reconnect ( #10579 )
...
* Set default GCS retries to 1
* Fix cc test
2020-09-05 13:14:07 -07:00
Sumanth Ratna
54215ff287
[tune] implement shim instantiation ( #10456 )
...
* Create ray.tune.suggest.create.create_scheduler
* Update __init__.py
* Resolve conflict in __init__.py
* Create ray.tune.schedulers.create.create_scheduler
* Update __init__.py
* Move create_scheduler to tune.schedulers.__init__
* Move create_searcher to tune.suggest.__init__
* Delete tune.suggest.create
* Delete tune.schedulers.create
* Update imports for shim functions in tune.__init__
* Remove shim from tune.suggest.__init__.__all__
* Remove shim from tune.schedulers.__init__.__all__
* Add ShimCreationTest
* Move ShimCreationTest to test_api
* Delete test_shim.py
* Add docstring for ray.tune.create_scheduler
* Add docstring to ray.tune.create_searcher
* Fix typo in ray.tune.create_scheduler docstring
* Fix lint errors in tune.schedulers.__init__
* Fix lint errors in tune.suggest.__init__
* Fix lint errors in tune.suggest.__init__
* Fix lint errors in tune.schedulers.__init__
* Fix imports in test_api
* Fix lint errors in test_api
* Fix kwargs in create_searcher
* Fix kwargs in create_scheduler
* Merge branch 'master' into shim-instantiation
* Update use-case in docs in tune.create_scheduler
* Update use-case in docs in tune.create_searcher
* Remove duplicate pytest run from test_api
* Add check to create_searcher
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
* Add check to create_scheduler
* lint
* Compare types of instances in test_api
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
* Add tune.create_searcher to docs
* Fix doc build
* Fix tests
* Add tune.create_scheduler to docs
* Fix tests
* Fix lint errors
* Update Ax search for master
* Fix metric kwarg for Ax in test_api
* Fix doc build
* Fix HyperOptSearch import in test_api
* Fix HyperOptSearch import in create_searcher
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 09:36:42 -07:00
Max Fitton
31f8ce4768
[Dashboard] Plasma Memory Usage in Machine View ( #10552 )
...
* wip
* lint
* more lint
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-09-05 00:34:26 -07:00
Eric Liang
8ee7c182f5
[1.0] move placement groups from experimental to util. Note they are still undocumented. ( #10554 )
...
* move files
* Update __init__.py
* remove
* Update __init__.py
2020-09-04 19:01:24 -07:00
Richard Liaw
4b3b46e09f
[docs] Tips for testing Ray applications ( #10583 )
2020-09-04 18:40:48 -07:00
Kai Fricke
2fac66650d
[tune] extend search space api docs ( #10576 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 18:39:51 -07:00
architkulkarni
c4c0857107
[Serve] Parametrize tests for pydantic backend ( #10559 )
2020-09-04 17:24:24 -07:00
Eric Liang
2e5e9b291b
[ray 1.0] Make private a few more things ( #10551 )
...
* reomve some more stuff
* no underscore
2020-09-04 17:19:27 -07:00
Simon Mo
55b6c19d98
[Serve] Implement ServeHandle refactoring ( #10527 )
2020-09-04 15:50:56 -07:00
Kai Fricke
6b6780a108
[tune] Allow trials to remain paused in BOHB ( #10531 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 15:29:33 -07:00
Eric Liang
da83bbd764
[1.0] Move dask scheduler from experimental to util ( #10553 )
...
* move dask
* fix dask
2020-09-04 12:16:32 -07:00
Edward Oakes
b1bd58581b
Print "Connecting to existing cluster" message to stderr instead of stdout ( #10575 )
2020-09-04 12:51:59 -05:00
Maksim Smolin
02efa2549d
[cli] Fix colors on light themes ( #10577 )
2020-09-04 10:45:27 -07:00
Edward Oakes
786f12edfd
[serve] Serve client refactor ( #10409 )
2020-09-04 12:02:23 -05:00
Kai Fricke
2e49e22f21
[tune] Add test_sample to bazel BUILD ( #10566 )
2020-09-04 09:09:02 -07:00
Kai Yang
5f5160ead9
[Core] Multi-tenancy: Worker capping ( #10500 )
2020-09-04 20:34:06 +08:00
PidgeyBE
51df0820de
[autoscaler] Fix ingress manifest bug ( #10536 )
2020-09-04 01:09:16 -05:00
Kai Fricke
5c3d4a6670
[tune] added MXNet integration callbacks ( #10533 )
2020-09-03 18:06:44 -07:00
Edward Oakes
ead30ca655
[Core] fix named actor bug ( #10550 )
2020-09-03 17:48:31 -07:00
Simon Mo
94374e1dd9
[Serve] Add Latency and Queue Size Metrics ( #10535 )
2020-09-03 17:33:37 -07:00
Simon Mo
eff4375c3d
[Serve] Produtionize Starlette Middlewares ( #10529 )
2020-09-03 17:31:38 -07:00
architkulkarni
0d93e92720
[Serve] Reimplement BackendConfig as pydantic model ( #10389 )
2020-09-03 19:16:17 -05:00
Richard Liaw
43a7a64b30
[tune] horovod trainable ( #10304 )
2020-09-03 16:53:35 -07:00
Clark Zinzow
7068c63dd8
Set Ray task name to Dask key for Dask tasks. ( #10547 )
2020-09-03 15:37:55 -07:00
Ian Rodney
c54853d45b
[Autoscaler] Actually try to catch when docker does not exist ( #10549 )
2020-09-03 14:00:06 -07:00
Ian Rodney
a13c83d7f0
Add WorkerCrashedError to cancel docs ( #10534 )
2020-09-03 13:23:04 -07:00
Clark Zinzow
0c0b0d0a73
[Core] Added support for submission-time task names. ( #10449 )
...
* Added support for submission-time task names.
* Suggestions from code review: add missing consts
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
* Add num_returns arg to actor method options docstring example.
* Add process name line and proctitle assertion to submission-time task name section of advanced docs.
* Add submission-time task name --> proctitle test for Python worker.
* Added Python actor options tests for num_returns and name.
* Added Java test for submission-time task names.
* Add dashboard image to task name docs section.
* Move to fstrings.
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
2020-09-03 11:45:24 -07:00
Edward Oakes
71274954d1
Remove unnecessary output when connecting to a cluster. ( #10512 )
2020-09-03 13:30:33 -05:00
Edward Oakes
e4d80e1b0f
fix passing sys config to start ( #10514 )
2020-09-03 11:18:21 -07:00
krfricke
91535e9102
[tune] Refactored Keras integration callbacks ( #10509 )
2020-09-03 10:16:08 -07:00
krfricke
06af62ba91
[tune] refactor tune search space ( #10444 )
...
* Added basic functionality and tests
* Feature parity with old tune search space config
* Convert Optuna search spaces
* Introduced quantized values
* Updated Optuna resolving
* Added HyperOpt search space conversion
* Convert search spaces to AxSearch
* Convert search spaces to BayesOpt
* Added basic functionality and tests
* Feature parity with old tune search space config
* Convert Optuna search spaces
* Introduced quantized values
* Updated Optuna resolving
* Added HyperOpt search space conversion
* Convert search spaces to AxSearch
* Convert search spaces to BayesOpt
* Re-factored samplers into domain classes
* Re-added base classes
* Re-factored into list comprehensions
* Added `from_config` classmethod for config conversion
* Applied suggestions from code review
* Removed truncated normal distribution
* Set search properties in tune.run
* Added test for tune.run search properties
* Move sampler initializers to base classes
* Add tune API sampling test, fixed includes, fixed resampling bug
* Add to API docs
* Fix docs
* Update metric and mode only when set. Set default metric and mode to experiment analysis object.
* Fix experiment analysis tests
* Raise error when delimiter is used in the config keys
* Added randint/qrandint to API docs, added additional check in tune.run
* Fix tests
* Fix linting error
* Applied suggestions from code review. Re-aded tune.function for the time being
* Fix sampling tests
* Fix experiment analysis tests
* Fix tests and linting error
* Removed unnecessary default_config attribute from OptunaSearch
* Revert to set AxSearch default metric
* fix-min-max
* fix
* nits
* Added function check, enhanced loguniform error message
* fix-print
* fix
* fix
* Raise if unresolved values are in config and search space is already set
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-03 09:06:13 -07:00
chaokunyang
ea95e6f7cc
[Java] lint java code ( #10494 )
2020-09-03 10:39:14 +08:00
Ian Rodney
b9633a2b67
[docker] Support multiple node types ( #10504 )
2020-09-02 18:27:59 -07:00
SangBin Cho
dc7fe1a4c5
[Placement Group] Atomic Placement Group Part 1, Basic Structure. ( #10482 )
...
* Write a test.
* Basic structure done.
* Reduce flakiness of tests.
* Addressed code review.
* Skipping tests because it is flaky for now.
* Fix linting issues.
* Increase sleep time to see lint messages.
* Lint issue fixed.
2020-09-02 18:14:46 -07:00
Ian Rodney
4324dd5929
[docker] Refactor "autoscaler" image into "-autoscaler" tag and "ray-ml" image. ( #10351 )
2020-09-02 13:03:35 -07:00
krfricke
57c4183724
[tune] add xgboost callbacks to integration module ( #10502 )
2020-09-02 11:16:09 -07:00
