Commit graph

2962 commits

Author SHA1 Message Date
Barak Michener
9f9b53e624
Remove superfluous execution of java (#10750) 2020-09-11 19:03:38 -07:00
Ian Rodney
4659e24495
[docker] Revert to rsync & cp instead of file mount for bootstrap config/key (#10734) 2020-09-11 16:56:26 -07:00
Richard Liaw
6662efd74b
[tune/rllib] revert removal of queue-trials (#10744) 2020-09-11 14:13:20 -07:00
Philipp Moritz
a91073d9da
Don't pin boto instead set lower limit on its version (#10711) 2020-09-11 13:22:32 -07:00
Alex Wu
d2778f6fbb
[hotfix] accelerator_types (#10725)
* .

* .
2020-09-11 12:43:43 -07:00
Alex Wu
1ff56765f0
[Autoscaler] Fix utilization calc (#10728) 2020-09-11 12:41:08 -07:00
Ian Rodney
13dc3b59f1
[autoscaler] Fix rsync file mounts (#10721) 2020-09-10 19:44:58 -07:00
Richard Liaw
401195d935
[cli] Remove extra wording + fix travis (#10726) 2020-09-10 19:11:04 -07:00
Eric Liang
cbc52a2a42
Remove colorful from ray core (#10723) 2020-09-10 18:41:59 -07:00
Kai Fricke
7eaf063f29
[tune] wrapper function to pass arbitrary objects through the object store to trainables (#10679) 2020-09-10 17:39:44 -07:00
Ian Rodney
ea6fe0f2a1
[autoscaler] use default value (#10706) 2020-09-10 17:06:56 -07:00
PidgeyBE
9d7be89973
[autoscaler] Fix ingress manifest (#10618) 2020-09-10 18:34:14 -05:00
Barak Michener
c6b1ed7f8f
release process: bump version number to 1.1.0.dev0 everywhere (#10686) 2020-09-10 16:00:21 -07:00
Alex Wu
12261c2a19
[Autoscaler] Cluster sync expand user (#10705)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-10 15:59:24 -07:00
Siyuan (Ryans) Zhuang
fb0ae148e6
Fix typo in ray start output (#10667) 2020-09-10 15:56:23 -07:00
architkulkarni
333f324b88
Run Serve Tests on Windows (#10682) 2020-09-10 15:54:37 -07:00
Richard Liaw
7aa55ca82c
[autoscaler] make commands very explicit on logs (#10713) 2020-09-10 10:47:46 -07:00
Richard Liaw
eb025ea8cb
[autoscaler] Create provider exactly once (#10703)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-10 01:03:52 -07:00
Kai Fricke
67bf396ae7
[tune] wandb log cleaning to use yaml representer (#10680)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-10 00:07:16 -07:00
Max Fitton
3e8164ff8a
[Dashboard] Logical View Actor Class Grouping Details (#10453)
* wip

* wip

* wip

* wip

* Need to track the timestamp actors are created for the dashboard. This adds that functionality back in and deletes unused code

* Add the materialui lab packages to get access to the Alert component and fix up some vulnerabilities with npm audit.

* Finish supporting information on a per-actor-class basis in the logical view, add bug fixes around timestamps and infeasible task names, and add a new warning popup that shows if there are infeasible actors around.

* lint and add seconds annotation to actor lifetime values

* real lint

* remove typo

* Somehow missed something last lint

* Add new comments for actor states

* Add underscores to some private functions

* Add tooltips to the actor states on the logical view

* change test metrics to be aligned with new changes.

* lint

* Remove some unnecessary log lines and catch error that happens when we try to decode data from an unexpected source

* Re-add a function I had removed. It is used in the Java codebase.

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-09-09 10:34:54 -07:00
Richard Liaw
153813936b
[tune] auto infer metrics (#10663)
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-09-09 09:53:47 -07:00
Richard Liaw
3501ea396c
[tune] All examples to use ConcurrencyLimiter (#10662)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-09-09 09:52:15 -07:00
Alex Wu
cd5b99e5e0
[hotfix] redis_password -> _redis_password (#10672) 2020-09-09 09:40:49 -07:00
Kai Yang
afa0216280
Remove the '--include-java' option (#10594) 2020-09-09 17:01:17 +08:00
Hao Chen
d22980a5c3
[Hotfix] fix bug about code_search_path in JobConfig (#10666) 2020-09-09 15:28:45 +08:00
Kai Fricke
d7c7aba99c
[tune] Tune experiment analysis improvements (#10645)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 21:00:52 -07:00
Alex Wu
d9c68fca5c
[Core] Logging improvements (#10625)
* other stuff
:

* lint

* .

* .

* lint

* comment

* lint

* .
2020-09-08 20:58:05 -07:00
Kai Fricke
756a9ea641
[tune] add mode/metric parameters to tune.run (#10627)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 17:06:21 -07:00
Alex Wu
3166693b29
[Core] Fix flaky test_failure (#10632) 2020-09-08 15:47:25 -07:00
Kai Fricke
87c4f36f02
[tune] Added timeout parameter to tune.run(), (#10642) 2020-09-08 15:38:28 -07:00
Amog Kamsetty
415be78cc0
[RaySGD] Simplify Builder Process (#10321)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 15:19:40 -07:00
Kai Fricke
69c1a9dd08
[tune] clean up logs before logging to wandb (#10654)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 14:48:18 -07:00
SangBin Cho
dcb9e03fde
[Placement Group] Atomic Creation using 2 phase protocol part 2. (#10599)
* In progress.

* In Progress

* Basic done.

* Fix build issues.

* Addressed code review.

* Change the confusing test name.

* Fix comments.

* Addressed code review.
2020-09-08 13:11:11 -07:00
Clark Zinzow
36e1f20e9c
Add Dask-Ray scheduler callbacks. (#10519)
Improve Dask-on-Ray documentation.

Move to RayCallback(s) namedtuples, and use top-level CBS tuple as source-of-truth for callback methods.
2020-09-08 13:00:58 -07:00
Simon Mo
fdd3acd492
Promote ray.experimental.queue to ray.util (#10624) 2020-09-08 12:56:53 -07:00
Simon Mo
8d5b8b2956
[Serve] Fix handle args data type issue (#10629) 2020-09-08 12:32:42 -07:00
Richard Liaw
5851e893ee
[tune] More robust resolution/detection of signature (#10365)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-09-08 11:38:16 -07:00
Ian Rodney
39c598bab0
[docker] No Docker CP if File Mount (#10633) 2020-09-08 10:25:24 -07:00
chaokunyang
bbfbc98a41
[Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
fyrestone
d2614d222c
[Doc] Cross language page (#10471) 2020-09-08 16:51:40 +08:00
Kai Yang
ca8792e4ff
[Java] Disable the multi-worker feature by default (#10593) 2020-09-08 13:10:46 +08:00
Richard Liaw
41bf5f3de0
[tune] change trial dir default to include name (#10608) 2020-09-07 19:45:13 -07:00
Edward Oakes
8db1f16f25
[tune] wandb - api_key_file clarification (#10614)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-07 16:31:50 -07:00
Kai Fricke
088f8ebb69
[tune] Add algorithms for search space conversion (#10621) 2020-09-07 13:44:16 -07:00
Richard Liaw
169c3a46de
[k8s] Broken Command Interactivity (#10297)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-07 09:56:41 -07:00
fyrestone
47c1a3c0c0
Fix ray.cross_language.java_function() missing accelerator_type arg (#10620) 2020-09-07 20:50:33 +08:00
Alex Wu
d6a9f0e2e4
[Core] Accelerator type API (#10561) 2020-09-06 20:58:40 -07:00
Alex Wu
a699f6a4d8
[Core] Fix override memory and object_store_memory in decorator (#10563) 2020-09-06 20:56:48 -07:00
Alex Wu
8906c1a59f
[Autoscaler] Demand autoscaler take into account utilized resources (#10464) 2020-09-06 20:54:44 -07:00
Kai Fricke
c5e9bafe15
[tune] Fix flaky test in test_sample (#10602) 2020-09-06 10:29:48 -07:00