Commit graph

1109 commits

Author SHA1 Message Date
Ameer Haj Ali
0d36e4c025
[autoscaler] Support min_workers for multi node type (#11041)
* prepare for head node

* move command runner interface outside _private

* remove space

* Eric

* flake

* min_workers in multi node type

* fixing edge cases

* eric not idle

* fix target_workers to consider min_workers of node types

* idle timeout

* minor

* minor fix

* test

* lint

* eric v2

* eric 3

* min_workers constraint before bin packing

* Update resource_demand_scheduler.py

* Revert "Update resource_demand_scheduler.py"

This reverts commit 818a63a2c86d8437b3ef21c5035d701c1d1127b5.

* reducing diff

Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
Co-authored-by: Alex Wu <alex@anyscale.io>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-28 22:02:01 -07:00
Kai Fricke
e7315b0856
[tune] Callbacks for tune runs (#11001) 2020-09-27 16:50:07 -07:00
Christian Kasim Loan
4285bee517
[Doc] Added John Snow Lab's NLU reference to community integration page (#10985)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-27 13:07:12 -07:00
SangBin Cho
109481afd9
[Metric] custom metrics refinement (#10861)
* In progress

* In Progress.

* Addressed code review.

* Add unit tests.

* Add a simple doc.

* Fixed test failure.

* Fix all test failures from serve.

* Addressed code review.
2020-09-25 09:10:28 -07:00
Eric Liang
609c1b8acd
Start moving ray internal files to _private module (#10994) 2020-09-24 22:46:35 -07:00
Richard Liaw
a563344bc2
[docs] remove ref to google groups -> github discussions (#11019) 2020-09-24 18:09:51 -07:00
Kai Fricke
d9c4dea7cf
[tune] strict metric checking (#10972) 2020-09-24 10:00:48 -07:00
SangBin Cho
5e6b887f2d
[Placement Group] Capture Child Task Part 1 (#10968)
* In progress.

* In progers.

* Done.

* Addressed code review.

* Increase timeout to make a test less flaky.

* Addressed code review.

* Addressed code review.
2020-09-24 09:02:03 -07:00
Amog Kamsetty
f42ab54112
[Docs] [Tune] Fix Tune Quick Start docs (#10996) 2020-09-24 00:28:01 -07:00
Ian Rodney
4c3f09094a
[docs] redis-port -> port (#10937) 2020-09-23 17:04:13 -07:00
SangBin Cho
cebab8886e
[Placement group] Refine doc (#10922) 2020-09-23 16:26:32 -07:00
Lee moon soo
df4c3abe30
[autoscaler] Staroid node provider (#10956) 2020-09-22 21:25:29 -07:00
Simon Mo
7fbe076813
[Serve] Unwrap Flask Request from ServeHandle (#10845) 2020-09-22 12:44:23 -07:00
Simon Mo
970fc37173
[Serve] Update architecture.svg (#10754) 2020-09-22 12:43:02 -07:00
Simon Mo
3c1a7c2954
[Doc][Serve] Update middleware docs for serve.client (#10819) 2020-09-22 11:03:32 -07:00
SangBin Cho
e3b4850224
[Placement group] Release test (#10924)
* Done.

* Lint.

* Addressed code review.
2020-09-22 00:49:04 -07:00
Kai Fricke
50d63b8077
[tune] update pt tutorial docs (#10925)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-21 13:33:37 -07:00
Richard Liaw
b0ca70f628
[tune+core] tune lifecycle and starting ray guide (#10813) 2020-09-21 11:27:50 -07:00
Sven Mika
805dad3bc4
[RLlib] SAC algo cleanup. (#10825) 2020-09-20 11:27:02 +02:00
Sumanth Ratna
d3fa39efd6
[docs] fix version flyout menu z-index (#10892) 2020-09-19 13:30:35 -07:00
Carlos Aguayo
86b1814e62
Update rllib-env.rst (#10891)
Tiny typo
2020-09-19 00:29:56 -07:00
rkube
cd7351f6a3
Streamlined slurm script and removed references to redis_password (#10827)
Co-authored-by: Ralph Kube <ralph.kube@uit.not>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-18 14:55:56 -07:00
Richard Liaw
41d7221dcd
fix (#10876) 2020-09-17 23:17:39 -07:00
Kai Fricke
508cfa3540
[tune] Support yield and return statements (#10857)
* Support `yield` and `return` statements in Tune trainable functions

* Support anonymous metric with ``tune.report(value)``

* Raise on invalid return/yield value

* Fix end to end reporter test
2020-09-17 20:18:35 -07:00
SangBin Cho
fedbdd5dc6
[Doc] Broken doc build fix. (#10865) 2020-09-17 13:27:30 -07:00
Benjamin Black
f2408b719c
Fixed PettingZooEnv (#10847) 2020-09-17 11:28:42 -07:00
Keqiu Hu
8a77cf925a
[cli][ray] update ray cli message (#10823) 2020-09-17 09:26:55 -07:00
Eric Liang
89da3f9ba7
[docs] Add RayDP link to community integrations (#10851) 2020-09-17 01:21:12 -07:00
Sumanth Ratna
77c3414bc2
[docs] fix book icon in version flyout menu (#10844)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 19:41:14 -07:00
Richard Liaw
829a2307df
[docs] raise z-index block (#10843)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Sumanth Ratna <sumanthratna@gmail.com>
2020-09-16 17:16:50 -07:00
SangBin Cho
1fdb7ef6c3
[docs] Placement group documentation (#10555)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 16:07:55 -07:00
SangBin Cho
d7d4e1c87b
[Doc] Document options method (#10830)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 14:23:24 -07:00
Kai Fricke
c9fafe7733
[tune] added type hints (#10806)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-15 21:03:56 -07:00
Kai Yang
da1d171c39
Java doc: "Configuring Ray" page (#10801) 2020-09-16 11:43:16 +08:00
Eric Liang
0d9d34a3c1
[docs] Sort library list alphabetically and add experimental note to Dask (#10815)
* sort

* update

* update
2020-09-15 17:26:09 -07:00
Richard Liaw
8d6fee14c7
[fix] Cite sources for example (#10798) 2020-09-15 14:37:40 -07:00
Eric Liang
3ec5fa1b51
[docs] Rename oss-users to ray-libraries (#10811) 2020-09-15 13:11:00 -07:00
architkulkarni
940f02913a
[Docs] update docs readme and fix typo (#10807) 2020-09-15 12:51:18 -07:00
Amog Kamsetty
d5a7c53908
[Ray SGD] use_local flag + Worker group abstraction (#10539)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-15 11:58:57 -07:00
Richard Liaw
1a4023387d
[docs] slurm + progress_bar example (#10782) 2020-09-15 00:16:36 -07:00
Eric Liang
72b28dc12b
[docs] Fix broken links in new community libraries page ++ (#10785)
* fix

* fix up

* update

* revert

* typo

* update
2020-09-14 21:18:28 -07:00
Ameer Haj Ali
6edacb22b8
Fix abstraction violations in command_runner interface (#10715)
* Fix abstraction violations in command_runner interface

* user guide

* lint

* breaking abstraction in commands

* extra initialization commands

* more cleanup

* small fixes

* fix test_integration_kubernetes.py

* lint

Co-authored-by: root <root@ip-172-31-28-155.us-west-2.compute.internal>
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
2020-09-14 20:28:38 -07:00
Hao Chen
1a5cfe0b79
[Java] rename config ray.redis.address to ray.address (#10772) 2020-09-15 11:13:19 +08:00
Eric Liang
daabe6bb1f
[docs] Polish community integrations docs (#10780) 2020-09-14 14:41:06 -07:00
Max Fitton
017737b82b
[Documentation] local_mode doc updates and actor / worker explanation from Slack (#10748)
* wip

* Update local mode docs in all locations

* Update doc/source/actors.rst

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Update doc/source/actors.rst

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Change duplicated text to links to a subtitle for local_mode

* change a reference to be explicit

* Apply suggestions from code review

Co-authored-by: Max Fitton <max@semprehealth.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-14 13:19:38 -07:00
Richard Liaw
020a105476
[docs] init list of oss projects (#10758) 2020-09-14 12:11:05 -07:00
Ian Rodney
5bc2ba38fd
[docker] Detect CPUs in container correctly (#10507)
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-13 23:40:48 -07:00
Alex Wu
d0b73647b4
[Autoscaler] Unmanaged nodes (#10513) 2020-09-13 11:58:47 -07:00
Simon Mo
9e8e34240f
[Doc] Add section for threaded actor (#10751) 2020-09-11 16:34:10 -07:00
Eric Liang
3eed3eca09
Move meta-learning algorithms into their own section in the TOC (#10727) 2020-09-11 12:26:16 -07:00