Commit graph

7339 commits

Author SHA1 Message Date
Tao Wang
6af0291347
[Core]Pull off timers out of heartbeat in raylet (#13963) 2021-02-24 11:59:13 +08:00
Amog Kamsetty
739f653983
[Tune] WandbLoggerCallback compatibility with Ray Client (#14280) 2021-02-23 18:31:19 -08:00
fyrestone
5e76a51d56
[Dashboard] Select port in dashboard (#13763)
* Dashboard select port; Fix dashboard may hangs when exit

* Add test case

* Fix

* Fix test_stats_collector.py::test_get_all_node_details

* Refine dashboard error messages

* Refine code

* Refine code

* Show last 10 lines of dashboard log if start dashboard failed

* Fix ValueError: too many values to unpack (expected 2) when getsockname

* Fix test_multi_node_3.py::test_calling_start_ray_head may fail

* Fix Windows CI

* Disable dashboard in C++ test

* Refine code

* Fix issue 7084

Co-authored-by: 刘宝 <po.lb@antfin.com>
2021-02-23 16:27:48 -08:00
SangBin Cho
b7c56b8a71
[Core] Improve the server startup error message. (#14267)
* Improve the error message further.

* fix comment.

* Fix comment 2.

* improve messages to be even more high level.

* Address code review.
2021-02-23 16:26:06 -08:00
DK.Pino
911b028c54
[Placement Group] Make the creation of placement group sync (#13858)
* make pg creation sync

* return successful immediately when pg registeration

* hold on

* fix ut

* make collection for callback

* make pg registration vector

* fix new cpp ut

* fix named py ut

* fix python ut bug

* fix python ut

* fix lint

* modify comment

* fix comment

* fix comment

* add new ut and fix old lint issue

* fix comment

* update comment

* fix conflict
2021-02-23 16:11:43 -08:00
Alex Wu
fe8a500e98
[Monitor] Log some diagnosis information on startup (#14287)
* .

* done?

* .

* .

Co-authored-by: Alex Wu <alex@anyscale.com>
2021-02-23 14:30:27 -08:00
Alex Wu
96fe6481ec
[autoscaler] fix summary when tags and instance creation aren't atomic (#14286)
* .

* done?

* .

Co-authored-by: Alex Wu <alex@anyscale.com>
2021-02-23 13:56:11 -08:00
Clark Zinzow
d344e77109
Revert "Revert "Inline small objects in GetObjectStatus response. (#13309)" (#13615)" (#13618)
This reverts commit 20acc3b05e.
2021-02-23 12:06:37 -08:00
SangBin Cho
be68a78b3f
[Object Spilling] Support multiple directories for spilling. (#14240)
* Finish the initial implementation.

* Improve the doc.

* Addressed comment.

* lint.

* f
2021-02-23 11:51:57 -08:00
Richard Liaw
acd2b202b3
[tune] fix pbt test (#14281)
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2021-02-23 11:48:09 -08:00
Clark Zinzow
488ba5e1fa
[Core] Start the non-primary Redis shard port range at a high random port. (#14266) 2021-02-23 11:00:31 -08:00
SangBin Cho
77fdc274eb
[LogMonitor] Add assertion on os.kill type (#14271) 2021-02-23 10:57:09 -08:00
Simon Mo
f7232f23e1
[Tune] Fix test_convergence_gaussian_process in Buildkite (#14263) 2021-02-23 10:41:40 -08:00
Simon Mo
dfd5eb4b0d
[Core] fix gcs use-after-free from ASAN (#14199) 2021-02-23 10:37:31 -08:00
Simon Mo
ed12114d70
[Buildkite] Fix java and lint failure (#14259) 2021-02-23 10:33:45 -08:00
Kai Fricke
757866ec01
[tune] enable placement groups per default (#13906)
* Refactor placement group factory object to accept placement_group arguments instead of callables

* Convert resources to pgf

* Enable placement groups per default

* Fix tests WIP

* Fix stop/resume with placement groups

* Fix progress reporter test

* Fix trial executor tests

* Check resource for trial, not resource object

* Move ENV vars into class

* Fix tests

* Sphinx

* Wait for trial start in PBT

* Revert merge errors

* Support trial reuse with placement groups

* Better check for just staged trials

* Fix trial queuing

* Wait for pg after trial termination

* Clean up PGs before tune run

* No PG settings in pbt scheduler

* Fix buffering tests

* Skip test if ray reports erroneous available resources

* Disable PG for cluster resource counting test

* Debug output for tests

* Output in-use resources for placement groups

* Don't start new trial on trial start failure

* Add docs

* Cleanup PGs once futures returned

* Fix placement group shutdown

* Use updated_queue flag

* Apply suggestions from code review

* Apply suggestions from code review

* Update docs

* Reuse placement groups independently from actors

* Do not remove placement groups for paused trials

* Only continue enqueueing trials if it didn't fail the first time

* Rename parameter

* Fix pause trial

* Code review + try_recover

* Update python/ray/tune/utils/placement_groups.py

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Move placement group lifecycle management

* Move total used resources to pg manager

* Update FAQ example

* Requeue trial if start was unsuccessful

* Do not cleanup pgs at start of run

* Revert "Do not cleanup pgs at start of run"

This reverts commit 933d9c4c

* Delayed PG removal

* Fix trial requeue test

* Trigger pg cleanup on status update

* Fix tests

* Fix docs

* fix-test

Signed-off-by: Richard Liaw <rliaw@berkeley.edu>

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-02-23 18:46:02 +01:00
Eric Liang
5107eabe1b
update (#14274) 2021-02-23 18:38:06 +02:00
javi-redondo
0408fe6a69
Small improvements to the Ray Cluster docs (#14241)
* Small improvements to the Ray Cluster docs

* Update quickstart.rst

Changed title for quick start

Co-authored-by: Javier Redondo <javier@Anyscale-MacBook-Pro.local>
2021-02-23 13:44:28 +02:00
ZhuSenlin
8be107196d
fix retry leasing worker (#14272) 2021-02-23 19:38:40 +08:00
Clark Zinzow
5ce9b93f47
[Core] Ownership-based Object Directory - Enabled by default (#14254) 2021-02-22 22:09:41 -08:00
Alex Wu
79653049d2
[core] Start less worker processes (#14202) 2021-02-22 22:01:38 -08:00
Farzan Taj
cf1bc66fb1
[logging] Don't try to kill autoscaler during log monitor cleanup (#14261) 2021-02-22 21:05:04 -08:00
ZhuSenlin
8e0b2d07f4
[Core] synchronize job config to worker when it registers to raylet (#13402) 2021-02-23 11:48:54 +08:00
Kai Fricke
fcd0dee581
[cli] Add ray cluster-dump CLI command to fetch logs (#14212)
* Add `ray get-logs` CLI command to fetch logs and state from nodes in a cluster

* Add dataclasses for py < 3.7

* Remove dataclasses dependency in setup.py

* Rename command, print what is collected

* Remove dataclass dependency

* Typo

* Lint

* Apply suggestions fom code review
2021-02-22 19:38:33 -08:00
Ian Rodney
54ab6d2801
set additional_properties to false (#14244) 2021-02-23 00:58:31 +02:00
dependabot[bot]
49c901e33d
[tune](deps): Bump wandb from 0.10.12 to 0.10.19 in /python/requirements (#14224)
Bumps [wandb](https://github.com/wandb/client) from 0.10.12 to 0.10.19.
- [Release notes](https://github.com/wandb/client/releases)
- [Changelog](https://github.com/wandb/client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/wandb/client/compare/v0.10.12...v0.10.19)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-02-22 14:54:09 -08:00
Simon Mo
f6a8a9be59
[Serve] Add RLlib tutorial (#14194) 2021-02-22 13:23:12 -08:00
Ameer Haj Ali
da6dbb0bfc
node_ip changes while sorting the node ips based on last used (#14234) 2021-02-22 12:30:24 -08:00
Clark Zinzow
708fb6b061
[Core - Autoscaler] Upon autoscaler failure, propagate error message to all current and future drivers (#14219) 2021-02-22 12:25:42 -08:00
Kathryn Zhou
d6521be7ef
Export GPU metrics, CPU count, and additional Memory metrics to Prometheus (#14170) 2021-02-22 10:04:18 -08:00
Michael Luo
ec2c10309b
[RLlib] CQL for HalfCheetah-Random-v0 + Hopper-Random-v0 + CQL Bug Fixes (#14243) 2021-02-22 17:30:18 +01:00
Sven Mika
95ef04b71a
[RLlib] Implement TorchPolicy.export_model. (#13989) 2021-02-22 17:09:40 +01:00
Antoni Baum
ffbba8e699
[Tune] Batch suggestions for HEBO (#14246)
* Batch suggestions for HEBO

* Better documentation
2021-02-22 14:24:37 +01:00
DK.Pino
7647d60fa9
[Placement Group] Support named placement group java api & Refactor construct method (#13821) 2021-02-22 20:12:09 +08:00
Sven Mika
3d20d58c90
[RLlib] Tune trial + checkpoint selection example. (#14209) 2021-02-22 12:52:37 +01:00
SangBin Cho
de8d9d3e44
[Test] Skip test_load_balancing_under_constrained_memory on Windows (#14242)
* Skip the window test.

* Remove unrelated changes.

* Remove unrelated changes.
2021-02-21 23:32:48 -08:00
Kai Yang
e75b143faf
[Core] Some small fixes and improvements (#14210) 2021-02-22 12:02:30 +08:00
Ryan Sander
8b5310a4e6
Fixed "multit-threaded" --> "multi-threaded" (#14236) 2021-02-21 19:25:51 -08:00
Dmitri Gekhtman
090970bdf5
[autoscaler] Max worker default infinity (#14201)
* random doc typo

* max-worker-default-inf

* fix

* -1 means infinity

* doc

* comment tweak

* fix random typo

* Cluster max-worker default

* fix

* typo

* test

* Git add the test

* doc-tweak

* rest of the test logistics

* periods in doc

* Address comments

* docstring
2021-02-22 05:14:00 +02:00
Richard Liaw
9eb79727aa
[tune] Support extending BOHB/Hyperband runs past max_t (#14171)
* initial-commit-to-support

Signed-off-by: Richard Liaw <rliaw@berkeley.edu>

* basic-test

Signed-off-by: Richard Liaw <rliaw@berkeley.edu>

* ok

Signed-off-by: Richard Liaw <rliaw@berkeley.edu>

* smoke-test

Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2021-02-20 14:28:59 -08:00
Kai Yang
d8c32be449
[Core] Simplify system config passing from Raylet to workers (#13860) 2021-02-20 20:20:13 +08:00
Stephanie Wang
a4d7792c0e
[core] Fix bugs in admission control again (#14222)
* Track which pull bundle requests are ready to run

* Regression test

* Reset retry timer on pull activation, don't count created objects towards memory usage, abort objects on pull deactivation

* Revert "Track which pull bundle requests are ready to run"

This reverts commit b5d0714783fa2fc842bdd4e2d2802228e25f03c2.

* Check object active before receiving chunk

* lint

* debug, unit test, fix race condition

* lint

* update

* lint

* fix

* fix build

* fix test

* remove print

* Fix bug in bytes accounting

* Split
2021-02-19 18:07:57 -08:00
SangBin Cho
5fcbf02bae
Fix. (#14218) 2021-02-19 18:06:34 -08:00
Qing Wang
b4f1cb86d3
[Java] Make options.resources copyable. (#14207) 2021-02-20 10:00:09 +08:00
Eric Liang
58f8c4b23a
Handle unhandled exception handler == nullptr in Java (#14221) 2021-02-19 16:54:41 -08:00
SangBin Cho
5740b2391e
Add multi node data processing cluster.yaml (#14198) 2021-02-19 16:16:55 -08:00
SangBin Cho
296792f963
Revert "[core] Fix bugs in admission control (#14157)" (#14217)
This reverts commit 94a819d00e.
2021-02-19 11:58:17 -08:00
Eric Liang
6a0b306221
fix stack (#14193) 2021-02-19 11:52:40 -08:00
Eric Liang
cc156f7b3c
Fix deadlock in unhandled exception handler and re-merge (#3) (#14192) 2021-02-19 11:52:09 -08:00
Amog Kamsetty
3ffe375a09
[Tune] Raise error when PBT is used with search algorithm (#14176) 2021-02-19 09:41:30 -08:00