Commit graph

2693 commits

Author SHA1 Message Date
Eric Liang
0ff24ec8dc
Add "ray status" debug tool for autoscaler. (#9091) 2020-06-24 18:22:03 -07:00
Ian Rodney
67e049bc7b
[autoscaler/docker] Relax missing docker section (#9105) 2020-06-24 12:35:42 -07:00
Alex Wu
c152730e4a
[Core] Log output from different jobs to different drivers. (#8885)
* .

* .

* Correct now

* No interactivity errors

* format

* Filtering

* lint

* .

* No more filtering

* Removed interactivity

* .

* .

* .

* .

* .

* .

* Redirection works

* formatting

* something broken?

* .

* Works

* formatting

* redirect output

* formatting

* formatting

* Fix file descriptor leakage

* format

* .

* .

* .

* .

* .

* Refactor

* .

* Only run on job switch

* .

* cleanup

* .

* ...

* Review

* .

* .

* .

* .

* whoops

* .

* Should fix bug

* .

* .

* addressed comments

* formatting

* formatting

* Fix typo

* .

* .

* .

* .

Co-authored-by: Ubuntu <ubuntu@ip-172-31-14-33.us-west-2.compute.internal>
2020-06-23 18:45:32 -07:00
henktillman
acb3280235
GCP credentials (#9052) 2020-06-23 17:11:18 -07:00
Max Fitton
7904235517
Node Info Functional Components (#9073) 2020-06-23 13:11:32 -07:00
Edward Oakes
c9010eb8ad
[serve] Add serve.shutdown() (#8766) 2020-06-23 13:42:03 -05:00
Simon Mo
b6d425526d
Move actor task submission to io service (#9093) 2020-06-23 10:07:33 -07:00
Xianyang Liu
b449ece2ea
[SGD] Variable worker CPU requirements (#8963) 2020-06-23 00:43:27 -07:00
Alex Wu
40c15b1ba0
[ParallelIterator] Fix for_each concurrent test cases/bugs (#8964)
* Everything works

* Update python/ray/util/iter.py

Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>

* .

* .

* removed print statements

Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-06-22 18:26:45 -07:00
Richard Liaw
e2330ffc35
[sgd] Cleanup code from last PR (#9076) 2020-06-22 15:17:07 -07:00
Ian Rodney
f76552d8db
[autoscaler] Expose cache_stopped_nodes in Example YAML (#8981) 2020-06-22 15:02:45 -07:00
Ian Rodney
b942bcd798
[Tune] remove whitelist from deep_copy (#8997) 2020-06-22 15:02:27 -07:00
Max Fitton
1d5c123c81
[Hotfix] Fix lint mistake accidentally pushed to master (#9077)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-06-21 19:19:07 -07:00
Richard Liaw
acdd873481
[docs/sgd] Fix test failure + make slack link large (#9051) 2020-06-21 15:55:06 -07:00
Simon Mo
2b5119218e
[Serve] Raise exception when _scale_replicas is infeasible (#9005) 2020-06-21 15:38:58 -07:00
Ameer Haj Ali
76583d4a3a
Creating head node might take more than 50-30 seconds to show up. (#9066) 2020-06-21 11:12:37 -07:00
Vishnu Deva
432ce1be50
[tune] fix for sync_on_checkpoint bug (#9057)
* #9056 fix for sync_on_checkpoint bug

* fix for failing checks

* update help string
2020-06-21 01:07:11 -07:00
Richard Liaw
e6ee39a6a3
[tune] checkpoint_dir test (#8024) 2020-06-20 17:56:24 -07:00
Allen
8fa584a445
[autoscaler] Run ray stop on cluster before tearing it down (#8922)
Co-authored-by: Allen Yin <allenyin@anyscale.io>
2020-06-20 17:02:34 -07:00
mehrdadn
981f67bfb0
Fix more Windows issues (#9011)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-19 18:51:45 -07:00
Max Fitton
ca66f88b96
Sortable/Groupable Memory Dashboard (#9014) 2020-06-19 16:26:35 -05:00
Max Fitton
ad09aa985c
Make Dashboard Port Configurable (#8999) 2020-06-19 16:26:22 -05:00
Zhilei Chen
d8a9247448
Remove gcs_service_disabled ci jobs and code (#8854) 2020-06-19 11:32:27 +08:00
Simon Mo
e89b8d37ae
[Serve] Fix PyTorch Tutorial (#9019) 2020-06-18 15:41:43 -07:00
mehrdadn
92f67cd2ae
Add Optional Fast Build Configuration (#8925)
* Fast builds by default

* Update doc/source/development.rst

Co-authored-by: Simon Mo <xmo@berkeley.edu>

Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Simon Mo <xmo@berkeley.edu>
2020-06-18 14:12:12 -07:00
Edward Oakes
8a99fd205e
[dashboard] Pipe resource assignments to dashboard (#8998) 2020-06-18 11:14:59 -05:00
Alan Guo
8f9b465968
Extract out "fillout_defaults" from other config preparation actions (#8996) 2020-06-17 16:40:37 -07:00
henktillman
508149b3c3
Remove redundant logger warning (#8954) 2020-06-15 21:14:58 -07:00
SangBin Cho
3d1b8c24fd
[Dashboard] Dashboard pubsub hotfix. (#8944) 2020-06-15 20:38:56 -05:00
Max Fitton
4a66b6783a
Logical View: Restructuring, tooltips, and QoL changes (#8916) 2020-06-15 16:09:29 -05:00
Max Fitton
ddb9368f2c
Display GPU Utilization in the Dashboard (#8564) 2020-06-15 15:27:44 -05:00
Richard Liaw
6c49c01837
[tune] Function API checkpointing (#8471)
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-06-15 10:42:54 -07:00
Scott Graham
91e57f2e53
[azure] default workers spot instances + billing profile (#8938) 2020-06-15 10:35:20 -07:00
Jack Carreira
19cc1ae781
[docs] Tune Search: Wrong parameter name (#8927) 2020-06-13 18:01:22 -07:00
mehrdadn
101c215125
Get more tests running on Windows (#6537)
* Get rid of system() calls

* Work around '/usr/share/mini' showing up on GitHub Actions (probably due to psutil truncation)

https://github.com/ray-project/ray/runs/722480047?check_suite_focus=true

* Don't check for socket max path length on Windows

* Don't check for socket existence on Windows

* Fix race condition in Windows fate-sharing

* Work around missing .exe extension for Redis tests

* Add more tests to GitHub Actions

Co-authored-by: Mehrdad <noreply@github.com>
2020-06-12 21:32:10 -07:00
Eli Meirom
5c56760fac
[tune] np.array compat for logger (#8918)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-12 16:39:01 -07:00
Ian Rodney
0e82f0d7c3
[autoscaler] Create Docker Command Runner (v2) (#8840)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-12 16:38:38 -07:00
Richard Liaw
58efec0f2b
[sgd] simplify cuda visible device setting (#8775) 2020-06-12 13:53:32 -07:00
Siyuan (Ryans) Zhuang
4b31b383f3
[Core] Run Plasma Store as a Raylet thread (with a feature flag) (#8897)
* integrate plasma store as a thread (C++)

* integrate plasma store as a thread (Python)

* fix config issues

* remove plasma component fail tests

* without forcefully kill the plasma store thread
2020-06-11 22:54:08 -07:00
krfricke
060e524c92
[tune] Parameter columns can now be specified in tune reporters (#8802)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-06-11 11:30:25 -07:00
Stephanie Wang
05010caed2
[core] Fix race condition for object reconstruction (#8791)
* Fix

* doc

* Unit test

* Update src/ray/core_worker/task_manager.h

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>

* Update src/ray/core_worker/task_manager.h

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>

* Update src/ray/core_worker/task_manager.h

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>

* lint

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-10 19:49:12 -07:00
Edward Oakes
527b0380c9
[serve] Add microbenchmark script (#8887) 2020-06-10 21:28:52 -05:00
Edward Oakes
3a9f45c4b3
[serve] Fix worker batch queue waiting logic (#8884) 2020-06-10 21:28:16 -05:00
Max Fitton
950b389581
Actor Search Bar in Logical View (#8865) 2020-06-10 20:43:56 -05:00
Sumanth Ratna
439dbb7822
[CLI] Add version option (#8886)
Closes https://github.com/ray-project/ray/issues/8878.
2020-06-10 18:12:00 -07:00
Simon Mo
cf53b35147
[Serve] Add doc for model composition (#8871)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-10 11:09:22 -07:00
fangfengbin
a5bebd4408
Fix create actor rpc reconnect bug (#8855) 2020-06-10 10:53:53 +08:00
Simon Mo
7d52159d1a
Fix Serve Flaky test_api::test_batching (#8867) 2020-06-09 16:49:17 -07:00
SangBin Cho
731ed8d232
[Core] Fix a detached actor bug fix when GCS actor management is off. (#8843) 2020-06-09 15:46:17 -07:00
mehrdadn
50f6272fcc
Replace ps call with psutil (#8851)
* Replace ps call with psutil

* Minor formatting

Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>
2020-06-09 14:21:19 -07:00