Commit graph

387 commits

Author SHA1 Message Date
Richard Liaw
43a7a64b30
[tune] horovod trainable (#10304) 2020-09-03 16:53:35 -07:00
Ian Rodney
dee2ab55eb
[docker] Use sh syntax and pull ray-deps (#10517) 2020-09-03 09:30:03 -07:00
Ian Rodney
4324dd5929
[docker] Refactor "autoscaler" image into "-autoscaler" tag and "ray-ml" image. (#10351) 2020-09-02 13:03:35 -07:00
Eric Liang
519354a39a
[api] Initial API deprecations for Ray 1.0 (#10325) 2020-08-28 15:03:50 -07:00
SongGuyang
cb70864c04
[cpp worker] support cluster mode and object Put/Get works (#9682) 2020-08-28 13:53:36 +08:00
Ian Rodney
465d4c50b6
[docker push fix] (#10375) 2020-08-27 17:07:48 -07:00
Eric Liang
583ad38f8f
remove shellcheck bazel (#10369) 2020-08-27 12:36:57 -07:00
Ian Rodney
2526c06b5e
[WIP] [docker] Cleanup Docker Base-Deps (#9988)
* cleanup-base deps

* only build base-deps a bit

* remove parens

* formatting

* add ray-deps

* gpu enabled

* always include wheel

* fix script

* log new variables

* run tests for docker

* try to include env variables

* source files

* remove bash when sourcing

* add new lines

* use wget

* dual build autoscaler

* switch to gnupg

* add gcc cmake

* remove blist

* clarify build-docker-images
2020-08-26 19:36:11 -07:00
Ian Rodney
e2eef6469b
Deprecate Jenkins (#10314) 2020-08-26 15:43:27 -07:00
fyrestone
05c103af94
[Dashboard] Start the new dashboard (#10131)
* Use new dashboard if environment var RAY_USE_NEW_DASHBOARD exists; new dashboard startup

* Make fake client/build/static directory for dashboard

* Add test_dashboard.py for new dashboard

* Travis CI enable new dashboard test

* Update new dashboard

* Agent manager service

* Add agent manager

* Register agent to agent manager

* Add a new line to the end of agent_manager.cc

* Fix merge; Fix lint

* Update dashboard/agent.py

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Update dashboard/head.py

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Fix bug

* Add tests for dashboard

* Fix

* Remove const from Process::Kill() & Fix bugs

* Revert error check of execute_after

* Raise exception from DashboardAgent.run

* Add more tests.

* Fix compile on Linux

* Use dict comprehension instead of dict(generator)

* Fix lint

* Fix windows compile

* Fix lint

* Test Windows CI

* Revert "Test Windows CI"

This reverts commit 945e01051ec95cff5fcc1c0bc37045b46e7ad9a6.

* Fix ParseWindowsCommandLine bug

* Update src/ray/util/util.cc

Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>

Co-authored-by: 刘宝 <po.lb@antfin.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>
2020-08-24 13:24:23 -07:00
Olli Huotari
ed6d1d7a7c
[Misc] Include info about flake8_quotes in format.sh (#10123) 2020-08-15 00:09:02 -07:00
Robert Nishihara
36e626e95d
Revert "[Dashboard] Start the new dashboard (#9860)" (#10116)
This reverts commit 739933e5b8.
2020-08-14 14:06:57 -07:00
Simon Mo
d0c2e90577
[Build] Make sure local format.sh check protobuf (#10118)
* Ignore protobuf files for clangformat check

* Revert "Ignore protobuf files for clangformat check"

This reverts commit ccd84d4e1517220eb4e946918174150ce2265467.

* Make sure protobuf is checked locally
2020-08-14 11:22:55 -07:00
fyrestone
739933e5b8
[Dashboard] Start the new dashboard (#9860) 2020-08-13 11:01:46 +08:00
Simon Mo
bb9ef511da
Use the right bucket for travis logs (#10073) 2020-08-12 11:46:49 -07:00
Simon Mo
f1ede1099f
[Hotfix] Pin opencv-python-headless==4.3.0.36 (#10049) 2020-08-11 15:58:18 -07:00
Simon Mo
5b4a10368f
Upload Travis in after_script phase (#10046)
The deploy phase is skipped when script/tests fails. This prevent us
from uploading failed result to S3.

This PR change it to after_script phase and the secret is injected
via Travis Env Var.

https://docs.travis-ci.com/user/job-lifecycle/
2020-08-11 11:46:00 -07:00
Simon Mo
4c52adddfa
[Core] Type check ObjectRef (#9856)
* Type check ObjectRef

* Bug fix

* Port typing tests to bazel test
2020-08-11 10:38:29 -07:00
Simon Mo
df676bc9aa
Upload bazel test logs to S3 (#9884) 2020-08-10 14:26:31 -07:00
mehrdadn
5331c30e35
Improve Clang-IWYU to automatically make #include fixes (#9858)
Co-authored-by: Mehrdad <noreply@github.com>
2020-08-10 12:49:58 -07:00
Richard Liaw
328b450cde
[tune] fix testing for serve-tune test breaking (#9993) 2020-08-07 23:05:18 -07:00
Barak Michener
8e76796fd0
ci: Redo format.sh --all script & backfill lint fixes (#9956) 2020-08-07 16:49:49 -07:00
Alex Wu
a54d3a1cee
[Autoscaler] Run resource demand scheduler in CI (#9945)
* .

* .
2020-08-07 13:30:39 -07:00
SangBin Cho
22934619df
[Release] Fix release tests (#9976)
* In Progress.

* Fix torch version.

* Fix asan run.sh

* Addressed code review.
2020-08-07 10:06:13 -07:00
Sven Mika
19d785b947
[LINT] Except RLlib from checking for flake8 error F821 (#9946) 2020-08-06 10:44:37 +02:00
Sven Mika
9b90f7db67
[RLlib] Missing type annotations policy templates. (#9846) 2020-08-06 05:33:24 +02:00
Amog Kamsetty
5af7d24f66
[Tune] Transformer blog example (#9789)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-04 22:05:01 -07:00
Simon Mo
bdc42f8dab
[CI] Bring back suppress_output (#9888) 2020-08-04 11:21:20 -07:00
Simon Mo
b4fb390219
Fix LINT for build-docker-images.sh (#9882) 2020-08-03 18:32:58 -07:00
Simon Mo
c218f2eff6
[docker] Build docker in Travis PR & Fix image build failing (#9787)
Co-authored-by: Ian Rodney <ian.rodney@gmail.com>
2020-08-03 16:37:15 -07:00
Simon Mo
edcd94f26b
temporarily enable output from linux wheel builds (#9881) 2020-08-03 16:22:39 -07:00
mehrdadn
b62ec7787f
Ignore grep exit code for shellcheck in format.sh (#9861)
Co-authored-by: Mehrdad <noreply@github.com>
2020-08-02 00:59:05 -07:00
Sven Mika
b4c527b3f3
[RLlib] Switch to PyTorch 1.6 for testing. (#9790) 2020-08-01 05:21:23 +02:00
mehrdadn
78995d085f
Fix macOS incompatibility in format.sh (#9832)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-31 09:25:55 -07:00
mehrdadn
e2c0174ab2
Factor out some Bazel options into .bazelrc (#9804)
* Factor out --keep_going in Bazel --config=ci

* Remove Bazel --test_timeout=600 for Windows

* Use global --test_output for Bazel CI

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-30 18:09:31 -07:00
mehrdadn
a7b97b6f8a
Add shellcheck support (#8574) 2020-07-30 18:39:28 -05:00
Barak Michener
68f3fec744
*: Centralize requirements.txt and unify dependency versions (#9759)
* python_test: fix cython_examples in doc/ and tests/

* update setup.py to parse the bazel version string better

* all: centralize all python deps into stackable requirements files in python/

* format

* Move cython test into the proper package

* Add cross-reference dependency comments for requirements and setup.py

* re-enable version pinning on CI, fix formatting

* fix up torchvision version

* fix case in shell
2020-07-30 11:22:56 -07:00
Sven Mika
b0b0463161
[RLlib] Trajectory View API (preparatory cleanup and enhancements). (#9678) 2020-07-29 21:15:09 +02:00
Simon Mo
9fbfee2424
Pin pytest version (#9767) 2020-07-28 19:54:48 -07:00
mehrdadn
fb5280f21b
Fix some Windows CI issues (#9708)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-28 18:10:23 -07:00
SangBin Cho
c00742f103
[Release] Fix release tests (#9733) 2020-07-28 10:44:06 -07:00
mehrdadn
2949c09ee8
Fix remote-watch.py (#9625)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-27 15:54:23 -07:00
krfricke
9f3570828a
[tune] move jenkins tests to travis (#9609)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-07-24 21:22:54 -07:00
mehrdadn
56d2cf6479
Shellcheck rewrites (#9597)
* Fix SC2001: See if you can use ${variable//search/replace} instead.

* Fix SC2010: Don't use ls | grep. Use a glob or a for loop with a condition to allow non-alphanumeric filenames.

* Fix SC2012: Use find instead of ls to better handle non-alphanumeric filenames.

* Fix SC2015: Note that A && B || C is not if-then-else. C may run when A is true.

* Fix SC2028: echo may not expand escape sequences. Use printf.

* Fix SC2034: variable appears unused. Verify use (or export if used externally).

* Fix SC2035: Use ./*glob* or -- *glob* so names with dashes won't become options.

* Fix SC2071: > is for string comparisons. Use -gt instead.

* Fix SC2154: variable is referenced but not assigned

* Fix SC2164: Use 'cd ... || exit' or 'cd ... || return' in case cd fails.

* Fix SC2188: This redirection doesn't have a command. Move to its command (or use 'true' as no-op).

* Fix SC2236: Use -n instead of ! -z.

* Fix SC2242: Can only exit with status 0-255. Other data should be written to stdout/stderr.

* Fix SC2086: Double quote to prevent globbing and word splitting.

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-24 17:24:19 -05:00
Simon Mo
a078a21437
[Serve] Allow multiple HTTP servers. (#9523) 2020-07-24 12:41:20 -07:00
Robert Nishihara
06c3518aa1
Drop support for Python 3.5. (#9622)
* Drop support for Python 3.5.

* Update setup.py
2020-07-23 19:26:06 -07:00
Simon Mo
3511b30283
Temporarily disable remote watcher (#9669) 2020-07-23 17:20:48 -07:00
Simon Mo
8df25b239f
Fix lint in remote-watch.py (#9668) 2020-07-23 16:18:22 -07:00
mehrdadn
75b2fc4313
Auto-cancel build when a new commit is pushed (#8043)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-23 16:07:00 -07:00
mehrdadn
b14728d999
Shellcheck quoting (#9596)
* Fix SC2006: Use $(...) notation instead of legacy backticked `...`.

* Fix SC2016: Expressions don't expand in single quotes, use double quotes for that.

* Fix SC2046: Quote this to prevent word splitting.

* Fix SC2053: Quote the right-hand side of == in [[ ]] to prevent glob matching.

* Fix SC2068: Double quote array expansions to avoid re-splitting elements.

* Fix SC2086: Double quote to prevent globbing and word splitting.

* Fix SC2102: Ranges can only match single chars (mentioned due to duplicates).

* Fix SC2140: Word is of the form "A"B"C" (B indicated). Did you mean "ABC" or "A\"B\"C"?

* Fix SC2145: Argument mixes string and array. Use * or separate argument.

* Fix SC2209: warning: Use var=$(command) to assign output (or quote to assign string).

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-21 21:56:41 -05:00