Commit graph

368 commits

Author SHA1 Message Date
mehrdadn
a7b97b6f8a
Add shellcheck support (#8574) 2020-07-30 18:39:28 -05:00
Barak Michener
68f3fec744
*: Centralize requirements.txt and unify dependency versions (#9759)
* python_test: fix cython_examples in doc/ and tests/

* update setup.py to parse the bazel version string better

* all: centralize all python deps into stackable requirements files in python/

* format

* Move cython test into the proper package

* Add cross-reference dependency comments for requirements and setup.py

* re-enable version pinning on CI, fix formatting

* fix up torchvision version

* fix case in shell
2020-07-30 11:22:56 -07:00
Sven Mika
b0b0463161
[RLlib] Trajectory View API (preparatory cleanup and enhancements). (#9678) 2020-07-29 21:15:09 +02:00
Simon Mo
9fbfee2424
Pin pytest version (#9767) 2020-07-28 19:54:48 -07:00
mehrdadn
fb5280f21b
Fix some Windows CI issues (#9708)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-28 18:10:23 -07:00
krfricke
9f3570828a
[tune] move jenkins tests to travis (#9609)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-07-24 21:22:54 -07:00
mehrdadn
56d2cf6479
Shellcheck rewrites (#9597)
* Fix SC2001: See if you can use ${variable//search/replace} instead.

* Fix SC2010: Don't use ls | grep. Use a glob or a for loop with a condition to allow non-alphanumeric filenames.

* Fix SC2012: Use find instead of ls to better handle non-alphanumeric filenames.

* Fix SC2015: Note that A && B || C is not if-then-else. C may run when A is true.

* Fix SC2028: echo may not expand escape sequences. Use printf.

* Fix SC2034: variable appears unused. Verify use (or export if used externally).

* Fix SC2035: Use ./*glob* or -- *glob* so names with dashes won't become options.

* Fix SC2071: > is for string comparisons. Use -gt instead.

* Fix SC2154: variable is referenced but not assigned

* Fix SC2164: Use 'cd ... || exit' or 'cd ... || return' in case cd fails.

* Fix SC2188: This redirection doesn't have a command. Move to its command (or use 'true' as no-op).

* Fix SC2236: Use -n instead of ! -z.

* Fix SC2242: Can only exit with status 0-255. Other data should be written to stdout/stderr.

* Fix SC2086: Double quote to prevent globbing and word splitting.

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-24 17:24:19 -05:00
Robert Nishihara
06c3518aa1
Drop support for Python 3.5. (#9622)
* Drop support for Python 3.5.

* Update setup.py
2020-07-23 19:26:06 -07:00
mehrdadn
b14728d999
Shellcheck quoting (#9596)
* Fix SC2006: Use $(...) notation instead of legacy backticked `...`.

* Fix SC2016: Expressions don't expand in single quotes, use double quotes for that.

* Fix SC2046: Quote this to prevent word splitting.

* Fix SC2053: Quote the right-hand side of == in [[ ]] to prevent glob matching.

* Fix SC2068: Double quote array expansions to avoid re-splitting elements.

* Fix SC2086: Double quote to prevent globbing and word splitting.

* Fix SC2102: Ranges can only match single chars (mentioned due to duplicates).

* Fix SC2140: Word is of the form "A"B"C" (B indicated). Did you mean "ABC" or "A\"B\"C"?

* Fix SC2145: Argument mixes string and array. Use * or separate argument.

* Fix SC2209: warning: Use var=$(command) to assign output (or quote to assign string).

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-21 21:56:41 -05:00
Philipp Moritz
a5f4659d9f
Support ray task type checking (#9574) 2020-07-21 19:05:42 -07:00
mehrdadn
4f470c3fc1
Shellcheck comments (#9595) 2020-07-21 16:47:09 -05:00
mehrdadn
c5cde65bc6
Add bazel to the PATH in setup.py (#9590)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-21 13:35:29 -07:00
mehrdadn
02cbd4fb7e
Skip uneeded steps on CI (#9582)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-20 12:41:57 -07:00
mehrdadn
ffb88cda6f
Fix Bazel in Docker (#9530)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-17 11:39:38 -07:00
mehrdadn
aa33aba1fa
Fix pip and Bazel interaction messing up CI (#9506)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-16 16:28:37 -07:00
mehrdadn
aa8928fac2
Make more tests compatible with Windows (#9303) 2020-07-15 11:34:33 -05:00
mehrdadn
ad83337f46
Make pip install verbose (#9496)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-15 18:02:42 +02:00
mehrdadn
ca4f3b79db
Speedups for GitHub Actions (#9343)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-14 14:51:51 -07:00
Ian Rodney
ed6157c257
[docker] Include base-deps image in rayproject Docker Hub (#9458) 2020-07-14 14:22:29 -07:00
mehrdadn
3d65682e62
Bazel selects compiler flags based on compiler (#9313)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-13 15:31:46 -07:00
Sven Mika
4da0e542d5
[RLlib] DDPG and SAC eager support (preparation for tf2.x) (#9204) 2020-07-08 16:12:20 +02:00
Tao Wang
f395e48031
[GCS] Add integration test for actor info cleaning (#8900) 2020-07-08 10:25:08 +08:00
Benjamin Black
1425cdf834
Pettingzoo environment support (#9271)
* added pettingzoo wrapper env and example

* added docs, examples for pettingzoo env support

* fixed pettingzoo env flake8, added test

* fixed pettingzoo env import

* fixed pettingzoo env import

* fixed pettingzoo import issue

* fixed pettingzoo test

* fixed linting problem

* fixed bad quotes

* future proofed pettingzoo dependency

* fixed ray init in pettingzoo env

* lint

* manual lint

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-07-06 21:32:26 -07:00
mehrdadn
65f89753b0
Move full build to install_ray() (#9276)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-02 21:06:31 -07:00
mehrdadn
29acf272b7
Build with Visual C++ (#9190)
Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Simon Mo <xmo@berkeley.edu>
2020-07-02 09:34:24 -07:00
mehrdadn
8f72a9fd1a
Fix more Windows tests (#9173) 2020-06-28 17:13:15 +08:00
Tao Wang
a268277f38
[BUILD]use first appearance of import when check order (#9119) 2020-06-28 11:04:29 +08:00
mehrdadn
fc4684d3ca
Update pandas to 1.0.5 (#9065)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-21 14:35:25 -05:00
mehrdadn
981f67bfb0
Fix more Windows issues (#9011)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-19 18:51:45 -07:00
mehrdadn
92f67cd2ae
Add Optional Fast Build Configuration (#8925)
* Fast builds by default

* Update doc/source/development.rst

Co-authored-by: Simon Mo <xmo@berkeley.edu>

Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Simon Mo <xmo@berkeley.edu>
2020-06-18 14:12:12 -07:00
mehrdadn
003cec87b4
[CI] Fix Conda Permission on MacOS Github Action(#9004)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-18 00:00:20 -07:00
mehrdadn
4afa2b304a
Clean up CI ASAN & .bazelrc (#8828) 2020-06-15 17:27:17 -07:00
mehrdadn
101c215125
Get more tests running on Windows (#6537)
* Get rid of system() calls

* Work around '/usr/share/mini' showing up on GitHub Actions (probably due to psutil truncation)

https://github.com/ray-project/ray/runs/722480047?check_suite_focus=true

* Don't check for socket max path length on Windows

* Don't check for socket existence on Windows

* Fix race condition in Windows fate-sharing

* Work around missing .exe extension for Redis tests

* Add more tests to GitHub Actions

Co-authored-by: Mehrdad <noreply@github.com>
2020-06-12 21:32:10 -07:00
mehrdadn
07637e5b5b
Upgrade Bazel and add required patches (#8847) 2020-06-12 14:59:22 -05:00
mehrdadn
67cd9a0c95
CI fixes and improvements (#8849)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-09 14:07:54 -07:00
mehrdadn
b8cc9a1cbb
Change GitHub Actions path to one with spaces (#8850)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-08 23:48:02 -07:00
Sven Mika
c74dc58f8b
[RLlib] Fix use_lstm flag for ModelV2 (w/o ModelV1 wrapping) and add it for PyTorch. (#8734) 2020-06-05 15:40:30 +02:00
Siyuan (Ryans) Zhuang
ea05ebe89e
Ship plasma store with Ray (#7901) 2020-06-03 17:44:34 -07:00
Max Fitton
b9f0f7ae5b
Dashboard minor refactor and first unit tests (#8705) 2020-06-03 11:04:55 -05:00
Alec Brickner
207ab44129
Raise major version limit for msgpack (#8466) 2020-06-01 20:00:36 -07:00
Patrick Ames
76450c8d47
[autoscaler] Honor separate head and worker node subnet IDs (#8374) 2020-05-28 18:16:46 -07:00
mehrdadn
79a4eac48c
Make more tests run on Windows (#8553) 2020-05-26 18:43:34 -05:00
Eric Liang
bb8d3c5cd0
ASAN build for ray core tests (#8431) 2020-05-21 15:11:03 -07:00
mehrdadn
ebf060d484
Make more tests run on Windows (#8446)
* Remove worker Wait() call due to SIGCHLD being ignored

* Port _pid_alive to Windows

* Show PID as well as TID in glog

* Update TensorFlow version for Python 3.8 on Windows

* Handle missing Pillow on Windows

* Work around dm-tree PermissionError on Windows

* Fix some lint errors on Windows with Python 3.8

* Simplify torch requirements

* Quiet git clean

* Handle finalizer issues

* Exit with the signal number

* Get rid of wget

* Fix some Windows compatibility issues with tests

Co-authored-by: Mehrdad <noreply@github.com>
2020-05-20 12:25:04 -07:00
mehrdadn
8da084bc54
Try to address linting issues (#8485) 2020-05-19 10:29:17 -05:00
Sven Mika
796a834c48
[RLlib] Attention Net integration into ModelV2 and learning RL example. (#8371) 2020-05-18 17:26:40 +02:00
SangBin Cho
1b734ba045
Pin sklearn version (#8465) 2020-05-15 16:54:54 -07:00
mehrdadn
cd0037064c
Windows wheels for multiple Python versions (#8369)
* Upload wheels to latest directory as well on GitHub Actions

* Fix bug in install-dependencies.sh

* Move out bazel build //:* from install_ray, since it isn't really necessary for that purpose

* Build wheels for different versions of Python on Windows

* Compile Windows in opt mode

Co-authored-by: Mehrdad <noreply@github.com>
2020-05-12 22:06:04 -07:00
mehrdadn
66b3edccb9
Prefer built-in system compilers over Clang download (#8355)
Co-authored-by: Mehrdad <noreply@github.com>
2020-05-11 11:53:35 -05:00
Sven Mika
2b0817cbd3
[RLlib] Retry pip installs (after waiting n seconds) in install-dependencies.sh (#8354) 2020-05-07 17:39:35 +02:00