2020-07-30 11:22:56 -07:00
|
|
|
# These are mirrored in setup.py as install_requires,
|
|
|
|
|
# which is what the users of the ray package will install. The rest of this file
|
|
|
|
|
# sets up all the packages necessary for a /developer/ of Ray.
|
|
|
|
|
#
|
|
|
|
|
# In short, if you change it here, PLEASE also change it in setup.py.
|
|
|
|
|
#
|
|
|
|
|
# setup.py install_requires
|
2021-10-12 01:25:52 +02:00
|
|
|
aiohttp>=3.7
|
2021-11-11 15:35:20 -08:00
|
|
|
aiosignal
|
2022-03-29 00:44:48 -07:00
|
|
|
click >= 7.0, <= 8.0.4
|
2021-02-01 15:27:39 -08:00
|
|
|
cloudpickle
|
2020-07-30 11:22:56 -07:00
|
|
|
filelock
|
2021-11-11 15:35:20 -08:00
|
|
|
frozenlist
|
2022-07-05 15:05:20 -07:00
|
|
|
gpustat == 1.0.0b1
|
2022-05-18 18:16:39 -07:00
|
|
|
grpcio >= 1.28.1, <= 1.43.0
|
2020-07-30 11:22:56 -07:00
|
|
|
jsonschema
|
|
|
|
|
msgpack >= 1.0.0, < 2.0.0
|
|
|
|
|
numpy >= 1.16
|
|
|
|
|
opencensus
|
2022-04-06 14:22:22 -07:00
|
|
|
prometheus_client >= 0.7.1, < 0.14.0
|
2022-06-18 16:06:56 -07:00
|
|
|
protobuf >= 3.15.3, < 4.0.0
|
2020-07-30 11:22:56 -07:00
|
|
|
py-spy >= 0.2.0
|
2021-05-12 15:08:20 +08:00
|
|
|
pydantic >= 1.8
|
2020-07-30 11:22:56 -07:00
|
|
|
pyyaml
|
|
|
|
|
requests
|
2021-11-18 08:00:30 -08:00
|
|
|
smart_open
|
2022-02-11 02:25:18 +08:00
|
|
|
virtualenv
|
2020-07-30 11:22:56 -07:00
|
|
|
|
|
|
|
|
## setup.py extras
|
|
|
|
|
dm_tree
|
|
|
|
|
flask
|
2022-05-23 17:43:35 +02:00
|
|
|
pygame
|
2022-05-23 08:18:44 +02:00
|
|
|
gym>=0.21.0,<0.24.0; python_version >= '3.7'
|
[RLlib] Upgrade gym version to 0.21 and deprecate pendulum-v0. (#19535)
* Fix QMix, SAC, and MADDPA too.
* Unpin gym and deprecate pendulum v0
Many tests in rllib depended on pendulum v0,
however in gym 0.21, pendulum v0 was deprecated
in favor of pendulum v1. This may change reward
thresholds, so will have to potentially rerun
all of the pendulum v1 benchmarks, or use another
environment in favor. The same applies to frozen
lake v0 and frozen lake v1
Lastly, all of the RLlib tests and have
been moved to python 3.7
* Add gym installation based on python version.
Pin python<= 3.6 to gym 0.19 due to install
issues with atari roms in gym 0.20
* Reformatting
* Fixing tests
* Move atari-py install conditional to req.txt
* migrate to new ale install method
* Fix QMix, SAC, and MADDPA too.
* Unpin gym and deprecate pendulum v0
Many tests in rllib depended on pendulum v0,
however in gym 0.21, pendulum v0 was deprecated
in favor of pendulum v1. This may change reward
thresholds, so will have to potentially rerun
all of the pendulum v1 benchmarks, or use another
environment in favor. The same applies to frozen
lake v0 and frozen lake v1
Lastly, all of the RLlib tests and have
been moved to python 3.7
* Add gym installation based on python version.
Pin python<= 3.6 to gym 0.19 due to install
issues with atari roms in gym 0.20
Move atari-py install conditional to req.txt
migrate to new ale install method
Make parametric_actions_cartpole return float32 actions/obs
Adding type conversions if obs/actions don't match space
Add utils to make elements match gym space dtypes
Co-authored-by: Jun Gong <jungong@anyscale.com>
Co-authored-by: sven1977 <svenmika1977@gmail.com>
2021-11-03 08:24:00 -07:00
|
|
|
gym==0.19.0; python_version < '3.7'
|
2020-07-30 11:22:56 -07:00
|
|
|
lz4
|
2021-07-22 03:24:18 +01:00
|
|
|
scikit-image
|
2021-08-12 08:39:31 -07:00
|
|
|
pandas>=1.0.5; python_version < '3.7'
|
2022-05-23 22:37:15 -07:00
|
|
|
pandas>=1.3.0; python_version >= '3.7'
|
2022-06-08 19:26:59 +02:00
|
|
|
scipy >= 1.5
|
2020-07-30 11:22:56 -07:00
|
|
|
tabulate
|
2021-05-24 11:14:23 -07:00
|
|
|
tensorboardX >= 1.9
|
2022-06-06 23:41:42 +00:00
|
|
|
uvicorn==0.16.0
|
2020-09-22 09:39:39 -07:00
|
|
|
dataclasses; python_version < '3.7'
|
2022-06-09 13:55:18 -07:00
|
|
|
starlette==0.18.0
|
2021-12-08 10:53:45 +08:00
|
|
|
aiorwlock
|
2020-07-30 11:22:56 -07:00
|
|
|
|
|
|
|
|
# Requirements for running tests
|
2022-04-13 22:31:30 +01:00
|
|
|
pyarrow >= 6.0.1, < 7.0.0
|
2022-06-17 15:26:46 -04:00
|
|
|
# Used for Dataset tests.
|
|
|
|
|
polars
|
2021-12-16 17:23:32 +00:00
|
|
|
azure-cli-core==2.29.1
|
|
|
|
|
azure-identity==1.7.0
|
|
|
|
|
azure-mgmt-compute==23.1.0
|
|
|
|
|
azure-mgmt-network==19.0.0
|
|
|
|
|
azure-mgmt-resource==20.0.0
|
|
|
|
|
msrestazure==0.6.4
|
2020-07-30 11:22:56 -07:00
|
|
|
boto3
|
2021-12-26 23:26:08 -05:00
|
|
|
cython >= 0.29.26
|
2020-09-22 09:39:39 -07:00
|
|
|
dataclasses; python_version < '3.7'
|
2020-07-30 11:22:56 -07:00
|
|
|
feather-format
|
2021-05-17 18:45:47 -04:00
|
|
|
google-api-python-client
|
2021-11-11 04:45:19 +01:00
|
|
|
google-cloud-storage
|
2020-08-19 17:49:50 +02:00
|
|
|
gym-minigrid
|
2020-07-30 11:22:56 -07:00
|
|
|
kubernetes
|
|
|
|
|
lxml
|
2022-04-27 09:57:14 -07:00
|
|
|
moto[s3,server]
|
2020-07-30 11:22:56 -07:00
|
|
|
mypy
|
|
|
|
|
networkx
|
|
|
|
|
numba
|
2022-04-22 10:45:03 +09:00
|
|
|
asyncmock
|
2020-12-01 19:43:08 -08:00
|
|
|
# higher version of llvmlite breaks windows
|
|
|
|
|
llvmlite==0.34.0
|
2020-07-30 11:22:56 -07:00
|
|
|
openpyxl
|
2021-05-18 17:06:43 -07:00
|
|
|
opentelemetry-api==1.1.0
|
|
|
|
|
opentelemetry-sdk==1.1.0
|
|
|
|
|
opentelemetry-exporter-otlp==1.1.0
|
2020-12-06 21:50:18 -08:00
|
|
|
pexpect
|
2020-07-30 11:22:56 -07:00
|
|
|
Pillow; platform_system != "Windows"
|
|
|
|
|
pygments
|
2021-10-18 13:10:06 -07:00
|
|
|
pyspark==3.1.2
|
Bump pytest from 5.4.3 to 7.0.1 (#26334)
See #23676 for context. This is another attempt at that as I figured out what's going wrong in `bazel test`. Supersedes #24828.
Now that there are Python 3.10 wheels for Ray 1.13 and this is no longer a blocker for supporting Python 3.10, I still want to make `bazel test //python/ray/tests/...` work for developing in a 3.10 env, and make it easier to add Python 3.10 tests to CI in future.
The change contains three commits with rather descriptive commit message, which I repeat here:
Pass deps to py_test in py_test_module_list
Bazel macro py_test_module_list takes a `deps` argument, but completely
ignores it instead of passes it to `native.py_test`. Fixing that as we
are going to use deps of py_test_module_list in BUILD in later changes.
cpp/BUILD.bazel depends on the broken behaviour: it deps-on a cc_library
from a py_test, which isn't working, see upstream issue:
https://github.com/bazelbuild/bazel/issues/701.
This is fixed by simply removing the (non-working) deps.
Depend on conftest and data files in Python tests BUILD files
Bazel requires that all the files used in a test run should be
represented in the transitive dependencies specified for the test
target. For py_test, it means srcs, deps and data.
Bazel enforces this constraint by creating a "runfiles" directory,
symbolic links files in the dependency closure and run the test in the
"runfiles" directory, so that the test shouldn't see files not in the
dependency graph.
Unfortunately, the constraint does not apply for a large number of
Python tests, due to pytest (>=3.9.0, <6.0) resolving these symbolic
links during test collection and effectively "breaks out" of the
runfiles tree.
pytest >= 6.0 introduces a breaking change and removed the symbolic link
resolving behaviour, see pytest pull request
https://github.com/pytest-dev/pytest/pull/6523 for more context.
Currently, we are underspecifying dependencies in a lot of BUILD files
and thus blocking us from updating to newer pytest (for Python 3.10
support). This change hopefully fixes all of them, and at least those in
CI, by adding data or source dependencies (mostly for conftest.py-s)
where needed.
Bump pytest version from 5.4.3 to 7.0.1
We want at least pytest 6.2.5 for Python 3.10 support, but not past
7.1.0 since it drops Python 3.6 support (which Ray still supports), thus
the version constraint is set to <7.1.
Updating pytest, combined with earlier BUILD fixes, changed the ground
truth of a few error message based unit test, these tests are updated to
reflect the change.
There are also two small drive-by changes for making test_traceback and
test_cli pass under Python 3.10. These are discovered while debugging CI
failures (on earlier Python) with a Python 3.10 install locally. Expect
more such issues when adding Python 3.10 to CI.
2022-07-13 12:14:35 +08:00
|
|
|
pytest==7.0.1
|
2022-01-13 11:35:30 -08:00
|
|
|
pytest-asyncio==0.16.0
|
2020-07-30 11:22:56 -07:00
|
|
|
pytest-rerunfailures
|
|
|
|
|
pytest-sugar
|
2021-07-13 19:14:41 -07:00
|
|
|
pytest-lazy-fixture
|
2020-07-30 11:22:56 -07:00
|
|
|
pytest-timeout
|
2022-02-16 02:51:01 +08:00
|
|
|
pytest-virtualenv
|
2022-04-19 09:16:47 -07:00
|
|
|
redis >= 3.5.0, < 4.0.0
|
2022-05-06 15:52:37 +01:00
|
|
|
scikit-learn==0.24.2
|
2020-08-22 13:29:10 -07:00
|
|
|
testfixtures
|
2020-07-30 11:22:56 -07:00
|
|
|
werkzeug
|
|
|
|
|
xlrd
|
2020-09-03 17:31:38 -07:00
|
|
|
starlette
|
2022-06-09 13:55:18 -07:00
|
|
|
fastapi==0.76.0
|
2020-10-30 14:47:07 -07:00
|
|
|
smart_open[s3]
|
2021-02-26 12:42:58 -08:00
|
|
|
tqdm
|
2021-03-29 17:38:51 -07:00
|
|
|
async-exit-stack
|
|
|
|
|
async-generator
|
2021-10-21 06:39:11 +01:00
|
|
|
cryptography>=3.0.0
|
2022-05-10 11:30:46 +08:00
|
|
|
proxy.py
|
2022-02-03 09:13:04 +01:00
|
|
|
# For doc tests
|
|
|
|
|
myst-parser==0.15.2
|
|
|
|
|
myst-nb==0.13.1
|
2022-02-22 19:45:30 +02:00
|
|
|
jupytext==1.13.6
|
2022-06-02 02:41:38 +00:00
|
|
|
pytest-docker-tools
|
2022-06-18 06:50:39 +00:00
|
|
|
pytest-forked
|