ray/ci/travis/check_minimal_install.py
SangBin Cho e62c0052a0
[Dashboard] Agent in minimal ray installation (#21817)
This is the second part of https://docs.google.com/document/d/12qP3x5uaqZSKS-A_kK0ylPOp0E02_l-deAbmm8YtdFw/edit#. After this PR, dashboard agents will fully work with minimal ray installation.

Note that this PR requires to introduce "aioredis", "frozenlist", and "aiosignal" to the minimal installation. These dependencies are very small (or will be removed soon), and including them to minimal makes thing very easy. Please see the below for the reasoning.
2022-01-26 04:03:54 -08:00

47 lines
1.4 KiB
Python

"""
This script ensures that some dependencies are _not_ installed in the
current python environment.
This is to ensure that tests with minimal dependencies are not tainted
by too many installed packages.
"""
from typing import List
# These are taken from `setup.py` for ray[default]
DEFAULT_BLACKLIST = [
"aiohttp",
"aiohttp_cors",
"colorful",
"py-spy",
# "requests",
"gpustat",
"opencensus",
"prometheus_client",
"smart_open"
]
def assert_packages_not_installed(blacklist: List[str]):
try:
from pip._internal.operations import freeze
except ImportError: # pip < 10.0
from pip.operations import freeze
installed_packages = [
p.split("==")[0].split(" @ ")[0] for p in freeze.freeze()
]
assert not any(p in installed_packages for p in blacklist), \
f"Found blacklisted packages in installed python packages: " \
f"{[p for p in blacklist if p in installed_packages]}. " \
f"Minimal dependency tests could be tainted by this. " \
f"Check the install logs and primary dependencies if any of these " \
f"packages were installed as part of another install step."
print(f"Confirmed that blacklisted packages are not installed in "
f"current Python environment: {blacklist}")
if __name__ == "__main__":
assert_packages_not_installed(DEFAULT_BLACKLIST)