mirror of
https://github.com/vale981/ray
synced 2025-03-04 17:41:43 -05:00
[Core] install jemalloc in Ray docker and use jemalloc in benchmark
release tests (#26112)
There are mysterious memory usage growth in Ray clusters that disappear when running with jemalloc. Before we are able to figure out the root cause, it seems using jemalloc by default can be a good walkaround. Because of its efficiency, using jemalloc by default can be beneficial, but we need to run more benchmarks to verify.
This commit is contained in:
parent
58bfad84d3
commit
513881584d
2 changed files with 5 additions and 1 deletions
|
@ -30,6 +30,7 @@ ENV HOME=/home/ray
|
|||
RUN sudo apt-get update -y && sudo apt-get upgrade -y \
|
||||
&& sudo apt-get install -y \
|
||||
git \
|
||||
libjemalloc-dev \
|
||||
wget \
|
||||
cmake \
|
||||
g++ \
|
||||
|
|
|
@ -1,5 +1,8 @@
|
|||
base_image: {{ env["RAY_IMAGE_ML_NIGHTLY_GPU"] | default("anyscale/ray-ml:nightly-py37-gpu") }}
|
||||
env_vars: {}
|
||||
env_vars: {"LD_PRELOAD": "/usr/lib/x86_64-linux-gnu/libjemalloc.so"}
|
||||
|
||||
debian_packages:
|
||||
- libjemalloc-dev
|
||||
|
||||
python:
|
||||
pip_packages: []
|
||||
|
|
Loading…
Add table
Reference in a new issue