Kai Fricke
5a7f6e4fdd
[rfc][ci] create fake docker-compose cluster environment ( #20256 )
...
Following #18987 this PR adds a docker-compose based local multi node cluster.
The fake multinode docker comprises two parts. The docker_monitor.py script is a watch script calling docker compose up whenever the docker-compose.yaml changes. The node provider creates and updates the docker compose according to the autoscaling requirements.
This mode fully supports autoscaling and comes with test utilities to start and connect to docker-compose autoscaling environments. There's also a sample test case showing how this can be used.
2022-01-11 04:35:36 +00:00
Archit Kulkarni
fd02065ce5
[CI] [docker] Fix docker image name regex matching ( #21409 )
2022-01-05 18:59:10 -08:00
Ian Rodney
1b42a49e71
[CI] [Docker Build] Allow Branches with Double digits in regex matching( #21401 )
2022-01-05 14:19:19 -08:00
Amog Kamsetty
4cbcb11458
[Docker] Add commit as label ( #20504 )
...
Adds the Ray commit sha as a label for the docker image.
2021-11-17 15:20:41 -08:00
chenk008
74fa267c72
Enable worker in container CI test ( #20174 )
2021-11-11 16:11:06 -08:00
Amog Kamsetty
5d54412f1c
[Docker] Alias ray-ml:nightly to ray-ml:nightly-gpu ( #19726 )
...
* wip
* wip
* update
* finish
* deprecate
* debug
* fix and address comments
* try catch
* fix
* split tests
* force
* merge
* docs
* wip
* fix and check
* update readme
* fix
* fix
* fix sanity checking
* format
* alias
* fix
* comment
2021-10-27 11:30:49 -07:00
Amog Kamsetty
db863aafc0
Revert "Revert "[Docker] Support multiple CUDA Versions ( #19505 )" ( #19756 )" ( #19763 )
...
This reverts commit e58fcca404
2021-10-26 17:32:56 -07:00
Amog Kamsetty
e58fcca404
Revert "[Docker] Support multiple CUDA Versions ( #19505 )" ( #19756 )
...
This reverts commit f0053d405b
2021-10-26 12:55:20 -07:00
Amog Kamsetty
f0053d405b
[Docker] Support multiple CUDA Versions ( #19505 )
...
* wip
* wip
* update
* finish
* deprecate
* debug
* fix and address comments
* try catch
* fix
* split tests
* force
* merge
* docs
* wip
* fix and check
* update readme
* fix
* fix
* fix sanity checking
* format
2021-10-25 18:57:05 -07:00
Kai Fricke
fb38d06cfb
Move RLLib GPU release test dependencies to ml docker ( #18208 )
2021-09-03 09:35:18 +01:00
Alex Wu
dde8250744
Better error message on docker wheel build ( #17881 )
...
* Better error message
* Apply suggestions from code review
Co-authored-by: Clark Zinzow <clarkzinzow@gmail.com>
Co-authored-by: Clark Zinzow <clarkzinzow@gmail.com>
2021-08-16 18:07:10 -07:00
Sven Mika
0bc0e17712
CUDA 11.2 in docker images
2021-08-16 12:31:19 +02:00
Ian Rodney
54f107f559
[Docker] Exclude +dbg builds when finding Wheels ( #17826 )
2021-08-13 16:04:57 -07:00
Amog Kamsetty
9f5dc5ec9f
[Docker] Downgrade to CUDA 11.0 ( #17806 )
2021-08-13 20:39:06 +02:00
mwtian
b8e71f641c
[Build] Ray Docker image for Python 3.9. ( #16571 )
2021-07-22 13:38:57 -07:00
SongGuyang
a57de0e224
support build different python wheel in setup.py ( #16998 )
2021-07-16 13:01:48 +08:00
chenk008
06c7db7dca
[Core] Rename container option and ray-nest-container ( #16771 )
...
* rename container_option to container
* rename ray-nest-container to ray-worker-container
* lint
Co-authored-by: wuhua.ck <wuhua.ck@alibaba-inc.com>
2021-07-01 13:12:26 +08:00
chenk008
c318293d9f
[Core] start worker in container ( #16671 )
2021-06-29 10:12:47 -07:00
Travis Addair
7802ff66d4
[docker] Updated GPU Dockerfiles to CUDA 11.2 ( #16269 )
2021-06-07 16:15:19 -07:00
Simon Mo
d6b3050632
[Buildkite] Wheels and Docker fixup ( #16241 )
2021-06-04 00:48:12 -07:00
Simon Mo
ab93a3a64a
[CI] Buildkite upload wheels to S3 and docker ( #16138 )
2021-06-03 20:10:31 -07:00
Sven Mika
f25d58492d
[Testing] Dependabot for RLlib. ( #15812 )
2021-05-17 18:24:13 +02:00
Ian Rodney
ca43e61949
[docker] Make Docker Build More Human Friendly ( #15543 )
2021-05-05 11:22:17 -07:00
Ian Rodney
34d3d9294c
[Docker] Fix Build Images & Include in pre-merge testing ( #15622 )
2021-05-03 16:18:25 -07:00
Ian Rodney
26682c347a
[docker] Authenticate earlier to avoid docker Rate-limits ( #15618 )
2021-05-03 12:28:34 -07:00
Travis Addair
0f921cdead
Changed base GPU image to devel to compile Horovod CUDA kernels ( #15559 )
2021-04-28 17:20:58 -07:00
Amog Kamsetty
643cf4c755
Revert "[Docker] Check torch and tf installation" ( #15536 )
...
This reverts commit fb17ef7a40
2021-04-27 08:40:13 -07:00
Ian Rodney
fb17ef7a40
[Docker] Check torch and tf installation
2021-04-27 00:24:23 -07:00
Ian Rodney
2e9b065260
[HotFix] Avoid pushing nightly tags without py in them ( #14916 )
2021-03-24 17:40:45 -07:00
Ian Rodney
fab2c40d29
[Docker] Build only on master or release ( #14798 )
2021-03-19 22:02:33 -07:00
Ian Rodney
b6c4f21fda
fix docker build ( #14536 )
2021-03-08 09:33:26 -08:00
Ian Rodney
8cfaea5fc5
[Docker] Make Docker Build Python file easier to use! ( #14223 )
2021-02-26 15:23:02 -08:00
Simon Mo
3fb6b07aea
[Buildkite] Add wheels, jars, and docker builds. ( #14190 )
2021-02-18 14:19:28 -08:00
Simon Mo
a3796b3ed5
[CI] Add other Travis Linux builds to buildkite ( #13769 )
2021-01-29 15:48:02 -08:00
Ian Rodney
813a7ab0e2
[docker] Build Python3.6 & Python3.8 Docker Images ( #13548 )
2021-01-28 15:24:50 -08:00
Ian Rodney
b4bcb9b60a
[Docker] Use Cuda 11 ( #13691 )
2021-01-27 13:45:30 -08:00
Amog Kamsetty
43f70faa25
[Tune] Pin Tune Dependencies ( #13027 )
...
Co-authored-by: Ian <ian.rodney@gmail.com>
2021-01-07 14:03:06 -08:00
Ian Rodney
ca6c2b2442
[docker] Use cuDNN7, not 8 ( #12375 )
2020-11-25 12:06:53 -08:00
Ian Rodney
8f2b447ba4
[docker pipeline] Base-Deps, Dataclasses & Releases ( #12119 )
2020-11-18 14:34:04 -06:00
Barak Michener
05c4e3fb2a
[build] Build wheels with manylinux2014 ( #11621 )
...
* necessary changes
* Split bazel install
* manylinux2014
* change references to manylinux2014
* Fix lint
* port alex's docker build changes
* fix config issue
* remove extra manylinux2010 requirement script
* revert SHA overwrite
* wip
* incompatible_linklibs
* fix nits
2020-11-03 19:36:32 -08:00
Ian Rodney
6e89702508
[docker] Disable Readme push to avoid errors ( #11770 )
2020-11-02 19:12:51 -08:00
Alex Wu
cce91b51bd
[docker] Fix docker regex ( #11726 )
...
Co-authored-by: Alex Wu <alex@anyscale.com>
2020-11-02 11:23:06 -08:00
Alex Wu
5a83d8918a
[release] Do not tag docker latest on release builds ( #11694 )
...
* fix
* Added comment
Co-authored-by: Alex Wu <alex@anyscale.com>
2020-10-29 23:13:25 -07:00
Barak Michener
91fa7e0b4e
[releng]: Quiet Docker Push (and explain why) ( #11623 )
2020-10-29 00:18:51 -07:00
Ian Rodney
7a0184e081
[docker] Push to DockerHub in CI ( #11442 )
2020-10-23 12:02:15 -07:00
Sumanth Ratna
4946c1e6de
[docker] Minor improvements ( #11352 )
2020-10-19 12:42:53 -07:00
Ian Rodney
6426fb3fff
[CI] Fix-Up Docker Build (Use Python) ( #11139 )
2020-10-12 14:22:51 -07:00
