Commit graph

575 commits

Author SHA1 Message Date
Kai Fricke
fb38d06cfb
Move RLLib GPU release test dependencies to ml docker (#18208) 2021-09-03 09:35:18 +01:00
mwtian
134ac0ef55
[CI] Fix clang-format to always compare against master (#18140) 2021-08-31 10:16:33 -07:00
Kai Fricke
a8dbc44f9a
[ci] minimal dependency install test (#18071) 2021-08-31 15:26:25 +02:00
Antoni Baum
5be6bda4cf
[tests] Add Ludwig CI test (#18126) 2021-08-30 12:27:39 -07:00
Simon Mo
7c01ea7d2f
[Serve][Hotfix] Skip get_deployment on windows (#18029) 2021-08-25 11:27:31 -05:00
Chen Shen
08193b8e0a
fix more windows failures (#18058) 2021-08-24 21:19:45 -07:00
Kai Fricke
d058f98546
[RLlib] Add GPU tests to CI (run per-PR). (#17891)
Co-authored-by: simon-mo <simon.mo@hey.com>
2021-08-24 09:20:45 +02:00
Clark Zinzow
5ca28b1cc8
[Core] Update Bazel (to 3.4.1), gRPC, boringssl, and absl as a precursor to gRPC streaming PR. (#17903)
* Update Bazel (to 3.4.1), gRPC, boringssl, absl.

* Always reinstall Bazel if needing to upgrade to a new Bazel version.

* Add patch for properly detecting Windows Python headers when building gRPC.

* Add minimum Bazel version check.

* Update docs with new Bazel version.
2021-08-21 11:33:11 -07:00
Sven Mika
a2d96c513a
[RLlib] Expand machine for nightly multi-gpu learning tests. (#17955) 2021-08-19 22:27:30 +02:00
Simon Mo
b573864928
[CI] Add test owners (#17893) 2021-08-18 18:38:31 -07:00
Simon Mo
8fe970f4e7
[Buildkite] Cleanup test wheel environment (#17912)
The macOS builders are shared and reused across commits.
@clarkzinzow found a bug that the installed version of the wheel
is not the on in PR. This should fix it.

https://buildkite.com/ray-project/ray-builders-pr/builds/11628#be6c5fd6-14a2-449c-8f35-e3382a6ee647
2021-08-18 08:32:35 -07:00
SangBin Cho
4971e13941
[Build] Asan wheel test (#17685)
* in progerss

* ASAN tests.

* d

* in progress

* in progress without the asan wheel

* Support the asan wheel.

* Support the asan wheels

* Not build a binary for asan

* Fix issues

* Remove a wrong build

* Separate out asan wheel build

* Try preparing more deps.

* ip

* Try different version

* done

* d

* Trial

* Another try

* Another try

* skip cpp build to see what happens

* add more des

* ip

* abc

* Try next

* completed

* try

* Try without static libasan

* dbg

* Try static link

* Fix issues

* abc
2021-08-17 10:21:41 -07:00
Alex Wu
dde8250744
Better error message on docker wheel build (#17881)
* Better error message

* Apply suggestions from code review

Co-authored-by: Clark Zinzow <clarkzinzow@gmail.com>

Co-authored-by: Clark Zinzow <clarkzinzow@gmail.com>
2021-08-16 18:07:10 -07:00
Sven Mika
0bc0e17712
CUDA 11.2 in docker images 2021-08-16 12:31:19 +02:00
Ian Rodney
54f107f559
[Docker] Exclude +dbg builds when finding Wheels (#17826) 2021-08-13 16:04:57 -07:00
Amog Kamsetty
9f5dc5ec9f
[Docker] Downgrade to CUDA 11.0 (#17806) 2021-08-13 20:39:06 +02:00
qicosmos
a2a1c46c83
[C++ Worker]Fix for mac (#17633)
* linkopts shared

* replace gflags with absl flags

* fix

* add test option

* fix

* add cpp worker to mac ci

* fix

* support empty redis password;mod arc argv

* add encoding

* test

* ignore example test on mac

* support mac

* fix

* fix and update doc

* fix

* fix run.sh

* fix init

* fix typo

* fix run.sh

* fix lint

Co-authored-by: 久龙 <guyang.sgy@antfin.com>
2021-08-13 12:22:37 +08:00
SongGuyang
c62ce78be8
make C++ example more simpler (#17609) 2021-08-09 19:39:16 +08:00
Simon Mo
c315596ed2
[Buildkite] Migrate macOS wheel builds (#16913) 2021-08-07 21:54:34 -07:00
Chen Shen
0fd3f761b9
[ci][rfc] build debug wheels and run python test on debug build (#17399)
* enable debug mode

* add

* :upload debug wheels

* upload debug wheels

* add

* fix bug

* add dbg

* Update python/setup.py

Co-authored-by: Simon Mo <simon.mo@hey.com>

* skip windows

Co-authored-by: Simon Mo <simon.mo@hey.com>
2021-08-05 17:58:19 -07:00
SongGuyang
3e42f54910
Support copyright format for c++ files (#14348) 2021-08-04 17:19:38 +08:00
Chen Shen
1b89fa8624
[object store refactor 2/n] More refactor on PlasmaAllocator, and add unit tests 2021-08-01 22:10:03 -07:00
mwtian
b8e71f641c
[Build] Ray Docker image for Python 3.9. (#16571) 2021-07-22 13:38:57 -07:00
Vince Jankovics
05c9dfbbda
[RLlib] CV2 to Skimage dependency change (#16841) 2021-07-21 22:24:18 -04:00
Simon Mo
250f0c24e0
[Runtime Env] Refactor local dev mode for linking ray packages (#17227) 2021-07-21 00:48:58 -07:00
Kai Fricke
e881c6cff8
[core] remove aiohttp dependencies (#17181) 2021-07-21 07:18:19 +01:00
Amog Kamsetty
777921b2e7
[dependencies] vendor colorama (#17183) 2021-07-19 16:29:29 -07:00
SongGuyang
a57de0e224
support build different python wheel in setup.py (#16998) 2021-07-16 13:01:48 +08:00
chenk008
8b4df111e4
[CI] Fix share file leak (#17122) 2021-07-16 09:36:39 +08:00
SongGuyang
560fd15568
[C++ worker] support build and add C++ worker to python wheel (#16496) 2021-07-08 14:42:26 +08:00
Amog Kamsetty
5c589debfa
Revert "Set runs_per_test_detect_flakes for core tests on master (#16863)" (#16936)
This reverts commit 44042519af.
2021-07-07 10:25:46 -07:00
Dmitri Gekhtman
c6497c6520
[client][test] Client multiprocessing tests + client api minor fix (#16904) 2021-07-07 09:47:27 -07:00
Eric Liang
44042519af
Set runs_per_test_detect_flakes for core tests on master (#16863) 2021-07-06 18:46:48 -07:00
Yi Cheng
4bb3883a73
[dataset] deduct filesystem automatically (#16762) 2021-07-03 00:50:59 -07:00
Clark Zinzow
52da2cce68
[Dataset] Adds JSON, CSV, Pandas, and Dask IO layers, and adds the write side of the Parquet IO layer. (#16724) 2021-07-01 11:57:40 -07:00
chenk008
06c7db7dca
[Core] Rename container option and ray-nest-container (#16771)
* rename container_option to container

* rename ray-nest-container to ray-worker-container

* lint

Co-authored-by: wuhua.ck <wuhua.ck@alibaba-inc.com>
2021-07-01 13:12:26 +08:00
chenk008
c318293d9f
[Core] start worker in container (#16671) 2021-06-29 10:12:47 -07:00
Amog Kamsetty
e26c232954
[CI] Suppress output for Mac wheel build (#16603) 2021-06-22 09:03:50 -07:00
mwtian
f5f23448fc
Support downloading and testing wheels for Python 3.9. (#16586) 2021-06-21 12:02:22 -07:00
Richard Liaw
ed093cebb0
Revert "[docs] readthedocs.yaml and remove requirements-rtd.txt (#16482)" (#16512)
This reverts commit c9537be5c1.
2021-06-17 11:50:30 -07:00
Richard Liaw
c9537be5c1
[docs] readthedocs.yaml and remove requirements-rtd.txt (#16482) 2021-06-17 09:40:06 -07:00
Simon Mo
577fa08649
[Buildkite] Drop the duplicated Travis tests (#16420) 2021-06-15 10:43:17 -07:00
Simon Mo
5f4495108e
Fix macOS compilation (#16412) 2021-06-14 13:30:38 -07:00
Simon Mo
6763e95079
Revert "Revert "[Buildkite] cleanup artifacts directory between builds"" (#16385) 2021-06-14 11:30:55 -07:00
Simon Mo
2cdaf132b5
Revert "[Buildkite] cleanup artifacts directory between builds (#16307)" (#16372) 2021-06-11 08:33:26 -07:00
SongGuyang
379c87dbbb
[C++ worker] bugfix of incorrect flag name "redis_password" and add test to support connecting to external cluster (#16219) 2021-06-11 11:49:13 +08:00
Simon Mo
8d56a36d28
[Buildkite] cleanup artifacts directory between builds (#16307) 2021-06-10 17:59:52 -07:00
mwtian
2e8d8fba02
[Build] Another attempt at building Python 3.9 MacOS wheels (#16347)
* Test rollforward python 3.9

* Upgrade setproctitle in thirdparty

* Update cython requirement to match those in wheel build scripts.

* Fix MANIFEST.in

* Fix file copying in setup.py
2021-06-10 10:20:30 -07:00
Simon Mo
4c0069edc2
[CI] Fix determine_tests_to_run logic (#16320)
We recently had two master breakages due to determine_tests_to_run
script bug.
https://github.com/ray-project/ray/pull/16120
https://github.com/ray-project/ray/pull/15981

This PR fix both of them.
2021-06-08 19:59:03 -07:00
Simon Mo
9afb6f1ada
Revert "[CI] macOS Build to buildkite (#16135)" (#16312)
This reverts commit 113556463d.
2021-06-08 09:33:03 -07:00