Commit graph

268 commits

Author SHA1 Message Date
Sven Mika
f3bbe4ea44
[RLlib] Test cases/BUILD cleanup; split "everything else" (longest running one rn) tests in 2. (#17640) 2021-08-16 22:01:01 +02:00
Simon Mo
61ac06cc6d
[Buildkite] Fix zsh bug so latest wheels are pushed correctly (#17831) 2021-08-13 15:33:14 -07:00
qicosmos
a2a1c46c83
[C++ Worker]Fix for mac (#17633)
* linkopts shared

* replace gflags with absl flags

* fix

* add test option

* fix

* add cpp worker to mac ci

* fix

* support empty redis password;mod arc argv

* add encoding

* test

* ignore example test on mac

* support mac

* fix

* fix and update doc

* fix

* fix run.sh

* fix init

* fix typo

* fix run.sh

* fix lint

Co-authored-by: 久龙 <guyang.sgy@antfin.com>
2021-08-13 12:22:37 +08:00
Clark Zinzow
d6eeb5dc70
[Datasets] Add local and S3 filesystem test coverage for file-based datasources. (#17158) 2021-08-12 08:39:31 -07:00
Simon Mo
c315596ed2
[Buildkite] Migrate macOS wheel builds (#16913) 2021-08-07 21:54:34 -07:00
Chen Shen
0fd3f761b9
[ci][rfc] build debug wheels and run python test on debug build (#17399)
* enable debug mode

* add

* :upload debug wheels

* upload debug wheels

* add

* fix bug

* add dbg

* Update python/setup.py

Co-authored-by: Simon Mo <simon.mo@hey.com>

* skip windows

Co-authored-by: Simon Mo <simon.mo@hey.com>
2021-08-05 17:58:19 -07:00
Eric Liang
d4f9d3620e
Move ray.data out of experimental (#17560) 2021-08-04 13:31:10 -07:00
architkulkarni
756a4e7a90
[Core] [runtime env] update tests to use ray.init(runtime_env=...) and add e2e test (#17232) 2021-07-26 11:21:30 -05:00
Sven Mika
5231fdd996
[Testing] Split RLlib example scripts CI tests into 4 jobs (from 2). (#17331) 2021-07-26 10:52:55 -04:00
matthewdeng
fdbeef6046
[SGD] RaySGD v2 skeleton code (#17300)
* [SGD] RaySGD v2 skeleton code

* add build file

* move file

* empty

* rename

* address comments

* add method interfaces

* move BUILD file out of tests dir

Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com>
2021-07-25 17:39:24 -07:00
mwtian
b8e71f641c
[Build] Ray Docker image for Python 3.9. (#16571) 2021-07-22 13:38:57 -07:00
Simon Mo
e7ede45e37
[Buildkite] Cleanup macOS builders (#17145)
macOS builders are reused, so excessive disk usage might lead to
run out of disk space error
2021-07-16 10:46:08 -07:00
Amog Kamsetty
5c589debfa
Revert "Set runs_per_test_detect_flakes for core tests on master (#16863)" (#16936)
This reverts commit 44042519af.
2021-07-07 10:25:46 -07:00
Eric Liang
44042519af
Set runs_per_test_detect_flakes for core tests on master (#16863) 2021-07-06 18:46:48 -07:00
Clark Zinzow
52da2cce68
[Dataset] Adds JSON, CSV, Pandas, and Dask IO layers, and adds the write side of the Parquet IO layer. (#16724) 2021-07-01 11:57:40 -07:00
chenk008
06c7db7dca
[Core] Rename container option and ray-nest-container (#16771)
* rename container_option to container

* rename ray-nest-container to ray-worker-container

* lint

Co-authored-by: wuhua.ck <wuhua.ck@alibaba-inc.com>
2021-07-01 13:12:26 +08:00
Amog Kamsetty
69507f53db
[Horovod] Add Horovod example (#16742)
* wip

* updates

* updates

* update

* formatting

* updates

* updates

* update

* fix

* add timeout
2021-06-29 19:15:15 -07:00
chenk008
c318293d9f
[Core] start worker in container (#16671) 2021-06-29 10:12:47 -07:00
Amog Kamsetty
be1f6d59fa
[CI] Re-try Tag rllib flaky tests (#16680) 2021-06-28 18:42:54 +02:00
Eric Liang
6bfa97eed7
Check in the first iteration of an Arrow-based dataset api (#16648) 2021-06-25 18:45:13 -07:00
SangBin Cho
f816f613c7
[Test] Handle flaky tests (#16602)
* Handle flaky tests.

* lint

* tag more

* add test_scheduling

* Remove global gc

Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com>
2021-06-23 16:24:12 -07:00
Amog Kamsetty
e6d9f0b393
[Dask] Support Dask 2021.06.1 (#16547) 2021-06-19 18:22:23 -07:00
Simon Mo
38b5fe7e51
[Buildkite] Add rest of the Python tests (#16517) 2021-06-18 11:18:05 -05:00
Antoni Baum
ec7d7c8630
[Tune] Add soft imports test (#16450) 2021-06-15 18:50:21 -07:00
architkulkarni
412085dea7
[Runtime Env] filter out post wheel tests from doc tests (#16439) 2021-06-15 15:34:45 -07:00
Simon Mo
6763e95079
Revert "Revert "[Buildkite] cleanup artifacts directory between builds"" (#16385) 2021-06-14 11:30:55 -07:00
Amog Kamsetty
f9936c4252
[Dask] Dask Example Tests (#16346)
* add examples

* update dask docs

* add build file

* formatting

* fix ci command

* fix

* Update python/ray/util/dask/BUILD

* newline

* fix pytest fixtures

* fixes

* formatting

* fix shuffle example
2021-06-12 20:25:45 -07:00
Chris K. W
3fa9f2e5d6
[Modin] Add tests for modin (#16260)
Adds modin tests that run with and without ray client.
2021-06-11 12:23:33 -07:00
Simon Mo
2cdaf132b5
Revert "[Buildkite] cleanup artifacts directory between builds (#16307)" (#16372) 2021-06-11 08:33:26 -07:00
Simon Mo
8d56a36d28
[Buildkite] cleanup artifacts directory between builds (#16307) 2021-06-10 17:59:52 -07:00
architkulkarni
7d029f8e71
[Doc] [Core] [runtime env] Add runtime env doc (#16290) 2021-06-09 20:02:16 -05:00
Amog Kamsetty
de4045703d
[SGD] Fix SGD Client CI (#16301) 2021-06-08 10:08:14 -07:00
Simon Mo
9afb6f1ada
Revert "[CI] macOS Build to buildkite (#16135)" (#16312)
This reverts commit 113556463d.
2021-06-08 09:33:03 -07:00
Simon Mo
113556463d
[CI] macOS Build to buildkite (#16135) 2021-06-07 21:33:00 -07:00
Siyuan (Ryans) Zhuang
480e5e822e
Inital workflow API implementation (#16174) 2021-06-07 10:00:15 -07:00
Simon Mo
d6b3050632
[Buildkite] Wheels and Docker fixup (#16241) 2021-06-04 00:48:12 -07:00
Simon Mo
ab93a3a64a
[CI] Buildkite upload wheels to S3 and docker (#16138) 2021-06-03 20:10:31 -07:00
Eric Liang
43c97c2afb
Disable timeline events collection in Ray by default (#15989) 2021-06-02 18:04:29 -07:00
Amog Kamsetty
65f1d67e9c
[SGD] Ray Client Support and tests (#16111)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-06-01 13:21:26 -07:00
Amog Kamsetty
cfa2997b86
[XGBoost] Add test with Ray Client (#16103) 2021-05-28 16:13:06 -07:00
Ian Rodney
b5adc87e0e
[CI] Decrease BuildKite Docker Build Time (#16020) 2021-05-24 10:31:54 -07:00
Amog Kamsetty
47cd075829
[Tune] Ray Client support for examples & CI (#15932)
Out of the box Ray Client support for Tune examples. Also add key examples with Ray Client to run in CI
2021-05-21 15:33:43 -07:00
architkulkarni
02f21653cc
[Core] Automatically inject ray and python version in runtime_env (#15958) 2021-05-21 17:15:52 -05:00
architkulkarni
c3d06697bb
[Core] Add dynamic conda env install in shim process (#15881) 2021-05-19 15:46:42 -05:00
Sven Mika
f25d58492d
[Testing] Dependabot for RLlib. (#15812) 2021-05-17 18:24:13 +02:00
Sven Mika
bc09e75b78
[RLlib] Fix 3 flakey test cases. (#15785) 2021-05-16 12:20:33 +02:00
Eric Liang
cb59d30917
Drop profiling events if the GCS becomes backlogged (#15726) 2021-05-11 14:10:34 -07:00
Ian Rodney
5d938514b5
[Tests] Re-enable disabled tests (#15723) 2021-05-10 22:26:24 -07:00
Eric Liang
ff36ae594b
Remove flaky tag from newly unflaky tests (#15639) 2021-05-05 12:15:46 -07:00
Simon Mo
e34632b3b4
[CI] Mark flaky tests "soft failed" in buildkite (#15544)
https://buildkite.com/changelog/56-command-steps-can-now-be-made-to-soft-fail
2021-04-27 14:22:28 -07:00