Commit graph

343 commits

Author SHA1 Message Date
Ian Rodney
8cfaea5fc5
[Docker] Make Docker Build Python file easier to use! (#14223) 2021-02-26 15:23:02 -08:00
Ian Rodney
1a9a0024d5
[Wheel] Build Py36 & Py38 in separate deploy (#13797) 2021-01-29 12:28:40 -08:00
Ian Rodney
813a7ab0e2
[docker] Build Python3.6 & Python3.8 Docker Images (#13548) 2021-01-28 15:24:50 -08:00
Amog Kamsetty
01d74af89d
[horovod] Horovod+Ray Pytorch Lightning Accelerator (#13458) 2021-01-22 16:30:10 -08:00
Stephanie Wang
0998d69968
[core] Admission control for pulling objects to the local node (#13514)
* Admission control, TODO: tests, object size

* Unit tests for admission control and some bug fixes

* Add object size to object table, only activate pull if object size is known

* Some fixes, reset timer on eviction

* doc

* update

* Trigger OOM from the pull manager

* don't spam

* doc

* Update src/ray/object_manager/pull_manager.cc

Co-authored-by: Eric Liang <ekhliang@gmail.com>

* Remove useless tests

* Fix test

* osx build

* Skip broken test

* tests

* Skip failing tests

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2021-01-21 16:46:42 -08:00
Amog Kamsetty
07e97fe4c2
[xgb] re-enable xgboost_ray tests (#13416)
* re-enable

* fix

* update xgb_ray version
2021-01-14 22:14:44 +01:00
Dmitri Gekhtman
1968b2f9d8
[autoscaler/k8s] [CI] Kubernetes test ray up, exec, down (#12514) 2021-01-13 15:03:56 -08:00
Amog Kamsetty
9eebd090cf
[Dependabot] [CI] Re-configure Dependabot and disable duplicate builds (#13359) 2021-01-12 09:28:58 -08:00
Amog Kamsetty
43f70faa25
[Tune] Pin Tune Dependencies (#13027)
Co-authored-by: Ian <ian.rodney@gmail.com>
2021-01-07 14:03:06 -08:00
chaokunyang
33089c44e2
Fix streaming ci failure (#12830) 2020-12-30 10:45:52 +08:00
Eric Liang
5a4e50c9d9
Disable broken streaming tests (#13095) 2020-12-29 00:58:18 -08:00
Max Fitton
81bfee79bc
Fix OS X Wheel Build - Update brew cask install (#13062)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-12-23 20:51:50 -08:00
Barak Michener
c4e273920f
[ray_client]: Insert decorators into the real ray module to allow for client mode (#13031) 2020-12-22 22:51:45 -08:00
Barak Michener
7ab9164f1b
[ray_client] Integrate with test_basic, test_basic_2 and test_actor (#12964) 2020-12-20 14:54:18 -08:00
Eric Liang
64c97d25d3
Enable by default new scheduler (#12735) 2020-12-19 13:22:24 -08:00
Kai Fricke
55ae567f7a
[tune] Fix and enable SigOpt tests (#12877)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-12-18 01:33:12 -08:00
Richard Liaw
c56799e3da
disable-for-now (#12838)
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2020-12-14 14:18:31 -08:00
Richard Liaw
2f2bd884a3
[tune] upgrade gpytorch, bump default pytorch to 1.7.0 (#12776)
* upgrade gpytorch

Signed-off-by: Richard Liaw <rliaw@berkeley.edu>

* pin

Signed-off-by: Richard Liaw <rliaw@berkeley.edu>

* version-torch

Signed-off-by: Richard Liaw <rliaw@berkeley.edu>

* fix-build

Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2020-12-12 10:35:33 -08:00
Richard Liaw
7c009d22cf
[docs] Add xgboost_ray to docs (#12184)
Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com>
2020-11-27 11:36:56 -08:00
Eric Liang
67544992b5
Remove the old operator directory (#12143) 2020-11-19 15:37:28 -08:00
dHannasch
96c1caccaf
Use Ubuntu 18.04 so that a newer version of Docker will be available by default. (#12139) 2020-11-19 10:40:07 -08:00
Eric Liang
c933477915
[new scheduler] Pass test_basic and add CI builds with flag on (#11635) 2020-10-28 11:02:43 -07:00
Max Fitton
caf3b04b27
[Dashboard] Turn on new dashboard by default pt 2 (#11510) 2020-10-23 15:52:14 -05:00
Richard Liaw
e7aa6441b7
[tune] a tiny ptl example (#11497) 2020-10-22 18:50:34 -07:00
Ian Rodney
6426fb3fff
[CI] Fix-Up Docker Build (Use Python) (#11139) 2020-10-12 14:22:51 -07:00
Max Fitton
ff6d412ad9
[Dashboard] Add API support for the logical view and machine view in new backend (#11012)
* Add API support for the logical view and machine view, which lean on datacenter in common.

* Update dashboard/datacenter.py

Co-authored-by: fyrestone <fyrestone@outlook.com>

* Update dashboard/modules/logical_view/logical_view_head.py

Co-authored-by: fyrestone <fyrestone@outlook.com>

* Address PR comments

* lint

* Add dashboard tests to CI build

* Fix integration issues

* lint

Co-authored-by: Max Fitton <max@semprehealth.com>
Co-authored-by: fyrestone <fyrestone@outlook.com>
2020-10-02 17:58:44 -07:00
Amog Kamsetty
4872ffb44c
[Tune] Upgrade Tune tests to TF v2.2 (#10963) 2020-09-22 18:30:05 -07:00
chaokunyang
1aad8aa39c
[Java] Fix java doc building error (#10757) 2020-09-14 17:44:45 +08:00
Ian Rodney
5bc2ba38fd
[docker] Detect CPUs in container correctly (#10507)
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-13 23:40:48 -07:00
chaokunyang
bf71c0b9f6
[Java] Deploy snapshort jars to maven repository in travis ci (#10701) 2020-09-10 15:40:16 -07:00
Richard Liaw
43a7a64b30
[tune] horovod trainable (#10304) 2020-09-03 16:53:35 -07:00
SangBin Cho
dc7fe1a4c5
[Placement Group] Atomic Placement Group Part 1, Basic Structure. (#10482)
* Write a test.

* Basic structure done.

* Reduce flakiness of tests.

* Addressed code review.

* Skipping tests because it is flaky for now.

* Fix linting issues.

* Increase sleep time to see lint messages.

* Lint issue fixed.
2020-09-02 18:14:46 -07:00
Ian Rodney
4324dd5929
[docker] Refactor "autoscaler" image into "-autoscaler" tag and "ray-ml" image. (#10351) 2020-09-02 13:03:35 -07:00
Simon Mo
52a5ec99d0
Skip multiple platform jar (#10478)
It's consistently failing on master
2020-09-01 13:13:31 -07:00
Simon Mo
d80e08ce95
Move Docker ahead in LINUX_WHEELS deploy steps (#10475) 2020-09-01 12:17:43 -07:00
Ian Rodney
4f3559292d
[travis] try to build docker images again (#10412) 2020-08-31 10:55:28 -07:00
Ian Rodney
d76d4822bd
[Docker] Fix building images (#10393) 2020-08-28 10:41:02 -07:00
SangBin Cho
7b29eb7949
[Build] Try parallel Python builds. (#10291)
* Trial 1.

* Parallelize even more.
2020-08-28 00:06:52 -07:00
SongGuyang
cb70864c04
[cpp worker] support cluster mode and object Put/Get works (#9682) 2020-08-28 13:53:36 +08:00
Ian Rodney
465d4c50b6
[docker push fix] (#10375) 2020-08-27 17:07:48 -07:00
Ian Rodney
9056854c06
drop keep alive (#10347) 2020-08-26 21:15:48 -07:00
Ian Rodney
2526c06b5e
[WIP] [docker] Cleanup Docker Base-Deps (#9988)
* cleanup-base deps

* only build base-deps a bit

* remove parens

* formatting

* add ray-deps

* gpu enabled

* always include wheel

* fix script

* log new variables

* run tests for docker

* try to include env variables

* source files

* remove bash when sourcing

* add new lines

* use wget

* dual build autoscaler

* switch to gnupg

* add gcc cmake

* remove blist

* clarify build-docker-images
2020-08-26 19:36:11 -07:00
fyrestone
05c103af94
[Dashboard] Start the new dashboard (#10131)
* Use new dashboard if environment var RAY_USE_NEW_DASHBOARD exists; new dashboard startup

* Make fake client/build/static directory for dashboard

* Add test_dashboard.py for new dashboard

* Travis CI enable new dashboard test

* Update new dashboard

* Agent manager service

* Add agent manager

* Register agent to agent manager

* Add a new line to the end of agent_manager.cc

* Fix merge; Fix lint

* Update dashboard/agent.py

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Update dashboard/head.py

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Fix bug

* Add tests for dashboard

* Fix

* Remove const from Process::Kill() & Fix bugs

* Revert error check of execute_after

* Raise exception from DashboardAgent.run

* Add more tests.

* Fix compile on Linux

* Use dict comprehension instead of dict(generator)

* Fix lint

* Fix windows compile

* Fix lint

* Test Windows CI

* Revert "Test Windows CI"

This reverts commit 945e01051ec95cff5fcc1c0bc37045b46e7ad9a6.

* Fix ParseWindowsCommandLine bug

* Update src/ray/util/util.cc

Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>

Co-authored-by: 刘宝 <po.lb@antfin.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>
2020-08-24 13:24:23 -07:00
Robert Nishihara
36e626e95d
Revert "[Dashboard] Start the new dashboard (#9860)" (#10116)
This reverts commit 739933e5b8.
2020-08-14 14:06:57 -07:00
fyrestone
739933e5b8
[Dashboard] Start the new dashboard (#9860) 2020-08-13 11:01:46 +08:00
Simon Mo
5b4a10368f
Upload Travis in after_script phase (#10046)
The deploy phase is skipped when script/tests fails. This prevent us
from uploading failed result to S3.

This PR change it to after_script phase and the secret is injected
via Travis Env Var.

https://docs.travis-ci.com/user/job-lifecycle/
2020-08-11 11:46:00 -07:00
Simon Mo
4c52adddfa
[Core] Type check ObjectRef (#9856)
* Type check ObjectRef

* Bug fix

* Port typing tests to bazel test
2020-08-11 10:38:29 -07:00
Simon Mo
65848201c3
Hotfix travis deploy step for bazel log uploads (#10032) 2020-08-10 20:50:50 -07:00
Simon Mo
df676bc9aa
Upload bazel test logs to S3 (#9884) 2020-08-10 14:26:31 -07:00
Richard Liaw
328b450cde
[tune] fix testing for serve-tune test breaking (#9993) 2020-08-07 23:05:18 -07:00