Commit graph

7433 commits

Author SHA1 Message Date
SangBin Cho
8b9e0d1e6c
Add tqdm to windows build. (#14197) 2021-02-18 16:01:04 -08:00
Simon Mo
3fb6b07aea
[Buildkite] Add wheels, jars, and docker builds. (#14190) 2021-02-18 14:19:28 -08:00
Clark Zinzow
c092a5d184
Cancel object location long-poll on object free. (#14165) 2021-02-18 14:09:43 -08:00
Stephanie Wang
dfb86e0a8f
[core] Push object chunks with multiple threads (#14191)
* Push object chunks with multiple threads

* fix build
2021-02-18 14:09:23 -08:00
Kai Fricke
a3dc92ead6
[tune] fix specifying nested metrics in progress reporter (#14189) 2021-02-18 22:26:03 +01:00
Sven Mika
775e685531
[RLlib] Issue #13824: compress_observations=True crashes for all algos not using a replay buffer. (#14034) 2021-02-18 21:36:32 +01:00
Barak Michener
50ccd41cbf
fix and test the errors, limited to pickling (#14174)
Change-Id: I95c4715c0f54b1d5909aeb8eb96403db22aa0f07
2021-02-18 11:13:15 -08:00
SangBin Cho
3ad05337f7
[Shuffle] Use progress bar for experimental.shuffle (#14179)
* done.

* Add time.
2021-02-18 11:05:54 -08:00
architkulkarni
6d88036340
[ray_client]: Skip flaky test_cancel_chain on Windows (#14167)
* skip test_cancel_chain on windows

* lint

* lint
2021-02-18 10:43:15 -08:00
SangBin Cho
66f93a3d63
Revert "Fix OSX error and re-merge unhandled exceptions handling (#14138)" (#14180)
This reverts commit ee584e8328.
2021-02-18 10:35:38 -08:00
Sven Mika
929946271d
[RLlib] Issue #14022: Trajectory View API fails in MA-env where a new agent terminates right away (done=True right after initial obs). (#14031) 2021-02-18 14:07:49 +01:00
qicosmos
bc46fc5fce
Cpp worker refactor serializer (#14027) 2021-02-18 15:37:58 +08:00
Qing Wang
b579186791
Fix reset load_code_from_local in 2nd session. (#13985)
Co-authored-by: Qing Wang <jovany.wq@antgroup.com>
2021-02-18 13:52:36 +08:00
Siyuan (Ryans) Zhuang
af8c0c1add
fix numpy ufunc serialization failures (#14143) 2021-02-17 21:28:21 -08:00
dependabot[bot]
323c7da70c
[tune](deps): Bump matplotlib from 3.3.3 to 3.3.4 in /python/requirements (#14087)
Bumps [matplotlib](https://github.com/matplotlib/matplotlib) from 3.3.3 to 3.3.4.
- [Release notes](https://github.com/matplotlib/matplotlib/releases)
- [Commits](https://github.com/matplotlib/matplotlib/compare/v3.3.3...v3.3.4)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-02-17 19:31:07 -08:00
Amog Kamsetty
be7114639d
[Tune] Update Transformers Example (#14150)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-6-151.us-west-2.compute.internal>
2021-02-17 18:37:27 -08:00
qicosmos
2307f54e88
[C++ API] simplify code of Arguments; avoid memory copy (#13978) 2021-02-18 10:33:18 +08:00
EscapeReality846089495
5ce1d262a3
[tune] Fixed atomic_save w/ os.replace (#14089)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-02-17 15:48:39 -08:00
SangBin Cho
9451b4ea86
[Object Spilling] Fix the race condition. (#14149)
* Fix the race condition.

* done.

* Fix the lint issu.e

* fix issues. addressed comments.
2021-02-17 14:35:22 -08:00
Kai Fricke
a0f73cf3f7
[xgboost] Update XGBoost release test configs (#13941)
* Update XGBoost release test configs

* Use GPU containers

* Fix elastic check

* Use spot instances for GPU

* Add debugging output

* Fix success check, failure checking, outputs, sync behavior

* Update release checklist, rename mounts
2021-02-17 23:00:49 +01:00
Antoni Baum
58d7398246
[Tune] Add HEBOSearch Searcher (#13863)
* HEBO first pass

* Fix bad quotes

* Fixes

* Reproductibility

* Update python/ray/tune/suggest/hebo.py

Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>

* Add hebo_example.py to BUILD

* Nit

* Update to pypi package

* Alphabetical HEBO requirement

* Fix syntax error

* Fix wrong space in hebo example

* Move validate_warmstart to utils

* Space assertion in HEBO

* Comment

* Apply suggestions from code review

Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>

* Formatting

Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
2021-02-17 22:53:10 +01:00
Eric Liang
ee584e8328
Fix OSX error and re-merge unhandled exceptions handling (#14138) 2021-02-17 13:35:07 -08:00
dependabot[bot]
67bdccca41
[tune](deps): Bump smart-open from 4.0.1 to 4.2.0 in /python/requirements (#14158)
Bumps [smart-open](https://github.com/piskvorky/smart_open) from 4.0.1 to 4.2.0.
- [Release notes](https://github.com/piskvorky/smart_open/releases)
- [Changelog](https://github.com/RaRe-Technologies/smart_open/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/piskvorky/smart_open/compare/4.0.1...v4.2.0)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-02-17 12:03:22 -08:00
Sumanth Ratna
c1d68d7dd0
[docs] Remove sphinx-gallery example runtimes (#14141)
e7f65d9b21/doc/conf.py (L340)
2021-02-17 11:07:16 -08:00
Alex Wu
753083c617
[docs][autoscaler] Update AWS node config link (#14125) 2021-02-17 10:44:10 -08:00
Kathryn Zhou
f6b5e838fe
Add disk and network metrics to Prometheus and fix dashboard (#14144) 2021-02-17 10:27:14 -08:00
SangBin Cho
3a6a977803
Revert "[Ownership based object directory] Turn on by default. (#13964)" (#14148)
This reverts commit 04d2df40cd.
2021-02-16 22:42:58 -08:00
architkulkarni
d9124e9329
Revert "[Core]Fix ray.kill doesn't cancel pending actor bug (#14025)" (#14146)
This reverts commit 1754359281.
2021-02-16 17:22:25 -08:00
SangBin Cho
04d2df40cd
[Ownership based object directory] Turn on by default. (#13964) 2021-02-16 17:16:44 -08:00
SangBin Cho
1b1420e069
[Scheduler] Fix spillback is done deterministically. (#14096)
* update.

* Fix comments.

* Addressed code review.

* fix a test.

* Addressed last code review.

* d.

* done.
2021-02-16 16:46:16 -08:00
SangBin Cho
4d7ab3c886
[Doc] Ray logging document. (#14102)
* Initial draft done.

* Addressed code review.
2021-02-16 15:27:30 -08:00
SangBin Cho
5135661bdf
[Metrics] Add spilling stats (#14103)
* Add stats for object spilling.

* Formatting.

* addressed code review.
2021-02-16 15:26:04 -08:00
Barak Michener
edf24580a6
[ray_client]: Set gRPC max message size to 4GiB (#14063)
* [ray_client]: Set gRPC max message size to 4GiB

Change-Id: Id4d6887cdd90dd761dd25248f10f104701462667

* reduce size

Change-Id: I71625ed3cffd9d8b3d7d3d7a981bb4dda00ed0a1

* Update test_basic_2.py

* Update test_advanced.py

* Update test_basic.py

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2021-02-16 14:32:23 -08:00
Simon Mo
33316d4f8f
Revert "Export additional metrics to Prometheus (#14061)" (#14134)
This reverts commit 82539f2da4.
2021-02-16 12:49:12 -08:00
Edward Oakes
019d84a9f3
[serve] [docs] High-level reorganization of the docs (#14120) 2021-02-16 14:07:56 -06:00
architkulkarni
3ce03a52bc
Revert "Revert "Revert "Unhandled exception handler based on local ref counti… (#14113)" (#14136)
This reverts commit e457872fe1.
2021-02-16 11:47:09 -08:00
SangBin Cho
b05f87d7b2
[Object Spilling] Share the same S3 session for smart_open spilling. (#13904) 2021-02-16 10:40:55 -08:00
Barak Michener
c43a64230e
[ray_client]: Fix mutual recursion (#14122) 2021-02-16 10:37:58 -08:00
SangBin Cho
684bb32cdf
Fix assert get_outer_ref None failed + Support better traceback. (#14126)
* in progress.

* Better exception handling & stacktrace.

* done.
2021-02-16 10:09:01 -08:00
Richard Liaw
864956f817
fix-skopt (#14116)
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2021-02-16 14:36:19 +01:00
Eric Liang
e434ffe06c
[tune] Avoid crash in client mode when return results creating logdir (#14115) 2021-02-15 19:25:14 -08:00
Ian Rodney
350fb5b9d1
[autoscaler] Remove Hardcoded 8265 (#14112) 2021-02-15 18:04:00 -08:00
Patrick Ames
da0c2c99a0
[autoscaler] Fix bad reference error when specifying IamInstanceProfile by name in config. (#14083) 2021-02-15 16:29:36 -08:00
Jack Parker-Holder
ebb6e552d2
[tune] PB2 - add small constant (#14118) 2021-02-15 16:04:10 -08:00
Edward Oakes
5e763893ea
[serve] Don't overwrite self.handle in StarletteEndpoint (#14111) 2021-02-15 17:51:54 -06:00
SangBin Cho
4ad79ca963
[Object Spilling] Remove LRU eviction (#13977)
* done.

* formatting.

* done.

* done.
2021-02-15 14:24:53 -08:00
Eric Liang
e457872fe1
Revert "Revert "Unhandled exception handler based on local ref counti… (#14113)
* Revert "Revert "Unhandled exception handler based on local ref counting (#14049)" (#14099)"

This reverts commit b45ae76765.

* reomve test

* fix

* fix
2021-02-15 14:11:11 -08:00
Alex Wu
4846a6c2d0
Release process update (#13798) 2021-02-15 11:40:49 -08:00
architkulkarni
496dd297e5
skip test_basic_reconstruction_actor_task on win (#14110) 2021-02-15 10:17:33 -08:00
architkulkarni
0fb96a61fc
[Serve] Add support for variable routes (#13968) 2021-02-15 11:42:42 -06:00