Ian Rodney
a4ebe2697c
[Autoscaler] Improve assert_called ( #19036 )
...
* improvements
* fix invocations
* improve not_has_call
2021-10-01 14:08:31 -07:00
Clark Zinzow
d22f838795
[Datasets] Delineate between ref and raw APIs for the Pandas/Arrow integrations. ( #18992 )
2021-10-01 13:08:25 -07:00
Frank Luan
f885060efa
Disable distributed sort test on Windows ( #19041 )
...
* [WIP] Sorting benchmark
* Separate num_mappers and num_reducers
* Add tests
* Fix tests
* Tracing
* Separate num_mappers and num_reducers
* Two-stage reduce
* Back pressure to avoid excessive spilling
* Make merger_concurrency an option
* Fix tests
* Tweaks
* Remote writers
* Format
* WIP
* Address comments
* Fix tests and address comments
* Lint
* Fix mount points for testing
* Simplify code path
* Address comments
* Disable distributed sort test on Windows
2021-10-01 12:17:28 -07:00
mwtian
56debfc063
[Object manager] fix comments
2021-10-01 11:42:07 -07:00
Stephanie Wang
c052395f4e
[core] Remove "plasma promotion" for serialized ObjectRefs
2021-10-01 10:39:55 -07:00
architkulkarni
b0a5564f4e
[Serve] Integrate metrics with minimal autoscaling algorithm and add e2e test ( #18793 )
2021-10-01 10:21:12 -07:00
mwtian
49a57aa477
[Scheduling] Report resource demand for infeasible 1-CPU tasks ( #19000 )
2021-09-30 22:03:02 -07:00
Jiajun Yao
d64872dd67
Fix python mutable default argument anti-pattern ( #19028 )
2021-10-01 13:05:02 +09:00
Edward Oakes
8e5d48d668
[runtime_env] Remove deprecated override_environment_variables and worker_env fields ( #18213 )
2021-09-30 18:55:24 -05:00
Jiajun Yao
81b052f222
[core] Fix port collision between metrics agent port and metrics export port ( #19016 )
2021-09-30 16:15:42 -07:00
Ian Rodney
02d1f659ba
[Workflows] Use RAY_ADDRESS in Tests ( #19012 )
2021-09-30 13:05:51 -07:00
Chris K. W
61d058fe66
[client] skip test_wrapped_actor_creation on windows ( #19013 )
...
* skip test_wrapped_actor_creation on windows
* rerun windows ci
2021-09-30 13:04:43 -07:00
Frank Luan
732af42ae9
[Sort benchmark] Two-stage reduce ( #17055 )
...
* [WIP] Sorting benchmark
* Separate num_mappers and num_reducers
* Add tests
* Fix tests
* Tracing
* Separate num_mappers and num_reducers
* Two-stage reduce
* Back pressure to avoid excessive spilling
* Make merger_concurrency an option
* Fix tests
* Tweaks
* Remote writers
* Format
* WIP
* Address comments
* Fix tests and address comments
* Lint
* Fix mount points for testing
* Simplify code path
* Address comments
2021-09-30 12:39:11 -07:00
architkulkarni
0f0b161ea1
Revert "Revert "[Serve] [doc] Improve runtime env doc"" ( #18943 )
...
* Revert "Revert "[Serve] [doc] Improve runtime env doc (#18782 )" (#18935 )"
This reverts commit e4f4c79252
2021-09-30 13:28:44 -05:00
Clark Zinzow
e384a6c91f
(TaskPool) Cancel all transformation tasks when one task fails or when SIGINT is received. ( #18991 )
2021-09-30 10:56:30 -07:00
gjoliver
e61f2c72d7
Upgrade bazel version to 4.2.1 ( #18996 )
2021-09-30 10:50:54 -07:00
mwtian
d12e35ce53
[Object manager] don't abort entire pull request on race condition in concurrent chunk receive ( #18955 )
2021-09-30 10:19:54 -07:00
Simon Mo
910553c3bb
[Core] Add private method to retrieve current task queue length ( #18964 )
2021-09-30 09:20:04 -07:00
Amog Kamsetty
98ac3f601c
[SGD] v1 to v2 Migration Guide ( #18887 )
...
* wip
* add guide
* fix test
* address comments
* add to docs
* fix
* remove markdown
* add warning to all pages
* formatting
* fix
* links
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* Update doc/source/raysgd/v2/migration-guide.rst
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
* address comments
* address comments
* fix
* address comments
Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>
2021-09-30 09:15:21 -07:00
architkulkarni
bf6e50813c
[runtime env] Parse local pip/conda requirements files locally upon task/actor definition ( #18988 )
2021-09-30 09:47:15 -05:00
Chris K. W
291fd36dee
_ray_trace_ctx fix follow-up ( #18950 )
...
* sanity check
* add test case
* fix assert
* refactor
* check kwargs instead of _kwargs
* format
2021-09-29 23:53:04 -07:00
Clark Zinzow
74b5d3d8f7
[Datasets] Minimize truncation on balanced splits. ( #18953 )
...
* Minimize truncation on balanced splits.
* Refactor into subroutines.
* Feedback and fixes.
2021-09-29 21:57:08 -07:00
Alex Wu
5709c6501b
[dataset][usability] Dataset dependencies ( #18346 )
2021-09-29 17:29:31 -07:00
Clark Zinzow
73a6cda812
Handle empty datasets properly in most Dataset transformations. ( #18983 )
2021-09-29 17:27:03 -07:00
Eric Liang
aa985e1a9c
Fix false positive error message from autoscaler events ( #18981 )
2021-09-29 15:51:18 -07:00
Antoni Baum
573c66a755
[GCP] Update GCP TPU config ( #18634 )
...
* [autoscaler] Update GCP TPU config
* Preemptible by default
* Remove libtpu link from head node
* Workaround
2021-09-29 12:41:26 -07:00
Jiajun Yao
ed9118393c
Listen to 127.0.0.1 by default on mac osx ( #18904 )
2021-09-29 11:40:19 -07:00
Eric Liang
3665c99896
Deflake test_failure_2.py::test_warning_for_infeasible_zero_cpu_actor
2021-09-29 11:39:16 -07:00
Dmitri Gekhtman
944309c017
Revert "[nightly] Deflaky nightly test many_nodes_actor_test ( #18582 )" ( #18954 )
...
* Revert "[nightly] Deflaky nightly test many_nodes_actor_test (#18582 )"
This reverts commit fc6a739e4b
2021-09-29 11:02:14 -04:00
Chong-Li
42744f29ee
[GCS] Make Gcs-based actor scheduler's bookkeeping consistent ( #18546 )
...
* Make Gcs-based scheduler's bookkeeping consistent
* Remove this from lambda function
* Fix lambda function
* Trigger SchedulePendingActors
* Test for acquiring/releasing resources
* Reorganize structure
* Avoid overloading post
* Fix gcs_actor_manager_test
* Fix post counter and rename some func
* Fix unique_ptr
* Fix unique_ptr
* Fix book lint error
* Lint
Co-authored-by: Chong-Li <lc300133@antgroup.com>
2021-09-29 05:53:34 -07:00
matthewdeng
91a5f67261
[SGD] add share_cuda_visible_devices config flag ( #18958 )
2021-09-29 00:21:46 -07:00
Eric Liang
4d763d3ffd
Increase metrics fetch timeout in autoscaler for large clusters
2021-09-28 15:24:44 -07:00
Edward Oakes
73b8936aa8
[runtime_env] Unify rpc::RuntimeEnv with serialized_runtime_env field ( #18641 )
2021-09-28 15:13:15 -05:00
Edward Oakes
96054953cc
[serve] Remove python_methods logic and raise an error dynamically instead ( #18927 )
2021-09-28 09:51:46 -07:00
Chris K. W
191af472ac
[client] remove ray_trace_ctx from kwargs if tracing disabled ( #18926 )
2021-09-28 09:47:43 -07:00
Ian Rodney
0d3544588e
[AutoRun] Fix Auto-Run for Client ( #18457 )
...
* remove old version
* auto init first attempt
* arg for fn decorator
* default to True
* ray.method should not autostart
* comments
* no auto init on global state fns
* tiny test fix
* quick tests
* respond to comments
* explain func
* fix comments
* forgot to save
* fix again
* fix reconnect tests
* fix medium tests
* fix workflows test
* Better fix for workflows
2021-09-28 08:00:26 -07:00
Richard Liaw
227aa9e89b
[tune] change delimiter for results ( #16573 )
...
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2021-09-28 10:03:00 +01:00
Kai Fricke
6be87a3453
[tune] fix tune list-trials metric ( #18914 )
2021-09-28 09:59:32 +01:00
Yi Cheng
e4f4c79252
Revert "[Serve] [doc] Improve runtime env doc ( #18782 )" ( #18935 )
...
This reverts commit d4d71985d5
2021-09-27 21:52:13 -07:00
Eric Liang
caf34a452c
Unify ArrowTensorType tables and Tensor blocks ( #18867 )
2021-09-27 16:24:09 -07:00
Maxim Egorushkin
be0133da1d
[Autoscaler][GCP] Allow Google Compute Engine instance templates. ( #18620 )
...
Co-authored-by: Maxim Egorushkin <maxim.egorushkin@gmail.com>
Co-authored-by: Ian <ian.rodney@gmail.com>
2021-09-27 16:08:41 -07:00
architkulkarni
d4d71985d5
[Serve] [doc] Improve runtime env doc ( #18782 )
2021-09-27 16:12:03 -05:00
Antoni Baum
72cc0c9bda
[SGDv2] Add Tune-Cifar-PyTorch-PBT example ( #18860 )
...
* [SGDv2] Add Tune-Cifar-PyTorch-PBT example
* Update python/ray/util/sgd/v2/BUILD
* Lint
* Update example
* Update docs
2021-09-27 09:22:40 -07:00
Jernej Makovsek
d6758ff92a
[tune] Fix HEBOSearch installation docs ( #18861 )
...
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
2021-09-27 09:06:14 +01:00
Chen Shen
aaae8c122b
Fix pid None in logs ( #18898 )
2021-09-25 17:07:32 -07:00
Chris K. W
0669e651b9
[client] Bump client proto version ( #18866 )
2021-09-24 14:35:59 -07:00
Eric Liang
11a2dfcaab
Improve unschedulable task warning messages by integrating with the autoscaler ( #18724 )
2021-09-24 12:19:58 -07:00
architkulkarni
fbf5f5d56b
[runtime env] [Serve] Fix error when uris field is None ( #18874 )
2021-09-24 14:07:17 -05:00
dependabot[bot]
40aec916d7
[RLlib](deps): Bump pyglet from 1.5.0 to 1.5.18 in /python/requirements/rllib ( #16687 )
...
* [RLlib](deps): Bump pyglet in /python/requirements/rllib
Bumps [pyglet](https://github.com/pyglet/pyglet ) from 1.5.0 to 1.5.18.
- [Release notes](https://github.com/pyglet/pyglet/releases )
- [Changelog](https://github.com/pyglet/pyglet/blob/v1.5.18/RELEASE_NOTES )
- [Commits](https://github.com/pyglet/pyglet/compare/v1.5.0...v1.5.18 )
---
updated-dependencies:
- dependency-name: pyglet
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com>
Co-authored-by: sven1977 <svenmika1977@gmail.com>
2021-09-24 19:32:55 +02:00
Guyang Song
337005d5a5
[C++ API][hotfix] fix C++ worker dynamic library loading issue on macOS ( #18877 )
...
* fix C++ worker in macox
* fix
2021-09-24 23:39:00 +08:00
