Commit graph

5079 commits

Author SHA1 Message Date
Eric Liang
d52ffd926e
Add task / actor name to driver log prefix (#18105)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-08-26 16:18:04 -07:00
Edward Oakes
6fa05ed708
[runtime_env] Better error message for working_dirs that exceed the max size (#18092) 2021-08-26 15:21:12 -05:00
Edward Oakes
3dc3f6102f
[serve] Remove unused ServeRequest codepath (#18120) 2021-08-26 15:08:00 -05:00
Chen Shen
a7365b74e6
[CI][easy] run test_nested_id both inlined and from plasma store. (#18081) 2021-08-26 10:32:06 -07:00
Edward Oakes
c16e730f0e
[runtime_env] Better error message when ray client server fails to start (#18088) 2021-08-26 11:35:11 -05:00
Edward Oakes
83bfbf3b59
[runtime_env] Fix warning message to not say ray.connect() (#18084) 2021-08-26 11:34:44 -05:00
Edward Oakes
0c5f7a698d
[core] Add type hints to public APIs in worker.py (#18049) 2021-08-26 09:51:44 -05:00
Edward Oakes
07c05e16fa
[serve] Remove unused HTTP method metadata & matching (#18079) 2021-08-26 09:49:49 -05:00
Edward Oakes
0dd75c2f87
[serve] Skip namespace test in test_standalone on windows (#18093) 2021-08-26 09:48:30 -05:00
Kai Fricke
34cf5db109
[tune] Fix hyperopt points to evaluate for nested lists (#18113) 2021-08-26 14:34:22 +02:00
Raphael CHEN
edac59f18f
[tune] correctly validate initial points for random search (#17282)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2021-08-26 10:24:51 +02:00
xwjiang2010
3fa20962cf
[Tune] Fix local mode. Add explicit concurrency limiter for local mode. (#18023)
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
2021-08-26 09:31:40 +02:00
Chen Shen
a29b157e2e
[core] better error message for lost objects (#18068) 2021-08-26 00:03:29 -07:00
Clark Zinzow
52bd0e1737
[Datasets] Drop empty tables when reading Parquet pieces. (#18098) 2021-08-26 00:02:08 -07:00
Eric Liang
e1f69ceb5e
Add documentation for DatasetPipeline.from_iterable (#18106) 2021-08-25 22:31:23 -07:00
Yi Cheng
f66c51de2d
[workflow] Support named step in workflow (#17915) 2021-08-25 19:51:45 -07:00
Clark Zinzow
ab0a638411
[Datasets] Add pyarrow minimum version check. (#18082) 2021-08-25 15:59:12 -07:00
Clark Zinzow
db1bdd28fc
Add pyarrow filesystem test coverage for Parquet reading. (#18087) 2021-08-25 15:58:57 -07:00
Edward Oakes
406dc0b458
[core] Disallow empty string namespace + add validation tests (#18048) 2021-08-25 15:37:02 -05:00
Eric Liang
451c501bbd
[doc] Add API stability annotations to developer guide (#18052) 2021-08-25 13:34:43 -07:00
SangBin Cho
c2d488a504
[Usability] Add backpressure to log monitor (#17774)
* Add backpressure to log monitor

* Added a test and addressed code review.

* Addressed code review.
2021-08-25 13:07:18 -07:00
Sasha Sobol
fcb044d47c
[autoscaler] make 0 default min/max workers for head node (#17757)
* make 0 default min/max workers for head node

* fix helm charts, test, defaults for head

* fix test, docs

* make 0 default min/max workers for head node

* fix helm charts, test, defaults for head

* fix test, docs

* comments. logging

* better wording (logs)

Co-authored-by: Dmitri Gekhtman <62982571+DmitriGekhtman@users.noreply.github.com>

* fix logging message

* fix max workers in raycluster.yaml

* use default values of 0 for min/max workders in a helm chart

* add missing line back

Co-authored-by: Dmitri Gekhtman <62982571+DmitriGekhtman@users.noreply.github.com>
2021-08-25 14:56:20 -04:00
Jiao
b52c873027
[serve] Use list_deployments in benchmark (#18050) 2021-08-25 12:26:46 -05:00
Nikita Vemuri
a9c731edd3
[serve] Remove requirement to specify namespace for serve.start(detached=True) (#17470) 2021-08-25 10:39:32 -05:00
Eric Liang
5571d2436d
Deprecate MLDataset (#18030) 2021-08-24 13:04:11 -07:00
Chen Shen
69fd5fb678
[CI] increase object spill test timeout for mac (#18036) 2021-08-24 13:03:50 -07:00
architkulkarni
97dd13be09
[Serve] [dashboard] Fix formatting bugs in cluster snapshot (#17977)
* show "unversioned" in actor metadata

* hash deployment names

* update test

* replace "Unversioned" with "None"

* bypass convert to camelCase for deployment names

* fix convert_case default to match previous setting

* lint

* replace deployment_name_hash with underscore
2021-08-24 12:06:26 -07:00
xwjiang2010
5d68657246
[Tune] Sanitize trial checkpoint filename. (#17985) 2021-08-24 10:08:36 -07:00
Chen Shen
3a04cb0d73
fix windows test failures (#18022) 2021-08-24 09:28:51 -07:00
Antoni Baum
1f8ce1ede8
[tune] Explicitly instantiate skopt categorical spaces (#18005) 2021-08-24 17:11:21 +02:00
Qing Wang
7c1f14ddd8
Do not connect in constructor to avoid potential risk. (#17916)
* Do not connect in ctor.

* Fix lint.

Co-authored-by: Qing Wang <jovany.wq@antgroup.com>
2021-08-24 16:41:30 +08:00
dependabot[bot]
15adedc72c
[tune](deps): Bump sigopt in /python/requirements/tune (#17996)
Bumps [sigopt](https://sigopt.com/) from 7.4.0 to 7.5.0.

---
updated-dependencies:
- dependency-name: sigopt
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-08-23 15:18:59 -07:00
dependabot[bot]
f97a292867
[tune](deps): Bump dask[complete] in /python/requirements/tune (#17997)
Bumps [dask[complete]](https://github.com/dask/dask) from 2021.06.1 to 2021.8.1.
- [Release notes](https://github.com/dask/dask/releases)
- [Changelog](https://github.com/dask/dask/blob/main/docs/release-procedure.md)
- [Commits](https://github.com/dask/dask/compare/2021.06.1...2021.08.1)

---
updated-dependencies:
- dependency-name: dask[complete]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-08-23 15:18:37 -07:00
Yi Cheng
5849f80e41
[Core] Fix typo of actor repr (#18011) 2021-08-23 14:33:51 -07:00
Edward Oakes
1a61082ed4
[serve] Remove deprecated endpoints code (#17989) 2021-08-23 13:53:09 -07:00
Amog Kamsetty
4c384df526
fix wheel links (#17973) 2021-08-23 13:43:34 -07:00
chenk008
b9978dd02b
[Core] revert: revert Unified worker starter (#18008) 2021-08-23 13:34:32 -07:00
Yi Cheng
fd71bde9b4
[client] Allow multiple client connections from one driver (#17942) 2021-08-23 13:01:58 -07:00
Dmitri Gekhtman
13d5d0f9ef
[autoscaler][hotfix] Update node list after terminating unhealthy nodes (#17992)
* Update nodes; update test.

* consistency

* lint
2021-08-22 18:22:10 -04:00
Clark Zinzow
5ca28b1cc8
[Core] Update Bazel (to 3.4.1), gRPC, boringssl, and absl as a precursor to gRPC streaming PR. (#17903)
* Update Bazel (to 3.4.1), gRPC, boringssl, absl.

* Always reinstall Bazel if needing to upgrade to a new Bazel version.

* Add patch for properly detecting Windows Python headers when building gRPC.

* Add minimum Bazel version check.

* Update docs with new Bazel version.
2021-08-21 11:33:11 -07:00
Edward Oakes
b969aa3c80
[dashboard] Don't start dashboard agent when missing dependencies (#17966) 2021-08-21 01:04:21 -07:00
Eric Liang
58e35a21b4
Add split_at_indices() (#17990) 2021-08-20 15:35:22 -07:00
Chen Shen
dac1ba632e
[usability][rfc] ray status show demand summary by default (#17892) 2021-08-20 15:29:37 -07:00
Chris K. W
e3fb9650b2
[Client] Skip client object ref, actor handle, and actor ref dealloc/del if client package has already been cleaned up (#17969) 2021-08-20 15:18:43 -07:00
Edward Oakes
3ea5c0dc6b
[serve] Remove deprecated routing code (ServeStarletteRouter) (#17986) 2021-08-20 16:56:45 -05:00
Simon Mo
8236b7412e
[Serve] Mark serve.start beta API (instead of stable) (#17956) 2021-08-20 16:36:48 -05:00
Chen Shen
3dbb2e0020
change the way test run (#17930) 2021-08-20 11:26:16 -07:00
Edward Oakes
30541025e5
[serve] Remove deprecated APIs from code & docs (#17754) 2021-08-20 11:59:45 -05:00
Stephanie Wang
b8fe776638
[core] Fix inlined nested ids (#17834)
* test

* Use ObjectRef instead of ObjectID in nested refs

* java

* doc

* java

* build

* build

* x

* lint

* simplify

* fix
2021-08-20 08:58:29 -07:00
Amog Kamsetty
9416fce91b
[SGD] v2 Tune integration + iterator API (#17839)
* [SGD] implement SGD Trainer.to_tune_trainable

* address some comments

* add RESULT_DUPLICATE

* extract trainable creation logic out of Trainer

* add 1 CPU for driver

* use class attribute to fix serialization issues

* add examples

* add test for tune error

* tune

* test tune_linear

* run_iterator

* add to build file

* Update python/ray/util/sgd/v2/trainer.py

Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>

* Update python/ray/util/sgd/v2/trainer.py

Co-authored-by: matthewdeng <matthew.j.deng@gmail.com>

* address comments

* fix tests & address comments

* resolve merge

* lint

* fix

* add team tag to tests

* fix tests

* lint

Co-authored-by: Matthew Deng <matthew.j.deng@gmail.com>
2021-08-20 08:31:21 -07:00