Yi Cheng
4bb3883a73
[dataset] deduct filesystem automatically ( #16762 )
2021-07-03 00:50:59 -07:00
Siyuan (Ryans) Zhuang
122bf309fa
[Workflow] Workflow management - Part I ( #16838 )
...
* refactoring
* share fate with the driver
* move TODOs to correct locations
* disable objectref test
* test raise exception when use object ref as inputs
2021-07-02 22:12:45 -07:00
Qing Wang
b9a3ab73b6
Fix Java driver log error ( #16832 )
...
* Fix
* Silence initial logs.
2021-07-03 11:53:42 +08:00
SangBin Cho
61451af06b
[OBOD] Bug fix from test_scheduling.py ( #16791 )
2021-07-02 19:26:31 -07:00
architkulkarni
f02e41a822
[Core] [runtime env] Add RuntimeEnvHash and JobID to SchedulingKey ( #16766 )
...
* add python integration test
* improve readability
* remove unneccessary ray start --head
* add shutdown_only
* move RuntimeEnvHash from worker_pool to task_spec
* lint
* Add runtimeEnvHash and JobID to SchedulingKey
* remove JobID from key and hopefully fix compile
* add test for same env
* lint
2021-07-02 18:15:28 -07:00
Eric Liang
f2f6176057
Deflake test_failure_3 ( #16854 )
2021-07-02 18:00:42 -07:00
loicsacre
b7be848f07
[tune] Allow the logging of wandb.Image in tune.integration.wandb ( #16839 )
2021-07-02 17:14:23 -07:00
Charles
2526299eba
[Autoscaler] Use NetworkInterfaces parameter to launch instances. ( #16816 )
2021-07-02 14:01:02 -07:00
dependabot[bot]
ba13c2f7dd
[RLlib](deps): Bump gym[atari] in /python/requirements/rllib ( #15992 )
...
Bumps [gym[atari]](https://github.com/openai/gym ) from 0.18.0 to 0.18.3.
- [Release notes](https://github.com/openai/gym/releases )
- [Commits](https://github.com/openai/gym/compare/0.18.0...0.18.3 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-07-02 09:58:18 -07:00
SangBin Cho
7bd3138227
[Test] Support stress test smoke test ( #16827 )
...
* Support smoke test
* lint
2021-07-02 09:50:26 -07:00
dependabot[bot]
ee9a1b022e
[tune](deps): Bump kubernetes in /python/requirements/tune ( #16002 )
...
Bumps [kubernetes](https://github.com/kubernetes-client/python ) from 12.0.1 to 17.17.0.
- [Release notes](https://github.com/kubernetes-client/python/releases )
- [Changelog](https://github.com/kubernetes-client/python/blob/master/CHANGELOG.md )
- [Commits](https://github.com/kubernetes-client/python/compare/v12.0.1...v17.17.0 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-07-02 09:48:02 -07:00
dependabot[bot]
81866a754a
[tune](deps): Bump optuna in /python/requirements/tune ( #16376 )
...
Bumps [optuna](https://github.com/optuna/optuna ) from 2.6.0 to 2.8.0.
- [Release notes](https://github.com/optuna/optuna/releases )
- [Commits](https://github.com/optuna/optuna/compare/v2.6.0...v2.8.0 )
---
updated-dependencies:
- dependency-name: optuna
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-07-02 09:46:52 -07:00
dependabot[bot]
0959fbca96
[tune](deps): Bump transformers in /python/requirements/tune ( #16672 )
...
Bumps [transformers](https://github.com/huggingface/transformers ) from 4.3.2 to 4.8.1.
- [Release notes](https://github.com/huggingface/transformers/releases )
- [Commits](https://github.com/huggingface/transformers/compare/v4.3.2...v4.8.1 )
---
updated-dependencies:
- dependency-name: transformers
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-07-02 09:45:23 -07:00
Kai Fricke
6c29f2bed6
[tune] Use fork for wandb, disable ipython in trainables ( #16675 )
2021-07-02 15:52:24 +01:00
Antoni Baum
cabd159423
FIx PlacementGroupFactory hashing ( #16842 )
2021-07-02 15:44:39 +01:00
Qing Wang
00678f74f6
Fix Java CI ( #16835 )
2021-07-02 21:52:51 +08:00
Alex Wu
c57e950ee1
Minimal code owner file ( #16836 )
2021-07-02 01:23:11 -07:00
Eric Liang
e77a964640
[dataset] Add datasource API ( #16826 )
2021-07-01 23:44:30 -07:00
Ian Rodney
f9daf7fa2c
[Connect] Separate Specific Server logs into different files ( #16534 )
...
* better debug logging
* log to separate files
* use getter/setter methods
* actually use type for ray.node.Node
* update docstring
* use public method
* add a test
* fix glob glob
* fix test again
2021-07-01 21:27:03 -07:00
liuyang-my
2c3ce469ba
[Serve] Define Java Backend ( #16169 )
2021-07-01 20:41:17 -07:00
qicosmos
7f78e8c014
[C++ Worker]Ignore genrated files ( #16803 )
2021-07-02 10:40:54 +08:00
Amog Kamsetty
33f31f53c8
[Rllib] Torch Backwards Compatibility ( #16813 )
2021-07-01 19:17:54 -07:00
Kai Fricke
521a05834d
[tune] Fix resume=REMOTE documentation and log more details ( #16709 )
2021-07-01 18:40:15 -07:00
Rodrigo de Lazcano
5072d86323
[rllib] parallel pettingzoo import ( #16722 )
2021-07-01 18:37:59 -07:00
Julius Frost
ada0552f16
[rllib] d4rl: fix for paths with multiple periods ( #16721 )
2021-07-01 18:35:50 -07:00
Anna Luo
569759eb01
[docs] Add best practices for Jupyter Notebook ( #16798 )
2021-07-01 18:34:29 -07:00
Eric Liang
7eec197d31
[data] Support block metadata and lazy loading of blocks from the filesystem ( #16689 )
2021-07-01 17:25:20 -07:00
matthewdeng
a3f89d9f53
[release] write output for golden notebook tests ( #16825 )
2021-07-01 16:10:58 -07:00
Siyuan (Ryans) Zhuang
b570606438
[Workflow] Ensure asynchronous execution of "workflow.run" & fix TODOs ( #16727 )
...
* initial commit
* code refactoring; non-blocking "workflow.run"
* Rename "workflow_root_dir" to "storage_url"
* readable workflow_id and step_id
* verbose logging
* remove unused code
* slugify
* storage -> storage_or_url
* fix comments
* storage_or_url -> storage
* get workflow outputs without extra object copy & transfer
* update tests
* tests workflow outputs resolving
2021-07-01 15:53:22 -07:00
Edward Oakes
ff37bdcbd9
[serve] Fix bazel test sizes now that we're on buildkite ( #16785 )
2021-07-01 16:27:31 -05:00
Chen Shen
34cd6a862a
[dataset] implements split ( #16765 )
2021-07-01 13:03:34 -07:00
Alex Wu
c27a02a807
[Dataset] read binary files ( #16717 )
...
* done
* done
* done
* .
* .
* lint
* .
Co-authored-by: Alex Wu <alex@anyscale.com>
2021-07-01 13:00:10 -07:00
Edward Oakes
d69e51f769
[serve] Update kubernetes docs to specify a namespace ( #16786 )
2021-07-01 14:36:07 -05:00
Clark Zinzow
52da2cce68
[Dataset] Adds JSON, CSV, Pandas, and Dask IO layers, and adds the write side of the Parquet IO layer. ( #16724 )
2021-07-01 11:57:40 -07:00
Edward Oakes
a6051ea3dc
[serve] Rolling updates for user_config changes ( #15909 )
2021-07-01 13:31:59 -05:00
Clark Zinzow
096b38df8b
[Dataset] Miscellaneous hotfixes. ( #16730 )
2021-07-01 10:50:06 -07:00
Edward Oakes
691f0a1dd1
[serve] Remove unnecessary STOPPED ReplicaState ( #16783 )
2021-07-01 12:35:00 -05:00
Eric Liang
0841b6d2de
Remove stray error message ( #16796 )
2021-07-01 10:11:48 -07:00
Dmitri Gekhtman
096559f679
[release] Update instructions (minor) ( #16812 )
2021-07-01 09:42:51 -07:00
Kai Fricke
6f48e4f566
[tune/wandb] Fix parameter lookup for sequences ( #16806 )
2021-07-01 15:22:25 +01:00
Sven Mika
7eb1a29426
[RLlib] Fix ModelV2 custom metrics for torch. ( #16734 )
2021-07-01 13:01:40 +02:00
mwtian
7669708237
Create a wait_for_num_nodes() function, and use it in train_small ( #16784 )
2021-07-01 10:17:53 +01:00
Antoni Baum
2cec40d0f5
[tune] LightGBM integration callbacks ( #16713 )
2021-07-01 10:12:57 +01:00
Siyuan (Ryans) Zhuang
18232bb808
[Core][Serialization] Fix recursive resolve/deserialization ( #16794 )
...
* fix recursive resolve
* fix threading issues
2021-07-01 01:44:24 -07:00
Sven Mika
ce3e550c43
[RLlib] Enhance comment in example script multi_agent_custom_policy. ( #16740 )
2021-07-01 10:28:38 +02:00
Amog Kamsetty
2c17f4907e
[Tune] Add pbt_transformers Client test ( #16793 )
2021-06-30 23:10:16 -07:00
chenk008
06c7db7dca
[Core] Rename container option and ray-nest-container ( #16771 )
...
* rename container_option to container
* rename ray-nest-container to ray-worker-container
* lint
Co-authored-by: wuhua.ck <wuhua.ck@alibaba-inc.com>
2021-07-01 13:12:26 +08:00
SangBin Cho
0ad2dac3ca
[Dataset] Map batch implementation ( #16729 )
2021-06-30 21:51:04 -07:00
Lixin Wei
e00d898b75
[Core] Lightweight Resource Report for New Scheduler ( #16527 )
...
* check resource diff
* fix
* fix
* comment modified
* fix
2021-06-30 21:27:29 -07:00
SangBin Cho
94149ef50c
[Test] Skip some flaky tests ( #16768 )
...
* done
* Add test gcs fault tolerance to the flaky test
* Addressed code review
* Addressed the last code review.
2021-06-30 20:48:09 -07:00
