Commit graph

8864 commits

Author SHA1 Message Date
Eric Liang
7ed62ea0ad
Initial implementation of Dataset pipelining and docs (#17309) 2021-07-28 21:12:01 -07:00
SangBin Cho
65c0c3f3a4
[Test] Fix releaser bug (#17418)
* Fix a bug

* done
2021-07-28 18:15:00 -07:00
Eric Liang
9b4bcb3bc2
[hotfix] Fix merge conflict that caused test_dataset to failed. 2021-07-28 14:58:31 -07:00
matthewdeng
a2f23e5433
[docs] update docs with pip requirements (#17317) 2021-07-28 14:26:40 -07:00
Edward Oakes
7007c6271d
[runtime_env] Gracefully fail tasks when an environment fails to be set up (#17249) 2021-07-28 15:25:02 -05:00
Yi Cheng
72abf81900
[gcs] Fix GCS related issues: ByteSizeLong and redis connection (#17373) 2021-07-28 13:01:54 -07:00
kk-55
a7f8dc9d77
[RLlib] New and changed version of parametric actions cartpole example + small suggested update in policy_client.py (#15664) 2021-07-28 15:25:09 -04:00
Eric Liang
4ffa549041
Support schema on read for csv/json (#17354) 2021-07-28 10:59:52 -07:00
Julius Frost
d7a5ec1830
[RLlib] SAC tuple observation space fix (#17356) 2021-07-28 12:39:28 -04:00
Jiao
2618236167
[serve] Fix single deployment nightly test (#17368) 2021-07-28 11:38:06 -05:00
Simon Mo
db126b24b9
[Serve] Fix response_model for class based view routes as well (#17376) 2021-07-28 09:31:02 -07:00
amavilla
f2d9b1f2b9
[docs] Link broken in Tune's page (#17394) (#17407) 2021-07-28 09:27:54 -07:00
Sven Mika
0d8fce8fd8
[RLlib] Discussion 2294: Custom vector env example and fix. (#16083) 2021-07-28 10:40:04 -04:00
Rohan138
f30b444bac
[Rllib] set self._allow_unknown_config (#17335)
Co-authored-by: Sven Mika <sven@anyscale.io>
2021-07-28 11:48:41 +01:00
Antoni Baum
1f35470560
[autoscaler] GCP TPU VM autoscaler (#17278) 2021-07-27 21:24:29 -07:00
Sven Mika
58da5c1c9b
[RLlib] Discussion 3001: Fix comment on internal state shape (must be [B x S=state dim]). (#17341) 2021-07-27 21:41:53 -04:00
Amog Kamsetty
d01e1c15c8
[SGD] v2 prototype: `WorkerGroup` implementation (#17330)
* wip

* formatting

* increase timeouts

* address comments

* comments

* fix

* address comments

* Update python/ray/util/sgd/v2/worker_group.py

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Update python/ray/util/sgd/v2/worker_group.py

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* address comments

* formatting

* fix

* avoid race condition

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-07-27 17:36:38 -07:00
Simon Mo
4a4210a083
Support streaming output of runtime env setup to logger/driver (#17306) 2021-07-27 16:39:15 -07:00
Edward Oakes
7225f28fff
[serve] Add Ray API stability annotations (#17295) 2021-07-27 16:00:15 -05:00
DK.Pino
2699b0f3ab
[Placement Group] Fix resource index assignment between with bundle index and without bundle index pg (#17318) 2021-07-27 13:51:02 -07:00
SangBin Cho
e1cd8580a0
[Test] Add various fixes to the nightly dashboard to improve signals (#17351)
* Add various fixes to the nightly dashboard to improve signals

* Fix issues
2021-07-27 12:37:11 -07:00
Alex Wu
5879e3132e
[Dataset] Support compressed files (#17355)
* .

* lint

* .

Co-authored-by: Alex Wu <alex@anyscale.com>
2021-07-27 12:35:16 -07:00
Sven Mika
90b21ce27e
[RLlib] De-flake 3 test cases; Fix config.simple_optimizer and SampleBatch.is_training warnings. (#17321) 2021-07-27 14:39:06 -04:00
Eric Liang
e70d84953e
[hotfix] Dataset tests accidentally disabled 2021-07-27 10:40:15 -07:00
Jiao
9eb1bcd061
[serve] Multi & single deployment large scale test (#17310) 2021-07-27 10:46:45 -05:00
Frank Luan
a6e8497dc9
[Dataset] Sort (#17142) 2021-07-27 01:53:53 -07:00
fyrestone
57b9b1bb0f
[Dashboard] Use a dedicated RPC to check the GCS is alive (#16330)
* Dashboard check gcs is alive

* Fix dashboard hangs at exit

* ray health-check call GCS CheckAlive

* Minor fixes

Co-authored-by: 刘宝 <po.lb@antfin.com>
2021-07-27 14:05:44 +08:00
Richard Liaw
597dc08dfe
Revert "Revert "[core] remove opencensus/prometheus_exporter dependencies"" (#17254)
* Revert "Revert "[core] remove opencensus/prometheus_exporter dependencies" (#17251)"

This reverts commit 7b44dd8ecb.

* Lint

* Fix more imports

Co-authored-by: Kai Fricke <kai@anyscale.com>
2021-07-26 21:09:25 -07:00
DK.Pino
684e2b28e9
Placement group bug fix (#17320) 2021-07-26 21:03:35 -07:00
Stefan Schneider
489febc6b2
[RLlib] Better example scripts: Description --no-tune and --local-mode CLI options (#17038) 2021-07-26 22:25:48 -04:00
Dmitri Gekhtman
d0e58af075
[autoscaler] Avoid race in no-updaters logic (#17328)
* Extra logic and test

* anglish
2021-07-26 16:05:33 -04:00
architkulkarni
bcb3a6789b
[Core] [runtime env] Cache created runtime envs (#17342) 2021-07-26 14:37:40 -05:00
dependabot[bot]
4bf377ee4b
[tune](deps): Bump gym[atari] in /python/requirements/tune (#17199)
Bumps [gym[atari]](https://github.com/openai/gym) from 0.18.0 to 0.18.3.
- [Release notes](https://github.com/openai/gym/releases)
- [Commits](https://github.com/openai/gym/compare/0.18.0...0.18.3)

---
updated-dependencies:
- dependency-name: gym[atari]
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-07-26 10:53:41 -07:00
architkulkarni
756a4e7a90
[Core] [runtime env] update tests to use ray.init(runtime_env=...) and add e2e test (#17232) 2021-07-26 11:21:30 -05:00
Edward Oakes
58423e6018
[serve] Improve nightly release test (#17277) 2021-07-26 11:15:46 -05:00
Julius Frost
16be091702
[RLlib] Refactor if __name__ == "__main__" into main() method in rollout/train.py for better reusability (#17315) 2021-07-26 11:12:59 -04:00
Sven Mika
5231fdd996
[Testing] Split RLlib example scripts CI tests into 4 jobs (from 2). (#17331) 2021-07-26 10:52:55 -04:00
Tao Wang
d98ec7fc4d
Remove libray_redis_module (#17283) 2021-07-25 23:15:29 -07:00
matthewdeng
fdbeef6046
[SGD] RaySGD v2 skeleton code (#17300)
* [SGD] RaySGD v2 skeleton code

* add build file

* move file

* empty

* rename

* address comments

* add method interfaces

* move BUILD file out of tests dir

Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com>
2021-07-25 17:39:24 -07:00
Sven Mika
0c5c70b584
[RLlib] Discussion 247: Allow remote sub-envs (within vectorized) to be used with custom APIs. (#17118) 2021-07-25 16:55:51 -04:00
Chris Bamford
29768a7c01
[RLLib] (P1 regression) Fixing view requirements in compute actions (#15856) 2021-07-25 14:25:07 -04:00
ddworak94
fba8461663
[RLlib] Add RNN-SAC agent (#16577)
Shoutout to @ddworak94 :)
2021-07-25 10:04:52 -04:00
Richard Liaw
d723ea8ef2
fix (#17311)
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2021-07-24 10:38:46 -07:00
Antoni Baum
b500a651b7
[docs] Add LightGBM Tune integration to docs (#17304)
* Add LightGBM integration to docs

* Fix
2021-07-23 21:21:13 -07:00
Yi Cheng
93be44eebf
[workflow] Fix more usability issues (#17305)
* up

* up

* up

* up

* up

* up

* fix test error

* up
2021-07-23 20:26:44 -07:00
Edward Oakes
2142abae57
[Serve] Properly support runtime_env working_dir (#16480) 2021-07-23 17:35:32 -07:00
Jiao
9b6be6f1c8
update dask compatibility for 1.5.0 (#17302)
* update dask compatibility for 1.5.0

* change to right file

* add pip install pytest

Co-authored-by: Jiao Dong <jiaodong@anyscale.com>
2021-07-23 17:31:42 -07:00
Kai Fricke
8db61569f1
[tune] Fix HDFS sync down template (#17291) 2021-07-23 13:01:14 -07:00
Yi Cheng
29352e7fa3
[workflow] Fix some usability issues (#17284) 2021-07-23 11:39:49 -07:00
Edward Oakes
cc38ffb0a0
[debugger] Add doc entry for the --ray-debugger-external flag (#17294) 2021-07-23 12:00:30 -05:00