Commit graph

8549 commits

Author SHA1 Message Date
liuyang-my
2c3ce469ba
[Serve] Define Java Backend (#16169) 2021-07-01 20:41:17 -07:00
qicosmos
7f78e8c014
[C++ Worker]Ignore genrated files (#16803) 2021-07-02 10:40:54 +08:00
Amog Kamsetty
33f31f53c8
[Rllib] Torch Backwards Compatibility (#16813) 2021-07-01 19:17:54 -07:00
Kai Fricke
521a05834d
[tune] Fix resume=REMOTE documentation and log more details (#16709) 2021-07-01 18:40:15 -07:00
Rodrigo de Lazcano
5072d86323
[rllib] parallel pettingzoo import (#16722) 2021-07-01 18:37:59 -07:00
Julius Frost
ada0552f16
[rllib] d4rl: fix for paths with multiple periods (#16721) 2021-07-01 18:35:50 -07:00
Anna Luo
569759eb01
[docs] Add best practices for Jupyter Notebook (#16798) 2021-07-01 18:34:29 -07:00
Eric Liang
7eec197d31
[data] Support block metadata and lazy loading of blocks from the filesystem (#16689) 2021-07-01 17:25:20 -07:00
matthewdeng
a3f89d9f53
[release] write output for golden notebook tests (#16825) 2021-07-01 16:10:58 -07:00
Siyuan (Ryans) Zhuang
b570606438
[Workflow] Ensure asynchronous execution of "workflow.run" & fix TODOs (#16727)
* initial commit

* code refactoring; non-blocking "workflow.run"

* Rename "workflow_root_dir" to "storage_url"

* readable workflow_id and step_id

* verbose logging

* remove unused code

* slugify

* storage -> storage_or_url

* fix comments

* storage_or_url -> storage

* get workflow outputs without extra object copy & transfer

* update tests

* tests workflow outputs resolving
2021-07-01 15:53:22 -07:00
Edward Oakes
ff37bdcbd9
[serve] Fix bazel test sizes now that we're on buildkite (#16785) 2021-07-01 16:27:31 -05:00
Chen Shen
34cd6a862a
[dataset] implements split (#16765) 2021-07-01 13:03:34 -07:00
Alex Wu
c27a02a807
[Dataset] read binary files (#16717)
* done

* done

* done

* .

* .

* lint

* .

Co-authored-by: Alex Wu <alex@anyscale.com>
2021-07-01 13:00:10 -07:00
Edward Oakes
d69e51f769
[serve] Update kubernetes docs to specify a namespace (#16786) 2021-07-01 14:36:07 -05:00
Clark Zinzow
52da2cce68
[Dataset] Adds JSON, CSV, Pandas, and Dask IO layers, and adds the write side of the Parquet IO layer. (#16724) 2021-07-01 11:57:40 -07:00
Edward Oakes
a6051ea3dc
[serve] Rolling updates for user_config changes (#15909) 2021-07-01 13:31:59 -05:00
Clark Zinzow
096b38df8b
[Dataset] Miscellaneous hotfixes. (#16730) 2021-07-01 10:50:06 -07:00
Edward Oakes
691f0a1dd1
[serve] Remove unnecessary STOPPED ReplicaState (#16783) 2021-07-01 12:35:00 -05:00
Eric Liang
0841b6d2de
Remove stray error message (#16796) 2021-07-01 10:11:48 -07:00
Dmitri Gekhtman
096559f679
[release] Update instructions (minor) (#16812) 2021-07-01 09:42:51 -07:00
Kai Fricke
6f48e4f566
[tune/wandb] Fix parameter lookup for sequences (#16806) 2021-07-01 15:22:25 +01:00
Sven Mika
7eb1a29426
[RLlib] Fix ModelV2 custom metrics for torch. (#16734) 2021-07-01 13:01:40 +02:00
mwtian
7669708237
Create a wait_for_num_nodes() function, and use it in train_small (#16784) 2021-07-01 10:17:53 +01:00
Antoni Baum
2cec40d0f5
[tune] LightGBM integration callbacks (#16713) 2021-07-01 10:12:57 +01:00
Siyuan (Ryans) Zhuang
18232bb808
[Core][Serialization] Fix recursive resolve/deserialization (#16794)
* fix recursive resolve

* fix threading issues
2021-07-01 01:44:24 -07:00
Sven Mika
ce3e550c43
[RLlib] Enhance comment in example script multi_agent_custom_policy. (#16740) 2021-07-01 10:28:38 +02:00
Amog Kamsetty
2c17f4907e
[Tune] Add pbt_transformers Client test (#16793) 2021-06-30 23:10:16 -07:00
chenk008
06c7db7dca
[Core] Rename container option and ray-nest-container (#16771)
* rename container_option to container

* rename ray-nest-container to ray-worker-container

* lint

Co-authored-by: wuhua.ck <wuhua.ck@alibaba-inc.com>
2021-07-01 13:12:26 +08:00
SangBin Cho
0ad2dac3ca
[Dataset] Map batch implementation (#16729) 2021-06-30 21:51:04 -07:00
Lixin Wei
e00d898b75
[Core] Lightweight Resource Report for New Scheduler (#16527)
* check resource diff

* fix

* fix

* comment modified

* fix
2021-06-30 21:27:29 -07:00
SangBin Cho
94149ef50c
[Test] Skip some flaky tests (#16768)
* done

* Add test gcs fault tolerance to the flaky test

* Addressed code review

* Addressed the last code review.
2021-06-30 20:48:09 -07:00
Dmitri Gekhtman
0cbeefdadf
[autoscaler] GPU=0 resource tweak (#16761)
* tweak

* use >, some fields don't admit an order
2021-06-30 16:51:25 -07:00
crdnb
113ed2a07c
[kubernetes] Adding cpu limit to make ray helm chart working in environments which require set resource limits (#16701) 2021-06-30 13:31:55 -07:00
Ian Rodney
1f14f366fd
[Client] Make Client_Hook per-thread (#16731) 2021-06-30 11:48:55 -07:00
ellimac54
bf4fcb2460
[doc] updated Windows development build instructions (#16778) 2021-06-30 11:34:46 -07:00
architkulkarni
3962ce286b
[Core] Bump override_environment_variables removal date from Ray 1.5 to 1.6 (#16755) 2021-06-30 09:31:08 -05:00
architkulkarni
077c04b06c
[Serve] Fix fastapi tutorial and update doc with deprecation warning (#16759) 2021-06-30 09:30:49 -05:00
SongGuyang
1d5c72ebde
[C++ API] rename 'ray_redis_address' to 'ray_address' (#16772) 2021-06-30 20:50:28 +08:00
Sven Mika
53206dd440
[RLlib] CQL BC loss fixes; PPO/PG/A2|3C action normalization fixes (#16531) 2021-06-30 12:32:11 +02:00
Kai Fricke
4b6f8a1ece
[cli] use shutil.move in ray cluster-dump and allow passing of tempfile (#16738) 2021-06-30 07:49:03 +01:00
architkulkarni
13a133817b
[Core] [runtime env] [Tests] Add C++ unit test for dispatch queue nonblocking behavior (#16751) 2021-06-29 20:16:17 -07:00
Amog Kamsetty
69507f53db
[Horovod] Add Horovod example (#16742)
* wip

* updates

* updates

* update

* formatting

* updates

* updates

* update

* fix

* add timeout
2021-06-29 19:15:15 -07:00
Alex Wu
d89f148fbf
[Pubsub] Don't depend on subscriber address (#16752)
* remove subscriber address

* .

* lint

* test

* done

* lint

* .

* Update BUILD.bazel

Co-authored-by: Alex <alex@anyscale.com>
2021-06-29 17:34:37 -07:00
SangBin Cho
3cde8c36c9
Properly update the pinned object size (#16476) 2021-06-29 17:00:19 -07:00
Simon Mo
2ac8a197db
[Serve] Copy FastAPI ResponseModel field (#16760) 2021-06-29 16:28:08 -07:00
Patrick Ames
cf8785b0e1
[docs] Note that ordering of objects returned is preserved for ray.get. (#16763) 2021-06-29 16:17:16 -07:00
Richard Liaw
bcb73ed58b
finished impl (#16753) 2021-06-29 14:37:42 -07:00
Amog Kamsetty
abd16a8438
[RLlib] Skip two_step_game_qmix test (#16758) 2021-06-29 14:27:48 -07:00
Amog Kamsetty
56068f8f81
Skip test_component_failures_2 on Windows (#16745) 2021-06-29 14:06:09 -07:00
Ian Rodney
b8f950775e
[Client] Keep client_mode for dumps_from_client (#16732) 2021-06-29 13:30:10 -07:00