Sven Mika
649580d735
[RLlib] Redo simplify multi agent config dict: Reverted b/c seemed to break test_typing (non RLlib test). ( #17046 )
2021-07-15 05:51:24 -04:00
Clark Zinzow
915c426515
[Dataset] Fix S3FileSystem subsystem initialization on deserialization. ( #17103 )
...
* Add S3FileSystem wrapper that initializes the S3 subsystem on deserialization, use it for file-based datasources.
* Use S3FileSystem wrapper for read_binary_files.
2021-07-14 23:32:48 -07:00
Eric Liang
38bddc3f2b
First cut at dataset documentation ( #16956 )
2021-07-14 23:27:13 -07:00
Chris K. W
bd9d7bbbaa
[client] Add support for protocol (ray://, local://, custom://) to ray.init ( #16946 )
2021-07-14 21:45:46 -07:00
Antoni Baum
ac54164e73
[Datasets] Implement to_tf ( #17000 )
...
Co-authored-by: Clark Zinzow <clarkzinzow@gmail.com>
2021-07-14 20:48:25 -07:00
Amog Kamsetty
caa78a3cff
Revert "[Core] Remove gpustat from core dependencies ( #17059 )" ( #17106 )
...
This reverts commit 7ec18f671a
2021-07-14 20:19:33 -07:00
Eric Liang
85725f2018
[data] Move Block to public API so that datasource API doesn't reference a private interface ( #17098 )
2021-07-14 18:59:13 -07:00
Yi Cheng
2088540ffb
[workflow] Get rid of asyncio.run for py36 ( #17065 )
2021-07-14 17:34:27 -07:00
Yi Cheng
75bdccb86e
fix bad test ( #17057 )
2021-07-14 11:42:08 -07:00
Antoni Baum
6e780ebf07
[tune] ResourceChangingScheduler dynamic resource allocation during tuning ( #16787 )
2021-07-14 10:45:13 +01:00
Antoni Baum
cfc5806c2d
[release] LightGBM release tests ( #17043 )
2021-07-14 08:38:55 +01:00
Philipp Moritz
0f79ebbd75
[Ray debugger] Sort breakpoints chronologically and print in table format ( #17051 )
2021-07-14 00:37:04 -07:00
Amog Kamsetty
7ec18f671a
[Core] Remove gpustat from core dependencies ( #17059 )
2021-07-13 21:22:02 -07:00
Yi Cheng
dc0f948cb9
[workflow] S3 support for workflow ( #16993 )
...
* up
* up
* up
* format
* up
* fix comment
* up
* update
* update
* move dep
* bump pytest versin
* use lazy_fixture explicitly
* format
2021-07-13 19:14:41 -07:00
Philipp Moritz
ac912f0ce1
Allow using breakpoint() to drop into Ray debugger ( #17025 )
...
* Set PYTHONBREAKPOINT
* update tests
* update
* update docs
* fix docs
* skip ray functions
* ok
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
* breakpoint() is only working in Python > 3.6
* add note
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-07-13 13:52:17 -07:00
Ian Rodney
fac6045c87
[GCP] Allow Head Node to Launch Workers with IAM Role ( #17027 )
2021-07-13 10:44:34 -07:00
Amog Kamsetty
38b5b6d24c
Revert "[RLlib] Simplify multiagent config (automatically infer class/spaces/config). ( #16565 )" ( #17036 )
...
This reverts commit e4123fff27
2021-07-13 09:57:15 -07:00
Kai Fricke
27d80c4c88
[RLlib] ONNX export for tensorflow (1.x) and torch ( #16805 )
2021-07-13 12:38:11 -04:00
Edward Oakes
f7759fa484
[core] Add ray.util.list_actors() API ( #16642 )
2021-07-13 10:00:28 -05:00
Sven Mika
e4123fff27
[RLlib] Simplify multiagent config (automatically infer class/spaces/config). ( #16565 )
2021-07-13 06:38:14 -04:00
Ian Rodney
9cb80fcf17
[Client][Proxy] Handle Non-Default Redis Password ( #16885 )
2021-07-12 23:57:51 -07:00
Eric Liang
e7350ff828
Fix flaky test_plasma_unlimited::test_fallback_allocation_failure ( #17016 )
...
* fix
* fix catch
2021-07-12 20:17:23 -07:00
Siyuan (Ryans) Zhuang
a8b57c78d6
[Workflow] Workflow management - Part II ( #16907 )
2021-07-12 17:31:23 -07:00
Qing Wang
4bde71ca86
[Java][Core] Support get current actor handle. ( #14900 )
2021-07-12 15:27:54 -07:00
corentinmarek
24e00fcb1b
Add initialization for transport params for non s3 storage ( #16054 )
2021-07-12 10:47:49 -07:00
Edward Oakes
87e6f99b9c
[serve] Bump timeouts on test_deploy and re-enable ( #16969 )
2021-07-12 11:38:02 -05:00
Wansoo Kim
c9e8c12f8c
[Refactor] Minor Refactoring and Typing ( #16964 )
2021-07-12 15:37:07 +01:00
Tao Wang
eed0ffc6ff
[Core]Align storage of session_dir in java/python so it can be accessed u… ( #16958 )
...
* Align storage of session_dir in java/python so they can be accessed using internal kv manager
* align cpp
2021-07-12 17:42:13 +08:00
qicosmos
298d2afc35
[Ray Log] remove glog dependency ( #16077 )
2021-07-12 17:06:52 +08:00
gurunath
e3966f59e3
[tune] explicitly raising tune import Error “[tune]” ( #16575 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-07-11 23:40:10 -07:00
Antoni Baum
0935ec30d0
[tune] Add information about environment variables to tune.run docstring ( #16980 )
2021-07-11 17:20:17 -07:00
Julius Frost
a88b217d3f
[rllib] Enhancements to Input API for customizing offline datasets ( #16957 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-07-10 15:05:25 -07:00
Scott Graham
3334357c58
[autoscaler] [azure] Fix Azure Autoscaling Failures ( #16640 )
...
Co-authored-by: Scott Graham <scgraham@microsoft.com>
2021-07-10 11:55:00 -07:00
Nikita Vemuri
6d36d7ed7e
[Serve] Call FastAPIWrapper class constructor before startup hooks ( #16941 )
...
* run constructor before startup hooks
* address comments
Co-authored-by: Nikita Vemuri <nikitavemuri@nikitas-mbp.attlocal.net>
2021-07-09 09:39:32 -07:00
Dmitri Gekhtman
27a9ae5e13
[autoscaler][gcp] Retry GCP BrokenPipeError ( #16952 )
2021-07-08 13:54:29 -07:00
Maxim Egorushkin
9cb5c9a422
Never convert trial_id to float when loading progress.csv. ( #16959 )
...
* Never convert trial_id to float when loading progress.csv.
* Formatting updated.
Co-authored-by: Maxim Egorushkin <maxim.egorushkin@gmail.com>
2021-07-08 11:06:11 -07:00
SongGuyang
560fd15568
[C++ worker] support build and add C++ worker to python wheel ( #16496 )
2021-07-08 14:42:26 +08:00
Clark Zinzow
cc215353e2
[Datasets] Adds Dataset.iter_batches(). ( #16853 )
2021-07-07 22:01:20 -07:00
Frank Luan
7c0320175c
Actor fix ( #16955 )
2021-07-07 20:51:36 -07:00
Clark Zinzow
9358dd4bc2
[Datasets] Port JSON and CSV readers to datasource API. ( #16938 )
...
* Port JSON and CSV readers to datasource API.
* Formatting.
* Moved datasources to datasource dir, created shared FileBasedDatasource.
* Confirm that accessing dataset schema raises an error.
* Formatting.
* Return None for unknown metadata instead of raising an error.
* Feedback.
2021-07-07 20:32:04 -07:00
Kai Yang
e925051ce4
[Core] Get node to connect for driver in global state accessor ( #16810 )
2021-07-08 11:21:12 +08:00
Amog Kamsetty
3c482cd6c8
Skip more test_deploy tests on OSX ( #16943 )
...
* skip more
* skip more
2021-07-07 16:53:21 -07:00
Simon Mo
f4671d55d8
Bump log monitor's sleep duration to 0.1s ( #16939 )
...
We observed in long running serving scenarios the log monitor
consistently uses 10% of cpus when there is no new lines. Hopefully
this new sleep duration should shrink that usage
2021-07-07 15:41:34 -07:00
Chen Shen
0421fa188e
[core] use fallocate for fallback allocation to avoid SIGBUS ( #16824 )
2021-07-07 14:50:11 -07:00
Dmitri Gekhtman
2f42b0c4b9
[kubernetes] K8s keep gpu zero override ( #16887 )
2021-07-07 13:45:34 -07:00
Chen Shen
dbd3260141
[core] Deprecate QuotaAwareEvictionPolicy ( #16911 )
2021-07-07 13:44:41 -07:00
Eric Liang
3b9f6ccc5e
Remove autoinit from ray.data ( #16925 )
2021-07-07 13:44:10 -07:00
Amog Kamsetty
b79ef3ba0f
[Serve] Skip more test_deploy tests on OSX ( #16937 )
2021-07-07 10:44:01 -07:00
Antoni Baum
8f41a34079
[tune] Placement group manager fixes ( #16844 )
...
Co-authored-by: Kai Fricke <kai@anyscale.com>
2021-07-07 10:42:19 -07:00
Antoni Baum
b737b2a877
[joblib] Improved object store management for Pool ( #16879 )
...
* Improved object store management for Pool
* Update docs, hints
* Add test
* Nit
* Nit
2021-07-07 10:39:18 -07:00
