Clark Zinzow
8302b5a335
[Core] Reverts full dispatch queue iteration PRs. ( #17127 )
...
* Revert "[Core] iterate over entire dispatch queue instead of returning when worker unavailable (#16535 )"
This reverts commit 54d66ac637#16751 )"
This reverts commit 13a133817b
2021-07-16 10:28:00 -07:00
Siyuan (Ryans) Zhuang
fd3742bb63
[Workflow] Update tests ( #17147 )
...
* update workflow tests
* use conftest
* use conftest
* use conftest
2021-07-16 09:25:40 -07:00
Eric Liang
40f1ee6e1b
Fix prefetch typo in Dataset ( #17143 )
2021-07-16 09:22:42 -07:00
fyrestone
e2808a35cf
Dashboard job module uses attrs instead of pydantic for job description ( #17116 )
2021-07-16 22:26:00 +08:00
Kai Fricke
49b72eec16
[tune] filter placement group resources if not in use ( #16996 )
2021-07-16 00:35:04 -07:00
Zhi Lin
6d9fb421c6
[tracing] Do not wrap when tracing is not enabled ( #16607 )
2021-07-16 00:27:54 -07:00
Eric Liang
f03b43c532
[dataset] Support callable classes to simplify state initialization ( #17136 )
2021-07-15 23:06:14 -07:00
SongGuyang
dcb1baabd7
[C++ API] support loading C++ dynamic libraries from code search path ( #16828 )
2021-07-16 13:02:45 +08:00
SongGuyang
a57de0e224
support build different python wheel in setup.py ( #16998 )
2021-07-16 13:01:48 +08:00
Eric Liang
e69987bc96
Improve dataset error message ( #17129 )
2021-07-15 20:58:15 -07:00
Edward Oakes
90a1667b29
[debugger] Clean up breakpoint state for dead jobs ( #17095 )
2021-07-15 22:20:09 -05:00
Ian Rodney
23d43919cd
[Client] Except TypeError when Deserializing ( #17035 )
...
Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com>
2021-07-15 19:10:21 -07:00
Amog Kamsetty
860addeafa
Remove pyspy dependency ( #17061 )
...
* remove pyspy
* fix
* update-for-posterity
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
* update
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
* Update setup.py
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-07-15 17:36:42 -07:00
Yi Cheng
138676295f
[core] Add bundle id as a label; ( #16819 )
...
* check
* up
* up
* up
* up
* up
* up
* format
* up
* up
* add test
* format
* up
* format
* up
* format
* up
* up
* up
* rollback
* uncomment
* format
* fix comments
* fix mac build
2021-07-15 16:05:42 -07:00
Amog Kamsetty
d607a894de
[Autoscaler] Remove jsonschema from core dependencies ( #17052 )
2021-07-15 13:56:44 -07:00
Siyuan (Ryans) Zhuang
dd1427548c
[Workflow] Readonly Virtual Actor ( #16963 )
...
* readonly virtual actor
* create and get actor
* add TODO
* mapping between actor ID and workflow ID
* update doc
* ensure storage serializable
* get_latest_output
* update storage
* tests
2021-07-15 13:44:51 -07:00
Amog Kamsetty
6ff4d1ddb1
[Datasets] to_torch implementation ( #17113 )
2021-07-15 13:02:07 -07:00
Stephanie Wang
bdaa96bf43
[core] Fix bugs in worker cleanup on driver exit ( #17049 )
...
* unit test
* cleanup test
* Don't kill workers when job finishes
* better test
* lint
* lint
* comment
* check
2021-07-15 12:53:51 -07:00
Qing Wang
d4635836ba
Port python API on get_current_actor_handle. ( #17110 )
...
* Port python API on get current actor handle.
* Address comment.
2021-07-15 11:22:46 -07:00
Eric Liang
3d764d7b4b
[data] Fix the ObjectRef type in the dataset docs ( #17111 )
...
* fix reft
* remove exp
* fix
2021-07-15 09:50:37 -07:00
architkulkarni
95a7c28ed5
[Core] [runtime env] Use global lock for conda install instead of per-env lock ( #17101 )
2021-07-15 11:33:30 -05:00
architkulkarni
8ece30246f
[Core] [runtime env] [Test] Partially deflake test_runtime_env_complicated by bumping 0.1s timeout to 0.5s ( #17109 )
2021-07-15 11:26:37 -05:00
Edward Oakes
58f62dbc52
[flaky test] Skip some flaky list_named_actors tests on windows ( #17087 )
2021-07-15 08:40:54 -07:00
Antoni Baum
f20311f194
[tune] ResourceChangingScheduler improvements ( #17082 )
2021-07-15 15:03:27 +01:00
Sven Mika
649580d735
[RLlib] Redo simplify multi agent config dict: Reverted b/c seemed to break test_typing (non RLlib test). ( #17046 )
2021-07-15 05:51:24 -04:00
Clark Zinzow
915c426515
[Dataset] Fix S3FileSystem subsystem initialization on deserialization. ( #17103 )
...
* Add S3FileSystem wrapper that initializes the S3 subsystem on deserialization, use it for file-based datasources.
* Use S3FileSystem wrapper for read_binary_files.
2021-07-14 23:32:48 -07:00
Eric Liang
38bddc3f2b
First cut at dataset documentation ( #16956 )
2021-07-14 23:27:13 -07:00
Chris K. W
bd9d7bbbaa
[client] Add support for protocol (ray://, local://, custom://) to ray.init ( #16946 )
2021-07-14 21:45:46 -07:00
Antoni Baum
ac54164e73
[Datasets] Implement to_tf ( #17000 )
...
Co-authored-by: Clark Zinzow <clarkzinzow@gmail.com>
2021-07-14 20:48:25 -07:00
Amog Kamsetty
caa78a3cff
Revert "[Core] Remove gpustat from core dependencies ( #17059 )" ( #17106 )
...
This reverts commit 7ec18f671a
2021-07-14 20:19:33 -07:00
Eric Liang
85725f2018
[data] Move Block to public API so that datasource API doesn't reference a private interface ( #17098 )
2021-07-14 18:59:13 -07:00
Yi Cheng
2088540ffb
[workflow] Get rid of asyncio.run for py36 ( #17065 )
2021-07-14 17:34:27 -07:00
Yi Cheng
75bdccb86e
fix bad test ( #17057 )
2021-07-14 11:42:08 -07:00
Antoni Baum
6e780ebf07
[tune] ResourceChangingScheduler dynamic resource allocation during tuning ( #16787 )
2021-07-14 10:45:13 +01:00
Antoni Baum
cfc5806c2d
[release] LightGBM release tests ( #17043 )
2021-07-14 08:38:55 +01:00
Philipp Moritz
0f79ebbd75
[Ray debugger] Sort breakpoints chronologically and print in table format ( #17051 )
2021-07-14 00:37:04 -07:00
Amog Kamsetty
7ec18f671a
[Core] Remove gpustat from core dependencies ( #17059 )
2021-07-13 21:22:02 -07:00
Yi Cheng
dc0f948cb9
[workflow] S3 support for workflow ( #16993 )
...
* up
* up
* up
* format
* up
* fix comment
* up
* update
* update
* move dep
* bump pytest versin
* use lazy_fixture explicitly
* format
2021-07-13 19:14:41 -07:00
Philipp Moritz
ac912f0ce1
Allow using breakpoint() to drop into Ray debugger ( #17025 )
...
* Set PYTHONBREAKPOINT
* update tests
* update
* update docs
* fix docs
* skip ray functions
* ok
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
* breakpoint() is only working in Python > 3.6
* add note
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-07-13 13:52:17 -07:00
Ian Rodney
fac6045c87
[GCP] Allow Head Node to Launch Workers with IAM Role ( #17027 )
2021-07-13 10:44:34 -07:00
Amog Kamsetty
38b5b6d24c
Revert "[RLlib] Simplify multiagent config (automatically infer class/spaces/config). ( #16565 )" ( #17036 )
...
This reverts commit e4123fff27
2021-07-13 09:57:15 -07:00
Kai Fricke
27d80c4c88
[RLlib] ONNX export for tensorflow (1.x) and torch ( #16805 )
2021-07-13 12:38:11 -04:00
Edward Oakes
f7759fa484
[core] Add ray.util.list_actors() API ( #16642 )
2021-07-13 10:00:28 -05:00
Sven Mika
e4123fff27
[RLlib] Simplify multiagent config (automatically infer class/spaces/config). ( #16565 )
2021-07-13 06:38:14 -04:00
Ian Rodney
9cb80fcf17
[Client][Proxy] Handle Non-Default Redis Password ( #16885 )
2021-07-12 23:57:51 -07:00
Eric Liang
e7350ff828
Fix flaky test_plasma_unlimited::test_fallback_allocation_failure ( #17016 )
...
* fix
* fix catch
2021-07-12 20:17:23 -07:00
Siyuan (Ryans) Zhuang
a8b57c78d6
[Workflow] Workflow management - Part II ( #16907 )
2021-07-12 17:31:23 -07:00
Qing Wang
4bde71ca86
[Java][Core] Support get current actor handle. ( #14900 )
2021-07-12 15:27:54 -07:00
corentinmarek
24e00fcb1b
Add initialization for transport params for non s3 storage ( #16054 )
2021-07-12 10:47:49 -07:00
Edward Oakes
87e6f99b9c
[serve] Bump timeouts on test_deploy and re-enable ( #16969 )
2021-07-12 11:38:02 -05:00
