Amog Kamsetty
874da9a25f
[Ray SGD] LightningModule integration + MNIST Example ( #11042 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-01 20:07:32 -07:00
Richard Liaw
9dc7b7b11d
[tune] enable ax test ( #11165 )
...
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-01 17:25:29 -07:00
Richard Liaw
f60d77d78e
[tune] Fix GPU thread leakage
2020-10-01 17:07:13 -07:00
Ian Rodney
0d5b09f426
[Docker] Automagically add "runtime=nvidia" ( #11125 )
2020-10-01 17:04:19 -07:00
Kai Fricke
681c24754a
[tune] Example for using huggingface hyperparamer_search API ( #11158 )
2020-10-01 16:00:57 -07:00
Alex Wu
a866be381c
[New Scheduler] Heartbeat ( #11024 )
...
* .
* refactor
* .
* .
* done?
* .
* .
* .
* lint
* no light heartbeat, no tests, fields 2,3
* .
* manually clang format :(
* .
* .
* test
* .
* .
* task manager heartbeat
* lint
* .
* add reminder
* CR
* CR
* cleanup
* CR
* comment
* lint
* .
2020-10-01 15:54:53 -07:00
Siyuan (Ryans) Zhuang
1ad52bdfbc
Remove the stale directory (pyarrow_files) ( #11163 )
2020-10-01 14:52:04 -07:00
Kai Fricke
bdf647c4ec
[tune] docker syncer ( #11035 )
...
* Add DockerSyncer
* Add docs
* Update python/ray/tune/integration/docker.py
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
* Updated docs
* fix dir
* Added docker integration test
* added docker integration test to bazel build
* Use sdk.rsync API
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-01 11:59:23 -07:00
Sumanth Ratna
98ebf8e2d8
[tune][docs] fix typo in Tune FAQ ( #11161 )
...
* Fix typo in tune FAQ (used to use)
* Update doc/source/tune/_tutorials/_faq.rst
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-01 11:20:41 -07:00
Richard Liaw
9070ed3e44
[hotfix] revert ax ( #11159 )
...
This reverts commit de3c606b20
2020-10-01 10:05:03 -07:00
Richard Liaw
b969e8cf59
[tune][hotfix] comment out test ( #11140 )
2020-10-01 10:04:40 -07:00
Kai Fricke
de3c606b20
[tune] Use latest Ax release ( #11155 )
...
* Use latest Ax release
* specify egg
* Install latest Ax only for py3.7
2020-10-01 08:51:15 -07:00
Sven Mika
36bda8432b
[RLlib] Trajectory view API: Simple List Collector (on by default for PPO); LSTM-agnostic ( #11056 )
2020-10-01 16:57:10 +02:00
Richard Liaw
0d93b1de93
[autoscaler] rsync to node ( #11122 )
2020-10-01 01:42:49 -07:00
Eric Liang
8f73014291
[autoscaler] Make it more clear NodeProvider and CommandRunner are private APIs ( #11086 )
2020-09-30 16:24:37 -07:00
Simon Mo
a518fb1031
[Doc] Use different pygments_style ( #11143 )
2020-09-30 16:16:55 -07:00
Eric Liang
090002b0ce
Blocking asyncio get warning should be logger.warn not logger.debug ( #11141 )
2020-09-30 16:16:35 -07:00
Benjamin Black
4445f32798
[rllib] Fixed pettingzoo wrapper ( #11060 )
...
* fixed PettingZooEnv, relevant docs, examples
* fixed linting error
* pettingzoo wrapper fix
* fixed linting issue
2020-09-30 15:34:47 -07:00
Kai Fricke
c77cfaa5ad
[tune] use dated experiment dir per default ( #11104 )
2020-09-30 14:43:59 -07:00
Siyuan (Ryans) Zhuang
f0dba6bd2b
Code cleanup about python3 asyncio compat ( #11134 )
...
* cleanup python3 compat and others
2020-09-30 14:22:25 -07:00
Tao Wang
0dcfa9ed6c
Add light heartbeat flag in python and use it in load metrics ( #11032 )
2020-09-30 11:39:28 -07:00
SangBin Cho
e44828d928
[Test] Make the test size bigger for tune to fix timeout. ( #11138 )
2020-09-30 11:35:31 -07:00
fangfengbin
138d6cced9
[GCS]Optimizing actor info query interface ( #11067 )
...
* add part code
* add part code
* fix review comment
* fix review comment
* fix review comment
* fix crash bug
* fix ut bug
* fix bug
* fix ut bug
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-09-30 11:34:42 -07:00
SangBin Cho
474af36591
[Core] Fix random bugs found. ( #11128 )
2020-09-30 00:11:57 -07:00
Kai Yang
3504391fd2
[Core] Multi-tenancy: enable multi-tenancy by default ( #10570 )
...
* Add new job in Travis to enable multi-tenancy
* fix
* Update .bazelrc
* Update .travis.yml
* fix test_job_gc_with_detached_actor
* fix test_multiple_downstream_tasks
* fix lint
* Enable multi-tenancy by default
* Kill idle workers in FIFO order
* Update test
* minor update
* Address comments
* fix some cases
* fix test_remote_cancel
* Address comments
* fix after merge
* remove kill
* fix worker_pool_test
* fix java test timeout
* fix test_two_custom_resources
* Add a delay when killing idle workers
* fix test_worker_failure
* fix test_worker_failed again
* fix DisconnectWorker
* update test_worker_failed
* Revert some python tests
* lint
* address comments
2020-09-29 23:54:53 -07:00
SangBin Cho
f54f7b23f6
[Object Spilling] Name IO workers properly. ( #11097 )
...
* Fix.
* Addressed code review.
2020-09-29 23:48:31 -07:00
Kai Yang
0c254878db
[Java] Upgrade TestNG to 7.3.0 ( #11135 )
2020-09-30 14:38:52 +08:00
Tao Wang
15ae8816f7
[GCS]Remove useless / heavy heartbeat pub ( #11132 )
2020-09-29 23:38:17 -07:00
Max Fitton
03c11d3b85
[Dashboard] Add Ray Config API to Reporter Head ( #11010 )
...
* Add Ray Config API to the backend for fetching config
* Address PR comments.
* Make reporter cache whole payload
* lint
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-09-29 17:57:49 -07:00
Maksim Smolin
94494c43d6
[cli] Updates ( #10777 )
2020-09-29 16:55:07 -07:00
Ameer Haj Ali
f17ad5d060
[autoscaler] resource demand scheduler get_nodes_to_launch should return Dict not List ( #11118 )
2020-09-29 15:32:56 -07:00
Kai Fricke
b8f344f695
[tune] add faq entry for reproducing experiments (setting seeds etc) ( #11106 )
2020-09-29 14:48:39 -07:00
architkulkarni
3ad670efa6
auto-update copyright year in docs ( #11114 )
2020-09-29 13:57:06 -07:00
Max Fitton
825737adc5
[Dashboard] Add old dashboard front end to new dir so we can get a diff going. ( #11113 )
...
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-09-29 13:46:42 -07:00
Kai Fricke
10015e60fb
[tune] fix flaky callback test ( #11102 )
2020-09-29 09:44:32 -07:00
Tao Wang
1db83764bf
[GCS]Use new getting all available resources interface instead of pub-sub … ( #10914 )
...
* Use new all available resources getting interface instead of pub-sub in state.py
* add missing server handler and test cases, fix comments
* add fine grained test assert
* per comments
* involve new added function _available_resources_per_node
* change ClientID to NodeID
* fix compile
* fix client id and lint
* robust tests check
* robust tests
2020-09-29 09:41:10 -07:00
Sven Mika
47eb6613b5
[RLlib] Remove unnecessary copies in compute_advantages. ( #10897 )
2020-09-29 12:25:20 +02:00
Sven Mika
f91c455527
[RLlib] Curiosity documentation. ( #11066 )
2020-09-29 09:39:22 +02:00
Ameer Haj Ali
0d36e4c025
[autoscaler] Support min_workers for multi node type ( #11041 )
...
* prepare for head node
* move command runner interface outside _private
* remove space
* Eric
* flake
* min_workers in multi node type
* fixing edge cases
* eric not idle
* fix target_workers to consider min_workers of node types
* idle timeout
* minor
* minor fix
* test
* lint
* eric v2
* eric 3
* min_workers constraint before bin packing
* Update resource_demand_scheduler.py
* Revert "Update resource_demand_scheduler.py"
This reverts commit 818a63a2c86d8437b3ef21c5035d701c1d1127b5.
* reducing diff
Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
Co-authored-by: Alex Wu <alex@anyscale.io>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-28 22:02:01 -07:00
SangBin Cho
0a6164ab15
[Core] Improve logging messages. ( #11082 )
2020-09-28 21:07:45 -07:00
Simon Mo
6cfc1a16a0
[Serve] Fix resource checking ( #11084 )
2020-09-28 18:10:43 -07:00
SangBin Cho
cef263a333
[Custom Metrics] Improve ray runtime context. ( #10981 )
...
* done.
* Addressed code review.
* Addressed code review.
2020-09-28 16:18:19 -07:00
fangfengbin
872219940b
[GCS]Fix miss PollOwnerForActorOutOfScope after gcs restarts bug ( #11054 )
...
* fix_RemoveActorFromOwner_crash_bug
* fix review comment
* fix review comment
* rm unused ut
* add testcase
* fix review comment
* rm unused import
* fix code style
* fix ut bug
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-09-28 10:06:40 -07:00
Kai Yang
79c6a6fa02
[Java] Enable retry in TestNG ( #11065 )
...
* Enable retry in Java test
* lint
* update
2020-09-28 22:16:06 +08:00
Lingxuan Zuo
27e1f513e3
[Log] make glog flush and RAY_LOG thread-safe ( #11002 )
...
* make glog flush and RAY_LOG thread-safe
* dump error log to console
* mapping all levels to destination
* hack glog for exporting message to stdout if no base name given
* patch lint
* use stdout logger by default
* add raylet std/err pytest checker
* add worker logs file check
* fix asan check
* loop in glog enums
* fix python lint
* lint for autoindent
* fix indent lint
* make raylet.err is not empty
2020-09-28 22:15:15 +08:00
fangfengbin
dd97f0c30d
[Java]Fix testSetResource bug ( #11064 )
...
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-09-28 17:53:08 +08:00
Tao Wang
25ac8f9aa5
[GCS]Use new flag to indicate whether resources are updated and update realtime resources view ( #10906 )
...
* Handle resources turning empty and update realtime view
* add up missing flag
* per comments
* use flag instead of special key to represent if resource changed
* Update src/ray/protobuf/gcs.proto
Co-authored-by: fangfengbin <869218239a@zju.edu.cn>
* fix lint in gcs.proto
* fix embarrassed mistake
Co-authored-by: fangfengbin <869218239a@zju.edu.cn>
2020-09-28 01:57:27 -07:00
fangfengbin
2e41a29c8f
[Placement Group]Support placement group request processing idempotent in raylet ( #10998 )
...
* add part code
* fix review comment
* fix review comment
* fix review comment
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-09-28 01:56:43 -07:00
fang yeqing
0765d989ae
[Core] Simplify logic in node manager class. ( #11063 )
...
Co-authored-by: 逗角 <yeqing.fyq@antfin.com>
2020-09-28 01:54:06 -07:00
fangfengbin
142234cbcb
[GCS]Fix ServiceBasedGcsClientTest bug ( #11031 )
...
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-09-28 14:50:36 +08:00
