Raphael Avalos
440c9c42be
[RLlib] Fix combination of lockstep and multiple agnts controlled by the same policy. ( #9521 )
...
* Change aggregation when lockstep is activated.
Modification of MultiAgentBatch.timeslices to support the combination of lockstep and multiple agents controlled by the same policy.
fix ray-project/ray#9295
* Line too long.
2020-07-19 23:03:12 -07:00
fangfengbin
0cee75c86a
GCS client add fetch operation before subscribe ( #9564 )
2020-07-20 10:16:42 +08:00
mehrdadn
2554a1a997
Bazel fixes ( #9519 )
2020-07-19 12:53:08 -07:00
Lingxuan Zuo
ce3f542739
[Metric] new cython interface for python worker metric ( #9469 )
2020-07-19 10:43:21 +08:00
Siyuan (Ryans) Zhuang
7edd1e6694
[Core] Remove socket pair exchange in Plasma Store ( #9565 )
...
* try use boost::asio for notification processing
2020-07-18 15:47:52 -07:00
krfricke
ad0219b80d
[tune] fix pbt checkpoint_freq ( #9517 )
...
* Only delete old checkpoint if it is not the same as the new one
* Return early if old checkpoint value coincides with new checkpoint value
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-07-18 00:58:16 -07:00
fangfengbin
b12b8e1324
[GCS]Fix lease worker leak bug when gcs server restarts ( #9315 )
...
* add part code
* fix compile bug
* fix review comments
* fix review comments
* fix review comments
* fix review comments
* fix review comment
* fix ut bug
* fix lint error
* fix review comment
* fix review comments
* add testcase
* add testcase
* fix bug
* fix review comments
* fix review comment
* fix review comment
* refine comments
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-07-18 15:49:41 +08:00
jerrylee.io
4c18463fb7
[cli] ray memory: added redis_password ( #9492 )
2020-07-18 00:08:41 -07:00
Richard Liaw
7e3ded7439
[tune] pin tune-sklearn ( #9498 )
2020-07-17 21:25:12 -07:00
Richard Liaw
ed476be4ad
quickfix ( #9552 )
2020-07-17 20:54:03 -07:00
Tom
cf719dd470
[Tune] Copy default_columns in new ProgressReporter instances ( #9537 )
2020-07-17 15:44:38 -07:00
Siyuan (Ryans) Zhuang
cba9545266
Add plasma store benchmark for small objects ( #9549 )
2020-07-17 14:20:59 -07:00
krfricke
87630cf024
[tune] Unflattened lookup for ProgressReporter ( #9525 )
...
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-07-17 13:52:54 -07:00
fangfengbin
5881417ec4
Fix bug that test_multi_node.py::test_multi_driver_logging hangs when GCS actor management is turned on ( #9539 )
...
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-07-17 11:53:29 -07:00
mehrdadn
ffb88cda6f
Fix Bazel in Docker ( #9530 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-17 11:39:38 -07:00
Sven Mika
887cf5eca7
MADDPG learning confirmation test. ( #9538 )
2020-07-17 20:18:02 +02:00
Simon Mo
e78945db96
[Serve] Add internal instruction for running benchmarks ( #9531 )
2020-07-17 11:17:37 -07:00
Alex Wu
a78c5d5ef2
[New scheduler] Queueing refactor ( #9491 )
...
* .
* test_args passes
* .
* test_basic.py::test_many_fractional_resources causes ray to hang
* test_basic.py::test_many_fractional_resources causes ray to hang
* .
* .
* useful
* test_many_fractional_resources fails instead of hanging now :)
* Passes test_fractional_resources
* .
* .
* Some cleanup
* git is hard
* cleanup
* .
* .
* .
* .
* .
* .
* .
* cleanup
* address reviews
* address reviews
* more refactor
* :)
* travis pls
* .
* travis pls
* .
2020-07-17 11:08:03 -07:00
Gabriele Oliaro
026c009086
Pipelining task submission to workers ( #9363 )
...
* first step of pipelining
* pipelining tests & default configs
- added pipelining unit tests in direct_task_transport_test.cc
- added an entry in ray_config_def.h, ray_config.pxi, and ray_config.pxd to configure the parameter controlling the maximum number of tasks that can be in fligh to each worker
- consolidated worker_to_lease_client_ and worker_to_lease_client_ hash maps in direct_task_transport.h into a single one called worker_to_lease_entry_
* post-review revisions
* linting, following naming/style convention
* linting
2020-07-17 10:45:13 -07:00
Stephanie Wang
b351d13940
[core] Add flag to enable object reconstruction during ray start ( #9488 )
...
* Add flag
* doc
* Fix tests
2020-07-17 10:13:14 -07:00
Alisa
f080aa6ce3
Add placement group manager and some code in core_worker ( #9120 )
...
Co-authored-by: Lingxuan Zuo <skyzlxuan@gmail.com>
2020-07-17 20:49:51 +08:00
Sven Mika
78dfed2683
[RLlib] Issue 8384: QMIX doesn't learn anything. ( #9527 )
2020-07-17 12:14:34 +02:00
mehrdadn
37942ea1e7
Windows cleanup ( #9508 )
...
* Remove unneeded code for Windows
* Get rid of usleep()
* Make platform_shims includes non-transitive
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-17 02:08:15 -07:00
Simon Mo
22a5c3d3ee
Hotfix Lint for Serve ( #9535 )
2020-07-17 00:40:33 -07:00
Lingxuan Zuo
3a74164289
[Stats] Fix metric exporter test ( #9376 )
2020-07-17 14:38:24 +08:00
Sven Mika
8204717eed
[RLlib] Issue 9218: PyTorch Policy places Model on GPU even with num_gpus=0 ( #9516 )
2020-07-17 05:53:25 +02:00
fangfengbin
008d973f62
fix java createActor NPE bug ( #9532 )
2020-07-17 11:01:51 +08:00
SangBin Cho
94e94ae0c3
[Core] Fix Java detached error ( #9526 )
2020-07-16 16:39:42 -07:00
mehrdadn
aa33aba1fa
Fix pip and Bazel interaction messing up CI ( #9506 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-16 16:28:37 -07:00
Simon Mo
60a838f0f0
[Serve] Use pickle instead of clouldpickle ( #9479 )
2020-07-16 15:44:10 -07:00
Simon Mo
761b584814
[Serve] Improve buffering for simple cases ( #9485 )
2020-07-16 15:34:08 -07:00
Siyuan (Ryans) Zhuang
d61d92afc7
Cleanup Plasma Store (hash utilities) ( #9524 )
2020-07-16 14:52:14 -07:00
Michael Luo
94fcd43593
[rllib] MAML Transform ( #9463 )
...
* MAML Transform
* Moved Inner Adapt to Method in Execution Plan
2020-07-16 11:11:33 -07:00
Stephanie Wang
baf4be245d
Fix flaky test_actor_failures::test_actor_restart ( #9509 )
...
* Fix flaky test
* os exit
2020-07-16 10:48:33 -07:00
Ameer Haj Ali
1e46d4e29f
[Autoscaler] Making bootstrap config part of the node provider interface ( #9443 )
...
* supporting custom bootstrap config for external node providers
* bootstrap config
* renamed config to cluster_config
* lint
* remove 2 args from importer
* complete move of bootstrap to node_provider
* renamed provider_cls
* move imports outside functions
* lint
* Update python/ray/autoscaler/node_provider.py
Co-authored-by: Eric Liang <ekhliang@gmail.com>
* final fixes
* keeping lines to reduce diff
* lint
* lamba config
* filling in -> adding for lint
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-07-16 09:54:20 -07:00
SangBin Cho
63e052a5f3
Fix. ( #9464 )
2020-07-16 11:51:32 -05:00
SangBin Cho
41ad5de1c4
Fix broken test_raylet_info_endpoint ( #9511 )
2020-07-16 11:51:06 -05:00
mehrdadn
ac39e23145
Get rid of build shell scripts and move them to Python ( #6082 )
2020-07-16 11:26:47 -05:00
Sven Mika
935d8308fb
[RLlib] Issue #9437 (PyTorch converts to CPU tensor, even if on GPU). ( #9497 )
2020-07-16 14:55:50 +02:00
SangBin Cho
2f674728a6
[GCS Actor Management] Gcs actor management broken detached actor ( #9473 )
2020-07-16 15:41:18 +08:00
mehrdadn
06ed2313e2
Fix clang-cl build ( #9494 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-15 22:17:11 -07:00
chaokunyang
9318e76b81
[Java] Named java actor ( #9037 )
2020-07-16 11:31:18 +08:00
kisuke95
5e2571e214
release gil in global state accessor ( #9357 )
2020-07-16 11:21:10 +08:00
Stephanie Wang
4e81804cba
[core] Replace task resubmission in raylet with ownership protocol ( #9394 )
...
* Add intended worker ID to GetObjectStatus, tests
* Remove TaskID owner_id
* lint
* Add owner address to task args
* Make TaskArg a virtual class, remove multi args
* Set owner address for task args
* merge
* Fix tests
* Add ObjectRefs to task dependency manager, pass from task spec args
* tmp
* tmp
* Fix
* Add ownership info for task arguments
* Convert WaitForDirectActorCallArgs
* lint
* build
* update
* build
* java
* Move code
* build
* Revert "Fix Google log directory again (#9063 )"
This reverts commit 275da2e400
2020-07-15 14:55:51 -07:00
krfricke
5a40299d42
[tune] extend PTL template (GPU, typing fixes, tensorboard) ( #9451 )
...
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-07-15 10:30:20 -07:00
mehrdadn
aa8928fac2
Make more tests compatible with Windows ( #9303 )
2020-07-15 11:34:33 -05:00
mehrdadn
ad83337f46
Make pip install verbose ( #9496 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-15 18:02:42 +02:00
Kai Yang
005ea1e125
Add job configs to gcs ( #9374 )
2020-07-15 15:18:48 +08:00
mehrdadn
33e400998c
Fix name clash on Windows ( #9412 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-14 23:14:53 -07:00
Stephanie Wang
6d99aa34a5
[core] Handle out-of-order actor table notifications ( #9449 )
...
* Drop stale actor table notifications
* build
* Add num_restarts to disconnect handler
* Unit test and increment num_restarts on ALIVE, not RESTARTING
* Wait for pid to exit
2020-07-14 22:55:04 -07:00
