Commit graph

787 commits

Author SHA1 Message Date
Sven Mika
41968512ca
[RLlib] Partial GPU examples (for learner and workers). (#15334) 2021-04-20 08:46:05 +02:00
Sven Mika
cecfc3b43b
[RLlib] Multi-GPU support for Torch algorithms. (#14709) 2021-04-16 09:16:24 +02:00
SangBin Cho
1d87e4447d
[Test] increase the test size of test io that consistenly times out (#15341) 2021-04-15 14:02:41 -07:00
Sven Mika
8b3554e37e
[RLlib] Remove all (already soft-deprecated) SampleBatch.data from code. (#15335) 2021-04-15 19:19:51 +02:00
Sven Mika
c90de315e5
[RLlib] APEX returns incorrect default resources (PleacementGroupFactory) colocated missing replay actors. (#15295) 2021-04-15 16:50:42 +01:00
Sven Mika
e961d2f4b2
[RLlib] Improve example scripts for attention nets, CartPole LSTM, and custom RNN-models. (#15329) 2021-04-15 16:11:34 +02:00
Sven Mika
45d6560759
[RLlib] Fix flakey custom_fast_model_torch/tf tests. (#15330) 2021-04-15 16:10:29 +02:00
SangBin Cho
27ab0c7633
[Test] Skip the failing rllib example test. (#15321) 2021-04-14 20:19:44 -07:00
Sven Mika
bbfa8ffec9
[RLlib] Minor release 1.3 warnings cleanups. (#15272) 2021-04-14 14:03:15 +02:00
Sven Mika
ef0f163d16
[RLlib] Discussion 1709: IMPALA (tf and torch) reports sum of entropy (over batch) in stats. Should report mean instead. (#15290) 2021-04-14 11:44:25 +02:00
Sven Mika
5254d2fb36
[RLlib] Support parallelizing evaluation and training (optional). (#15040) 2021-04-13 09:53:35 +02:00
Sven Mika
9c5a0cfd7a
[RLlib] Issue 14385: Policy.compute_actions_from_input_dict does not properly track accessed fields for Policy's view requirements. (#14386) 2021-04-11 18:20:04 +02:00
Sven Mika
dfc116ea27
[RLlib] Discussion 681: Metrics prepends newest episodes instead of appending. (#15236) 2021-04-11 15:31:43 +02:00
Sven Mika
1c9701e9cb
[RLlib] Discussion 1513: on_episode_step() callback called after very first reset (should not). (#15218) 2021-04-11 13:16:17 +02:00
Sven Mika
b267f1f1ba
[RLlib] Add support for Int-Box action spaces. (#15012) 2021-04-11 13:16:01 +02:00
Dmitri Gekhtman
58fbb419ea
[client][rllib] Add client_mode_hook for ray.get_gpu_ids (#15185) 2021-04-08 23:36:11 -07:00
Yi Cheng
e552e3f19c
Skip test_dependency_torch (#15123) 2021-04-05 18:02:10 -07:00
Kai Fricke
d33b0e4bc3
[tune] Reconcile placement groups every N seconds to avoid bottlenecks when running many short trials (#15011)
Closes a release blocking issue
2021-04-01 17:04:44 +02:00
Sven Mika
1bb70e4907
[RLlib] Issue 14523: Torch + py3.8 leads to GPU device error. (#15014) 2021-03-30 21:43:11 +02:00
Sven Mika
95686a8fdd
[RLlib] Issue 14533: Tf-eager properly use tree.map_struct on value of type Repeated (RLlib-specific space) (#15015) 2021-03-30 19:28:45 +02:00
Sven Mika
c8ca4d03ad
[RLlib] Issue with agent-id -> pol-id mapping not required to be fixed across different episodes. (#15020) 2021-03-30 19:25:52 +02:00
Raphael CHEN
93d4244d9c
[RLlib] Correctly get bytes size of SampleBatch (#14801) 2021-03-30 19:24:58 +02:00
Michael Luo
b84575c092
[RLlib] 2 RLlib Flaky Tests (#14930) 2021-03-30 19:21:13 +02:00
Eric Liang
b90cc51c27
[RLlib] Attempt splitting rollout test to avoid initial timeout (#14999) 2021-03-30 19:20:02 +02:00
Sven Mika
4f66309e19
[RLlib] Redo issue 14533 tf enable eager exec (#14984) 2021-03-29 20:07:44 +02:00
Sven Mika
e98808ce11
[RLlib] Fix 2 flakey test cases. (#14892) 2021-03-29 17:20:29 +02:00
Eric Liang
af8a93f2a4
Deflake some RLlib tests (#14947)
* fix

* update

* 100

* flake
2021-03-26 11:45:17 -07:00
Sven Mika
803be1d968
[RLlib] Trajectory view blogpost example script changes. (#14893) 2021-03-25 14:16:50 +01:00
Sven Mika
8698cf9bc8
[RLlib] Fix param noise test case on CI. (#14926) 2021-03-25 12:33:23 +01:00
SangBin Cho
fa5f961d5e
Revert "[RLlib] Issue 14533: tf.enable_eager_execution() must be called at beginning. (#14737)" (#14918)
This reverts commit 3e389d5812.
2021-03-25 00:42:01 -07:00
mvindiola1
5e350ceaa2
[RLlib] Issue 14119: Fix TD3 policy delay for torch. (#14840) 2021-03-24 16:26:22 +01:00
Raoul Khouri
c37fa3f389
[RLlib] Example and test for custom Trainer wrapper experiments (#14652) 2021-03-24 16:22:46 +01:00
Jack Parsons
3df7a010b1
[RLlib] Fixing conv filters config for ComplexInputNetwork (#14749) 2021-03-24 16:15:36 +01:00
astronauti
8874ccec2d
[RLlib] Update sac_tf_policy.py (add tf.cast to float32 for rewards) (#14843) 2021-03-24 16:12:55 +01:00
Sven Mika
6708211b59
[RLlib] JSONReader: Mix files if > 1 at beginning (each worker should start with different file). (#14865) 2021-03-24 16:07:40 +01:00
Sven Mika
3e389d5812
[RLlib] Issue 14533: tf.enable_eager_execution() must be called at beginning. (#14737) 2021-03-24 12:54:27 +01:00
Sven Mika
78c64ca151
[RLlib] Attention net example script: Clarifications on how to use with Trainer.compute_action. (#14864) 2021-03-23 19:33:01 +01:00
Sven Mika
04bc0a9828
[RLlib] Remove all non-trajectory view API code. (#14860) 2021-03-23 09:50:18 -07:00
Sven Mika
3e7899d251
[RLlib] Issue 14653: Empty env steps cause key error in SimpleListCollector. (#14765) 2021-03-23 10:30:53 +01:00
Sven Mika
f859ebb99f
[RLlib] Fix env rendering and recording options (for non-local mode; >0 workers; +evaluation-workers). (#14796) 2021-03-23 10:06:06 +01:00
Sven Mika
e7557ae433
[RLlib] Issue 13132: DQN does not update target net after restore (#14838) 2021-03-23 08:30:37 +01:00
Clark Zinzow
1a9ba19012
[Core] Adds deprecation decorator and fixes privatization of a few APIs. (#14811) 2021-03-22 10:31:50 -07:00
Kai Fricke
be30b784a4
Amend #14308 (fix for post_fcnet_hiddens) (#14354) 2021-03-22 15:44:18 +01:00
Chris Bamford
cd89f0dc55
[RLLib] Episode media logging support (#14767) 2021-03-19 09:17:09 +01:00
Ian Rodney
eb12033612
[Code Cleanup] Switch to use ray.util.get_node_ip_address() (#14741)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-03-18 13:10:57 -07:00
Sven Mika
c3a15ecc0f
[RLlib] Issue #13802: Enhance metrics for multiagent->count_steps_by=agent_steps setting. (#14033) 2021-03-18 20:27:41 +01:00
Sven Mika
69202c6a7d
[RLlib] Obsolete usage tracking dict via sample batch. (#13065) 2021-03-17 08:18:15 +01:00
Sven Mika
78a134efa2
[RLlib] Add HowTo set env seed to our custom env example script. (#14471) 2021-03-16 08:12:27 +01:00
Sven Mika
4e17f95927
[RLlib] Unflake 2 test cases (SAC cont. cartpole). (#14620) 2021-03-15 14:03:54 +01:00
Sven Mika
ee4b6e7e3b
[RLlib] Unity3D example broken due to change in ML-Agents API. Attention-net prev-n-a/r. Attention-wrapper works with images. (#14569) 2021-03-12 18:27:25 +01:00