ray/rllib/tuned_examples/ppo/pendulum-ddppo.yaml
Yi Cheng fd0f967d2e
Revert "[RLlib] Move (A/DD)?PPO and IMPALA algos to algorithms dir and rename policy and trainer classes. (#25346)" (#25420)
This reverts commit e4ceae19ef.

Reverts #25346

linux://python/ray/tests:test_client_library_integration never fail before this PR.

In the CI of the reverted PR, it also fails (https://buildkite.com/ray-project/ray-builders-pr/builds/34079#01812442-c541-4145-af22-2a012655c128). So high likely it's because of this PR.

And test output failure seems related as well (https://buildkite.com/ray-project/ray-builders-branch/builds/7923#018125c2-4812-4ead-a42f-7fddb344105b)
2022-06-02 20:38:44 -07:00

20 lines
498 B
YAML

pendulum-ddppo:
env: Pendulum-v1
run: DDPPO
stop:
episode_reward_mean: -300
timesteps_total: 1500000
config:
framework: torch
rollout_fragment_length: 250
num_gpus_per_worker: 0
num_workers: 4
num_envs_per_worker: 10
observation_filter: MeanStdFilter
gamma: 0.95
sgd_minibatch_size: 50
num_sgd_iter: 5
clip_param: 0.3
vf_clip_param: 10.0
lambda: 0.1
lr: 0.00015