ray/rllib/tuned_examples/ppo/cartpole-ppo-hyperband.yaml

cartpole-ppo:
    env: CartPole-v0
    run: PPO
    num_samples: 3
    stop:
        episode_reward_mean: 200
        time_total_s: 180
    config:
        # Works for both torch and tf.
        framework: tf
        num_workers: 1
        num_sgd_iter:
            grid_search: [1, 4]
        sgd_minibatch_size:
            grid_search: [128, 256, 512]
        observation_filter: MeanStdFilter
[tune] hyperband (#1156) * trial scheduler interface * remove * wip median stopping * remove * median stopping rule * update * docs * update * Revrt * update * hyperband untested * small changes before moving on * added endpoints * good changes * init tests * smore tests * unfinished tests * testing * testing code * morbugs * fixes * end * tests and typo * nit * try this * tests * testing * lint * lint * lint * comments and docs * almost screwed up * lint 2017-11-06 22:30:25 -08:00			`cartpole-ppo:`
			`env: CartPole-v0`
[tune] Support user-defined trainable functions / classes / envs with a shared object registry (#1226) 2017-11-20 17:52:43 -08:00			`run: PPO`
[tune] Rename 'repeat' to 'num_samples' (#2698) Deprecates the `repeat` argument and introduces `num_samples`. Also updates docs accordingly. 2018-08-24 15:05:24 -07:00			`num_samples: 3`
[tune] hyperband (#1156) * trial scheduler interface * remove * wip median stopping * remove * median stopping rule * update * docs * update * Revrt * update * hyperband untested * small changes before moving on * added endpoints * good changes * init tests * smore tests * unfinished tests * testing * testing code * morbugs * fixes * end * tests and typo * nit * try this * tests * testing * lint * lint * lint * comments and docs * almost screwed up * lint 2017-11-06 22:30:25 -08:00			`stop:`
			`episode_reward_mean: 200`
			`time_total_s: 180`
			`config:`
[RLlib] Benchmark and regression test yaml cleanup and restructuring. (#8414) 2020-05-26 11:10:27 +02:00			`# Works for both torch and tf.`
[RLlib] Auto-framework, retire `use_pytorch` in favor of `framework=...` (#8520) 2020-05-27 16:19:13 +02:00			`framework: tf`
[tune] hyperband (#1156) * trial scheduler interface * remove * wip median stopping * remove * median stopping rule * update * docs * update * Revrt * update * hyperband untested * small changes before moving on * added endpoints * good changes * init tests * smore tests * unfinished tests * testing * testing code * morbugs * fixes * end * tests and typo * nit * try this * tests * testing * lint * lint * lint * comments and docs * almost screwed up * lint 2017-11-06 22:30:25 -08:00			`num_workers: 1`
			`num_sgd_iter:`
			`grid_search: [1, 4]`
[rllib] clarify train batch size for PPO (#2793) It's possible to configure PPO in a way that ends up discarding most of the samples (they are treated as "stragglers"). Add a warning when this happens, and raise an exception if the waste is particularly egregious. 2018-09-05 12:06:13 -07:00			`sgd_minibatch_size:`
[tune] hyperband (#1156) * trial scheduler interface * remove * wip median stopping * remove * median stopping rule * update * docs * update * Revrt * update * hyperband untested * small changes before moving on * added endpoints * good changes * init tests * smore tests * unfinished tests * testing * testing code * morbugs * fixes * end * tests and typo * nit * try this * tests * testing * lint * lint * lint * comments and docs * almost screwed up * lint 2017-11-06 22:30:25 -08:00			`grid_search: [128, 256, 512]`
Update hyperband-cartpole.yaml (#6121) Typo 2019-11-09 20:39:03 -07:00			`observation_filter: MeanStdFilter`