ray/doc/source/rllib-envs.svg

1 line
77 KiB
XML
Raw Normal View History

[rllib] Document "v2" APIs (#2316) * re * wip * wip * a3c working * torch support * pg works * lint * rm v2 * consumer id * clean up pg * clean up more * fix python 2.7 * tf session management * docs * dqn wip * fix compile * dqn * apex runs * up * impotrs * ddpg * quotes * fix tests * fix last r * fix tests * lint * pass checkpoint restore * kwar * nits * policy graph * fix yapf * com * class * pyt * vectorization * update * test cpe * unit test * fix ddpg2 * changes * wip * args * faster test * common * fix * add alg option * batch mode and policy serving * multi serving test * todo * wip * serving test * doc async env * num envs * comments * thread * remove init hook * update * fix ppo * comments1 * fix * updates * add jenkins tests * fix * fix pytorch * fix * fixes * fix a3c policy * fix squeeze * fix trunc on apex * fix squeezing for real * update * remove horizon test for now * multiagent wip * update * fix race condition * fix ma * t * doc * st * wip * example * wip * working * cartpole * wip * batch wip * fix bug * make other_batches None default * working * debug * nit * warn * comments * fix ppo * fix obs filter * update * wip * tf * update * fix * cleanup * cleanup * spacing * model * fix * dqn * fix ddpg * doc * keep names * update * fix * com * docs * clarify model outputs * Update torch_policy_graph.py * fix obs filter * pass thru worker index * fix * rename * vlad torch comments * fix log action * debug name * fix lstm * remove unused ddpg net * remove conv net * revert lstm * wip * wip * cast * wip * works * fix a3c * works * lstm util test * doc * clean up * update * fix lstm check * move to end * fix sphinx * fix cmd * remove bad doc * envs * vec * doc prep * models * rl * alg * up * clarify * copy * async sa * fix * comments * fix a3c conf * tune lstm * fix reshape * fix * back to 16 * tuned a3c update * update * tuned * optional * merge * wip * fix up * move pg class * rename env * wip * update * tip * alg * readme * fix catalog * readme * doc * context * remove prep * comma * add env * link to paper * paper * update * rnn * update * wip * clean up ev creation * fix * fix * fix * fix lint * up * no comma * ma * Update run_multi_node_tests.sh * fix * sphinx is stupid * sphinx is stupid * clarify torch graph * no horizon * fix config * sb * Update test_optimizers.py
2018-07-01 00:05:08 -07:00
<svg version="1.1" viewBox="0.0 0.0 2394.0 762.0" fill="none" stroke="none" stroke-linecap="square" stroke-miterlimit="10" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns="http://www.w3.org/2000/svg"><clipPath id="p.0"><path d="m0 0l2394.0 0l0 762.0l-2394.0 0l0 -762.0z" clip-rule="nonzero"/></clipPath><g clip-path="url(#p.0)"><path fill="#000000" fill-opacity="0.0" d="m0 0l2394.0 0l0 762.0l-2394.0 0z" fill-rule="evenodd"/><path fill="#d9ead3" d="m16.0 21.514435l536.9764 0l0 182.51968l-536.9764 0z" fill-rule="evenodd"/><path stroke="#000000" stroke-width="1.0" stroke-linejoin="round" stroke-linecap="butt" d="m16.0 21.514435l536.9764 0l0 182.51968l-536.9764 0z" fill-rule="evenodd"/><path fill="#000000" d="m32.085846 113.1199q0 -8.5625 4.59375 -13.390625q4.59375 -4.84375 11.859375 -4.84375q4.75 0 8.5625 2.28125q3.828125 2.265625 5.828125 6.328125q2.015625 4.0625 2.015625 9.21875q0 5.234375 -2.109375 9.359375q-2.109375 4.125 -5.984375 6.25q-3.859375 2.125 -8.34375 2.125q-4.84375 0 -8.671875 -2.34375q-3.8125 -2.359375 -5.78125 -6.40625q-1.96875 -4.0625 -1.96875 -8.578125zm4.6875 0.0625q0 6.21875 3.328125 9.796875q3.34375 3.5625 8.390625 3.5625q5.125 0 8.4375 -3.609375q3.328125 -3.609375 3.328125 -10.234375q0 -4.203125 -1.421875 -7.328125q-1.421875 -3.125 -4.15625 -4.84375q-2.71875 -1.734375 -6.125 -1.734375q-4.828125 0 -8.3125 3.328125q-3.46875 3.3125 -3.46875 11.0625zm33.492188 26.21875l0 -34.4375l3.84375 0l0 3.234375q1.359375 -1.90625 3.0625 -2.84375q1.71875 -0.953125 4.15625 -0.953125q3.1875 0 5.625 1.640625q2.4375 1.640625 3.671875 4.625q1.25 2.984375 1.25 6.546875q0 3.828125 -1.375 6.890625q-1.375 3.046875 -3.984375 4.6875q-2.609375 1.625 -5.5 1.625q-2.109375 0 -3.78125 -0.890625q-1.671875 -0.890625 -2.75 -2.25l0 12.125l-4.21875 0zm3.8125 -21.859375q0 4.8125 1.9375 7.109375q1.953125 2.296875 4.71875 2.296875q2.8125 0 4.8125 -2.375q2.015625 -2.390625 2.015625 -7.375q0 -4.765625 -1.96875 -7.125q-1.953125 -2.375 -4.671875 -2.375q-2.6875 0 -4.765625 2.53125q-2.078125 2.515625 -2.078125 7.3125zm39.914062 4.296875l4.359375 0.53125q-1.03125 3.828125 -3.828125 5.9375q-2.78125 2.109375 -7.109375 2.109375q-5.46875 0 -8.671875 -3.359375q-3.1875 -3.375 -3.1875 -9.4375q0 -6.28125 3.234375 -9.75q3.234375 -3.46875 8.390625 -3.46875q4.984375 0 8.140625 3.40625q3.171875 3.390625 3.171875 9.546875q0 0.375 -0.015625 1.125l-18.5625 0q0.234375 4.109375 2.3125 6.296875q2.09375 2.171875 5.203125 2.171875q2.328125 0 3.96875 -1.21875q1.640625 -1.21875 2.59375 -3.890625zm-13.84375 -6.828125l13.890625 0q-0.28125 -3.140625 -1.59375 -4.703125q-2.015625 -2.4375 -5.21875 -2.4375q-2.90625 0 -4.890625 1.953125q-1.984375 1.9375 -2.1875 5.1875zm23.507812 14.84375l0 -24.890625l3.796875 0l0 3.53125q2.734375 -4.09375 7.921875 -4.09375q2.25 0 4.125 0.8125q1.890625 0.796875 2.828125 2.109375q0.9375 1.3125 1.3125 3.125q0.234375 1.171875 0.234375 4.09375l0 15.3125l-4.21875 0l0 -15.140625q0 -2.578125 -0.5 -3.859375q-0.484375 -1.28125 -1.734375 -2.03125q-1.25 -0.765625 -2.9375 -0.765625q-2.703125 0 -4.65625 1.71875q-1.953125 1.703125 -1.953125 6.484375l0 13.59375l-4.21875 0zm23.445312 0l13.203125 -34.359375l4.90625 0l14.0625 34.359375l-5.1875 0l-4.0 -10.40625l-14.375 0l-3.765625 10.40625l-4.84375 0zm9.921875 -14.109375l11.65625 0l-3.59375 -9.515625q-1.640625 -4.34375 -2.4375 -7.125q-0.65625 3.296875 -1.84375 6.5625l-3.78125 10.078125zm26.65625 14.109375l0 -34.359375l4.546875 0l0 34.359375l-4.546875 0zm41.96875 -13.484375l0 -4.03125l14.5625 -0.015625l0 12.75q-3.359375 2.671875 -6.921875 4.03125q-3.5625 1.34375 -7.3125 1.34375q-5.0625 0 -9.203125 -2.171875q-4.125 -2.171875 -6.234375 -6.265625q-2.109375 -4.109375 -2.109375 -9.171875q0 -5.015625 2.09375 -9.359375q2.09375 -4.359375 6.03125 -6.46875q3.9375 -2.109375 9.078125 -2.109375q3.71875 0 6.734375 1.21875q3.015625 1.203125 4.71875 3.359375q1.71875 2.15625 2.609375 5.625l-4.109375 1.125q-0.765625 -2.625 -1.921875 -4.125q-1.140625 -1.5 -3.28125 -2.40625q-2.125 -0.90625 -4.734375 -0.90625q-3.109375 0 -5.390625 0.953125q-2.265625 0.953125 -3.671875 2.5q-1.390625 1.546875 -2.15625 3.390625q-1.3125 3.1875 -1.3125 6.92