4 commits

Author	SHA1	Message	Date
xwjiang2010	9af8f11191	Revert "[docs] Clean up doc structure (first part) (#21667)" (#21763) ... This reverts commit 38e46c9fb3.	2022-01-20 15:30:56 -08:00
Max Pumperla	38e46c9fb3	[docs] Clean up doc structure (first part) (#21667)	2022-01-20 16:19:04 +01:00
Eric Liang	abdc3b592e	[rllib] Update multi-gpu impala numbers (#3327)	2018-11-19 20:55:27 -08:00
Eric Liang	9ea57c2a93	[rllib] Basic IMPALA implementation (using deepmind's reference vtrace.py) (#2504) ... Rename AsyncSamplesOptimizer -> AsyncReplayOptimizer Add AsyncSamplesOptimizer that implements the IMPALA architecture integrate V-trace with a3c policy graph audit V-trace integration benchmark compare vs A3C and with V-trace on/off PongNoFrameskip-v4 on IMPALA scaling from 16 to 128 workers, solving Pong in <10 min. For reference, solving this env takes ~40 minutes for Ape-X and several hours for A3C.	2018-08-01 20:53:53 -07:00