* Add a SWAP TaskQueue so that we can keep track of tasks that are temporarily dequeued
* Fix bug where tasks that fail to be forwarded don't appear to be local by adding them to SWAP queue
* cleanups
* updates
* updates
* remove mutable data in jni
fix flatbuffer string to ID check
* replace sizeof(ID) by ID.size()
sizeof(ID) = 20 if no other members in class
* fix new string unbounded
* code polished according to comments
* lazy hash eval
* Allow decorating ray actor methods.
* Add test.
* Add get postprocessors.
* Improve documentation.
* Make it work for remote functions.
* Temporary fix.
What do these changes do?
Add --limit flag for ls
Add ordering functionality to --sort flag
Remove last_result from the names of columns for ls
Fix weird double quote error messages (\")
* Separate lock for function manager and worker
* Lint
* Add test case
* Remove print in remote function.
* Remove test and add ray.exit_actor
* Update python/ray/worker.py
Co-Authored-By: guoyuhong <guoyuhong1985@outlook.com>
* Move exit_actor from worker.py to actor.py
* Update actor.py
* Update actor.py
* Modifying WORKSPACE file, so that you can make the project used as a thirdparty
* Modifying WORKSPACE file, so that you can make the project used as a thirdparty
* add some files
* modify some repositories
* modify the name of 'ray_deps_build_all'
* Remove unnecessary apt installations in docker commands
* Add example for different head/worker image in gcp gpu example
* Update gcp gpu example docker image to tf 1.13
* Change the VM sourceImage for gcp/example-full.yaml
* Change the gcp gpu docker VM images for consistency
* Change gcp default project id to be consistent with other examples
* [rllib] Separate optimisers for DDPG actor & crit.
* [rllib] Better names for DDPG variables & options
Config changes:
- noise_scale -> exploration_ou_noise_scale
- exploration_theta -> exploration_ou_theta
- exploration_sigma -> exploration_ou_sigma
- act_noise -> exploration_gaussian_sigma
- noise_clip -> target_noise_clip
* [rllib] Make DDPG less class-y
Used functions to replace three classes with only an __init__ method & a
handful of unrelated attributes.
* [rllib] Refactor DDPG noise
* [rllib] Unify DDPG exploration annealing
Added option "exploration_should_anneal" to enable linear annealing of
exploration noise. By default this is off, for consistency with DDPG &
TD3 papers. Also renamed "exploration_final_eps" to
"exploration_final_scale" (that name seems to have been carried over
from DQN, and doesn't really make sense here). Finally, tried to rename
"eps" to "noise_scale" wherever possible.
