hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-09 12:56:46 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
2382 commits 227 branches 67 tags 234 MiB
Commit graph

1027 commits

Author SHA1 Message Date
Eric Liang
59901a88a0
[rllib] Native support for Dict and Tuple spaces; fix Tuple action spaces; add prev a, r to LSTM (#3051) 2018-10-20 15:21:22 -07:00
Peter Schafhalter
fa469783d8 Fix bug when connecting to password-secured cluster (#3083) 2018-10-18 21:43:03 -07:00
Devin Petersohn
8fcdafc6ea Adding Python3.7 wheels support (#2546) 
* Adding Python3.7 wheels support

* Adding Mac wheels update

* fix

* numpy version

* choose different numpy versions depending on python version

* fix
 2018-10-18 17:58:39 -07:00
Peter Schafhalter
b82fd157a7 Remove Redis protected mode (#3073) 
Follow-up to #2925 and #2952. Removes the Redis protected mode implementation from Ray which was replaced by Redis port authentication.
 2018-10-17 22:48:14 -07:00
Philipp Moritz
2c52d9dfa0 Fix actor handle id creation when actor handle was pickled (#3074) 2018-10-17 18:00:52 -07:00
Richard Liu
3c0803e7e9 [rllib] use ray.wait to get next worker result in async sample optimizer (#2993) 2018-10-17 17:44:51 -07:00
Peter Schafhalter
a41bbc10ef Add password authentication to Redis ports (#2952) 
* Implement Redis authentication

* Throw exception for legacy Ray

* Add test

* Formatting

* Fix bugs in CLI

* Fix bugs in Raylet

* Move default password to constants.h

* Use pytest.fixture

* Fix bug

* Authenticate using formatted strings

* Add missing passwords

* Add test

* Improve authentication of async contexts

* Disable Redis authentication for credis

* Update test for credis

* Fix rebase artifacts

* Fix formatting

* Add workaround for issue #3045

* Increase timeout for test

* Improve C++ readability

* Fixes for CLI

* Add security docs

* Address comments

* Address comments

* Adress comments

* Use ray.get

* Fix lint
 2018-10-16 22:48:30 -07:00
Eric Liang
a9e454f6fd
[rllib] Include config dicts in the sphinx docs (#3064) 2018-10-16 15:55:11 -07:00
Praveen Palanisamy
4d8cfc0bf5 [tune] Fix (some more) misleading comments in tune/results.py (#3068) 
## What do these changes do?

Fix the misleading comments in code for:
 - `EPISODES_THIS_ITER`
 - `EPISODES_TOTAL`

Had noted it before and planned to fix it along with some other changes but seemed very relevant to stay next to #3058 so sending this now.
 2018-10-16 11:07:53 -07:00
Eric Liang
6240ccbc6e
[rllib] Add more warnings when multi-agent envs might not be set up right (#3061) 2018-10-15 13:42:56 -07:00
Eric Liang
3c891c6ece
[rllib] Parallel-data loading and multi-gpu support for IMPALA (#2766) 2018-10-15 11:02:50 -07:00
Marlon
4dc78b735b [tune] Fix misleading comment (#3058) 2018-10-14 22:25:39 -07:00
Eric Liang
866c7a574c
[rllib] Don't crash printing out error message (#3054) 
* fix er

* update
 2018-10-13 19:50:23 -07:00
Eric Liang
473ee4eb3f
[rllib] Add unit test and some better error messages for custom policy states (#3032) 2018-10-13 00:03:52 -07:00
Richard Liaw
f9b58d7b02
[tune] Tweaks to Trainable and Verbosity (#2889) 2018-10-11 23:42:13 -07:00
Kristian Hartikainen
2d35a97a76 Bug/log syncer fails with parentheses (#2653) 
* Update rsync command

* Escape rsync locations

* Fix the accidental variable move

* Update rsync to use -s flag
 2018-10-06 00:34:53 -07:00
Richard Liaw
ecd8f39580 [core] Improve logging message when plasma store is started. (#3029) 
Improve logging message when plasma store is started.
 2018-10-05 15:24:24 -07:00
Richard Liaw
0651d3b629 [tune/core] Use Global State API for resources (#3004) 2018-10-04 17:23:17 -07:00
Robert Nishihara
faa31ae018 Introduce concept of resources required for placing a task. (#2837) 
* Introduce concept of resources required for placement.
* Add placement resources to task spec
* Update java worker
* Update taskinfo.java
 2018-10-04 10:35:39 -07:00
Si-Yuan
f2dbd3096c Minor improvements and fixes in Python code. (#3022) 
This commit fix some small defects. 
1. Remove a comment that should have been removed in #3003
2. Remove `redis_protected_mode` that is never used in `ray.init()`
3. Fix `object_id_seed` that is forgotten to be passed into `ray._init()`
4. Remove several redundant brackets.
 2018-10-03 21:08:20 -07:00
Yuhong Guo
9948e8c11b Move function/actor exporting & loading code to function_manager.py (#3003) 
Move function/actor exporting & loading code to function_manager.py to prepare the code change for function descriptor for python.
 2018-10-03 16:21:04 -07:00
Robert Nishihara
d73ee36e60 Update links to use latest 0.5.3 wheels instead of 0.5.2. (#3018) 2018-10-03 13:43:40 -07:00
Si-Yuan
cc7e2ecdd5 Change logfile names and also allow plasma store socket to be passed in. (#2862) 2018-10-03 10:03:53 -07:00
Robert Nishihara
3ce8eb2d4c Test dying_worker_get and dying_worker_wait for xray. (#2997) 
This tests the case in which a worker is blocked in a call to ray.get or ray.wait, and then the worker dies. Then later, the object that the worker was waiting for becomes available. We need to make sure not to try to send a message to the dead worker and then die. Related to #2790.
 2018-10-02 00:08:47 -07:00
Eric Liang
2019b4122b
[rllib] Remove legacy multiagent support (#2975) 
* remove legacy

* remove reshaper
 2018-10-01 13:07:11 -07:00
Eric Liang
b45bed4bce
[rllib] Propagate model options correctly in ARS / ES, to action dist of PPO (#2974) 
* fix

* fix

* fix it

* propagate conf to action dist

* move carla example too

* rr

* Update policies.py

* wip

* lint
 2018-10-01 12:49:39 -07:00
Eric Liang
e4bea8d10e
[rllib] Default to truncate_episodes and add some more config validators (#2967) 
* update

* link it

* warn about truncation

* fix

* Update rllib-training.rst

* deprecate tests failing
 2018-09-30 18:37:55 -07:00
Eric Liang
814c35b7d7
[rllib] Simplify sample batch size and num envs config, n_step adjustment (#2995) 
* simplify vec batch requirements

* Update rllib-training.rst

* Update rllib-training.rst

* Update rllib-training.rst

* Update rllib-training.rst

* Update rllib-training.rst

* Update rllib-models.rst
 2018-09-30 18:36:22 -07:00
old-bear
8aa736572b [tune] Fix hyperband edge case for None entries (#2964) 2018-09-30 09:57:43 -07:00
Eric Liang
65dcafdc3f
[rllib] Refactor save() / restore() code of agents and avoid O(n_workers) save size (#2982) 2018-09-30 01:15:13 -07:00
Eric Liang
747253e0f6
[rllib] Don't shuffle samples in PPO when using lstm 2018-09-30 01:13:56 -07:00
Eric Liang
b06c604a51
[rllib] Add some more tuned atari results to documentation (#2991) 
* dqn results ++

* add scale

* hour

* fix

* small dqn table

* update

* steps

* upd

* apex

* up

* add apex results

* tip
 2018-09-29 23:13:36 -07:00
Eric Liang
cf9cd5da9d
[ray] Add --new flag for ray attach (#2973) 
* new flag

* yapf
 2018-09-29 23:04:13 -07:00
Eric Liang
cb56f39070 [rllib] Entropy calculation for diag gaussian missing 0.5 term (#2968) 
See: https://en.wikipedia.org/wiki/Multivariate_normal_distribution#Entropy
 2018-09-29 22:57:47 -07:00
old-bear
b3f0dcf20b [tune] Add a raise_on_failed_trial flag in run_experiments (#2961) 
Adds a flag to control raising TuneError if some trial fails in `run_experiments`.
 2018-09-29 11:29:46 -07:00
Eric Liang
f1c55497ce
[rllib] Fix edge case in n-step calculation and non-apex replay prioritization (#2929) 
* fix

* lint
 2018-09-28 15:22:33 -07:00
Marlon
5eaf429c53 Fix typo in autoscaler yaml (#2981) 2018-09-27 09:48:18 -07:00
Richard Liaw
1c9617bc1c
[autoscaler] Add tmux support for attach and exec (#2907) 
Adds a tmux flag that can be used to support background execution of experiments. Cannot be used together with screen. Seems to be useful feature that has shown up with different users.
 2018-09-26 23:22:45 -07:00
eugenevinitsky
1943ae44da [rllib] Use SGD optimizer for ARS (#2916) 2018-09-26 22:32:26 -07:00
Peter Schafhalter
fcdca6de18 Fix test for available resources (#2914) 2018-09-25 23:07:23 -07:00
Robert Nishihara
39b4a89fde Bump version 0.5.2 to 0.5.3. (#2936) 2018-09-25 09:49:58 -07:00
Eric Liang
75ef70afca
[rllib] Auto-clip atari rewards 2018-09-24 12:55:11 -07:00
Eric Liang
8331d1ebe0
[rllib] Add vf clipping param to fix pendulum example (#2921) 
* add vf clip

* fix test

* Update ppo.py
 2018-09-23 13:11:17 -07:00
Eric Liang
3267676994 [Experimental] Add experimental distributed SGD API (#2858) 
* check in sgd api

* idx

* foreach_worker foreach_model

* add feed_dict

* update

* yapf

* typo

* lint

* plasma op change

* fix plasma op

* still not working

* fix

* fix

* comments

* yapf

* silly flake8

* small test
 2018-09-19 21:12:37 -07:00
Praveen Palanisamy
b23fd5de13 [rllib] Adds agent name & env id to default logdir prefix (#2859) 
* Added agent name & env id to default logdir prefix

* Revert "Added agent name & env id to default logdir prefix"

This reverts commit 07cfdf80d2537da3c67dd4f553c5f3e43671cc7d.

* Added default logger creator with informative prefix to Agent

* Updated import order & improved str cat

* Update agent.py
 2018-09-18 22:22:07 -07:00
Eric Liang
3a3782c39f
[rllib] Fix LSTM regression on truncated sequences and add regression test (#2898) 
* fix

* add test

* yapf

* yapf

* fix space

* Oops that should be lstm: True

* Update cartpole_lstm.py
 2018-09-18 15:09:16 -07:00
Eric Liang
ab8348b1f5
[rllib] Reward clipping should default to off 2018-09-18 15:08:01 -07:00
Robert Nishihara
ea9d1cc887 Remove dependence on psutil. Add utility functions for getting system memory. (#2892) 2018-09-18 15:03:29 +08:00
Robert Nishihara
61bf6c6123 Fix regression in directing worker output to stdout/stderr. (#2897) 2018-09-17 16:40:45 -07:00
Richard Liaw
899e4585bc Don't include redundant entries in global_state.client_table (#2880) 2018-09-17 12:52:49 -07:00