hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 10:31:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
3093 commits 227 branches 67 tags 234 MiB
Commit graph

3093 commits

This branch
This branch
All branches
Author SHA1 Message Date
Kristian Hartikainen
88bab5d3c4 [tune] Pretty print params json in logger.py (#4903) 2019-06-01 12:38:59 -07:00
Eric Liang
9aa1cd613d
[rllib] Allow Torch policies access to full action input dict in extra_action_out_fn (#4894) 
* fix torch extra out

* preserve setitem

* fix docs
 2019-06-01 16:58:49 +08:00
Eric Liang
1c073e92e4
[rllib] Fix documentation on custom policies (#4910) 
* wip

* add docs

* lint

* todo sections

* fix doc
 2019-06-01 16:13:21 +08:00
Yuhong Guo
0066d7cf2a Hotfix for change of from_random to FromRandom (#4909) 2019-05-31 16:41:31 +08:00
Yuhong Guo
1f0809e2b4 Refactor ID Serial 2: change all ID functions to CamelCase (#4896) 2019-05-31 11:31:18 +08:00
Si-Yuan
4e0be8b450
Drop duplicated string format (#4897) 
This string format is unnecessary. java_worker_options has been appended to the commandline later.
 2019-05-30 19:43:27 +08:00
Hao Chen
2912a7cb86
Initial high-level code structure of CoreWorker. (#4875) 2019-05-30 02:43:17 -07:00
Qing Wang
b7c284aaa3
Refactor redis callback handling (#4841) 
* Add CallbackReply

* Fix

* fix linting by format.sh

* Fix linting

* Address comments.

* Fix
 2019-05-30 11:54:30 +08:00
Eric Liang
3f4d37cd0e
[rllib] Fix Multidiscrete support (#4869) 2019-05-29 20:41:02 -07:00
Eric Liang
2dd0beb5bd
[rllib] Allow access to batches prior to postprocessing (#4871) 2019-05-29 18:17:14 -07:00
Robert Nishihara
a218a14c92 Bump version from 0.8.0.dev0 to 0.7.1. (#4890) 2019-05-29 16:57:28 -07:00
Richard Liaw
acee89b1f6
[tune] Auto-init Ray + default SearchAlg (#4815) 2019-05-29 12:09:34 -07:00
Philipp Moritz
64eb7b322c Upgrade arrow to latest master (#4858) 2019-05-28 16:04:16 -07:00
Qing Wang
64a01b2ab6 Update deps commits of opencensus to support building with bzl 0.25.x (#4862) 
* Update deps to support bzl 2.5.x

* Fix
 2019-05-28 14:29:34 +08:00
Yuhong Guo
fa0892f285
Replace ReturnIds with NumReturns in TaskInfo to reduce the size (#4854) 
* Refine TaskInfo

* Fix

* Add a test to print task info size

* Lint

* Refine
 2019-05-28 13:30:41 +08:00
Eric Liang
d7be5a5d36
[rllib] Fix error getting kl when simple_optimizer: True in multi-agent PPO 2019-05-27 17:24:45 -07:00
Eric Liang
a45c61e19b
[rllib] Update concepts docs and add "Building Policies in Torch/TensorFlow" section (#4821) 
* wip

* fix index

* fix bugs

* todo

* add imports

* note on get ph

* note on get ph

* rename to building custom algs

* add rnn state info
 2019-05-27 14:17:32 -07:00
Richard Liaw
574e1c7695
[tune] Fix up Ax Search and Examples (#4851) 
* update Ax for cleaner API

* docs update
 2019-05-27 13:23:17 -07:00
Robert Nishihara
7a78e1e320 Install bazel in autoscaler development configs. (#4874) 2019-05-26 16:13:50 -07:00
Robert Nishihara
6703519144 Move global state API out of global_state object. (#4857) 2019-05-26 11:27:53 -07:00
IkedaYutaro
ea8d7b4dc0 Fix a typo in kubernetes yaml (#4872) 2019-05-25 23:13:58 -07:00
Eric Liang
7237ea70c4 [rllib] [RFC] Deprecate Python 2 / RLlib (#4832) 2019-05-25 10:45:26 -07:00
Richard Liaw
0ce0ecbe9c
[tune] Later expansion of local_dir (#4806) 2019-05-25 02:19:28 -07:00
Devin Petersohn
a7d01aba9b Update wheel versions in documentation to 0.8.0.dev0 and 0.7.0. (#4847) 2019-05-24 16:49:13 -07:00
Robert Nishihara
49fe894e22 Export remote functions when first used and also fix bug in which rem… (#4844) 
* Export remote functions when first used and also fix bug in which remote functions and actor classes are not exported from workers during subsequent ray sessions.

* Documentation update

* Fix tests.

* Fix grammar
 2019-05-24 13:44:39 -07:00
Devin Petersohn
4e281ba938 Add section to bump version of master branch and cleanup release docs (#4846) 2019-05-23 18:06:07 -07:00
Devin Petersohn
ba6c595094 Bump Ray master version to 0.8.0.dev0 (#4845) 2019-05-23 17:02:20 -07:00
Robert Nishihara
2015085192
Fix bug in which actor classes are not exported multiple times. (#4838) 2019-05-23 09:22:46 -07:00
Yuhong Guo
1a39fee9c6
Refactor ID Serial 1: Separate ObjectID and TaskID from UniqueID (#4776) 
* Enable BaseId.

* Change TaskID and make python test pass

* Remove unnecessary functions and fix test failure and change TaskID to
16 bytes.

* Java code change draft

* Refine

* Lint

* Update java/api/src/main/java/org/ray/api/id/TaskId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/BaseId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/BaseId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/ObjectId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comment

* Lint

* Fix SINGLE_PROCESS

* Fix comments

* Refine code

* Refine test

* Resolve conflict
 2019-05-22 14:46:30 +08:00
Qing Wang
259cdfa0de Fix issue when starting raylet_monitor (#4829) 2019-05-22 11:08:24 +08:00
Qing Wang
081708bdef [Java] Dynamic resource API in Java (#4824) 2019-05-21 17:13:48 +08:00
Eric Liang
02583a8598 [rllib] Rename PolicyGraph => Policy, move from evaluation/ to policy/ (#4819) 
This implements some of the renames proposed in #4813
We leave behind backwards-compatibility aliases for *PolicyGraph and SampleBatch.
 2019-05-20 16:46:05 -07:00
Eric Liang
6cb5b90bd6
[rllib] [RFC] Dynamic definition of loss functions and modularization support (#4795) 
* dynamic graph

* wip

* clean up

* fix

* document trainer

* wip

* initialize the graph using a fake batch

* clean up dynamic init

* wip

* spelling

* use builder for ppo pol graph

* add ppo graph

* fix naming

* order

* docs

* set class name correctly

* add torch builder

* add custom model support in builder

* cleanup

* remove underscores

* fix py2 compat

* Update dynamic_tf_policy_graph.py

* Update tracking_dict.py

* wip

* rename

* debug level

* rename policy_graph -> policy in new classes

* fix test

* rename ppo tf policy

* port appo too

* forgot grads

* default policy optimizer

* make default config optional

* add config to optimizer

* use lr by default in optimizer

* update

* comments

* remove optimizer

* fix tuple actions support in dynamic tf graph
 2019-05-18 00:23:11 -07:00
Noah Golmant
1ef9c0729d [tune] Initial track integration (#4362) 
Introduces a minimally invasive utility for logging experiment results. A broad requirement for this tool is that it should integrate seamlessly with Tune execution.
 2019-05-17 11:34:05 -07:00
Qing Wang
dcd6d4949c Fix Java worker log dir (#4781) 2019-05-17 16:13:28 +08:00
Richard Liaw
e20855ccae
[tune] Remove extra parsing functionality (#4804) 2019-05-16 23:11:35 -07:00
Richard Liaw
88b45a53d6
[autoscaler] rsync cluster (#4785) 2019-05-16 23:11:06 -07:00
Richard Liaw
ffe61fcc70
[tune] Support non-arg submit (#4803) 2019-05-16 23:10:07 -07:00
Philipp Moritz
84cf474abc Change tagline in documentation and README. (#4807) 
* Update README.rst, index.rst, tutorial.rst and  _config.yml
 2019-05-17 13:34:14 +08:00
Eric Liang
3807fb505b
[rllib] TensorFlow 2 compatibility (#4802) 2019-05-16 22:12:07 -07:00
Eric Liang
7d5ef6d99c
[rllib] Support continuous action distributions in IMPALA/APPO (#4771) 2019-05-16 22:05:07 -07:00
Hao Chen
ffd596d5bb
Fix pom file generation (#4800) 2019-05-17 10:56:39 +08:00
Richard Liaw
9f2645d6ea [tune] Fix CLI test (#4801) 2019-05-16 13:50:03 -07:00
Yuhong Guo
98dd033179
[JAVA] setDefaultUncaughtExceptionHandler to log uncaught exception in user thread. (#4798) 
* Add WorkerUncaughtExceptionHandler

* Fix

* revert bazel and pom
 2019-05-16 19:53:15 +08:00
Devin Petersohn
1490a98a71 Bump version to 0.7.0 (#4791) 2019-05-15 22:55:21 -07:00
Hao Chen
643f62dc43
[Java][Bazel] Refine auto-generated pom files (#4780) 2019-05-16 11:19:31 +08:00
Stephanie Wang
cb1a195ca2
Queue tasks in the raylet in between async callbacks (#4766) 
* Add a SWAP TaskQueue so that we can keep track of tasks that are temporarily dequeued

* Fix bug where tasks that fail to be forwarded don't appear to be local by adding them to SWAP queue

* cleanups

* updates

* updates
 2019-05-15 10:23:25 -07:00
Richard Liaw
3bbafc7105
[autoscaler] Fix submit (#4782) 2019-05-14 19:52:28 -07:00
Jones Wong
c5161a2c4d [rllib] fix clip by value issue as TF upgraded (#4697) 
*  fix clip_by_value issue

*  fix typo
 2019-05-13 15:39:25 -07:00
Stephanie Wang
1622fc21fc Fatal check if object store dies (#4763) 2019-05-13 11:59:12 -07:00