Commit graph

3314 commits

Author SHA1 Message Date
Qing Wang
259cdfa0de Fix issue when starting raylet_monitor (#4829) 2019-05-22 11:08:24 +08:00
Qing Wang
081708bdef [Java] Dynamic resource API in Java (#4824) 2019-05-21 17:13:48 +08:00
Eric Liang
02583a8598 [rllib] Rename PolicyGraph => Policy, move from evaluation/ to policy/ (#4819)
This implements some of the renames proposed in #4813
We leave behind backwards-compatibility aliases for *PolicyGraph and SampleBatch.
2019-05-20 16:46:05 -07:00
Eric Liang
6cb5b90bd6
[rllib] [RFC] Dynamic definition of loss functions and modularization support (#4795)
* dynamic graph

* wip

* clean up

* fix

* document trainer

* wip

* initialize the graph using a fake batch

* clean up dynamic init

* wip

* spelling

* use builder for ppo pol graph

* add ppo graph

* fix naming

* order

* docs

* set class name correctly

* add torch builder

* add custom model support in builder

* cleanup

* remove underscores

* fix py2 compat

* Update dynamic_tf_policy_graph.py

* Update tracking_dict.py

* wip

* rename

* debug level

* rename policy_graph -> policy in new classes

* fix test

* rename ppo tf policy

* port appo too

* forgot grads

* default policy optimizer

* make default config optional

* add config to optimizer

* use lr by default in optimizer

* update

* comments

* remove optimizer

* fix tuple actions support in dynamic tf graph
2019-05-18 00:23:11 -07:00
Noah Golmant
1ef9c0729d [tune] Initial track integration (#4362)
Introduces a minimally invasive utility for logging experiment results. A broad requirement for this tool is that it should integrate seamlessly with Tune execution.
2019-05-17 11:34:05 -07:00
Qing Wang
dcd6d4949c Fix Java worker log dir (#4781) 2019-05-17 16:13:28 +08:00
Richard Liaw
e20855ccae
[tune] Remove extra parsing functionality (#4804) 2019-05-16 23:11:35 -07:00
Richard Liaw
88b45a53d6
[autoscaler] rsync cluster (#4785) 2019-05-16 23:11:06 -07:00
Richard Liaw
ffe61fcc70
[tune] Support non-arg submit (#4803) 2019-05-16 23:10:07 -07:00
Philipp Moritz
84cf474abc Change tagline in documentation and README. (#4807)
* Update README.rst, index.rst, tutorial.rst and  _config.yml
2019-05-17 13:34:14 +08:00
Eric Liang
3807fb505b
[rllib] TensorFlow 2 compatibility (#4802) 2019-05-16 22:12:07 -07:00
Eric Liang
7d5ef6d99c
[rllib] Support continuous action distributions in IMPALA/APPO (#4771) 2019-05-16 22:05:07 -07:00
Hao Chen
ffd596d5bb
Fix pom file generation (#4800) 2019-05-17 10:56:39 +08:00
Richard Liaw
9f2645d6ea [tune] Fix CLI test (#4801) 2019-05-16 13:50:03 -07:00
Yuhong Guo
98dd033179
[JAVA] setDefaultUncaughtExceptionHandler to log uncaught exception in user thread. (#4798)
* Add WorkerUncaughtExceptionHandler

* Fix

* revert bazel and pom
2019-05-16 19:53:15 +08:00
Devin Petersohn
1490a98a71 Bump version to 0.7.0 (#4791) 2019-05-15 22:55:21 -07:00
Hao Chen
643f62dc43
[Java][Bazel] Refine auto-generated pom files (#4780) 2019-05-16 11:19:31 +08:00
Stephanie Wang
cb1a195ca2
Queue tasks in the raylet in between async callbacks (#4766)
* Add a SWAP TaskQueue so that we can keep track of tasks that are temporarily dequeued

* Fix bug where tasks that fail to be forwarded don't appear to be local by adding them to SWAP queue

* cleanups

* updates

* updates
2019-05-15 10:23:25 -07:00
Richard Liaw
3bbafc7105
[autoscaler] Fix submit (#4782) 2019-05-14 19:52:28 -07:00
Jones Wong
c5161a2c4d [rllib] fix clip by value issue as TF upgraded (#4697)
*  fix clip_by_value issue

*  fix typo
2019-05-13 15:39:25 -07:00
Stephanie Wang
1622fc21fc Fatal check if object store dies (#4763) 2019-05-13 11:59:12 -07:00
Qing Wang
62c949bbd5 Fix ray stop by killing raylet before plasma (#4778) 2019-05-13 14:53:10 +08:00
Eric Liang
69352e3302
[rllib] Implement learn_on_batch() in torch policy graph 2019-05-12 21:29:58 -07:00
Adi Zimmerman
f3b8b9093d Update tutorial link in doc (#4777) 2019-05-12 15:08:47 -07:00
Romil Bhardwaj
004440f526 Dynamic Custom Resources - create and delete resources (#3742) 2019-05-11 20:06:04 +08:00
Eric Liang
351753aae5
[rllib] Remove dependency on TensorFlow (#4764)
* remove hard tf dep

* add test

* comment fix

* fix test
2019-05-10 20:36:18 -07:00
ashione
ccc540adf1 Remove mutable data function in id(UniqueID and its subclass) (#4696)
* remove mutable data in jni
fix flatbuffer string to ID check

* replace sizeof(ID) by ID.size()

sizeof(ID) = 20 if no other members in class

* fix new string unbounded

* code polished according to comments

* lazy hash eval
2019-05-09 16:41:48 +08:00
cgraywang
584adb45b8 [tune] Add MXNet Gluon example on CIFAR-10 (#4683) 2019-05-08 21:39:07 -07:00
Yuhong Guo
481bfbde58
[c++] Allow RayConfig to have items other then integer (#4701)
* Allow RayConfig to have items other then integer

* Fix a small bug
2019-05-09 11:18:28 +08:00
Adi Zimmerman
28d381373d [tune] Add Ax to Tune (#4731) 2019-05-08 15:54:29 -07:00
Romil Bhardwaj
0421cba4e8 Autoscaler hotfix for #4555. (#4653) 2019-05-08 14:50:52 -07:00
Jacob Beck
28496c8b50 [rllib] Qmix padding patch (#4735)
* Qmix padding patch

* Update qmix_policy_graph.py

* lint errors

* more linting

* Update qmix_policy_graph.py
2019-05-08 14:07:29 -07:00
Devin Petersohn
edb8465910 [ray-core] Initial addition of performance integration testing files (#4325) 2019-05-08 13:40:54 -07:00
Devin Petersohn
3a72430e87 Bump Modin version to 0.5 (#4752)
* Bump Modin version

* Update Travis pandas version
2019-05-07 01:12:52 -07:00
Richard Liaw
7f50c96adb
[tune] Reduce sampling API clutter (#4739)
Adds some sugar for tune sampling API (for commonplace sampling idioms).
2019-05-06 17:42:39 -07:00
Eric Liang
71b2dec3b4
[rllib] Fix bounds of space returned by preprocessor.observation_space (#4736) 2019-05-05 18:25:38 -07:00
Si-Yuan
bd00735fe8 Fix tempfile issues (#4605) 2019-05-05 16:06:15 -07:00
Daniel Ho
dca1c25d88 [tune] Fix setup-dev relative path (#4747) 2019-05-05 00:39:07 -07:00
Richard Liaw
f2faf5ce75 [tune] Contributor Guide and Design Page (#4716)
* Move setup script out

* some changes

* Finished Contributor guide

* some comments to the design

* move

* Apply suggestions from code review

Co-Authored-By: richardliaw <rliaw@berkeley.edu>

* sourcecode

* comments
2019-05-05 00:04:13 -07:00
Robert Nishihara
d81e71e297 Enable actor methods to be decorated on the caller side also and get postprocessors. (#4732)
* Allow decorating ray actor methods.

* Add test.

* Add get postprocessors.

* Improve documentation.

* Make it work for remote functions.

* Temporary fix.
2019-05-04 11:53:47 -07:00
Peng Zhenghao
897b35ce36 [tune] fix restore error at tune.run() (#4733) 2019-05-04 02:56:15 -04:00
Adi Zimmerman
36b71d1446 [Tune] Post-Experiment Tools (#4351) 2019-05-04 02:51:26 -04:00
William Ma
406c429384 [doc] Remove instructions for installing Python2 for webui. (#4740) 2019-05-02 22:35:23 -07:00
Federico Fontana
78bb26286e Replaced discontinued rnn_cell.BasicLSTMCell with rnn_cell.LSTMCell (#4703)
* Fixed bug in Dirichlet (#4440)

* Replaced deprecated rnn_cell.BasicLSTMCell with rnn_cell.LSTMCell
2019-05-02 13:19:27 -07:00
Andrew Tan
f87235f232 [tune] Example for Tune blog post (#4673) 2019-05-02 13:16:48 -04:00
Robert Nishihara
af463e8bb1 Find bazel even if it isn't in the PATH. (#4729) 2019-05-01 21:29:48 -07:00
Andrew Tan
23ae73135e [tune] Tune CLI Fixes (#4659)
What do these changes do?
  Add --limit flag for ls
  Add ordering functionality to --sort flag
  Remove last_result from the names of columns for ls
  Fix weird double quote error messages (\")
2019-04-30 18:21:33 -07:00
Yuhong Guo
448a7bd08d Add lock in fetch_and_execute_function_to_run of import_thread.py (#4718) 2019-04-30 10:47:16 -07:00
Yuhong Guo
4eade036a0
Separate thread locks for worker and function manager. (#4499)
* Separate lock for function manager and worker

* Lint

* Add test case

* Remove print in remote function.

* Remove test and add ray.exit_actor

* Update python/ray/worker.py

Co-Authored-By: guoyuhong <guoyuhong1985@outlook.com>

* Move exit_actor from worker.py to actor.py

* Update actor.py

* Update actor.py
2019-04-29 14:55:37 +08:00
Ruifang Chen
c578be23a5 [Bazel] Modifying WORKSPACE file, so that you can make the project used as a thirdparty project (#4711)
* Modifying WORKSPACE file, so that you can make the project used as a thirdparty

* Modifying WORKSPACE file, so that you can make the project used as a thirdparty

* add some files

* modify some repositories

* modify the name of 'ray_deps_build_all'
2019-04-28 22:02:49 -07:00