Commit graph

1597 commits

Author SHA1 Message Date
Brandon Bertelsen
c04b69902c Updates for #5072 (#5091) 2019-07-06 16:05:50 -07:00
Eric Liang
0448847a02
Update protobuf version (#5128) 2019-07-06 15:59:55 -07:00
Aleksei Petrenko
09bde397c9 Multiagent experiment resume (#5102)
* Fixed problem with multiagent experiment resume

* Applied format script

* fix lint
2019-07-06 11:38:17 -07:00
Dušan Josipović
e9b88dcbed [wingman -> tune] Add system performance tracking (#4924) 2019-07-06 00:57:35 -07:00
Richard Liaw
c3e9d94b18
[tune][minor] Reduce checkpointing frequency (#4859) 2019-07-06 00:54:24 -07:00
Kim Jeong Ju
4b56a5eb27 [tune] missing torch.load in mnist_pytorch_trainable.py (#5103) 2019-07-06 00:14:41 -07:00
Philipp Moritz
c5253cc300 Add job table to state API (#5076) 2019-07-06 00:05:48 -07:00
Richard Liaw
53d5a8a45f
[tune] Fix sort (#5111)
* fix sort

* fix tune list-experiments

* Update python/ray/tune/tests/test_commands.py
2019-07-05 16:05:10 -07:00
Robert Nishihara
9cc4cc6a52
Fail format.sh if yapf/flake8 versions are incorrect. (#5083) 2019-07-04 23:22:01 -07:00
ztangent
41a16c55ef [tune] Fixed bug with joining experiment_path twice. (#5106) 2019-07-03 22:48:07 -07:00
Patrick
1a543a6571 [serve] add missing __init__.py file under serve/utils (#4609)
* bugfix: add missing serve/utils __init__.py file

* Update __init__.py

* lint
2019-07-03 17:27:59 -07:00
Richard Liaw
0dbb6c4911
[tune] PBT perturbing after first iteration (#5097) 2019-07-03 17:27:26 -07:00
Eric Liang
34d054ff19
[rllib] ModelV2 API (#4926) 2019-07-03 15:59:47 -07:00
Kristian Hartikainen
9e0192bc0b [tune] Change the log syncing behavior (#4450)
* Change the log syncing behavior

* fix up abstractions for syncer

* Finished checkpoint syncing

* Code

* Set of changes to get things running

* Fixes for log syncing

* Fix parts

* Lint and other fixes

* fix some test

* Remove extra parsing functionality

* some test fixes

* Fix up cloud syncing

* Another thing to do

* Fix up tests and local sync

Changes LogSync into a mixin, and adds tests for different
functionalities.

* Fix up tests, start on local migration

* fix distributed migrations

* comments

* formatting

* Better checkpoint directory handling

* fix tests

* fix tests

* fix click

* comments

* formatting comments

* formatting and comments

* sync function deprecations

* syncfunction

* Add documentation for Syncing and Uploading

* nit

* BaseSyncer as base for Mixin in edge case

* more docs

* clean up assertions

* validate

* nit

* Update test_cluster.py

* betterdoc

* Update tune-usage.rst

* cleanup

* nit
2019-07-02 20:46:00 -07:00
Eric Liang
904dcf081d
Switch cluster longevity tests to DLAMI, fix ray up verbosity (#5084)
* fix

* add branch commit

* comments

* Update ci/long_running_tests/.gitignore

Co-Authored-By: Robert Nishihara <robertnishihara@gmail.com>
2019-07-02 00:19:05 -07:00
Simon Mo
d7ccfbe46b Bump version to 0.8.0.dev2 (#5069) 2019-06-29 23:30:26 -07:00
Simon Mo
b5d473847c bump version to 0.7.2 (#5066) 2019-06-29 19:06:51 -07:00
Joey Jiang
d6bbbdef35 Use gRPC to handle communication and data transmission between object manager (#4996) 2019-06-28 10:56:34 +08:00
Qing Wang
62e4b591e3
[ID Refactor] Rename DriverID to JobID (#5004)
* WIP

WIP

WIP

Rename Driver -> Job

Fix complition

Fix

Rename in Java

In py

WIP

Fix

WIP

Fix

Fix test

Fix

Fix C++ linting

Fix

* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/core_worker/core_worker.cc

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Address comments

* Fix

* Fix CI

* Fix cpp linting

* Fix py lint

* FIx

* Address comments and fix

* Address comments

* Address

* Fix import_threading
2019-06-28 00:44:51 +08:00
Qing Wang
d9768c1cd2
[hotfix] Fix master's linting (#5049)
The linting in CI on master always fail.
2019-06-27 20:21:32 +08:00
Hao Chen
a1156754e9
Fix test_task_forward (#5040) 2019-06-27 14:37:00 +08:00
Daniel Edgecumbe
49c6e81de2 autoscaler/monitor: Kill workers on exception (#4997) 2019-06-26 17:59:12 -07:00
Robert Nishihara
a17c08faa4 Lengthen buffer in resource test. (#4961) 2019-06-26 09:54:04 -07:00
Richard Liaw
b1827d5fbe
[tune] Update MNIST Example (#4991) 2019-06-25 22:50:15 -07:00
Philipp Moritz
bbe3e5b4ed [rllib] Give error if sample_async is used with pytorch for A3C (#5000)
* give error if sample_async is used with pytorch

* update

* Update a3c.py
2019-06-25 22:06:35 -07:00
Eric Liang
aa5fc52e32
[rllib] Add QMIX mixer parameters to optimizer param list (#5014)
* add mixer params

* Update qmix_policy.py
2019-06-25 19:02:40 -07:00
Hao Chen
0131353d42 [gRPC] Migrate gcs data structures to protobuf (#5024) 2019-06-25 14:31:19 -07:00
Qing Wang
e33d0eac68
Add dynamic worker options for worker command. (#4970)
* Add fields for fbs

* WIP

* Fix complition errors

* Add java part

* FIx

* Fix

* Fix

* Fix lint

* Refine API

* address comments and add test

* Fix

* Address comment.

* Address comments.

* Fix linting

* Refine

* Fix lint

* WIP: address comment.

* Fix java

* Fix py

* Refin

* Fix

* Fix

* Fix linting

* Fix lint

* Address comments

* WIP

* Fix

* Fix

* minor refine

* Fix lint

* Fix raylet test.

* Fix lint

* Update src/ray/raylet/worker_pool.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/runtime/src/main/java/org/ray/runtime/AbstractRayRuntime.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* Address comments.

* Fix test.

* Update src/ray/raylet/worker_pool.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* Address comments.

* Fix

* Fix lint

* Fix lint

* Fix

* Address comments.

* Fix linting
2019-06-23 18:08:33 +08:00
Joey Jiang
a7f84b536f Fix no cpus test (#5009) 2019-06-21 17:08:25 +08:00
Richard Liaw
31b6da12f9
[tune] Tutorial UX Changes (#4990)
* add integration, iris, ASHA, recursive changes, set reuse_actors=True, and enable Analysis as a return object

* docstring

* fix up example

* fix

* cleanup tests

* experiment analysis
2019-06-21 12:59:49 +08:00
Eric Liang
1d17125333 temp fix for build (#5006) 2019-06-20 18:07:44 -07:00
Andrew Berger
e59e8074dd fix handling of non-integral timeout values in signal.receive (#5002) 2019-06-20 15:33:40 -07:00
Hao Chen
2bf92e02e2
[gRPC] Use gRPC for inter-node-manager communication (#4968) 2019-06-17 19:00:50 +08:00
Simon Mo
05e2748070 Inherit Function Docstrings and other metedata (#4985) 2019-06-15 11:01:27 -07:00
Eric Liang
fa1d4c9807
[rllib] Fix DDPG example (#4973) 2019-06-13 15:07:46 -07:00
Robert Nishihara
d2f5b71c3b Remove typing from setup.py install_requirements. (#4971) 2019-06-12 15:02:12 -07:00
Peter Schafhalter
e0e52f1871 [sgd] Add non-distributed PyTorch runner (#4933)
* Add non-distributed PyTorch runner

* use dist.is_available() instead of checking OS

* Nicer exception

* Fix bug in choosing port

* Refactor some code

* Address comments

* Address comments
2019-06-11 22:38:34 -07:00
Philipp Moritz
1e2b649580 Use proper session directory for debug_string.txt (#4960) 2019-06-10 23:46:37 -07:00
Robert Nishihara
6f48992322 Make release stress tests work and improve them. (#4955) 2019-06-10 23:04:01 -07:00
Eric Liang
4f8e100fe0 fix (#4950) 2019-06-10 10:20:55 +08:00
Robert Nishihara
a82e8118a0 Fix resource bookkeeping bug with acquiring unknown resource. (#4945) 2019-06-07 21:07:27 -07:00
Eric Liang
77689d1116
[rllib] Port remainder of algorithms to build_trainer() pattern (#4920) 2019-06-07 16:45:36 -07:00
Eric Liang
9e328fbe6f
[rllib] Add docs on how to use TF eager execution (#4927) 2019-06-07 16:42:37 -07:00
Yuhong Guo
5eff47b657 [C++] Add hash table to Redis-Module (#4911) 2019-06-07 16:11:37 +08:00
Robert Nishihara
c3f8fc1c44
Update version number in documentation after release 0.7.0 -> 0.7.1 and 0.8.0.dev0 -> 0.8.0.dev1. (#4941) 2019-06-06 17:22:45 -07:00
Robert Nishihara
a0f14e9e6c Bump version from 0.7.1 to 0.8.0.dev1. (#4937) 2019-06-06 11:20:05 -07:00
Timon Ruban
2702b15b04 [tune] Add requirements-dev.txt and update docs for contributing (#4925)
* Add requirements-dev.txt and update docs.

* Update doc/source/tune-contrib.rst

Co-Authored-By: Richard Liaw <rliaw@berkeley.edu>

* Unpin everything except for yapf.
2019-06-05 09:04:36 -07:00
Hao Chen
d106283769 Better organize ray_common module (#4898) 2019-06-04 23:19:09 -07:00
Timon Ruban
c2253d2313 [tune] Make PBT Quantile fraction configurable (#4912) 2019-06-03 18:45:15 -07:00
Hersh Godse
89722ff003 [tune] Directional metrics for components (#4120) (#4915) 2019-06-02 22:13:40 -07:00