Commit graph

3093 commits

Author SHA1 Message Date
Vlad Firoiu
39a09fa457 Turn replay into a circular queue. (#4667) 2019-04-19 11:42:00 -07:00
Wang Qing
9d481cc2e6 [hotfix] Missing import breaks Travis builds 2019-04-18 23:12:44 -07:00
Wang Qing
0d433b220c [hotfix] Hot fix for CI linting error 2019-04-18 21:48:55 -07:00
Eric Liang
5a562bbf12
[rllib] Fix num_gpus cast and raise error on large batch (#4652) 2019-04-18 15:23:29 -07:00
Hao Chen
be2cbdf130
[Bazel] Use rules_jvm_external to manage java dependencies (#4615) 2019-04-18 16:53:25 +08:00
Eric Liang
6848dfd179
[rllib] Replace ray.get() with ray_get_and_free() to optimize memory usage (#4586) 2019-04-17 20:30:03 -04:00
Devin Petersohn
20c4c16891 Upload wheels from all branches to support release branches (#4651) 2019-04-17 16:24:55 -07:00
Eric Liang
3fd9dea721
[rllib] Fix tune.run(Agent class) (#4630)
* update

* Update __init__.py
2019-04-15 09:12:23 -07:00
Richard Liaw
776a7308c8
[tune] Better ASHA defaults (#4623)
## What do these changes do?
Sets ASHA defaults to paper defaults.


## Related issue number


## Linter

- [ ] I've run `scripts/format.sh` to lint the changes in this PR.
2019-04-15 01:45:43 -07:00
Vlad Firoiu
f600591468 Cast MultiCategorical num_outputs to int. (#4629) 2019-04-14 19:51:37 -07:00
Robert Nishihara
967e8aad9d Make def test_submitting_many_actors_to_one less stressful. (#4622) 2019-04-14 12:19:57 -07:00
Andrew Tan
57af1c6819 Update volume size to 100 (#4616) 2019-04-14 11:40:16 -07:00
Zachary Barry
3838548356 Custom SSH socket directories (#4299)
* ssh_control_path added as an auth option.

* revamped default ssh options to take in control path, nodeupdater checks auth config to see if a custom SSH sockets path was specified, otherwise the original hardcoded path is used. control path is now a nodeupdater instance variable

* revert socketdir in auth config and change method for determining dir

* new ssh dir method

* Lint

* ' -> " lint

* changed using USER env to getpass.getuser()
2019-04-13 23:55:41 -07:00
Daniel Edgecumbe
3e1adafbce [autoscaler] Add an aggressive_autoscaling flag (#4285) 2019-04-13 18:44:32 -07:00
Devin Petersohn
56a78baf67 Bump version to 0.6.6 (#4621) 2019-04-13 10:37:17 -07:00
Hao Chen
d52b080081
[Java] Avoid unnecessary memory copy and addd a benchmark (#4611) 2019-04-14 00:17:04 +08:00
Richard Liaw
0bfb0d2c29 [tune] Fix checkpointing for Gym Types 2019-04-12 21:03:56 -07:00
Eric Liang
6e7680bf21
[rllib] Clean up concepts documentation and policy optimizer creation (#4592) 2019-04-12 21:03:26 -07:00
Romil Bhardwaj
0f42f87ebc Updating zero capacity resource semantics (#4555) 2019-04-12 16:53:57 -07:00
cfan
bb207a205b [rllib] Support torch device and distributions. (#4553) 2019-04-12 11:39:14 -07:00
Wang Qing
5cfbfe5df6 [Java] Implement GcsClient (#4601) 2019-04-12 22:44:47 +08:00
Wang Qing
fe07a5b4b1 Add delete_creating_tasks option for internal.free() (#4588)
* add delete creating task objects.

* format code style

* Fix lint

* add tests add address comments.

* Refine test

* Refine java test

* Fix CI

* Refine

* Fix lint

* Fix CI
2019-04-12 13:38:31 +08:00
justinwyang
e88e706fcc Enforce quoting style in Travis. (#4589) 2019-04-11 14:24:26 -07:00
ppeagle
6697407ec4 [Java Streaming] Fix StreamSource constructor and SourceFunction initialization (#4597) 2019-04-10 20:02:11 +08:00
Kristian Hartikainen
ed02bf11f7 [autoscaler] Lint code that we forgot to lint in #4537 (#4584)
* Lint code that we forgot to lint in previous PR

* Revert setup command merge

* Lint

* Revert "Revert setup command merge"

This reverts commit 55e1cdb1f256ea51ef66a38730d8f7865f1f5ad1.

* Fix testReportsConfigFailures test

* Minor syntax tweaks

* Lint
2019-04-10 17:01:36 +08:00
Vlad Firoiu
74fd3d7e21 [rllib] Support prev_state/prev_action in rollout and fix multiagent (#4565)
* Cleaner and more correct treatment of agent states in rollout.py

* support lstm_use_prev_action_reward in rollout.py

* Linter.

* appease flake8

* Use _DUMMY_AGENT_ID instead of 0.

* All agents have a policy_agent_mapping.
Reset the mapping cache at the start of each episode.

* Update rollout.py

* Fix rollout.py for single-agent envs.

* Use agent_id, not policy_id.
2019-04-10 00:01:25 -07:00
Eric Liang
f8e8743347
[tune] Improve PBT example (#4575) 2019-04-09 20:59:17 -07:00
Si-Yuan
dab99d26af
Improve code related to node (#4383)
* Make full use of node

implement local node

fix bugs mentioned in comments

* Add more tests

* Use more specific exception handling

* fix, lint

* fix for py2.x
2019-04-09 17:27:54 +08:00
Wang Qing
c5bcec54f3 Add ignore items for java build (#4579) 2019-04-09 15:59:58 +08:00
Eric Liang
4f46d3e9bf
[rllib] Add multi-agent examples for hand-coded policy, centralized VF (#4554) 2019-04-09 00:36:49 -07:00
Duane
7f23e8431b fixed typo in kuber yaml (#4582) 2019-04-08 23:13:42 -07:00
Stefan Pantic
915486984a [autoscaler] Add support for separate docker containers on head and worker nodes (#4537)
* Added support for running different docker containers on clusters

* Remove node specific container names

* Keep old options and expand with node specific configuration

* Optimized imports

* Changed docker fields for autoscaler

* Auto reformat

* Updated comments

* Updated condition

* Run linter

* Updated example

* Changed condition for docker images, updated examples

* Removed duplicate line

* Fixed setup_commands

* Update autoscaler.py

* fix_better_image
2019-04-07 16:51:32 -07:00
Jones Wong
da5a471485 [rllib] validate observation in NoPreprocessor (#4546) 2019-04-07 16:11:50 -07:00
Eric Liang
f9b8e77e3b
[rllib] Don't merge unrolls from same episode when calculating seq lens (#4557) 2019-04-07 12:11:30 -07:00
Eric Liang
37208216ae
[rllib] Rename Agent to Trainer (#4556) 2019-04-07 00:36:18 -07:00
Dušan Josipović
820c71b7d0 [tune/rllib] Add checkpoint eraser (#4490) 2019-04-06 20:01:54 -07:00
ctombumila37
7746d20d30 [rllib] ExternalMultiAgentEnv (#4200) 2019-04-06 19:58:14 -07:00
Andrew Tan
991b911e1d [tune] Add --columns flag for CLI (#4564) 2019-04-05 19:49:01 -07:00
Jérémy
300ec72d15 [tune] Add compatibility to nevergrad 0.2.0+ (#4529)
## What do these changes do?

This PR prepares for future version  0.2.0 of `nevergrad`, in which each suggestion is a `Candidate` instance having fields `args` and `kwargs` instead of being a `np.ndarray`. The proposed changes are compatible with all versions of `nevergrad` (manually tested with `nevergrad_example.py` on both `master` and current version `v0.1.6`).

See `nevergrad`'s [CHANGELOG](https://github.com/facebookresearch/nevergrad/blob/master/CHANGELOG.md) for more information on the change.

## Related issue number

None

## Linter

- [x] I've run `scripts/format.sh` to lint the changes in this PR.
2019-04-05 19:44:58 -07:00
Andrew Tan
bfd0af52bc [tune] Add documentation to --output flag (#4518)
## What do these changes do?

Add documentation for the `--output` flag for ls / lsx in the Tune CLI.

## Related issue number

Closes #4511 

## Linter

- [x] I've run `scripts/format.sh` to lint the changes in this PR.
2019-04-05 00:16:35 -07:00
Richard Liaw
50b2aa0740
[tune] Better handling of tune.function in global checkpoint (#4519)
Enables result keys to be queried by CLI.
2019-04-04 21:08:47 -07:00
Federico Fontana
fb88f7efe6 Fixed bug in Dirichlet (#4440) (#4560) 2019-04-04 14:33:09 -07:00
Tasha Chin
5693cd1344 [docs] Show source code (#3281) 2019-04-03 21:30:20 -07:00
William Ma
4b25810994 Adds a push_id to every push in the object manager (#4407) 2019-04-03 17:12:06 -07:00
Yuhong Guo
c2349cf12d Remove local/global_scheduler from code and doc. (#4549) 2019-04-03 17:05:09 -07:00
Adi Zimmerman
51dae23d5c [tune] Search Alg delay import + CLI timing test (#4230) 2019-04-03 08:52:45 -07:00
cclauss
68ccc4d3cf Travis CI: Do not hard-code Trusty, it EOLs this month (#4545)
* Travis CI: Do not hard-code Trusty, it EOLs this month

Do not hard-code __Trusty__ because it reaches its end-of-life this month.
https://wiki.ubuntu.com/Releases

* Update .travis.yml
2019-04-03 16:39:52 +08:00
Philipp Moritz
b0f6ddf6d1 Remove CMake files (#4493) 2019-04-02 22:17:33 -07:00
Wang Qing
7d776f35e1 Integrate metrics (#4246) 2019-04-02 21:01:02 -07:00
cclauss
8e19d3721f Travis CI: The 'sudo' tag is now deprecated (#4542)
[Travis are now recommending removing the __sudo__ tag](https://blog.travis-ci.com/2018-11-19-required-linux-infrastructure-migration).

"_If you currently specify __sudo: false__ in your __.travis.yml__, we recommend removing that configuration_"
2019-04-03 10:55:19 +08:00