Commit graph

1620 commits

Author SHA1 Message Date
Eric Liang
3ed18d0b59
Fix edge case in autoscaler with poor bin packing (#5702)
* fix edge case

* fix for general case
2019-09-13 11:46:10 -07:00
Stephanie Wang
1d4a11a433 Only use git repo if .git exists (#5701) 2019-09-13 11:34:34 -07:00
Edward Oakes
07c4c6367a [core worker] Python core worker object interface (#5272) 2019-09-12 23:07:46 -07:00
Edward Oakes
ee5db5b67f Raise error if space in redis password (#5673) 2019-09-11 20:58:39 -07:00
Eric Liang
faeaa34bdd
Deflake cluster heartbeat test (#5552) 2019-09-11 12:26:04 -07:00
Eric Liang
2fdefe19b7
Take into account queue length in autoscaling (#5684) 2019-09-11 11:31:35 -07:00
Philipp Moritz
9ce6dd9b88
[Projects] Add "session execute" (#5681) 2019-09-11 00:50:05 -07:00
Hersh Godse
336aef1774 [tune] Save and Restore for bayesopt (#5623) 2019-09-10 13:11:59 -07:00
Simon Mo
147e7d46ec
[Flaky tests] FIx test fork (#5671)
* Start testing test_fork

Maybe queue actor takes too long to initialize, that's why we are
seeing "Many python processes started" since most of the python
tasks are blocked on ray.get

* Add a comment
2019-09-09 19:21:20 -07:00
Richard Liaw
0010f54378 Update Cloudpickle (#5643) 2019-09-09 17:17:29 -07:00
Kai Yang
ed761900f6 [Java] Support direct actor call in Java worker (#5504) 2019-09-09 14:29:20 +08:00
Robert Nishihara
87adb5a3c8
Remove timeout in test_actor_lifetime_load_balancing. (#5659) 2019-09-08 16:10:59 -07:00
Eric Liang
ebb431a95a Add internal_api.pin_object_data() for pinning arbitrary object ids (#5637)
* add intenral pin method

* add pin

* update
2019-09-08 15:05:00 -07:00
Kai Yang
d8f5804690 Support metadata for passing by value task arguments (#5527) 2019-09-08 11:07:48 +08:00
Stephanie Wang
cb7102f31e [projects] Wrap ProjectDefinition in a class (#5654) 2019-09-07 18:30:17 -07:00
Philipp Moritz
d0125d4212 Fix log monitor process error when attempting to read raylet PID. (#5655) 2019-09-07 15:51:09 -07:00
Kai Yang
732336fc4f [Java] Support multiple workers in Java worker process (#5505) 2019-09-07 22:52:05 +08:00
Richard Liaw
d89ceb3ee5
[tune] Fix numerical error (#5653) 2019-09-07 07:34:51 -07:00
Kai Yang
8a352a8e70 ray stop kills processes more carefully (#5508) 2019-09-06 17:49:12 +08:00
Devin Petersohn
c33d6662ce Remove Modin from Ray wheels. (#5647)
There are several reasons for this:

* We no longer support python2
* There should be only 1 way of installing Modin
  * Issue management on these wheels
* I have never heard of anyone using this feature
* It is rarely kept up to date
* Modin depends on specific versions of Ray because of past API changes
2019-09-05 23:46:27 -07:00
Mitchell Stern
ddadc18ef6 Fix bug in ray.errors and update its default behavior (#5576) 2019-09-05 13:18:57 -07:00
Stephanie Wang
edcc56ea01 Project fixes and cleanups (#5632) 2019-09-05 11:55:42 -07:00
Eric Liang
19bbf1eb4d [rllib] Revert [rllib] Port DDPG to the build_tf_policy pattern (#5626) 2019-09-04 21:39:22 -07:00
Richard Liaw
34f6d2fc5c [tune] Update trainable docs and support hparams (#5558) 2019-09-04 12:44:42 -07:00
lanlin
3ea9062419 Lazily create summary writer for TF2 logger. (#5631) 2019-09-04 09:22:56 -07:00
Richard Liaw
ad96d3c4fb [tune] Fix TB Memory Leak (#5629) 2019-09-03 23:44:12 -07:00
Richard Liaw
130b8f21da
[tune] Global checkpointing for tune at end (#5499) 2019-09-03 15:36:25 -07:00
jichan3751
1711e202a3 [training] Tensorflow interface for MultiNode SGD (#5440) 2019-09-03 15:35:42 -07:00
Edward Oakes
4ed6ee0b1e Better error message for actor class inheritance (#5598) 2019-09-03 10:42:27 -07:00
lanlin
c3b0c62290 Remove the unused argument cusomt_loggers in Experiment. (#5619) 2019-09-03 10:34:46 -07:00
Edward Oakes
dfd2a45f69 Simplify symlinking and don't print warnings (#5615) 2019-09-02 13:31:10 -07:00
Eric Liang
a101812b9f
Replace --redis-address with --address in test, docs, tune, rllib (#5602)
* wip

* add tests and tune

* add ci

* test fix

* lint

* fix tests

* wip

* sugar dep
2019-09-01 16:53:02 -07:00
Richard Liaw
c49b98cfc4
[tune] Add encoder for PBT (#5599)
* Add encoder

* Apply suggestions from code review
2019-09-01 15:27:42 -07:00
Si-Yuan
0292f99e6c Fix DeprecationWarning (#5608) 2019-09-01 15:21:32 -07:00
Edward Oakes
0cc0abf857 Create session_latest symlink for Ray sessions (#5580) 2019-08-31 22:14:54 -07:00
Eric Liang
daf38c8723
[tune] Deprecate tune.function (#5601)
* remove tune function

* remove examples

* Update tune-usage.rst
2019-08-31 16:00:10 -07:00
Eric Liang
3e70daba74
Warn on resource deadlock; improve object store error messages (#5555)
* wip

* wip

* wip

* wip

* wip

* add impl

* second

* warn once
2019-08-30 16:45:54 -07:00
Eric Liang
bea43c85b1
Ref count objects created with ray.put (#5590)
* wip

* add weakref option

* tune util

* test ref

* doc

* fix tests
2019-08-30 16:43:23 -07:00
Robert Nishihara
93e103135b Update doc versions from 0.8.0.dev3 to 0.8.0.dev4. (#5585) 2019-08-29 22:42:57 -07:00
Philipp Moritz
85a92bcb8b Bump version string to 0.8.0.dev4 (#5523) 2019-08-29 21:25:28 -07:00
Philipp Moritz
04b869678e
Fix O(n^2) behavior in the log_monitor (#5569) 2019-08-29 14:46:31 -07:00
Richard Liaw
411f30c125
[docs] Second push of changes (#5391) 2019-08-28 17:54:15 -07:00
Philipp Moritz
ddfababb82 Fix log files being opened as unicode files (#5545) 2019-08-27 12:47:00 -07:00
idthanm
52a6a1b9f7 [tune] TF2.0 TensorBoard support (#5547)
* Fix tensorboard log issue with tensorflow2.0

* tf2 support
2019-08-27 10:53:27 -07:00
Eric Liang
d20696300e
Fix autoscaler format string for memory (#5542)
* add format string

* fix cast
2019-08-26 23:25:11 -07:00
Eric Liang
ff73b67154
fix test (#5544) 2019-08-26 23:24:40 -07:00
Simon Mo
948b1b09e8 Remove previous version of ray.serve (#5541) 2019-08-26 19:28:19 -07:00
Philipp Moritz
f1dcce5a47
[projects] Add named commands to sessions (#5525) 2019-08-26 14:16:17 -07:00
Eric Liang
97ccd75952
[rllib] Enable object store memory limit by default (#5534) 2019-08-26 01:37:28 -07:00
Andrey K
d41963c546 Fixed: missing brackets when appending proc info on OutOfMemory (#5530)
* Fixed: missing brackets when appending proc info on OutOfMemory

proc_stats.append was missing the set of brackets when adding a tuple to the list, which resulted in runtime error instead of correct Out of Memory message display.

* Update memory_monitor.py
2019-08-24 18:33:20 -07:00