Commit graph

3409 commits

Author SHA1 Message Date
Eric Liang
4979b8c4d9
Ordered execution of tasks per actor handle (#5664) 2019-09-14 22:31:33 -07:00
Edward Oakes
a8888c5ff4 [flaky test] Fix test_calling_start_ray_head (#5644) 2019-09-14 22:27:45 -07:00
Robert Nishihara
74a34b736d Call ray.put in ray.init() to speed up first object store access. (#5685) 2019-09-14 21:27:32 -07:00
Simon Mo
1560ace65a
Use set comprehensions (#5707) 2019-09-14 15:44:25 -07:00
Edward Oakes
a5d7de6aaf [core worker] Python core worker normal task submission (#5566) 2019-09-14 13:02:53 -07:00
Simon Mo
5f88823c49
[Serve] Rewrite Ray.Serve From Scratch (#5562)
* Commit and format files

* address stylistic concerns

* Replcae "Usage" by "Example" in doc

* Rename srv to serve

* Add serve to CI process; Fix 3.5 compat

* Improve determine_tests_to_run.py

* Quick cosmetic for determien_tests

* Address comments

* Address comments

* Address comment

* Fix typos and grammar

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* Update python/ray/experimental/serve/global_state.py

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* Use __init__ for Query and WorkIntent class

* Remove dataclasses dependency

* Rename oid to object_id for clarity

* Rename produce->enqueue_request, consume->dequeue_request

* Address last round of comment
2019-09-13 21:36:56 -07:00
Si-Yuan
4c964c0941 Initial implementation for pickle5 support (#5611) 2019-09-13 17:54:14 -07:00
Simon Mo
fc9f03cd96 Fix queue actor init in setup_queue_actor fixture (#5676) 2019-09-13 12:35:44 -07:00
Eric Liang
3ed18d0b59
Fix edge case in autoscaler with poor bin packing (#5702)
* fix edge case

* fix for general case
2019-09-13 11:46:10 -07:00
Stephanie Wang
1d4a11a433 Only use git repo if .git exists (#5701) 2019-09-13 11:34:34 -07:00
Edward Oakes
07c4c6367a [core worker] Python core worker object interface (#5272) 2019-09-12 23:07:46 -07:00
Kai Yang
1b880191b0 Replace NotImplementedException with UnsupportedOperationException (#5694) 2019-09-12 00:40:26 -07:00
Edward Oakes
ee5db5b67f Raise error if space in redis password (#5673) 2019-09-11 20:58:39 -07:00
Edward Oakes
0bf79cfbde Properly short circuit core worker Get() on exception (#5672) 2019-09-11 18:38:14 -07:00
Ashwinee Panda
946ebfaa3c [rllib] Validate that entropy coeff is not an integer (#5687)
* Validate that entropy coeff is not an integer

Passing an integer value for entropy coeff such as 0 raises an error somewhere inside the TF policy graph, so this checks to make sure the entropy coeff is a float.

* Cast to float instead

Also move this check after the negative value check
2019-09-11 14:35:42 -07:00
Eric Liang
faeaa34bdd
Deflake cluster heartbeat test (#5552) 2019-09-11 12:26:04 -07:00
Eric Liang
bc6a95deb0
[rllib] Eager execution for centralized critic example, fix simple optimizer for multiagent (#5683) 2019-09-11 12:15:34 -07:00
Eric Liang
2fdefe19b7
Take into account queue length in autoscaling (#5684) 2019-09-11 11:31:35 -07:00
Philipp Moritz
9ce6dd9b88
[Projects] Add "session execute" (#5681) 2019-09-11 00:50:05 -07:00
Hersh Godse
336aef1774 [tune] Save and Restore for bayesopt (#5623) 2019-09-10 13:11:59 -07:00
Robert Nishihara
4d16677a68 Fix PyPI version in readme. (#5662) 2019-09-09 19:54:57 -07:00
Simon Mo
147e7d46ec
[Flaky tests] FIx test fork (#5671)
* Start testing test_fork

Maybe queue actor takes too long to initialize, that's why we are
seeing "Many python processes started" since most of the python
tasks are blocked on ray.get

* Add a comment
2019-09-09 19:21:20 -07:00
Richard Liaw
0010f54378 Update Cloudpickle (#5643) 2019-09-09 17:17:29 -07:00
Kai Yang
ed761900f6 [Java] Support direct actor call in Java worker (#5504) 2019-09-09 14:29:20 +08:00
Eric Liang
74abeab057
[rllib] Improve accessing model state docs (#5656)
* [rllib] better model docs

* fix

* s
2019-09-08 23:01:26 -07:00
Robert Nishihara
87adb5a3c8
Remove timeout in test_actor_lifetime_load_balancing. (#5659) 2019-09-08 16:10:59 -07:00
Eric Liang
ebb431a95a Add internal_api.pin_object_data() for pinning arbitrary object ids (#5637)
* add intenral pin method

* add pin

* update
2019-09-08 15:05:00 -07:00
Kai Yang
d8f5804690 Support metadata for passing by value task arguments (#5527) 2019-09-08 11:07:48 +08:00
Stephanie Wang
cb7102f31e [projects] Wrap ProjectDefinition in a class (#5654) 2019-09-07 18:30:17 -07:00
Philipp Moritz
d0125d4212 Fix log monitor process error when attempting to read raylet PID. (#5655) 2019-09-07 15:51:09 -07:00
Eric Liang
cf90394a09
[rllib] Fix TF2 import of EagerVariableStore (#5625) 2019-09-07 12:10:03 -07:00
Eric Liang
1455a19c85
Consolidate and clean up documentation (#5645) 2019-09-07 11:50:18 -07:00
Kai Yang
732336fc4f [Java] Support multiple workers in Java worker process (#5505) 2019-09-07 22:52:05 +08:00
Richard Liaw
d89ceb3ee5
[tune] Fix numerical error (#5653) 2019-09-07 07:34:51 -07:00
Kai Yang
8a352a8e70 ray stop kills processes more carefully (#5508) 2019-09-06 17:49:12 +08:00
Philipp Moritz
744f6e45d4 Update release documentation after 0.7.4 release (#5646)
* Update release documentation after 0.7.4 release

* update

* update
2019-09-06 00:03:57 -07:00
Devin Petersohn
c33d6662ce Remove Modin from Ray wheels. (#5647)
There are several reasons for this:

* We no longer support python2
* There should be only 1 way of installing Modin
  * Issue management on these wheels
* I have never heard of anyone using this feature
* It is rarely kept up to date
* Modin depends on specific versions of Ray because of past API changes
2019-09-05 23:46:27 -07:00
Mitchell Stern
ddadc18ef6 Fix bug in ray.errors and update its default behavior (#5576) 2019-09-05 13:18:57 -07:00
Stephanie Wang
edcc56ea01 Project fixes and cleanups (#5632) 2019-09-05 11:55:42 -07:00
Eric Liang
19bbf1eb4d [rllib] Revert [rllib] Port DDPG to the build_tf_policy pattern (#5626) 2019-09-04 21:39:22 -07:00
Edward Oakes
f38bb288e2 Clean up Wait() in the core worker (#5628) 2019-09-04 21:31:34 -07:00
Zhijun Fu
bb5609afb3 ignore object exists error for memory store provider (#5607) 2019-09-05 11:45:35 +08:00
Richard Liaw
34f6d2fc5c [tune] Update trainable docs and support hparams (#5558) 2019-09-04 12:44:42 -07:00
lanlin
3ea9062419 Lazily create summary writer for TF2 logger. (#5631) 2019-09-04 09:22:56 -07:00
micafan
8236936189 Fix code style in unit test of GCS. (#5634) 2019-09-04 19:36:44 +07:00
Richard Liaw
ad96d3c4fb [tune] Fix TB Memory Leak (#5629) 2019-09-03 23:44:12 -07:00
Edward Oakes
6ab5714465 Temporarily remove pytest-sugar dependency (#5627) 2019-09-03 23:05:17 -07:00
Richard Liaw
130b8f21da
[tune] Global checkpointing for tune at end (#5499) 2019-09-03 15:36:25 -07:00
jichan3751
1711e202a3 [training] Tensorflow interface for MultiNode SGD (#5440) 2019-09-03 15:35:42 -07:00
Edward Oakes
0c68b4cc30 Clean up Wait() and Get() in the core worker (#5556) 2019-09-03 14:45:15 -07:00