Commit graph

3834 commits

Author SHA1 Message Date
micafan
a0dc02042b [GCS] Add ErrorInfoAccessor to GCS Client (#6749) 2020-01-15 13:38:58 +08:00
Tianyi Chen
9a4da1951e [Streaming] Streaming scheduler - part1-1: job graph (#6712) 2020-01-15 13:12:03 +08:00
Edward Oakes
4227fd1b60
fix flaky test_wait (#6791) 2020-01-14 14:43:16 -06:00
Kai Yang
ddd4c42fe5 [Java] Add killActor API in Java (#6728)
* Add killActor API in Java

* fix javadoc

* update test case

* Address comments
2020-01-14 17:12:00 +08:00
Sven Mika
2bcf72e306 DQN distributional model: Replace all legacy tf.contrib imports with tf.keras.layers.xyz or tf.initializers.xyz. (#6772)
- This fixes a test case in test_evaluators.py.
2020-01-13 21:48:16 -08:00
Edward Oakes
3ea3b56eb1
Hotfix missing fields in multiprocessing.Pool (#6784) 2020-01-13 16:39:33 -06:00
Sven Mika
4ee566129f Ignore io.UnsupportedOperation error when "Enabling nice stack traces on SIGSEGV etc." in worker.py::connect(). (#6771)
- Fixes RLlib tf-eager test cases for all agents when run locally on Ubuntu and Mac.
2020-01-13 14:31:13 -08:00
Edward Oakes
fc473e6a08
Use us-west-2 for application stress tests (#6782) 2020-01-13 15:01:03 -06:00
Philipp Moritz
a26431f587
Upgrade react-scripts to fix #6739 (#6769) 2020-01-13 11:58:21 -08:00
Edward Oakes
a950e95c7d
Use exit() in __kill_actor__ (#6760) 2020-01-13 11:37:59 -06:00
chaokunyang
36b2634479 [Java] Remove singleton exceptions (#6765) 2020-01-13 10:28:06 +08:00
Stephanie Wang
453a214571
Publish unexpected worker failures (#6734)
* Publish unexpected worker failures

* comment

* Move failure handler to NodeManager, update comments
2020-01-11 10:39:22 -08:00
chaokunyang
723fe86882 [Java] Fix building Java with maven (#6764)
* lint

* gen_maven_deps for ray_java_pkg
2020-01-11 14:26:27 +08:00
fangfengbin
ed8b2a9b85 Add stats handler to gcs server (#6750) 2020-01-11 12:46:24 +08:00
micafan
ce8170db99 [GCS] Add StatsInfoAccessor to GCS Client (#6748) 2020-01-10 13:55:10 +08:00
chaokunyang
4097d076d4 Package ray java jars into wheels (#6600) 2020-01-10 11:41:00 +08:00
Michael Luo
e5dded917c SAC site changes (#6759) 2020-01-09 18:13:42 -08:00
chenk008
f69081242e Ray operator travis (#6731) 2020-01-09 16:16:08 -06:00
Sven
60d4d5e1aa Remove future imports (#6724)
* Remove all __future__ imports from RLlib.

* Remove (object) again from tf_run_builder.py::TFRunBuilder.

* Fix 2xLINT warnings.

* Fix broken appo_policy import (must be appo_tf_policy)

* Remove future imports from all other ray files (not just RLlib).

* Remove future imports from all other ray files (not just RLlib).

* Remove future import blocks that contain `unicode_literals` as well.
Revert appo_tf_policy.py to appo_policy.py (belongs to another PR).

* Add two empty lines before Schedule class.

* Put back __future__ imports into determine_tests_to_run.py. Fails otherwise on a py2/print related error.
2020-01-09 00:15:48 -08:00
fangfengbin
ca454c5c1b Add task reconstruction function to task info handler (#6711) 2020-01-09 15:37:42 +08:00
Yunzhi Zhang
3673835f30 Fix spurious warning message when submitting many tasks (#6752) 2020-01-08 22:52:46 -08:00
micafan
1211e6a1fc [GCS] Add async register nodes to GCS Client (#6742) 2020-01-09 10:51:22 +08:00
Eric Liang
69c5a2bc3c
Warn if OMP_NUM_THREADS is set (#6729) 2020-01-08 14:59:07 -08:00
Eric Liang
a745886242
Disable HTTP proxy for gRPC connections (#6744)
* disable http proxy for grpc

* add test
2020-01-08 09:23:22 -08:00
micafan
0a5d0109a4 add actor table data creation method to pb_util.h (#6746) 2020-01-08 22:39:17 +08:00
chaokunyang
70c7d47c09 [Streaming] java cross lang streaming graph (#6689) 2020-01-08 17:32:35 +08:00
micafan
91a3fa0157 [GCS]access task reconstruction in TaskInfoAccessor (#6688)
* add task lease interface to TaskInfoAccessor

* impl of task lease

* support accessing task lease in TaskInfoAccessor

* update raylet usage of task lease

* add comment

* fix lint

* fix UT of TaskDependencyManager

* fix UT of ReconstructionPolicy

* rm useless code from UT

* add task reconstruction methods to gcs

* fix ut of RedisGcsClient

* update test

* update comments
2020-01-08 16:59:06 +08:00
Lixin Wei
859dbad155 Fix estimate_available_memory() in utils.py (#6302) 2020-01-08 15:22:47 +08:00
fangfengbin
303d1a959b Add task lease method to task info handler (#6710)
* add task lease methods to task info handler

* rebase master
2020-01-08 14:25:55 +08:00
Tianyi Chen
9dacebec1a [Streaming] Add configuration with owner config. (#6687) 2020-01-08 11:19:01 +08:00
Frithjof
872a3522aa Add machinable to list of projects using Tune (#6737) 2020-01-07 15:10:17 -08:00
Edward Oakes
5f843cd998
Clean up stress_testing_config.yaml (#6738)
* Clean up stress_testing_config.yaml

* comment
2020-01-07 17:05:07 -06:00
Eric Liang
a6c8c342b7
Better document guarantees provided by par iter API (#6726)
* update

* Update doc/source/iter.rst

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* Update doc/source/iter.rst

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-01-07 14:41:50 -08:00
Zhijun Fu
329b9440ba fix missing override for HandleWaitForObjectEviction (#6733) 2020-01-07 13:20:35 -08:00
Zhijun Fu
72335dbe46
[rpc] refactor RPC server code (#6661)
* refactor RPC client

* remove unused code

* format

* fix

* resolve comments

* format

* update

* refactor rpc server

* update

* format

* fix

* fix

* Update src/ray/rpc/worker/core_worker_server.h

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* resolve comments

* format

* update

* update

* add a comment

* fix

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-01-07 22:03:42 +08:00
Michał Słapek
aaeb3c44a5 [tune] Add _change_working_directory to RayTrialExecutor (#6228) (#6320)
* [tune] Add _switch_working_directory to RayTrialExecutor (#6228)

* Make _switch_working_directory before warn_if_slow

* Rename _switch_working_directory to _change_working_directory
2020-01-07 01:51:04 -08:00
Robert Nishihara
5e43b25e8c
Document fault tolerance behavior. (#6698) 2020-01-06 22:34:06 -08:00
Ujval Misra
20ba7ef647 [tune] Move util to utils package (#6682)
* Move util.py to utils

* Fix import
2020-01-06 18:11:02 -08:00
Edward Oakes
78d6290a65
Add kubectl to autoscaler docker image (#6721) 2020-01-06 17:30:51 -06:00
Edward Oakes
2a4d2c6e9e
Basic reference counting & pinning (#6554) 2020-01-06 17:30:26 -06:00
mehrdadn
c9855c9769 Remove std::move<std::shared_ptr>(...) to avoid bugs (#6720) 2020-01-06 17:17:26 -06:00
Eric Liang
63363e19be
Update bug_report.md (#6704) 2020-01-06 10:55:04 -08:00
Zhijun Fu
5bb20f6ac9
remove unused params in grpc macros (#6677)
* remove unused params in grpc macros

* format

* fix

* format

* fix
2020-01-06 21:35:40 +08:00
mehrdadn
76c986bdc7 Windows compatibility stubs (#6706) 2020-01-05 21:21:17 -08:00
mehrdadn
e6165cb14b Fix master as it seems to have been broken via these conflicting commits: (#6708)
c51fbfb453
2228079481

Co-authored-by: GitHub Web Flow <noreply@github.com>
2020-01-06 12:29:21 +08:00
fangfengbin
1000e3322d Add gcs server task info handler (#6695) 2020-01-06 11:09:32 +08:00
Lingxuan Zuo
c51fbfb453 [streaming] Message bundle use inplacement instance (#6606)
* streaming message bundle use inplacement instance

* fix typo & enable common test

* fix compiler warning

* block copy for serilization

* add reference

* remove streaming common test to travis script
2020-01-06 11:04:29 +08:00
mehrdadn
2228079481 Fix missing overrides (#6703) 2020-01-05 17:00:23 -08:00
Philipp Moritz
e15bd8ff1a
Run core worker tests in thread sanitizer and fix thread safety issues (#6701) 2020-01-05 16:18:21 -08:00
micafan
cc110ff1e3 [GCS]Add task lease methods to TaskInfoAccessor (#6645) 2020-01-05 13:54:33 +08:00