Commit graph

4056 commits

Author SHA1 Message Date
Simon Mo
8f246c17b5
Initialize async plasma for async actors (#6813)
* Initialize async plasma for async actors

* Address comment
2020-01-17 14:58:06 -08:00
Ameer Haj Ali
9f9c3f5026 adding context parameter for pool with a warning for not being supported (#6776) 2020-01-17 16:57:18 -06:00
Richard Liaw
a3a268435f
[docs] Edit survey links (#6777) 2020-01-17 11:52:04 -08:00
Zhijun Fu
92380dd4e6 Fix crash in HandleObjectMissing when direct actor creation task is not found in local_queues_ (#6817) 2020-01-17 13:29:13 -06:00
Edward Oakes
30776450a3
num_cpus=1 by default in Pool (#6812) 2020-01-17 13:28:25 -06:00
Qstar
0f3205af0b [Projects] Delete pods associated with the project when running ray session stop (#6787) 2020-01-17 10:42:30 -08:00
Mitchell Stern
9f96091aef [Dashboard] Add logical view displaying actor tree (#6810)
* [Dashboard] Add logical view displaying actor tree

* Fix key error in test_raylet_info_endpoint
2020-01-17 10:25:27 -08:00
Yuhao Yang
5f36e6eacb [tune] get checkpoints paths for a trial after tuning (#6643) 2020-01-17 10:15:04 -08:00
chaokunyang
fa3c513276 [Streaming] Streaming filter transform (#6816)
* add filter transform

* lint

* add new line
2020-01-17 22:05:47 +08:00
micafan
e143f85ca0 [GCS] Use new interface class GcsClient in ray (#6805) 2020-01-17 14:51:18 +08:00
Mitchell Stern
8e8b66a4b8 Add route for /favicon.ico to fix missing favicon (#6815) 2020-01-16 21:03:21 -06:00
Richard Liaw
232be5a058
[sgd] fault tolerance for pytorch + revamp documentation (#6465) 2020-01-16 18:38:27 -08:00
fangfengbin
e5ad4e6f8d Add worker info handler to gcs service (#6798)
* add worker info handler

* rebase master

* add log

* remove unused variable

* fix code style
2020-01-16 22:35:00 +08:00
Mitchell Stern
05674c219f Accept any port in test_get_webui in test_webui.py (#6804) 2020-01-15 23:16:35 -06:00
mehrdadn
fb8e3615d5 Use Boost.Process instead of pid_t (#6510)
* Use Boost.Process instead of pid_t

This will let us handle child processes (mostly) uniformly across platforms.
TODO: There is no SIGTERM on Windows; achieving something equivalent is fairly involved.
2020-01-15 20:05:02 -08:00
fangfengbin
f9fa93eaf1 Add error info handler to gcs service (#6754)
* add error info accessor

* rebase master

* add function comments

* capture type instead of request
2020-01-16 11:59:00 +08:00
Edward Oakes
b750bd7fc9
Use 2xlarge instances in long running tests (#6802) 2020-01-15 19:47:59 -06:00
Ziyad Edher
c480d1d1e4 Treat static methods as class methods instead of instance methods in actors (#6756)
* Treat static methods as class methods rather than instance methods

* Add tests for static methods in actors

* Revert formatting changes

* Readd future imports

* Restructure static method check

* Documentation enhancements

* Fix linting issues
2020-01-15 19:38:41 -06:00
micafan
2e972e725a [GCS] Add WorkerInfoAccessor to GCS Client (#6788) 2020-01-16 09:28:32 +08:00
mehrdadn
4780b52ea8 Polish clang-format and let it run in a local repo (#6793) 2020-01-15 11:17:49 -08:00
Qing Wang
ad90693ca8
[Java] Enhancement single process mode (#6795)
* enhancement

* Add ut

* Update java/runtime/src/main/java/org/ray/runtime/task/LocalModeTaskSubmitter.java

Co-Authored-By: Kai Yang <kfstorm@outlook.com>

* Update java/test/src/main/java/org/ray/api/test/RunModeTest.java

Co-Authored-By: Kai Yang <kfstorm@outlook.com>

* Address comments

* Use ExecutorSerivce to replace raw thread

Co-authored-by: Kai Yang <kfstorm@outlook.com>
2020-01-15 21:38:53 +08:00
Kai Yang
cd5fc81bdd Show the exit code if RunManager failed to start a process (#6797) 2020-01-15 19:31:56 +08:00
micafan
a0dc02042b [GCS] Add ErrorInfoAccessor to GCS Client (#6749) 2020-01-15 13:38:58 +08:00
Tianyi Chen
9a4da1951e [Streaming] Streaming scheduler - part1-1: job graph (#6712) 2020-01-15 13:12:03 +08:00
Edward Oakes
4227fd1b60
fix flaky test_wait (#6791) 2020-01-14 14:43:16 -06:00
Kai Yang
ddd4c42fe5 [Java] Add killActor API in Java (#6728)
* Add killActor API in Java

* fix javadoc

* update test case

* Address comments
2020-01-14 17:12:00 +08:00
Sven Mika
2bcf72e306 DQN distributional model: Replace all legacy tf.contrib imports with tf.keras.layers.xyz or tf.initializers.xyz. (#6772)
- This fixes a test case in test_evaluators.py.
2020-01-13 21:48:16 -08:00
Edward Oakes
3ea3b56eb1
Hotfix missing fields in multiprocessing.Pool (#6784) 2020-01-13 16:39:33 -06:00
Sven Mika
4ee566129f Ignore io.UnsupportedOperation error when "Enabling nice stack traces on SIGSEGV etc." in worker.py::connect(). (#6771)
- Fixes RLlib tf-eager test cases for all agents when run locally on Ubuntu and Mac.
2020-01-13 14:31:13 -08:00
Edward Oakes
fc473e6a08
Use us-west-2 for application stress tests (#6782) 2020-01-13 15:01:03 -06:00
Philipp Moritz
a26431f587
Upgrade react-scripts to fix #6739 (#6769) 2020-01-13 11:58:21 -08:00
Edward Oakes
a950e95c7d
Use exit() in __kill_actor__ (#6760) 2020-01-13 11:37:59 -06:00
chaokunyang
36b2634479 [Java] Remove singleton exceptions (#6765) 2020-01-13 10:28:06 +08:00
Stephanie Wang
453a214571
Publish unexpected worker failures (#6734)
* Publish unexpected worker failures

* comment

* Move failure handler to NodeManager, update comments
2020-01-11 10:39:22 -08:00
chaokunyang
723fe86882 [Java] Fix building Java with maven (#6764)
* lint

* gen_maven_deps for ray_java_pkg
2020-01-11 14:26:27 +08:00
fangfengbin
ed8b2a9b85 Add stats handler to gcs server (#6750) 2020-01-11 12:46:24 +08:00
micafan
ce8170db99 [GCS] Add StatsInfoAccessor to GCS Client (#6748) 2020-01-10 13:55:10 +08:00
chaokunyang
4097d076d4 Package ray java jars into wheels (#6600) 2020-01-10 11:41:00 +08:00
Michael Luo
e5dded917c SAC site changes (#6759) 2020-01-09 18:13:42 -08:00
chenk008
f69081242e Ray operator travis (#6731) 2020-01-09 16:16:08 -06:00
Sven
60d4d5e1aa Remove future imports (#6724)
* Remove all __future__ imports from RLlib.

* Remove (object) again from tf_run_builder.py::TFRunBuilder.

* Fix 2xLINT warnings.

* Fix broken appo_policy import (must be appo_tf_policy)

* Remove future imports from all other ray files (not just RLlib).

* Remove future imports from all other ray files (not just RLlib).

* Remove future import blocks that contain `unicode_literals` as well.
Revert appo_tf_policy.py to appo_policy.py (belongs to another PR).

* Add two empty lines before Schedule class.

* Put back __future__ imports into determine_tests_to_run.py. Fails otherwise on a py2/print related error.
2020-01-09 00:15:48 -08:00
fangfengbin
ca454c5c1b Add task reconstruction function to task info handler (#6711) 2020-01-09 15:37:42 +08:00
Yunzhi Zhang
3673835f30 Fix spurious warning message when submitting many tasks (#6752) 2020-01-08 22:52:46 -08:00
micafan
1211e6a1fc [GCS] Add async register nodes to GCS Client (#6742) 2020-01-09 10:51:22 +08:00
Eric Liang
69c5a2bc3c
Warn if OMP_NUM_THREADS is set (#6729) 2020-01-08 14:59:07 -08:00
Eric Liang
a745886242
Disable HTTP proxy for gRPC connections (#6744)
* disable http proxy for grpc

* add test
2020-01-08 09:23:22 -08:00
micafan
0a5d0109a4 add actor table data creation method to pb_util.h (#6746) 2020-01-08 22:39:17 +08:00
chaokunyang
70c7d47c09 [Streaming] java cross lang streaming graph (#6689) 2020-01-08 17:32:35 +08:00
micafan
91a3fa0157 [GCS]access task reconstruction in TaskInfoAccessor (#6688)
* add task lease interface to TaskInfoAccessor

* impl of task lease

* support accessing task lease in TaskInfoAccessor

* update raylet usage of task lease

* add comment

* fix lint

* fix UT of TaskDependencyManager

* fix UT of ReconstructionPolicy

* rm useless code from UT

* add task reconstruction methods to gcs

* fix ut of RedisGcsClient

* update test

* update comments
2020-01-08 16:59:06 +08:00
Lixin Wei
859dbad155 Fix estimate_available_memory() in utils.py (#6302) 2020-01-08 15:22:47 +08:00