Richard Liaw
52d9189d5d
[autoscaler] port-forward for attach + redis_port ( #7145 )
...
* port-forward
* fixport
* force redis port in init mode
* test
* Update python/ray/tests/test_ray_init.py
2020-02-14 15:17:00 -08:00
Simon Mo
30de1286bd
Use pip install setup.py ( #7158 )
2020-02-14 13:53:36 -08:00
Adrian O'Grady
fe6ce714a0
[rllib] - TaskPool.completed_prefetch() no longer returns stale object ids after an error ( #7139 )
2020-02-13 22:30:44 -08:00
Qing Wang
f3703bafa3
[Java] Support concurrent actor calls API. ( #7022 )
...
* WIP
Temp change
Attach native thread to jvm
* Fix run mode
* Address comments.
2020-02-14 13:02:39 +08:00
Alex Wu
0d3687a10d
No warning for docker memory > system memory ( #7151 )
2020-02-13 15:21:44 -08:00
Edward Oakes
b81b93a9c0
Convert stress tests to projects ( #6495 )
2020-02-13 09:19:24 -08:00
Qing Wang
94a286ef1d
[Java] Add session_dir as temp_dir for logs, socket files like Python ( #7044 )
...
* Support
* Add gcs_server support
* Fix ut
* Fix
* Remove unused py code
* Fix linting
* Fix cross language ci
* Fix CI
* Add docstring
* Fix
* Fix linting
* Add a singleton for config
* Refine
* fix
* Fix
* linting
* Remove FileUnit
* Fix
* Fix
* Fix
* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com>
* Fix streaming singleprocess CI
* Fix checkstyle
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-02-13 17:49:52 +08:00
Sven Mika
5518a738b3
[RLlib] Fix erroneous use of LinearSchedule (in DDPG's exploration annealing). ( #7125 )
...
* Fix erroneous use of LinearSchedule (in DDPG's exploration annealing).
Erase schedules_obsoleted.py.
* Trigger re-test.
* Re-test.
2020-02-12 23:46:49 -08:00
wanxing
9fc3e2e50f
[Streaming]Add RefreshChannelInfo to support flow-control ( #7071 )
...
* add RefreshChannelInfo
* fix name
* add override
* fix
* fix return value
2020-02-13 09:30:56 +08:00
Edward Oakes
e904711e74
Add python tests for serialized object ID reference counting ( #7038 )
2020-02-12 16:52:07 -08:00
Edward Oakes
d91d3ea936
Split half of test_actor into test_actor_advanced ( #7143 )
2020-02-12 15:17:25 -08:00
Simon Mo
0e94e1dc2a
[Asyncio] Increase recursion limit manually ( #7142 )
2020-02-12 14:15:36 -08:00
Sven Mika
f41a9b9813
[RLlib] Fix KL method of MultiCategorial tf distribution (issue #7009 ). ( #7119 )
...
* Fix KL method of MultiCategorial tf distribution.
* Fix KL method of MultiCategorial tf distribution.
* Merge AsyncReplayOptimizer fixes into this branch.
2020-02-12 12:46:15 -08:00
Edward Oakes
275fd343fb
Change CI to properly list python3.6 ( #7126 )
2020-02-12 11:15:46 -08:00
Mitchell Stern
5dda0b66bf
[Dashboard] Refactor dialogs to use parent component state instead of routes ( #7129 )
2020-02-12 10:59:47 -08:00
aannadi
d941ac6c89
Updating package-lock.json with latest npm ( #7128 )
2020-02-12 09:54:20 -08:00
Richard Liaw
fc9352c588
[docs] Make walkthrough and starting Ray materials clear ( #7099 )
...
* make starting ray a separate page
* concept
* Apply suggestions from code review
Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>
* more fics
* Apply suggestions from code review
Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-02-11 23:17:30 -08:00
Eric Liang
305eaaabe9
Fix hang if actor object id is returned from a task that exits ( #6885 )
2020-02-11 20:28:13 -08:00
mehrdadn
e09f63ad65
Fix build errors and add more targets to Windows builds ( #6811 )
...
* Fix common.fbs rename (due to apache/arrow/commit/bef9a1c251397311a6415d3dc362ef419d154caa)
* Add missing COPTS
* Use socketpair(AF_INET) if boost::asio::local is unavailable (e.g. on Windows)
* Fix compile bug in service_based_gcs_client_test.cc (fix build breakage in #6686 )
* Work around googletest/gmock inability to specify override to avoid -Werror,-Winconsistent-missing-override
* Fix missing override on IsPlasmaBuffer()
* Fix missing libraries for streaming
* Factor out install-toolchains.sh
* Put some Bazel flags into .bazelrc
* Fix jni_md.h missing inclusion
* Add ~/bin to PATH for Bazel
* Change echo $$(date) > $@ to date > $@
* Fix lots of unquoted paths
* Add system() call checks for Windows
Co-authored-by: GitHub Web Flow <noreply@github.com>
2020-02-11 16:49:33 -08:00
Simon Mo
039d2cde88
Change log level for OMP warning ( #7114 )
2020-02-11 14:15:38 -08:00
Sven Mika
2a0e4d94aa
[RLlib] Fix AsyncReplayOptimizer bug where it swallows all good worker tasks … ( #7111 )
2020-02-11 12:51:44 -08:00
mehrdadn
fea54ab97f
Use --force_pic to prevent Bazel from compiling the same files twice, which slows down the build considerably. ( #7116 )
2020-02-11 12:11:53 -08:00
aannadi
d7ff55852a
[tune][Dashboard] Added Tune Dashboard ( #6911 )
2020-02-11 11:56:49 -08:00
Simon Mo
0d5225c743
[Build] Use latest known tagged arrow image for linux build ( #7115 )
2020-02-11 11:17:48 -08:00
Simon Mo
0ddc389830
Fix documentation building with psutil issue ( #7077 )
2020-02-11 10:00:29 -08:00
Lingxuan Zuo
3d9bd64591
[Streaming] DataWriter use event driven model. ( #7043 )
...
* streaming writer use event driven model.
* minor changes according reviewer comments
* Fix according to reviewer's comments
* fix bazel lint
* code polished
* Add more comments
* rename Stop & Start of EventQueue to Freeze and Unfreeze.
2020-02-11 22:24:45 +08:00
Eric Liang
58c94f6381
[core] Delete() should never remote objects from in-memory store ( #7117 )
2020-02-10 22:40:09 -08:00
Simon Mo
bec92a8946
[Hotfix] Fix flake8 lint failing ( #7118 )
2020-02-10 19:57:21 -08:00
Maksim Smolin
4139e02f01
[autoscaler] Add `--all-nodes` option to rsync-up ( #7065 )
...
* Add option to sync workers to rsync-up
* Format
* Rename --sync-workers to --all-nodes
2020-02-10 16:27:59 -08:00
mehrdadn
ad1848b623
Comment iwyu.sh ( #7110 )
...
Co-authored-by: GitHub Web Flow <noreply@github.com>
2020-02-10 15:28:36 -08:00
Eric Liang
026f6884b5
[rllib] Add Decentralized DDPPO trainer and documentation ( #7088 )
2020-02-10 15:28:27 -08:00
Sven Mika
6e1c3ea824
[RLlib] Exploration API (+EpsilonGreedy sub-class). ( #6974 )
2020-02-10 15:22:07 -08:00
SangBin Cho
1e690673d8
Render tasks that are not schedulable on the dashboard. ( #7034 )
2020-02-10 14:23:06 -08:00
Alex Wu
3f99be8dad
Add 'ray dashboard' command ( #6959 )
2020-02-10 12:55:21 -08:00
Alex Wu
72c31e3e19
Ray nodes should respect docker limits ( #7039 )
2020-02-10 11:08:38 -08:00
Qstar
52ed42635f
add role rbac and add add guide ( #7091 )
2020-02-10 11:03:15 -08:00
mehrdadn
83c4e947c7
Make Cython rules more consistent for Bazel ( #6840 )
2020-02-10 10:45:54 -08:00
Dean Wampler
c729378bd5
Check that the user's python version is supported ( #7003 )
2020-02-10 10:32:23 -08:00
Simon Mo
f6c09ff614
Add serve stress test ( #7076 )
2020-02-10 09:37:39 -08:00
chaokunyang
247a4d022a
Fix passing empty bytes in python tasks ( #7045 )
...
* ensure data_ won't be null_ptr when size == 0
* when data_sizes[i] == 0, we should Allocate an empty buffer
* work around for pyarrow.py_buffer
* fix comments
* add null ptr check
* add test for bytes
* lint
2020-02-10 12:07:29 +08:00
fangfengbin
694c0f2867
[Java] Enable GCS server when running java unit tests ( #7041 )
...
* enable gcs service when run java testcase
* fix ci bug
* fix windows compile bug
* fix ci bug
* restart ci job
* enable java testcase
* restart ci job
* restart ci job
* add debug log
* add debug log
* restart ci job
* add debug log
* restart ci
* add debug log
* fix java testcase bug
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
2020-02-10 09:39:14 +08:00
Eric Liang
48e2adbc21
[tune] Remove unused TF loggers ( #7090 )
2020-02-09 13:58:24 -08:00
Ujval Misra
98a07fe37e
[tune] Asynchronous saves ( #6912 )
...
* Support asynchronous saves
* Fix merge issues
* Add test, fix existing tests
* More informative warning
* Lint, remove print statements
* Address comments, add checkpoint.is_resolved fn
* Add more detailed comments
2020-02-09 12:17:45 -08:00
fyrestone
0648bd28ef
[xlang] Cross language Python support ( #6709 )
2020-02-08 13:01:28 +08:00
Alind Khare
f146d05b36
[Serve] Added support for composing arbitrary DAGs ( #7015 )
2020-02-07 17:55:26 -08:00
mehrdadn
ad4ac9aa70
Add clang-iwyu ( #7081 )
...
* Add iwyu
Co-authored-by: GitHub Web Flow <noreply@github.com>
2020-02-07 16:19:46 -08:00
Ion
f9885b8710
New scheduler local node ( #6913 )
...
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-02-07 12:57:59 -08:00
Sven Mika
676a011784
Make sure pre-push is executable. ( #7079 )
2020-02-07 11:38:14 -08:00
Stephanie Wang
3333ee84a5
Fix ref counting ( #7075 )
2020-02-06 14:35:08 -08:00
Sven Mika
5ac5ac9560
[RLlib] Fix broken example: tf-eager with custom-RNN ( #6732 ). ( #7021 )
...
* WIP.
* Fix float32 conversion in OneHot preprocessor (would cause float64 in eager, then NN-matmul-failure).
Add proper seq-len + state-in construction in eager_tf_policy.py::_compute_gradients().
* LINT.
* eager_tf_policy.py: Only set samples["seq_lens"] if RNN. Otherwise, eager-tracing will throw flattened-dict key-mismatch error.
* Move issue code to examples folder.
Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-02-06 09:44:08 -08:00
