Commit graph

3975 commits

Author SHA1 Message Date
Dean Wampler
c729378bd5
Check that the user's python version is supported (#7003) 2020-02-10 10:32:23 -08:00
Simon Mo
f6c09ff614
Add serve stress test (#7076) 2020-02-10 09:37:39 -08:00
chaokunyang
247a4d022a Fix passing empty bytes in python tasks (#7045)
* ensure data_ won't be null_ptr when size == 0

* when data_sizes[i] == 0, we should Allocate an empty buffer

* work around for pyarrow.py_buffer

* fix comments

* add null ptr check

* add test for bytes

* lint
2020-02-10 12:07:29 +08:00
fangfengbin
694c0f2867
[Java] Enable GCS server when running java unit tests (#7041)
* enable gcs service when run java testcase

* fix ci bug

* fix windows compile bug

* fix ci bug

* restart ci job

* enable java testcase

* restart ci job

* restart ci job

* add debug log

* add debug log

* restart ci job

* add debug log

* restart ci

* add debug log

* fix java testcase bug

* restart ci job

* restart ci job

* restart ci job

* restart ci job

* restart ci job

* restart ci job

* restart ci job

* restart ci job
2020-02-10 09:39:14 +08:00
Eric Liang
48e2adbc21
[tune] Remove unused TF loggers (#7090) 2020-02-09 13:58:24 -08:00
Ujval Misra
98a07fe37e [tune] Asynchronous saves (#6912)
* Support asynchronous saves

* Fix merge issues

* Add test, fix existing tests

* More informative warning

* Lint, remove print statements

* Address comments, add checkpoint.is_resolved fn

* Add more detailed comments
2020-02-09 12:17:45 -08:00
fyrestone
0648bd28ef [xlang] Cross language Python support (#6709) 2020-02-08 13:01:28 +08:00
Alind Khare
f146d05b36
[Serve] Added support for composing arbitrary DAGs (#7015) 2020-02-07 17:55:26 -08:00
mehrdadn
ad4ac9aa70
Add clang-iwyu (#7081)
* Add iwyu

Co-authored-by: GitHub Web Flow <noreply@github.com>
2020-02-07 16:19:46 -08:00
Ion
f9885b8710
New scheduler local node (#6913)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-02-07 12:57:59 -08:00
Sven Mika
676a011784
Make sure pre-push is executable. (#7079) 2020-02-07 11:38:14 -08:00
Stephanie Wang
3333ee84a5
Fix ref counting (#7075) 2020-02-06 14:35:08 -08:00
Sven Mika
5ac5ac9560
[RLlib] Fix broken example: tf-eager with custom-RNN (#6732). (#7021)
* WIP.

* Fix float32 conversion in OneHot preprocessor (would cause float64 in eager, then NN-matmul-failure).
Add proper seq-len + state-in construction in eager_tf_policy.py::_compute_gradients().

* LINT.

* eager_tf_policy.py: Only set samples["seq_lens"] if RNN. Otherwise, eager-tracing will throw flattened-dict key-mismatch error.

* Move issue code to examples folder.

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-02-06 09:44:08 -08:00
Simon Mo
a0ba4499ac
[Serve] Fix batching bug 2020-02-05 14:18:19 -08:00
ijrsvt
0826f95e1c
Including psutil & setproctitle (#7031) 2020-02-05 14:16:58 -08:00
Sven Mika
93ed86f175
[Tune] logger.py: Relax TBX Summary ValueErrors with e.g. empty lists in lists (and all… (#6987) 2020-02-05 12:02:39 -08:00
Sven Mika
0e3960893a
[RLlib] Add rainbow config hint to algo-documentation. (#7052) 2020-02-05 12:01:43 -08:00
Edward Oakes
580314bf81
Fix Ctrl-C hanging in in-memory store ray.get/ray.wait (#7033) 2020-02-05 10:17:22 -08:00
fangfengbin
ade7ebfc0c
Add service based gcs client (#6686) 2020-02-05 12:06:25 +08:00
Eric Liang
37053443b4
Restore set omp (#7051) 2020-02-04 15:02:23 -08:00
Dean Wampler
9b9c7f86f7
Improved contributor instructions (#7026)
* Added small section on installation when using Anaconda. Also fixed an obsolete link to Anaconda.

* Delete more temporary directories when running the doc "make clean".

* Added a link to the docs for building and contributing

* Minor comment
2020-02-04 14:07:51 -08:00
Eric Liang
dc7e78deb4
[rllib] Add -v and --torch flags to first page of docs (#7032)
* add verbose doc

* torch
2020-02-04 10:17:51 -08:00
Simon Mo
dd095c476a
Move serve and asyncio tests to bazel (#6979) 2020-02-04 08:29:16 -08:00
Edward Oakes
844f607c93
Collect contained ObjectIDs during deserialization (#7029) 2020-02-03 22:49:14 -08:00
Simon Mo
5e8ded344a
[Serve] Fix flaky test with nursery double init (#6982) 2020-02-03 21:32:12 -08:00
Tianyi Chen
13882d052d
[Streaming] Streaming scheduler - part1-2: execution graph (#6666) 2020-02-04 11:51:21 +08:00
Edward Oakes
984490d2be
Collect object IDs during serialization (#6946) 2020-02-03 18:38:11 -08:00
SangBin Cho
ca5a9c6739
Exclude test profiling info endpoint (#7030)
* Skip test_profiling_info_endpoint when pytest running locally

* Fixed formatting.

* Fixed the reason for skipping the test based on pr comments
2020-02-03 16:49:03 -08:00
Siyuan (Ryans) Zhuang
42cbf801e1
workaround for python3.5 fast numpy serialization (#6675) 2020-02-03 13:08:18 -08:00
Mitchell Stern
271de9b04d
[Dashboard] Remove files used by previous dashboard (#7028) 2020-02-03 11:51:09 -08:00
Tianyi Chen
1c3d5add31
[Java] Fix check style problem. (#7019) 2020-02-03 22:10:38 +08:00
Hao Chen
b53d00b659
[Java] Fix Java test issues (#7000) 2020-02-03 19:21:25 +08:00
Eric Liang
740bd00651
Use 100k for memory limit #7013) 2020-02-02 22:48:59 -08:00
Eric Liang
f939cb39ee
always set it (#7006) 2020-02-02 22:48:29 -08:00
Edward Oakes
77436c2e32
Use getppid() to check if the raylet has failed (#6963) 2020-02-02 22:05:21 -08:00
Richard Liaw
52c33b53f7
[minor][core] fix gpu ids for SLURM (#7014)
* fix gpu ids

* fix
2020-02-02 16:09:22 -08:00
Frank Röder
9d04f6617a
[tune] Align scheduler mode with search algorithm in example of… (#7012) 2020-02-02 15:06:39 -08:00
Philipp Moritz
cc43c9c1a2
Increase limit for autoscaler keys (#7007) 2020-02-01 22:29:40 -08:00
Eric Liang
fbc545c03b
[rllib] Support parallel, parameterized evaluation (#6981)
* eval api

* update

* sync eval filters

* sync fix

* docs

* update

* docs

* update

* link

* nit

* doc updates

* format
2020-02-01 22:12:12 -08:00
Sven Mika
b9ad79d66f
Add cartpole PPO torch to regression (besides tf). (#7005) 2020-02-01 17:41:38 -08:00
Eric Liang
8b4b49662b
Force OMP_NUM_THREADS=1 if unset (#6998)
* force omp

* update

* set

* workers

* link
2020-02-01 11:46:11 -08:00
roireshef
3c60caa448
[rllib] implemented compute_advantages without gae (#6941) 2020-01-31 22:25:45 -08:00
Edward Oakes
92525f35d1
Remove raylet client from Python worker (#6018) 2020-01-31 18:23:01 -08:00
Edward Oakes
341a921d81
Remove vanilla pickle serialization for task arguments (#6948) 2020-01-31 16:52:43 -08:00
Yutai Zhou
9b6794cbb0
[rllib] updated policy definition link (#6989) 2020-01-31 16:22:11 -08:00
Edward Oakes
8f07d21d19
Remove thread sanitizer from CI (#6996) 2020-01-31 14:15:27 -08:00
Jaroslaw Rzepecki
67319bc887
[RLlib] Update MARWIL to use tf policy template (#6975)
* update MARWIL to use tf policy template

* formatting fixes
2020-01-31 12:57:52 -08:00
Edward Oakes
4a78b60cf7
Remove link to meetup RSVP from docs (#6995) 2020-01-31 11:32:50 -08:00
SangBin Cho
c9f5def56a
Show lint download commands if tools not installed (#6984) 2020-01-31 10:42:09 -08:00
Sven Mika
211a9be9a5
[RLlib] Bug fix: PR anneals beta parameter beyond final given value. (#6973)
* Bug fix: PR anneals beta parameter beyond final given value.

* LINT.

* Trigger travis re-test.
2020-01-31 09:55:03 -08:00