Commit graph

4970 commits

Author SHA1 Message Date
Siyuan (Ryans) Zhuang
d7549d6184
Replace arrow::Status with ray::Status in Plasma (#9154)
* add object store status

* replace arrow status with ray status

* cleanup

* remove plasma common.cc
2020-06-26 14:06:34 -07:00
Dean Wampler
b7cc1e78d7
Removed obsolete "detached=True" for detached actor in documentation. (#9158)
* Added small section on installation when using Anaconda. Also fixed an obsolete link to Anaconda.

* Delete more temporary directories when running the doc "make clean".

* Fixed typo in LinearDiscreteEnv docs

* Removed the "detached=True" from the description of detachted actors, because it is now deprecated.

Co-authored-by: Dean Wampler <dean@concurrentthought.com>
2020-06-26 09:47:41 -07:00
Richard Liaw
56d934bc18
[docs] Revised Cluster documentation (#9062)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-26 09:29:22 -07:00
Sven Mika
af1203b9df
[RLlib] Issue 8507 (PyTorch does not support custom loss). (#9142) 2020-06-26 09:52:22 +02:00
Sven Mika
e93a1a82ab
Issue 8407: RNN sequencing error in QMIX (#9139) 2020-06-26 09:50:31 +02:00
Ian Rodney
f940ccd6fb
[autoscaler] Better explain min/max/initial worker settings (#9132) 2020-06-25 20:38:03 -07:00
Ian Rodney
42631c5b87
[autoscaler/docker] Migrate --docker to --run-env (#9001) 2020-06-25 20:37:42 -07:00
mehrdadn
11bda7272b
[windows] Work around msgpack issue on PowerPC64LE (#9140)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-25 20:36:22 -07:00
Stephanie Wang
490cddc250
[core] Refactor distributed ref counting to remove owner task ID (#9049)
* Add intended worker ID to GetObjectStatus, tests

* Remove TaskID owner_id

* lint

* Update message

* lint

* Fix build
2020-06-25 17:55:03 -07:00
krfricke
22ea8dde84
[Tune] Added XGBoost tutorial and template (#9060)
* Added XGBoost tutorial and template

* XGBoost tutorial: Cut some clutter

* Apply suggestions from code review

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Added XGboost logo

* Fixed further references

Co-authored-by: Kai Fricke <kai@anyscale.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-25 15:59:54 -07:00
mehrdadn
ab3413c124
Make process termination more robust (#9081) 2020-06-25 15:30:53 -05:00
Richard Liaw
75e6775b36
[docs] Make Contributions/Building pages more prominent (#9054)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-25 12:38:12 -07:00
mehrdadn
07655036d2
[tune] os.replace() instead of os.rename() for cross-platform (#9141)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-25 12:30:51 -07:00
Xianyang Liu
0bfcc2e5ba
[core] Better support multi-nic environments by respecting user-provided IP (#8512) 2020-06-25 14:03:12 -05:00
Alex Wu
46962f5db1
[Core] Log monitor multidriver (#8953) 2020-06-25 11:05:53 -07:00
Eric Liang
4522038259
[iter] Add .transform() function for arbitrary generator transforms (#8978) 2020-06-25 11:04:14 -07:00
henktillman
0f1d99befc
[autoscaler] Remove Fingerprint checking (#9133) 2020-06-25 10:22:54 -07:00
Sven Mika
4fd8977eaf
[RLlib] Minor cleanup in preparation to tf2.x support. (#9130)
* WIP.

* Fixes.

* LINT.

* Fixes.

* Fixes and LINT.

* WIP.
2020-06-25 19:01:32 +02:00
Edward Oakes
aa3fd62cac
[serve] Add shadow traffic API (#9106) 2020-06-25 10:55:22 -05:00
Eric Liang
536795ef79
[autoscaler] Initial support for multiple worker types (#9096)
* wip

* fix

* update

* debug state

* fix

* update

* update

* fix test

* fix

* fix

* update

* fix

* types and docs

* update
2020-06-24 23:08:30 -07:00
Eric Liang
0ff24ec8dc
Add "ray status" debug tool for autoscaler. (#9091) 2020-06-24 18:22:03 -07:00
Siyuan (Ryans) Zhuang
80bcbe20c7
[Core] Remove object notification IPC between Plasma and Raylet (initial step) (#8939)
* initial refactoring

redirect notifications to eventloop

implement direct notifications

* protect vector with mutex
2020-06-24 13:54:40 -07:00
ElektroChan89
4bc1d7c043
[docs] Update grid_random.rst (#9102) 2020-06-24 12:36:42 -07:00
Ian Rodney
67e049bc7b
[autoscaler/docker] Relax missing docker section (#9105) 2020-06-24 12:35:42 -07:00
mehrdadn
0487c250e8
Windows compatibility (#93)
Co-authored-by: mehrdadn <mehrdadn@users.noreply.github.com>
Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-24 11:27:28 -07:00
SongGuyang
cbf38573bd
C++ worker API refactoring (#9053) 2020-06-24 19:33:46 +08:00
Sven Mika
aa231799ed
Dyna test: small -> medium. (#9118) 2020-06-24 12:02:44 +02:00
Siyuan (Ryans) Zhuang
613abdf1b6
Remove arrow macros in plasma store (#9115) 2020-06-23 23:34:44 -07:00
mehrdadn
98d68b31c3
Suppress GRPC SO_REUSADDR warning on Linux (#7972)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-23 21:58:43 -07:00
Alex Wu
c152730e4a
[Core] Log output from different jobs to different drivers. (#8885)
* .

* .

* Correct now

* No interactivity errors

* format

* Filtering

* lint

* .

* No more filtering

* Removed interactivity

* .

* .

* .

* .

* .

* .

* Redirection works

* formatting

* something broken?

* .

* Works

* formatting

* redirect output

* formatting

* formatting

* Fix file descriptor leakage

* format

* .

* .

* .

* .

* .

* Refactor

* .

* Only run on job switch

* .

* cleanup

* .

* ...

* Review

* .

* .

* .

* .

* whoops

* .

* Should fix bug

* .

* .

* addressed comments

* formatting

* formatting

* Fix typo

* .

* .

* .

* .

Co-authored-by: Ubuntu <ubuntu@ip-172-31-14-33.us-west-2.compute.internal>
2020-06-23 18:45:32 -07:00
henktillman
acb3280235
GCP credentials (#9052) 2020-06-23 17:11:18 -07:00
goulou
9b4428c668
[ASHA][docs] Change default value of "brackets" (#9101)
Closes #9058
2020-06-23 14:43:27 -07:00
Siyuan (Ryans) Zhuang
acb7270bd7
Adopt upstream plasma changes (#9061)
* adopt upstream plasma changes
2020-06-23 14:19:57 -07:00
Amog Kamsetty
649a08926d
Fix link to serve (#9109) 2020-06-23 16:06:24 -05:00
Max Fitton
7904235517
Node Info Functional Components (#9073) 2020-06-23 13:11:32 -07:00
Tanay Wakhare
f77c638d6d
Pytorch AttentionNet (#9088) 2020-06-23 20:42:30 +02:00
Edward Oakes
c9010eb8ad
[serve] Add serve.shutdown() (#8766) 2020-06-23 13:42:03 -05:00
Simon Mo
b6d425526d
Move actor task submission to io service (#9093) 2020-06-23 10:07:33 -07:00
Siyuan (Ryans) Zhuang
306ca75737
Fix ray arrow logs (#9097)
* convert arrow logs to ray logs

* remove extra plasma tests and modules
2020-06-23 10:02:30 -07:00
Michael Luo
cf0894d396
[rllib] MAML Agent (#8862)
* Halfway done with transferring MAML to new Ray

* MAML Beta Out

* Debugging MAML atm

* Distributed Execution

* Pendulum Mass Working

* All experiments complete

* Cleaned up codebase

* Travis CI

* Travis CI

* Tests

* Merged conflicts

* Fixed variance bug conflict

* Comment resolved

* Apply suggestions from code review

fixed test_maml

* Update rllib/agents/maml/tests/test_maml.py

* asdf

* Fix testing

Co-authored-by: Sven Mika <sven@anyscale.io>
2020-06-23 09:48:23 -07:00
Xianyang Liu
b449ece2ea
[SGD] Variable worker CPU requirements (#8963) 2020-06-23 00:43:27 -07:00
chaokunyang
acd765cb22
[Streaming] fix source loop (#9085) 2020-06-23 11:57:06 +08:00
Zhilei Chen
8f2564f1a6
fix a bug that move a const variable (#9080) 2020-06-23 11:54:18 +08:00
Alex Wu
40c15b1ba0
[ParallelIterator] Fix for_each concurrent test cases/bugs (#8964)
* Everything works

* Update python/ray/util/iter.py

Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>

* .

* .

* removed print statements

Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-06-22 18:26:45 -07:00
Edward Oakes
b88059326d
[docs] Rotate serve to top of sidebar (#9090) 2020-06-22 17:52:11 -07:00
Richard Liaw
e2330ffc35
[sgd] Cleanup code from last PR (#9076) 2020-06-22 15:17:07 -07:00
Ian Rodney
f76552d8db
[autoscaler] Expose cache_stopped_nodes in Example YAML (#8981) 2020-06-22 15:02:45 -07:00
Ian Rodney
b942bcd798
[Tune] remove whitelist from deep_copy (#8997) 2020-06-22 15:02:27 -07:00
Amog Kamsetty
f95ab4f506
[Testing] Multi-node Training+Tune Long Running Test (#8966) 2020-06-22 14:49:16 -07:00
Siyuan (Ryans) Zhuang
7a110b9401
[Core] Remove digests in plasma (4x performance improvement) (#8980)
* remove digest in plasma

* totally remove list
2020-06-22 14:24:32 -07:00