Barak Michener
21994c594b
python/test: Faster tests and better BUILD ( #9791 )
2020-08-06 10:58:42 -07:00
chaokunyang
5aba53e9b2
[dist] Fix travis deploy for java dist ( #9768 )
2020-07-30 10:59:11 +08:00
mehrdadn
fb5280f21b
Fix some Windows CI issues ( #9708 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-28 18:10:23 -07:00
SangBin Cho
423dc96cc4
Revert "[dist] swap mac/linux wheel build order ( #9746 )" and "Fix package and upload ray jar ( #9742 )" ( #9758 )
...
* Revert "[dist] swap mac/linux wheel build order (#9746 )"
This reverts commit a9340565ff
.
* Revert "Fix package and upload ray jar (#9742 )"
This reverts commit c290c308fe
.
2020-07-28 15:34:29 -07:00
chaokunyang
c290c308fe
Fix package and upload ray jar ( #9742 )
2020-07-28 11:53:25 +08:00
Simon Mo
7740136b93
Revert "Package and upload ray cross-platform jar ( #9540 )" ( #9730 )
...
This reverts commit 881032593d
.
2020-07-27 10:40:21 -07:00
chaokunyang
881032593d
Package and upload ray cross-platform jar ( #9540 )
2020-07-27 17:20:20 +08:00
Siyuan (Ryans) Zhuang
54a0d8b69e
[Core] Try remove all windows compat shims ( #9671 )
...
* try remove compat for arrow
* remove unistd.h
* remove socket compat
* delete arrow windows patch
2020-07-25 12:00:36 -07:00
SangBin Cho
d49b19c24c
[Stats] Improve Stats::Init & Add it to GCS server ( #9563 )
2020-07-25 10:42:08 -07:00
mehrdadn
980ade01c8
Rename path variable due to zsh conflict ( #9610 )
2020-07-21 10:17:50 -07:00
mehrdadn
2554a1a997
Bazel fixes ( #9519 )
2020-07-19 12:53:08 -07:00
mehrdadn
37942ea1e7
Windows cleanup ( #9508 )
...
* Remove unneeded code for Windows
* Get rid of usleep()
* Make platform_shims includes non-transitive
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-17 02:08:15 -07:00
mehrdadn
3d65682e62
Bazel selects compiler flags based on compiler ( #9313 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-13 15:31:46 -07:00
mehrdadn
5c853eaa6a
Fix copy to workspace ( #9400 )
2020-07-11 14:27:56 +02:00
mehrdadn
dd2cc6eb48
Update hiredis and remove Windows patches ( #9289 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-09 18:45:44 -07:00
mehrdadn
b6c11f3dd7
Bazel move more shell to native rules ( #9314 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-09 09:02:35 -07:00
Lingxuan Zuo
0562236533
[Stats] Make aggeration window and report interval configurable. ( #9235 )
2020-07-09 12:44:38 +08:00
mehrdadn
7135cb2aec
Fix .exe file extensions ( #9197 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-02 15:29:34 -05:00
mehrdadn
29acf272b7
Build with Visual C++ ( #9190 )
...
Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Simon Mo <xmo@berkeley.edu>
2020-07-02 09:34:24 -07:00
mehrdadn
79c4c67ed9
Split hiredis from Redis and use it directly ( #9176 )
...
* Split hiredis from Redis and use it directly
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-29 18:16:32 -07:00
mehrdadn
e060d99c6e
Bazel: strip_prefix=True should strip leading 'v' ( #9175 )
...
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-29 11:27:56 -07:00
mehrdadn
07637e5b5b
Upgrade Bazel and add required patches ( #8847 )
2020-06-12 14:59:22 -05:00
mehrdadn
d78757623d
bazel build --compilation_mode=debug ( #6457 )
2020-06-05 14:36:10 +02:00
Siyuan (Ryans) Zhuang
ea05ebe89e
Ship plasma store with Ray ( #7901 )
2020-06-03 17:44:34 -07:00
Simon Mo
a8e4ddbd57
Update Redis to 5.0.9 ( #8722 )
2020-06-02 14:10:07 -07:00
mehrdadn
ebf060d484
Make more tests run on Windows ( #8446 )
...
* Remove worker Wait() call due to SIGCHLD being ignored
* Port _pid_alive to Windows
* Show PID as well as TID in glog
* Update TensorFlow version for Python 3.8 on Windows
* Handle missing Pillow on Windows
* Work around dm-tree PermissionError on Windows
* Fix some lint errors on Windows with Python 3.8
* Simplify torch requirements
* Quiet git clean
* Handle finalizer issues
* Exit with the signal number
* Get rid of wget
* Fix some Windows compatibility issues with tests
Co-authored-by: Mehrdad <noreply@github.com>
2020-05-20 12:25:04 -07:00
mehrdadn
4bdef78e2e
Various CI fixes and cleanup ( #8289 )
2020-05-05 10:47:49 -07:00
Qing Wang
98bfcd53bc
[Java] Rename group id and package name. ( #7864 )
...
* Initial
* Change streaming's
* Fix
* Fix
* Fix org_ray
* Fix cpp file name
* Fix streaming
* Fix
* Fix
* Fix testlistening
* Fix missing sth in python
* Fix
* Fix
* Fix SPI
* Fix
* Fix complation
* Fix
* Fix CI
* Fix checkstyle
Fix checkstyle
* Fix streaming tests
* Fix streaming CI
* Fix streaming checkstyle.
* Fix build
* Fix bazel dep
* Fix
* Fix ray checkstyle
* Fix streaming checkstyle
* Fix bazel checkstyle
2020-04-12 17:59:34 +08:00
acxz
11c2b500b8
[bazel] Remove deprecated and now non-existent flag ( #7886 )
2020-04-03 22:36:01 -07:00
mehrdadn
65054a2c7c
Python 3.8 compatibility ( #7754 )
2020-04-01 10:03:23 -07:00
mehrdadn
f86e623095
Fix & improve GitHub Actions CI builds ( #7784 )
2020-03-30 16:29:54 -07:00
SongGuyang
c195dc8f88
Basic C++ worker implementation ( #6125 )
2020-03-27 23:01:08 +08:00
mehrdadn
b4030cdbbe
File HANDLE/descriptor translation layer for Windows ( #7657 )
...
* Use TCP sockets on Windows with custom HANDLE <-> FD translation layer
* Get Plasma working on Windows
Co-authored-by: Mehrdad <noreply@github.com>
2020-03-23 21:08:25 -07:00
Stephanie Wang
53549314c5
[core] Option to fallback to LRU on OutOfMemory ( #7410 )
...
* Add a test for LRU fallback
* Update error message
* Upgrade arrow to master
* Integrate with arrow
* Revert "Bazel mirrors (#7385 )"
This reverts commit 44aded5272
.
* Don't LRU evict
* Revert "Revert "Bazel mirrors (#7385 )""
This reverts commit b6359fea78d1bd3925452ca88ac71e0c9e5c7dd3.
* Add lru_evict flag
* fix internal config
* Fix
* upgrade arrow
* debug
* Set free period in config for lru_evict, override max retries to fix
test
* Fix test?
* fix test
* Revert "debug"
This reverts commit 98f01c63a267f38218f5047b1866e4c1c8280017.
* fix exception str
* Fix ref count test
* Shorten travis test?
2020-03-14 11:28:43 -07:00
mehrdadn
fc76586518
Redis on Windows ( #7509 )
...
* Switch hiredis on Windows to that of the Windows port of Redis
* Use boost::asio::ip::tcp::socket::native_handle_type
* Use normal hiredis instead of Windows-specific one
* Finish up using normal hiredis
Co-authored-by: Mehrdad <noreply@github.com>
2020-03-09 18:49:54 -07:00
Stephanie Wang
95bb0c5357
Upgrade plasma to latest version, use synchronous Seal ( #7470 )
...
* Upgrade arrow to master
* fix build
* todo
* lint
* Fix hanging test
2020-03-09 10:30:44 -07:00
mehrdadn
44aded5272
Bazel mirrors ( #7385 )
...
* Switch to mirrors.bazel.build where possible
* Switch from .zip to .tar.gz for smaller downloads (it's also the default download on UNIX)
* Use direct GitHub URLs in Bazel files for clarity
* Don't pass patches to local_repository
* Remove github_repository()
* Switch to GitHub actions/checkout@v2 which is faster
* Use faster extraction method for LLVm on Windows
* Move LLVM_VERSION_WINDOWS to the shell script since it's not a CI-specific value
* Change GITHUB_TOKEN to GITHUB
* Don't show timestamps for GitHub Actions
* Factor out some options from GitHub Actions
* Tell Bazel to stay on the same volume in GitHun Actions
* Display progress output when downloading toolchains
Co-authored-by: GitHub Web Flow <noreply@github.com>
2020-03-01 14:04:06 -08:00
mehrdadn
5fb5be0ba5
Some bug fixes for Windows ( #7374 )
...
* Fix MAP_SHARED check in sys/mman.h
* Fix missing :platform_shims dependency for ray_util
* dlmalloc patch for Arrow
2020-02-28 10:22:32 -08:00
mehrdadn
0efaa9b310
Use Redis for Windows ( #7364 )
2020-02-28 10:18:56 -08:00
mehrdadn
57b33f1bed
Upgrade Boost ( #6899 )
2020-02-25 14:33:12 -08:00
mehrdadn
b97b8c2be1
Fix github_repository(path=...) accidentally requiring other fields that shouldn't be necessary ( #7275 )
...
Co-authored-by: GitHub Web Flow <noreply@github.com>
2020-02-24 11:39:08 -08:00
mehrdadn
bde575b8dd
Revert "Use Boost.Process instead of pid_t ( #6510 )" ( #6909 )
...
This reverts commit fb8e3615d5
.
2020-01-26 10:26:44 -06:00
mehrdadn
fb8e3615d5
Use Boost.Process instead of pid_t ( #6510 )
...
* Use Boost.Process instead of pid_t
This will let us handle child processes (mostly) uniformly across platforms.
TODO: There is no SIGTERM on Windows; achieving something equivalent is fairly involved.
2020-01-15 20:05:02 -08:00
Chaokun Yang
7bbfa85c66
[Streaming] Streaming data transfer java ( #6474 )
2019-12-22 10:56:05 +08:00
mehrdadn
f06d7422db
Improve handling and caching of GitHub repository archives ( #6526 )
...
* Use GitHub mirror to allow caching BoringSSL
* Add archive suffix as an optional parameter
2019-12-20 17:22:35 -08:00
mehrdadn
b0b6b56bb7
Platform shims for Windows ( #6548 )
...
* Platform shims for Windows
* Satisfy linter
2019-12-20 12:32:07 -08:00
mehrdadn
1e817f48df
Fix Arrow and Windows linking issues in Bazel ( #6546 )
...
* Fix Windows system library dependencies in Boost rules
* Fix missing utf8cpp source and header files in arrow target
2019-12-20 11:53:20 -08:00
mehrdadn
ab5a9f0946
Patch hiredis for Windows ( #6446 )
2019-12-17 15:32:47 -08:00
mehrdadn
7a24144bfd
Polish Bazel build scripts ( #6424 )
...
* Polish Bazel build scripts
* Remove glog references from streaming_logging.cc
* Move out COPTS and reference them
* Disable streaming on Windows
* Remove -fno-gnu-unique
2019-12-17 02:38:36 -08:00
mehrdadn
9d6e03aba0
Fix use of select() instead of poll() ( #6477 )
...
* Fix Arrow poll() patch
- Negative timeout for poll() was not translated to infinite timeout for select()
- Only use select() on Windows, as other systems limit the range of the file descriptors
* Apply poll() -> select() patch to Redis's ae.c as well
2019-12-17 02:33:37 -08:00