Commit graph

39 commits

Author SHA1 Message Date
Philipp Moritz
62de86ff7a fix redis module build dependencies (#2247) 2018-06-13 10:18:09 -07:00
Stephanie Wang
cb5e6e6d68 Add dependency between copy_ray and python extensions (#2221) 2018-06-08 20:41:54 -07:00
songqing
4dd4698564 unify build dir for Python and Java (#2171)
* unify build dir for Python and Java

* enable executables auto installed when just running 'make'

* fix plasma_store copy error

* fix cmake error about copying executables

* lint fix

* recover python/setup.py

* enable to copy optional file automatically

* a small fix of path

* lint fix

* lint fix

* lint fix

* Add comment.
2018-06-01 16:28:27 -07:00
Yujie Liu
5918776dd4 [JavaWorker] Changes to the build system for support java worker (#2092)
* Changes to the build system for support java worker
--------------------------
This commit includes changes to the build system, which is part of the java worker support of Ray.
It consists of the following changes:
 - the changes of CMakeLists.txt files
 - the changes of the python setup.py and init files for the adaptation of the changed build system
 - move the location of local_scheduler_extension.cc for the adaptation of the changed build system which maybe better support multi-language worker

* minor whitespace

* Linting
2018-05-18 19:09:23 -07:00
Zhenyu Guo
f1e5789c26 restructure how to organize 3rd party libs (#1630)
* restructure how to organize 3rd party libs

* Minor whitespace changes.

* Fix compilation on Linux.

* Pass around Python executable so that the correct version of Python is used.
2018-03-01 14:29:56 -08:00
Philipp Moritz
a3f8fa426b Start integrating new GCS APIs (#1379)
* Start integrating new GCS calls

* fixes

* tests

* cleanup

* cleanup and valgrind fix

* update tests

* fix valgrind

* fix more valgrind

* fixes

* add separate tests for GCS

* fix linting

* update tests

* cleanup

* fix python linting

* more fixes

* fix linting

* add plasma manager callback

* add some documentation

* fix linting

* fix linting

* fixes

* update

* fix linting

* fix

* add spillback count

* fixes

* linting

* fixes

* fix linting

* fix

* fix

* fix
2018-01-31 11:01:12 -08:00
Philipp Moritz
3d224c4edf Second Part of Internal API Refactor (#1326) 2017-12-26 16:22:04 -08:00
Philipp Moritz
cac5f47600 First Part of Internal Ray API Refactor (#1173)
* add Ray status class

* add C++ util files

* add ID types

* more APIs

* build system integration

* add test infrastructure and implement some APIs

* add more tests

* fix bugs

* add task table tests

* update

* add toolchain file

* fix

* test

* link with pthread

* update

* fix

* more fixes

* fixes

* always vendor gtest and gflags

* linting

* fixes

* add constants file

* comments

* more fixes

* fix linting
2017-12-14 14:54:09 -08:00
Philipp Moritz
7030ef366f Rebase Ray on latest arrow (remove numbuf from Ray). (#910)
* remove some stuff

* put get roundtrip working

* fixes

* more fixes

* cleanup

* fix tests

* latest arrow

* fixes

* fix tests

* fix linting

* rebase

* fixes

* fix bug

* bring back libgcc error

* fix linting

* use official arrow repo

* fixes
2017-09-04 22:58:49 -07:00
Philipp Moritz
054ae4180e Fix installation instruction for ubuntu 14.04 (#805)
* fix installation instruction for ubuntu 14.04

* upgrade cmake requirements

* fix
2017-08-02 18:14:14 -07:00
Philipp Moritz
c3b39b4d86 Pull Plasma from Apache Arrow and remove Plasma store from Ray. (#692)
* Rebase Ray on top of Plasma in Apache Arrow

* add thirdparty building scripts

* use rebased arrow

* fix

* fix build

* fix python visibility

* comment out C tests for now

* fix multithreading

* fix

* reduce logging

* fix plasma manager multithreading

* make sure old and new object IDs can coexist peacefully

* more rebasing

* update

* fixes

* fix

* install pyarrow

* install cython

* fix

* install newer cmake

* fix

* rebase on top of latest arrow

* getting runtest.py run locally (needed to comment out a test for that to work)

* work on plasma tests

* more fixes

* fix local scheduler tests

* fix global scheduler test

* more fixes

* fix python 3 bytes vs string

* fix manager tests valgrind

* fix documentation building

* fix linting

* fix c++ linting

* fix linting

* add tests back in

* Install without sudo.

* Set PKG_CONFIG_PATH in build.sh so that Ray can find plasma.

* Install pkg-config

* Link -lpthread, note that find_package(Threads) doesn't seem to work reliably.

* Comment in testGPUIDs in runtest.py.

* Set PKG_CONFIG_PATH when building pyarrow.

* Pull apache/arrow and not pcmoritz/arrow.

* Fix installation in docker image.

* adapt to changes of the plasma api

* Fix installation of pyarrow module.

* Fix linting.

* Use correct python executable to build pyarrow.
2017-07-31 21:04:15 -07:00
Robert Nishihara
1ae7e7d29e Rename photon -> local scheduler. (#322) 2017-02-27 12:24:07 -08:00
Philipp Moritz
a708e36225 Switch build system to use CMake completely. (#200)
* switch to CMake completely

...

* cleanup

* Run C tests, update installation instructions.
2017-01-17 16:56:40 -08:00
Robert Nishihara
072f442c1f Update worker.py and services.py to use plasma and the local scheduler. (#19)
* Update worker code and services code to use plasma and the local scheduler.

* Cleanups.

* Fix bug in which threads were started before the worker mode was set. This caused remote functions to be defined on workers before the worker knew it was in WORKER_MODE.

* Fix bug in install-dependencies.sh.

* Lengthen timeout in failure_test.py.

* Cleanups.

* Cleanup services.start_ray_local.

* Clean up random name generation.

* Cleanups.
2016-11-02 00:39:35 -07:00
Stephanie Wang
b6872182bf Add hiredis to build (#395)
* Add hiredis to build

* make hiredis build if ray has been cloned before this commit
2016-09-01 20:15:00 -07:00
Philipp Moritz
5591aa4665 cleanup serialization code (#291) 2016-07-25 15:47:10 -07:00
Philipp Moritz
4a0f35b042 new arrow serialization code (serialize python objects recursively) (#284) 2016-07-25 13:41:47 -07:00
Robert Nishihara
1133315746 help cmake find right python interpreter on mac (#251) 2016-07-11 12:16:10 -07:00
Johann Schleier-Smith
474dd8b449 reorder includes to fix version conflicts (#250)
Thanks for the changes!
2016-07-10 14:50:34 -07:00
mehrdadn
cd92a8d787 Remove boost::filesystem dependency (#245) 2016-07-10 09:48:56 -07:00
Robert Nishihara
1138936fce help cmake find correct version of python on mac os x (#237) 2016-07-08 16:31:21 -07:00
Philipp Moritz
7af0f1b221 Write computation graph to file 2016-06-27 12:20:30 -07:00
Robert Nishihara
3bf5ed9a91 use correct verison of Python on Mac OS X (#167) 2016-06-25 15:40:01 -07:00
Philipp Moritz
912fd5cc81 Write logs to files instead of printing them to stdout 2016-06-19 12:45:34 -07:00
Philipp Moritz
51581308fd integrate numbuf into tree and remove ftruncate to prepare windows port 2016-06-18 12:00:17 -07:00
Robert Nishihara
4cc024ae36 renaming project, halo -> ray (#95) 2016-06-10 14:12:15 -07:00
Philipp Moritz
12ca2d4422 link libraries statically and make halo work on Mac OS X 2016-06-10 13:16:07 -07:00
Robert Nishihara
67086f663e change filenames and directory structure to use halo (#81) 2016-06-03 18:32:57 -07:00
Robert Nishihara
6d97c55299 add computation graph (#75) 2016-06-02 16:35:46 -07:00
Philipp Moritz
e2509a044c Build script for installing photon 2016-05-16 09:29:50 -07:00
Philipp Moritz
8d0c3be28f implement serialization using numbuf 2016-04-26 15:14:04 -07:00
Philipp Moritz
f5147d8e59 arrow integration for ndarrays 2016-04-05 00:57:14 -07:00
Philipp Moritz
dd88bae487 implement event based object store 2016-03-17 22:32:31 -07:00
Robert Nishihara
08a7e4d450 implementing worker.py and miscellaneous changes 2016-03-10 12:40:05 -08:00
Philipp Moritz
f47bad3828 switching from Cython to Python C API 2016-03-10 12:35:31 -08:00
Philipp Moritz
3ebf8b0699 clean up, mainly the scheduler 2016-03-02 15:23:11 -08:00
Philipp Moritz
743f843524 before refactoring 2016-03-01 01:02:08 -08:00
Robert Nishihara
98c066e822 install on mac osx 2016-02-22 17:35:03 -08:00
Philipp Moritz
5da148c1ab getting the object store working 2016-02-22 13:55:06 -08:00