2014-09-05 23:33:55 +02:00
|
|
|
jobmanager
|
|
|
|
==========
|
2015-04-26 16:01:07 +02:00
|
|
|
[](https://pypi.python.org/pypi/jobmanager)
|
|
|
|
[](https://travis-ci.org/cimatosa/jobmanager)
|
2016-09-29 00:47:56 +02:00
|
|
|
[](https://codecov.io/gh/cimatosa/jobmanager)
|
2015-04-26 16:01:07 +02:00
|
|
|
|
2014-09-05 23:33:55 +02:00
|
|
|
|
2014-12-22 20:14:46 +01:00
|
|
|
Easy distributed computing based on the python class SyncManager for remote communication and python module multiprocessing for local parallelism.
|
2014-12-22 18:56:36 +01:00
|
|
|
|
2015-04-03 09:37:21 +02:00
|
|
|
### Documentation
|
|
|
|
The documentation is available at http://cimatosa.github.io/jobmanager/
|
|
|
|
|
2016-09-28 11:28:31 +02:00
|
|
|
### TODO
|
|
|
|
* timeout for client
|
|
|
|
* single proxy for client and queue for subprocesses
|
2016-09-28 15:31:54 +02:00
|
|
|
* user signal to server to retrieve status
|
2016-09-29 15:15:59 +02:00
|
|
|
|
|
|
|
### known Problems
|
2016-09-28 11:28:31 +02:00
|
|
|
|
2016-09-29 15:15:59 +02:00
|
|
|
#### Python2.7
|
|
|
|
* regular shutdown takes very long -> travis tests cancel due to timeout
|
|
|
|
#### Python3.4
|
|
|
|
* some tests result in `segmentation fault (core dumped)`, nonetheless they pass
|
2016-09-28 11:28:31 +02:00
|
|
|
|
2016-09-29 15:15:59 +02:00
|
|
|
Therefore it is highly encouraged to use Python3.5 (and probably higher).
|
|
|
|
|
|
|
|
### Developer's note (out of date)
|
2014-12-22 20:14:46 +01:00
|
|
|
After cloning into jobmanager, create a virtual environment
|
2014-12-22 18:56:36 +01:00
|
|
|
|
2014-12-22 20:14:46 +01:00
|
|
|
virtualenv --system-site-packages ve_jm
|
|
|
|
source ve_jm/bin/activate
|
|
|
|
|
2015-01-21 13:49:51 +01:00
|
|
|
Install all dependencies
|
|
|
|
|
2015-01-26 15:55:14 +01:00
|
|
|
python setup.py develop
|
2015-01-21 13:49:51 +01:00
|
|
|
|
|
|
|
Running an example
|
2014-12-22 20:14:46 +01:00
|
|
|
|
|
|
|
python examples/simple_example.py
|
2016-09-28 11:28:31 +02:00
|
|
|
|
2015-01-21 13:49:51 +01:00
|
|
|
Running tests
|
|
|
|
|
2015-01-24 11:57:10 +01:00
|
|
|
python setup.py test
|