hiro/jobmanager
1
0
Fork 0
mirror of https://github.com/vale981/jobmanager synced 2025-03-05 18:01:38 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
No description
160 commits 4 branches 1 tag 2 MiB
Python 99.3%
Shell 0.6%
Find a file
Richard Hartmann 59693bad8b Merge branch 'cima_working' (still an intermediate step, but some new features needed to be transferred to master) 
main new features:
  - a new decorator ProgressBarExtended class (see ec23d5d)
  - intermediate stopping of the progressBar loop, may make_sure_its_down, which will ensure
    that the loop has stopped -> this allows for clean printing inbetween
  - extended PersistentDataStructure (clear, show_stat, ... are the main things)
  - PersistentDataServer now expects that each arg (which must be named tuple now) has a member id
    which is used a key for the sql db -> faster look up that using big binay chunks

some bugs remove

some steps toward python2.7 compatibility
2015-01-29 20:59:24 +01:00
doc working pypi setup files. 2014-12-22 18:39:55 +01:00
examples added example using FunctionCall_Client, which enabled to pass the function to call in parallel via const_arg of the jobmanagerServer 2015-01-07 15:02:08 +01:00
jobmanager new progress decorator, 1) (de)activate with kwargs in function call 2) gives access to the progressBar instance -> allows for stop to do clean printing -- and tests for that 2015-01-29 20:58:36 +01:00
tests new progress decorator, 1) (de)activate with kwargs in function call 2) gives access to the progressBar instance -> allows for stop to do clean printing -- and tests for that 2015-01-29 20:58:36 +01:00
.gitignore gitignore update 2015-01-21 19:06:00 +01:00
LICENSE copy from jobmanager bakup 2014-09-05 23:33:55 +02:00
MANIFEST.in These are the promised setup files. 2014-12-22 20:16:22 +01:00
README.md fixed typo in README.md and added more precise info to setup.py 2015-01-26 15:57:22 +01:00
setup.cfg These are the promised setup files. 2014-12-22 20:16:22 +01:00
setup.py Update setup.py 2015-01-29 10:19:02 +01:00

README.md

jobmanager

Easy distributed computing based on the python class SyncManager for remote communication and python module multiprocessing for local parallelism.

Developer's note

After cloning into jobmanager, create a virtual environment

virtualenv --system-site-packages ve_jm
source ve_jm/bin/activate

Install all dependencies

python setup.py develop

Running an example

python examples/simple_example.py

Running tests

python setup.py test