hiro/jobmanager
1
0
Fork 0
mirror of https://github.com/vale981/jobmanager synced 2025-03-06 02:11:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
161 commits 4 branches 1 tag 2 MiB
Commit graph

161 commits

This branch
This branch
All branches
Author SHA1 Message Date
Richard Hartmann
3c652e304b pop kwargs that are None from the kwargs dict, before passing is to set_integrator 2015-02-04 14:00:28 +01:00
Richard Hartmann
59693bad8b Merge branch 'cima_working' (still an intermediate step, but some new features needed to be transferred to master) 
main new features:
  - a new decorator ProgressBarExtended class (see ec23d5d)
  - intermediate stopping of the progressBar loop, may make_sure_its_down, which will ensure
    that the loop has stopped -> this allows for clean printing inbetween
  - extended PersistentDataStructure (clear, show_stat, ... are the main things)
  - PersistentDataServer now expects that each arg (which must be named tuple now) has a member id
    which is used a key for the sql db -> faster look up that using big binay chunks

some bugs remove

some steps toward python2.7 compatibility
 2015-01-29 20:59:24 +01:00
Richard Hartmann
ec23d5d168 new progress decorator, 1) (de)activate with kwargs in function call 2) gives access to the progressBar instance -> allows for stop to do clean printing -- and tests for that 2015-01-29 20:58:36 +01:00
Richard Hartmann
3179cc27ec test 'not in' for persistentDataStruture 2015-01-29 14:12:03 +01:00
Richard Hartmann
a81f15deb3 use special id flag store data via persistentData_Server, made merge_arg_and_const_arg work with new 'id' used by PersistentData_Server 2015-01-29 14:11:22 +01:00
Paul Müller
3a5432e4a5 Update setup.py 2015-01-29 10:19:02 +01:00
Richard Hartmann
fa17cefe97 test_progress, reduce change to get hang up. tested with 2.7 and 3.4 2015-01-29 00:01:40 +01:00
Richard Hartmann
bb605418d8 added PDS.clear() to remove all data from the database, and some tests for that 2015-01-28 22:45:41 +01:00
Richard Hartmann
73eeb26233 Merge branch 'master' of https://github.com/cimatosa/jobmanager into cima_working 2015-01-28 21:04:09 +01:00
Richard Hartmann
cf35c0d69c moved dict conversion to merge_arg_and_const_arg, to this functions can now handle dict_like data from named tuple 2015-01-28 15:41:43 +01:00
Richard Hartmann
e18320e0b8 minor bugfixes in PDS 2015-01-27 19:48:14 +01:00
Richard Hartmann
3a8ffe62ea minor advances in show PDS stats 2015-01-27 19:15:36 +01:00
Richard Hartmann
0030b7c8bb push to tqo 2015-01-27 18:54:09 +01:00
Richard Hartmann
5759b6c698 minor bugfix to push to tqo 2015-01-27 18:43:51 +01:00
Richard Hartmann
83b3ab106d minor bugfix to push to tqo 2015-01-27 18:40:22 +01:00
Richard Hartmann
3416e3b393 added status function for persistentDataStructure 2015-01-27 18:37:16 +01:00
Richard Hartmann
8270166b91 added verbose info for persistentDataServer in case of overwrite = True 2015-01-27 18:36:53 +01:00
Paul Müller
e2b050f942 shout -> shut 2015-01-27 14:30:16 +01:00
Richard Hartmann
9fca527563 added sub_data check as public member to PeristentDataStructure 2015-01-27 13:57:27 +01:00
Richard Hartmann
e10a28ce4c moved test_decorator.py to tests (like all others 2015-01-27 13:56:24 +01:00
Richard Hartmann
808d81e07e Merge branch 'master' into cima_working 2015-01-27 13:22:28 +01:00
Paul Müller
87c78b33c2 Merge pull request #12 from cimatosa/new_decorator 
New decorator
 2015-01-27 10:55:50 +01:00
Paul Müller
405c49fcd2 Merge branch 'master' into new_decorator 
Conflicts:
	jobmanager/progress.py
 2015-01-27 10:55:15 +01:00
Paul Müller
37bf6e5737 Added override_count=False keyword to jobmanager.decorators.decorate_module_ProgressBar to enable switching to jobmanager.decorators.ProgressBarOverrideCount. 2015-01-27 08:19:57 +01:00
Richard Hartmann
7c9323636a Merge branch 'new_decorator' into cima_working 2015-01-27 00:44:54 +01:00
Richard Hartmann
de29ceedb6 new decorator class ProgressBarOverrideCount which follows #12, including a test example 2015-01-27 00:39:31 +01:00
Richard Hartmann
ca3976749e added more transparent coloring of the status info, not yet to be set by user 2015-01-27 00:37:27 +01:00
Richard Hartmann
49ffa49d9c Merge branch 'new_decorator' into cima_working 2015-01-26 21:37:11 +01:00
Richard Hartmann
5fa703b579 Merge branch 'master' into cima_working 2015-01-26 21:33:19 +01:00
cimatosa
b02806d951 fixed typo in README.md and added more precise info to setup.py 2015-01-26 15:57:22 +01:00
Paul Müller
44e44971f7 Update README.md 2015-01-24 11:57:10 +01:00
cimatosa
f54eb0c447 some changed to make the test run with python2.7, and some more tests, still not done jet 2015-01-23 15:15:18 +01:00
cimatosa
643197eef7 fixed typo in jobmanager.py and added some debug info -> still neede because there is some touble with python2.7 and multiprocessing 2015-01-23 15:13:38 +01:00
cimatosa
01e589bd02 fixed bug in merge_arg_... when there is no 'args' at all, which is also valid as args beeing an empty tuple 2015-01-23 15:11:38 +01:00
cimatosa
7f3411b4ea some intermed state 2015-01-22 15:27:13 +01:00
Paul Müller
4a747ac9e6 moved script to new tests folder 2015-01-21 19:42:20 +01:00
Paul Müller
91395ac5d4 "python setup.py test" now works 2015-01-21 19:42:20 +01:00
Paul Müller
050a108e83 Update README.md 2015-01-21 19:14:11 +01:00
Paul Müller
065b00154e gitignore update 2015-01-21 19:06:00 +01:00
Paul Müller
5a0dc656a2 - added runtests.py (blob of pytest) 
- html output with aha uses runtests.py
- renamed test directory
 2015-01-21 19:06:00 +01:00
cimatosa
48831754f8 catch persistentData import Error when sqlitedict is not there 2015-01-21 15:03:46 +01:00
cimatosa
937617de75 minor changes to run the teste for the new_decorator branch using python2.7 and python3.4 2015-01-21 14:48:52 +01:00
cimatosa
913bf22be4 added test_servers.py 2015-01-21 14:31:45 +01:00
cimatosa
ce2ccfb41b better error message when the number of subprocesses spawned by the client in non positive, some comments in the code 2015-01-21 14:30:54 +01:00
cimatosa
3594d67c12 minor change to make python 3.4 compatible. Changed default behavior of progressBar decorator. The functions to be decorated NEEDS (c,m) in their definition. made it also possible to call the decorated functions with c or/and m as positional agruments. Added test for that, moved existing tests to test/test_decorators.py. This closes #11 2015-01-21 14:27:42 +01:00
cimatosa
0301665936 fixed some errors in PersistentDataStructur 2015-01-20 17:12:09 +01:00
cimatosa
6c78fc07cb Merge branch 'cima_working' 2015-01-19 17:50:38 +01:00
cimatosa
f9edd904c0 persistent Data can now assign other persistentDataStructures as values, testing for that included 2015-01-19 17:40:25 +01:00
Richard Hartmann
5b5e6eac9d made const_arg beeing copied from client (seems more robust), fixed some trouble with catching 'Addresse in use error' 2015-01-15 16:17:58 +01:00
cimatosa
ba967893f7 intermed work on const_arg copy vs shared, handling port used Error, some highlighting 2015-01-14 15:07:01 +01:00