Jug is a task-based parallelism framework. Jug allows you to write code that is broken up into tasks and run different tasks on different processors. It uses the filesystem to communicate between processes and works correctly over NFS, so you can coordinate processes on different machines. Jug is a pure Python implementation and should work on any platform that can run Python.
|Tags||Python parallel programming mapreduce python3|
|Operating Systems||Unix OS Independent|
Release Notes: This is a bugfix release. It fixes save/load of numpy subclasses, redis URL parsing, and correct handling of the case where sqlite3 is not available. Also included is support for newer versions of Ipython.
Release Notes: This release adds provenance tracking. jug is now able to output metadata on the computation results (including all dependencies).
Release Notes: This version adds Python 3 support and a debug mode (in which execution is slower, as jug executes more checks for possible bugs in the user's script).
Release Notes: This release includes use of Ipython debugger (by Alex Ford), faster Tasklets and unloading, better error messages, and the new currymap function.
Release Notes: This version fixes a few bugs with caching of status and CompoundTasks. Jug now works correctly on new versions of Python (with the random hash fix). This version adds --cache --clear suboption to status and regular expression support to invalidate.