ndcctools.work_queue Namespace Reference

Data Structures

class  Factory
class  PythonTask
class  PythonTaskNoResult
class  RemoteTask
class  Task
class  WorkQueue
 Python Work Queue object. More...

Detailed Description

Work Queue distributed task execution framework - Python interface.

The Work Queue system provides a distributed task execution framework for high throughput applications consisting of millions of tasks running on thousands of workers. This Python interface allows for the creation of manager applications that define, submit, monitor, and collect tasks. The objects and methods provided by this package correspond to the native C API in work_queue.h.

The SWIG-based Python bindings provide a higher-level interface that revolves around the following objects: