cctools
ndcctools.work_queue Namespace Reference

Data Structures

class  Factory
 
class  PythonTask
 
class  PythonTaskNoResult
 
class  RemoteTask
 
class  Task
 
class  WorkQueue
 Python Work Queue object. More...
 

Detailed Description

Work Queue distributed task execution framework - Python interface.

The Work Queue system provides a distributed task execution framework for high throughput applications consisting of millions of tasks running on thousands of workers. This Python interface allows for the creation of manager applications that define, submit, monitor, and collect tasks. The objects and methods provided by this package correspond to the native C API in work_queue.h.

The SWIG-based Python bindings provide a higher-level interface that revolves around the following objects: