cctools
ndcctools.work_queue Namespace Reference

Work Queue distributed task execution framework - Python interface. More...

Data Structures

class  Factory
 Launch a Work Queue factory. More...
 
class  PythonTask
 Python PythonTask object. More...
 
class  PythonTaskNoResult
 
class  RemoteTask
 Python RemoteTask object. More...
 
class  Task
 Python Task object. More...
 
class  WorkQueue
 Python Work Queue object. More...
 

Detailed Description

Work Queue distributed task execution framework - Python interface.

The Work Queue system provides a distributed task execution framework for high throughput applications consisting of millions of tasks running on thousands of workers. This Python interface allows for the creation of manager applications that define, submit, monitor, and collect tasks. The objects and methods provided by this package correspond to the native C API in work_queue.h.

The SWIG-based Python bindings provide a higher-level interface that revolves around the following objects: