ndcctools.taskvine Namespace Reference

Namespaces
	dask_executor
	file
	manager
	task

Data Structures
class	DaskVine
	DaskVine compatibility class. More...

Detailed Description

TaskVine data intensive workflow framework - Python Interface

TaskVine is a framework for building large scale distributed data intensive applications that run on clusters, clouds, grids, and similar distributed systems. A TaskVine application consists of a main program that creates a Manager object, and then submits Task objects that use File objects representing data sources. The manager distributes tasks across available workers and returns results to the main application.

See the TaskVine Manual for complete documentation.

Recommended import statement:

import ndcctools.taskvine as vine

Relevant classes using recommended import statement:

• vine.Manager
• vine.Task
• vine.PythonTask

Severless execution:

• vine.LibraryTask
• vine.FunctionCall

Dask execution:

• vine.DaskVine