This document provides an overview of the LOFAR pipeline system. This system has largely been developed to support the LOFAR imaging pipeline, but is now being deployed for a variety of science pipelines on the LOFAR cluster. This document is split into a number of sections: the first describes the aims of the framework, the structure of a pipeline, and gives an overview of how the system fits together. The second provides details on how to run pre-defined pipelines. The third provides a tutorial introduction to writing pipelines and pipeline components. The fourth describes the framework codebase in more detail, and is intended for pipeline authors who wish to dig a little deeper, as well as those interested in developing the framework itself. The final section provides a guide to the imaging pipeline itself.
This documentation is still a work in progress. See the to-do list for upcoming improvements.
The pipeline system was developed by John Swinbank (University of Amsterdam) in 2009 & 2010, based on/extending the cuisine framework for WSRT by Adriaan renting. Since 2011, the primary maintainer are Marcel Loose and Wouter Klijn (ASTRON).