The lofarpipe package

The lofarpipe package contains all the Python modules included with the core framework code. This includes the lofarpipe.cuisine pacakge (inherited from the cuisine framework for WSRT), the lofarpipe.support pacakge (containing all the pipeline framework code), and the lofarpipe.tests package (which contains a limited selection of test).

• The lofarpipe.cuisine package
  • lofarpipe.cuisine.WSRTrecipe
  • lofarpipe.cuisine.cook
• The lofarpipe.support package
  • The construction of recipes
  • Checking of recipe inputs and outputs (“ingredients”)
    • Pre-defined fields
    • Infrastructure
  • Logging
    • Searching logs
    • Logging process output
      • Standard output/error
      • Logging libraries
    • Logging resource usage
  • Distribution of pipeline jobs
    • Node scripts
    • Compute jobs
    • Scheduling and rate limiting
    • Dispatch mechanisms
    • Exchanging data between master and nodes
    • Clean shut-down and recovery
  • Utility and convenience functions
    • Parset handling
    • Cluster descriptions (clusterdesc) handling
    • Grouping input data
    • Process control
    • File and directory maniupulaton
    • Iterators and generators
    • Miscellaneous
    • Exceptions
• The lofarpipe.tests package
  • The lofarpipe.tests.lofaringredient module