LOFAR Pre-Processing Pipeline¶
The Low-Frequency Array (LOFAR) Pre-Processing Pipeline is a workflow that’s meant to be run on raw LOFAR data post-correlation. The input is assumed to have been produced with COBALT (Correlator and Beamformer Application for the LOFAR Telescope) and it’s meant to be run on the Central Processing cluster (CEP).
The pipeline prepares raw LOFAR data for further processing, e.g., with calibration and imaging pipelines, such as LINC and Rapthor. It’s a re-implementation of the old Pre-Processing Pipeline, written in the Common Workflow Language (CWL); the old pipeline was implemented in the Generic Pipeline Framework.
It performs the following operations:
initial flagging of bad data
removal of bright off-axis sources (demixing)
averaging in time and frequency
and compression of the visibility data
Attention
The CWL implementation of the Pre-Processing Pipeline is currently in development. Please beware that it is in an experimental state and not fully functional yet. Use at your own risk!