An AIPS-based, distributed processing method for large radio interferometric datasets

Stephen Bourke, Huib Jan van Langevelde, Karl Torstensson, Aaron Golden

Research output: Contribution to journalArticle

Abstract

The data output rates of modern radio interferometric telescopes make the traditional data reduction process impractical in many cases. We report on the implementation of a lightweight infrastructure, named AIPSLite, that enables the deployment of AIPS interferometric processing routines on distributed systems in an autonomous and fault tolerant manner. We discuss how this approach was used to search for sources of 6.7 GHz methanol maser emission in the Cep A region with the European VLBI Network (EVN). The field was searched out to a radius of 1.25 min-1 at milli-arcsecond spatial resolution and 1024 frequency channels with 0.088 km s-1 velocity resolution. The imaged data was on the order of 30 TB. Processing was performed on 128 processors of the Irish Centre for High End Computing (ICHEC) linux cluster with a run time of 42 h, and a total of 212 CPU days.

Original languageEnglish (US)
Pages (from-to)59-76
Number of pages18
JournalExperimental Astronomy
Volume36
Issue number1-2
DOIs
StatePublished - Aug 2013

Fingerprint

distributed processing
radio
very long base interferometry
radio telescopes
data reduction
masers
central processing units
methyl alcohol
spatial resolution
very long baseline interferometry
radii
methanol
output
infrastructure
method

Keywords

  • AIPS
  • AIPSLite
  • Distributed processing
  • Interferometry data processing
  • ParselTongue

ASJC Scopus subject areas

  • Astronomy and Astrophysics
  • Space and Planetary Science

Cite this

An AIPS-based, distributed processing method for large radio interferometric datasets. / Bourke, Stephen; van Langevelde, Huib Jan; Torstensson, Karl; Golden, Aaron.

In: Experimental Astronomy, Vol. 36, No. 1-2, 08.2013, p. 59-76.

Research output: Contribution to journalArticle

Bourke, S, van Langevelde, HJ, Torstensson, K & Golden, A 2013, 'An AIPS-based, distributed processing method for large radio interferometric datasets', Experimental Astronomy, vol. 36, no. 1-2, pp. 59-76. https://doi.org/10.1007/s10686-012-9315-0
Bourke, Stephen ; van Langevelde, Huib Jan ; Torstensson, Karl ; Golden, Aaron. / An AIPS-based, distributed processing method for large radio interferometric datasets. In: Experimental Astronomy. 2013 ; Vol. 36, No. 1-2. pp. 59-76.
@article{f3e14a9c33d04d86a926a9d68cf392bc,
title = "An AIPS-based, distributed processing method for large radio interferometric datasets",
abstract = "The data output rates of modern radio interferometric telescopes make the traditional data reduction process impractical in many cases. We report on the implementation of a lightweight infrastructure, named AIPSLite, that enables the deployment of AIPS interferometric processing routines on distributed systems in an autonomous and fault tolerant manner. We discuss how this approach was used to search for sources of 6.7 GHz methanol maser emission in the Cep A region with the European VLBI Network (EVN). The field was searched out to a radius of 1.25 min-1 at milli-arcsecond spatial resolution and 1024 frequency channels with 0.088 km s-1 velocity resolution. The imaged data was on the order of 30 TB. Processing was performed on 128 processors of the Irish Centre for High End Computing (ICHEC) linux cluster with a run time of 42 h, and a total of 212 CPU days.",
keywords = "AIPS, AIPSLite, Distributed processing, Interferometry data processing, ParselTongue",
author = "Stephen Bourke and {van Langevelde}, {Huib Jan} and Karl Torstensson and Aaron Golden",
year = "2013",
month = "8",
doi = "10.1007/s10686-012-9315-0",
language = "English (US)",
volume = "36",
pages = "59--76",
journal = "Experimental Astronomy",
issn = "0922-6435",
publisher = "Springer Netherlands",
number = "1-2",

}

TY - JOUR

T1 - An AIPS-based, distributed processing method for large radio interferometric datasets

AU - Bourke, Stephen

AU - van Langevelde, Huib Jan

AU - Torstensson, Karl

AU - Golden, Aaron

PY - 2013/8

Y1 - 2013/8

N2 - The data output rates of modern radio interferometric telescopes make the traditional data reduction process impractical in many cases. We report on the implementation of a lightweight infrastructure, named AIPSLite, that enables the deployment of AIPS interferometric processing routines on distributed systems in an autonomous and fault tolerant manner. We discuss how this approach was used to search for sources of 6.7 GHz methanol maser emission in the Cep A region with the European VLBI Network (EVN). The field was searched out to a radius of 1.25 min-1 at milli-arcsecond spatial resolution and 1024 frequency channels with 0.088 km s-1 velocity resolution. The imaged data was on the order of 30 TB. Processing was performed on 128 processors of the Irish Centre for High End Computing (ICHEC) linux cluster with a run time of 42 h, and a total of 212 CPU days.

AB - The data output rates of modern radio interferometric telescopes make the traditional data reduction process impractical in many cases. We report on the implementation of a lightweight infrastructure, named AIPSLite, that enables the deployment of AIPS interferometric processing routines on distributed systems in an autonomous and fault tolerant manner. We discuss how this approach was used to search for sources of 6.7 GHz methanol maser emission in the Cep A region with the European VLBI Network (EVN). The field was searched out to a radius of 1.25 min-1 at milli-arcsecond spatial resolution and 1024 frequency channels with 0.088 km s-1 velocity resolution. The imaged data was on the order of 30 TB. Processing was performed on 128 processors of the Irish Centre for High End Computing (ICHEC) linux cluster with a run time of 42 h, and a total of 212 CPU days.

KW - AIPS

KW - AIPSLite

KW - Distributed processing

KW - Interferometry data processing

KW - ParselTongue

UR - http://www.scopus.com/inward/record.url?scp=84881224688&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84881224688&partnerID=8YFLogxK

U2 - 10.1007/s10686-012-9315-0

DO - 10.1007/s10686-012-9315-0

M3 - Article

VL - 36

SP - 59

EP - 76

JO - Experimental Astronomy

JF - Experimental Astronomy

SN - 0922-6435

IS - 1-2

ER -