A pipeline for automatically processing and analysing archival images from multiple instruments

Seathrún Ó Tuairisg, Aaron Golden, Raymond Butler, Andrew Shearer, Bruno Voisin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

To take advantage of the recent upsurge in astrophysical research applications of grid technologies coupled with the increase in temporal and spatial coverage afforded to us by dedicated all-sky surveys and on-line data archives, we have developed an automated image reduction and analysis pipeline for a number of different astronomical instruments. The primary science goal of the project is in the study of long-term optical variability of brown dwarfs, although it can be tailored to suit many varied astrophysical phenomena. The pipeline complements Querator,1 the custom search-engine which accesses the astronomical image archives based at the ST-ECF/ESO centre in Garching, Germany. To increase our dataset we complement the reduction and analysis of WFI (Wide Field Imager, mounted on the 2.2-m MPG/ESO telescope at La Silla) archival images with the analysis of pre-reduced co-spatial HST/WFPC2 images and near infrared images from the DENIS archive. Our pipeline includes CCD-image reduction, registration, astrometry, photometry, and image matching stages. We present sample results of all stages of the pipeline and describe how we overcome such problems as missing or incorrect image meta-data, interference fringing, poor image calibration files etc. The pipeline was written using tasks contained in the IRAF environment, linked together with Unix Shell Scripts and Perl, and the image reduction and analysis is performed using a 40-processor Origin SGI 3800 based at NUI, Galway.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
EditorsP.J. Quinn, A. Bridger
Pages467-473
Number of pages7
Volume5493
DOIs
StatePublished - 2004
Externally publishedYes
EventOptimizing Scientific Return for Astronomy through Information Technologies - Glasgow, United Kingdom
Duration: Jun 24 2004Jun 25 2004

Other

OtherOptimizing Scientific Return for Astronomy through Information Technologies
CountryUnited Kingdom
CityGlasgow
Period6/24/046/25/04

Fingerprint

Pipelines
Processing
Photometry
Image matching
Search engines
European Southern Observatory
Metadata
Charge coupled devices
Image sensors
Telescopes
complement
astrophysics
Calibration
Infrared radiation
metadata
astrometry
files
Germany
photometry
central processing units

Keywords

  • Data archives
  • Data reduction
  • Image processing
  • Optical astronomy

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Tuairisg, S. Ó., Golden, A., Butler, R., Shearer, A., & Voisin, B. (2004). A pipeline for automatically processing and analysing archival images from multiple instruments. In P. J. Quinn, & A. Bridger (Eds.), Proceedings of SPIE - The International Society for Optical Engineering (Vol. 5493, pp. 467-473) https://doi.org/10.1117/12.550669

A pipeline for automatically processing and analysing archival images from multiple instruments. / Tuairisg, Seathrún Ó; Golden, Aaron; Butler, Raymond; Shearer, Andrew; Voisin, Bruno.

Proceedings of SPIE - The International Society for Optical Engineering. ed. / P.J. Quinn; A. Bridger. Vol. 5493 2004. p. 467-473.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tuairisg, SÓ, Golden, A, Butler, R, Shearer, A & Voisin, B 2004, A pipeline for automatically processing and analysing archival images from multiple instruments. in PJ Quinn & A Bridger (eds), Proceedings of SPIE - The International Society for Optical Engineering. vol. 5493, pp. 467-473, Optimizing Scientific Return for Astronomy through Information Technologies, Glasgow, United Kingdom, 6/24/04. https://doi.org/10.1117/12.550669
Tuairisg SÓ, Golden A, Butler R, Shearer A, Voisin B. A pipeline for automatically processing and analysing archival images from multiple instruments. In Quinn PJ, Bridger A, editors, Proceedings of SPIE - The International Society for Optical Engineering. Vol. 5493. 2004. p. 467-473 https://doi.org/10.1117/12.550669
Tuairisg, Seathrún Ó ; Golden, Aaron ; Butler, Raymond ; Shearer, Andrew ; Voisin, Bruno. / A pipeline for automatically processing and analysing archival images from multiple instruments. Proceedings of SPIE - The International Society for Optical Engineering. editor / P.J. Quinn ; A. Bridger. Vol. 5493 2004. pp. 467-473
@inproceedings{9b4aee06fe1f45a1a4cd13ed391a6f66,
title = "A pipeline for automatically processing and analysing archival images from multiple instruments",
abstract = "To take advantage of the recent upsurge in astrophysical research applications of grid technologies coupled with the increase in temporal and spatial coverage afforded to us by dedicated all-sky surveys and on-line data archives, we have developed an automated image reduction and analysis pipeline for a number of different astronomical instruments. The primary science goal of the project is in the study of long-term optical variability of brown dwarfs, although it can be tailored to suit many varied astrophysical phenomena. The pipeline complements Querator,1 the custom search-engine which accesses the astronomical image archives based at the ST-ECF/ESO centre in Garching, Germany. To increase our dataset we complement the reduction and analysis of WFI (Wide Field Imager, mounted on the 2.2-m MPG/ESO telescope at La Silla) archival images with the analysis of pre-reduced co-spatial HST/WFPC2 images and near infrared images from the DENIS archive. Our pipeline includes CCD-image reduction, registration, astrometry, photometry, and image matching stages. We present sample results of all stages of the pipeline and describe how we overcome such problems as missing or incorrect image meta-data, interference fringing, poor image calibration files etc. The pipeline was written using tasks contained in the IRAF environment, linked together with Unix Shell Scripts and Perl, and the image reduction and analysis is performed using a 40-processor Origin SGI 3800 based at NUI, Galway.",
keywords = "Data archives, Data reduction, Image processing, Optical astronomy",
author = "Tuairisg, {Seathr{\'u}n {\'O}} and Aaron Golden and Raymond Butler and Andrew Shearer and Bruno Voisin",
year = "2004",
doi = "10.1117/12.550669",
language = "English (US)",
volume = "5493",
pages = "467--473",
editor = "P.J. Quinn and A. Bridger",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - A pipeline for automatically processing and analysing archival images from multiple instruments

AU - Tuairisg, Seathrún Ó

AU - Golden, Aaron

AU - Butler, Raymond

AU - Shearer, Andrew

AU - Voisin, Bruno

PY - 2004

Y1 - 2004

N2 - To take advantage of the recent upsurge in astrophysical research applications of grid technologies coupled with the increase in temporal and spatial coverage afforded to us by dedicated all-sky surveys and on-line data archives, we have developed an automated image reduction and analysis pipeline for a number of different astronomical instruments. The primary science goal of the project is in the study of long-term optical variability of brown dwarfs, although it can be tailored to suit many varied astrophysical phenomena. The pipeline complements Querator,1 the custom search-engine which accesses the astronomical image archives based at the ST-ECF/ESO centre in Garching, Germany. To increase our dataset we complement the reduction and analysis of WFI (Wide Field Imager, mounted on the 2.2-m MPG/ESO telescope at La Silla) archival images with the analysis of pre-reduced co-spatial HST/WFPC2 images and near infrared images from the DENIS archive. Our pipeline includes CCD-image reduction, registration, astrometry, photometry, and image matching stages. We present sample results of all stages of the pipeline and describe how we overcome such problems as missing or incorrect image meta-data, interference fringing, poor image calibration files etc. The pipeline was written using tasks contained in the IRAF environment, linked together with Unix Shell Scripts and Perl, and the image reduction and analysis is performed using a 40-processor Origin SGI 3800 based at NUI, Galway.

AB - To take advantage of the recent upsurge in astrophysical research applications of grid technologies coupled with the increase in temporal and spatial coverage afforded to us by dedicated all-sky surveys and on-line data archives, we have developed an automated image reduction and analysis pipeline for a number of different astronomical instruments. The primary science goal of the project is in the study of long-term optical variability of brown dwarfs, although it can be tailored to suit many varied astrophysical phenomena. The pipeline complements Querator,1 the custom search-engine which accesses the astronomical image archives based at the ST-ECF/ESO centre in Garching, Germany. To increase our dataset we complement the reduction and analysis of WFI (Wide Field Imager, mounted on the 2.2-m MPG/ESO telescope at La Silla) archival images with the analysis of pre-reduced co-spatial HST/WFPC2 images and near infrared images from the DENIS archive. Our pipeline includes CCD-image reduction, registration, astrometry, photometry, and image matching stages. We present sample results of all stages of the pipeline and describe how we overcome such problems as missing or incorrect image meta-data, interference fringing, poor image calibration files etc. The pipeline was written using tasks contained in the IRAF environment, linked together with Unix Shell Scripts and Perl, and the image reduction and analysis is performed using a 40-processor Origin SGI 3800 based at NUI, Galway.

KW - Data archives

KW - Data reduction

KW - Image processing

KW - Optical astronomy

UR - http://www.scopus.com/inward/record.url?scp=10444253872&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=10444253872&partnerID=8YFLogxK

U2 - 10.1117/12.550669

DO - 10.1117/12.550669

M3 - Conference contribution

AN - SCOPUS:10444253872

VL - 5493

SP - 467

EP - 473

BT - Proceedings of SPIE - The International Society for Optical Engineering

A2 - Quinn, P.J.

A2 - Bridger, A.

ER -