Objective evaluation of reconstruction methods for quantitative SPECT imaging in the absence of ground truth

Abhinav K. Jha, Na Song, Brian Caffo, Eric C. Frey

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Quantitative single-photon emission computed tomography (SPECT) imaging is emerging as an important tool in clinical studies and biomedical research. There is thus a need for optimization and evaluation of systems and algorithms that are being developed for quantitative SPECT imaging. An appropriate objective method to evaluate these systems is by comparing their performance in the end task that is required in quantitative SPECT imaging, such as estimating the mean activity concentration in a volume of interest (VOI) in a patient image. This objective evaluation can be performed if the true value of the estimated parameter is known, i.e. we have a gold standard. However, very rarely is this gold standard known in human studies. Thus, no-gold-standard techniques to optimize and evaluate systems and algorithms in the absence of gold standard are required. In this work, we developed a no-gold-standard technique to objectively evaluate reconstruction methods used in quantitative SPECT when the parameter to be estimated is the mean activity concentration in a VOI. We studied the performance of the technique with realistic simulated image data generated from an object database consisting of five phantom anatomies with all possible combinations of five sets of organ uptakes, where each anatomy consisted of eight different organ VOIs. Results indicate that the method pro-vided accurate ranking of the reconstruction methods. We also demonstrated the application of consistency checks to test the no-gold-standard output.

Original languageEnglish (US)
Title of host publicationProgress in Biomedical Optics and Imaging - Proceedings of SPIE
PublisherSPIE
Volume9416
ISBN (Print)9781628415063
DOIs
StatePublished - 2015
EventMedical Imaging 2015: Image Perception, Observer Performance, and Technology Assessment - Orlando, United States
Duration: Feb 25 2015Feb 26 2015

Other

OtherMedical Imaging 2015: Image Perception, Observer Performance, and Technology Assessment
CountryUnited States
CityOrlando
Period2/25/152/26/15

Fingerprint

Single photon emission computed tomography
ground truth
Single-Photon Emission-Computed Tomography
tomography
Imaging techniques
evaluation
photons
Gold
anatomy
gold
organs
Anatomy
ranking
Biomedical Research
emerging
estimating
Databases
optimization
output

Keywords

  • Evaluating reconstruction meth-ods.
  • No-gold-standard methods
  • Quantitative SPECT

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics
  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Cite this

Jha, A. K., Song, N., Caffo, B., & Frey, E. C. (2015). Objective evaluation of reconstruction methods for quantitative SPECT imaging in the absence of ground truth. In Progress in Biomedical Optics and Imaging - Proceedings of SPIE (Vol. 9416). [94161K] SPIE. https://doi.org/10.1117/12.2081286

Objective evaluation of reconstruction methods for quantitative SPECT imaging in the absence of ground truth. / Jha, Abhinav K.; Song, Na; Caffo, Brian; Frey, Eric C.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 9416 SPIE, 2015. 94161K.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jha, AK, Song, N, Caffo, B & Frey, EC 2015, Objective evaluation of reconstruction methods for quantitative SPECT imaging in the absence of ground truth. in Progress in Biomedical Optics and Imaging - Proceedings of SPIE. vol. 9416, 94161K, SPIE, Medical Imaging 2015: Image Perception, Observer Performance, and Technology Assessment, Orlando, United States, 2/25/15. https://doi.org/10.1117/12.2081286
Jha AK, Song N, Caffo B, Frey EC. Objective evaluation of reconstruction methods for quantitative SPECT imaging in the absence of ground truth. In Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 9416. SPIE. 2015. 94161K https://doi.org/10.1117/12.2081286
Jha, Abhinav K. ; Song, Na ; Caffo, Brian ; Frey, Eric C. / Objective evaluation of reconstruction methods for quantitative SPECT imaging in the absence of ground truth. Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 9416 SPIE, 2015.
@inproceedings{6e3cc7c6ee8b456d98523384e6f39b89,
title = "Objective evaluation of reconstruction methods for quantitative SPECT imaging in the absence of ground truth",
abstract = "Quantitative single-photon emission computed tomography (SPECT) imaging is emerging as an important tool in clinical studies and biomedical research. There is thus a need for optimization and evaluation of systems and algorithms that are being developed for quantitative SPECT imaging. An appropriate objective method to evaluate these systems is by comparing their performance in the end task that is required in quantitative SPECT imaging, such as estimating the mean activity concentration in a volume of interest (VOI) in a patient image. This objective evaluation can be performed if the true value of the estimated parameter is known, i.e. we have a gold standard. However, very rarely is this gold standard known in human studies. Thus, no-gold-standard techniques to optimize and evaluate systems and algorithms in the absence of gold standard are required. In this work, we developed a no-gold-standard technique to objectively evaluate reconstruction methods used in quantitative SPECT when the parameter to be estimated is the mean activity concentration in a VOI. We studied the performance of the technique with realistic simulated image data generated from an object database consisting of five phantom anatomies with all possible combinations of five sets of organ uptakes, where each anatomy consisted of eight different organ VOIs. Results indicate that the method pro-vided accurate ranking of the reconstruction methods. We also demonstrated the application of consistency checks to test the no-gold-standard output.",
keywords = "Evaluating reconstruction meth-ods., No-gold-standard methods, Quantitative SPECT",
author = "Jha, {Abhinav K.} and Na Song and Brian Caffo and Frey, {Eric C.}",
year = "2015",
doi = "10.1117/12.2081286",
language = "English (US)",
isbn = "9781628415063",
volume = "9416",
booktitle = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",
publisher = "SPIE",

}

TY - GEN

T1 - Objective evaluation of reconstruction methods for quantitative SPECT imaging in the absence of ground truth

AU - Jha, Abhinav K.

AU - Song, Na

AU - Caffo, Brian

AU - Frey, Eric C.

PY - 2015

Y1 - 2015

N2 - Quantitative single-photon emission computed tomography (SPECT) imaging is emerging as an important tool in clinical studies and biomedical research. There is thus a need for optimization and evaluation of systems and algorithms that are being developed for quantitative SPECT imaging. An appropriate objective method to evaluate these systems is by comparing their performance in the end task that is required in quantitative SPECT imaging, such as estimating the mean activity concentration in a volume of interest (VOI) in a patient image. This objective evaluation can be performed if the true value of the estimated parameter is known, i.e. we have a gold standard. However, very rarely is this gold standard known in human studies. Thus, no-gold-standard techniques to optimize and evaluate systems and algorithms in the absence of gold standard are required. In this work, we developed a no-gold-standard technique to objectively evaluate reconstruction methods used in quantitative SPECT when the parameter to be estimated is the mean activity concentration in a VOI. We studied the performance of the technique with realistic simulated image data generated from an object database consisting of five phantom anatomies with all possible combinations of five sets of organ uptakes, where each anatomy consisted of eight different organ VOIs. Results indicate that the method pro-vided accurate ranking of the reconstruction methods. We also demonstrated the application of consistency checks to test the no-gold-standard output.

AB - Quantitative single-photon emission computed tomography (SPECT) imaging is emerging as an important tool in clinical studies and biomedical research. There is thus a need for optimization and evaluation of systems and algorithms that are being developed for quantitative SPECT imaging. An appropriate objective method to evaluate these systems is by comparing their performance in the end task that is required in quantitative SPECT imaging, such as estimating the mean activity concentration in a volume of interest (VOI) in a patient image. This objective evaluation can be performed if the true value of the estimated parameter is known, i.e. we have a gold standard. However, very rarely is this gold standard known in human studies. Thus, no-gold-standard techniques to optimize and evaluate systems and algorithms in the absence of gold standard are required. In this work, we developed a no-gold-standard technique to objectively evaluate reconstruction methods used in quantitative SPECT when the parameter to be estimated is the mean activity concentration in a VOI. We studied the performance of the technique with realistic simulated image data generated from an object database consisting of five phantom anatomies with all possible combinations of five sets of organ uptakes, where each anatomy consisted of eight different organ VOIs. Results indicate that the method pro-vided accurate ranking of the reconstruction methods. We also demonstrated the application of consistency checks to test the no-gold-standard output.

KW - Evaluating reconstruction meth-ods.

KW - No-gold-standard methods

KW - Quantitative SPECT

UR - http://www.scopus.com/inward/record.url?scp=84932086441&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84932086441&partnerID=8YFLogxK

U2 - 10.1117/12.2081286

DO - 10.1117/12.2081286

M3 - Conference contribution

AN - SCOPUS:84932086441

SN - 9781628415063

VL - 9416

BT - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

PB - SPIE

ER -