Can radiologist training and testing ensure high performance in CT colonography? Lessons from the national CT colonography trial

Joel G. Fletcher, Mei Hsiu Chen, Benjamin A. Herman, C. Daniel Johnson, Alicia Toledano, Abraham H. Dachman, Amy K. Hara, Jeff L. Fidler, Christine O. Menias, Kevin J. Coakley, Mark Kuo, Karen M. Horton, Jugesh Cheema, Revathy Iyer, Bettina Siewert, Judy Yee, Richard Obregon, Peter Zimmerman, Robert Halvorsen, Giovanna Casola & 1 others Martina Morrin

Research output: Contribution to journalArticle

27 Citations (Scopus)

Abstract

OBJECTIVE. The objective of this article is to describe the experience of the National CT Colonography Trial with radiologist training and qualification testing at CT colonography (CTC) and to correlate this experience with subsequent performance in a prospective screening study. SUBJECTS AND METHODS. Ten inexperienced radiologists participated in a 1-day educational course, during which partial CTC examinations of 27 cases with neoplasia and full CTC examinations of 15 cases were reviewed using primary 2D and 3D search. Subsequently 15 radiologists took a qualification examination composed of 20 CTC cases. Radiologists who did not pass the first qualification examination attended a second day of focused retraining of 30 cases, which was followed by a second qualification examination. The results of the initial and subsequent qualification tests were compared with reader performance in a large prospective screening trial. RESULTS. All radiologists took and passed the qualification examinations. Seven radiologists passed the qualification examination the first time it was offered, and eight radiologists passed after focused retraining. Significantly better sensitivities were obtained on the second versus the first examination for the retrained radiologists (difference = 16%, p < 0.001). There was no significant difference in sensitivities between the groups who passed the qualification examination the first time versus those who passed the second time in the prospective study (88% vs 92%, respectively; p = 0.612). In the prospective study, the odds of correctly identifying diseased cases increased by 1.5 fold for every 50-case increase in reader experience or formal training (p < 0.025). CONCLUSION. A significant difference in performance was observed among radiologists before formalized training, but testing and focused retraining improved radiologist performance, resulting in an overall high sensitivity across radiologists in a subsequent, prospective screening study.

Original languageEnglish (US)
Pages (from-to)117-125
Number of pages9
JournalAmerican Journal of Roentgenology
Volume195
Issue number1
DOIs
StatePublished - Jul 1 2010
Externally publishedYes

Fingerprint

Computed Tomographic Colonography
Prospective Studies
Radiologists

Keywords

  • ACRIN
  • CT
  • CT colonography
  • Radiologist training
  • Reader performance

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Fletcher, J. G., Chen, M. H., Herman, B. A., Daniel Johnson, C., Toledano, A., Dachman, A. H., ... Morrin, M. (2010). Can radiologist training and testing ensure high performance in CT colonography? Lessons from the national CT colonography trial. American Journal of Roentgenology, 195(1), 117-125. https://doi.org/10.2214/AJR.09.3659

Can radiologist training and testing ensure high performance in CT colonography? Lessons from the national CT colonography trial. / Fletcher, Joel G.; Chen, Mei Hsiu; Herman, Benjamin A.; Daniel Johnson, C.; Toledano, Alicia; Dachman, Abraham H.; Hara, Amy K.; Fidler, Jeff L.; Menias, Christine O.; Coakley, Kevin J.; Kuo, Mark; Horton, Karen M.; Cheema, Jugesh; Iyer, Revathy; Siewert, Bettina; Yee, Judy; Obregon, Richard; Zimmerman, Peter; Halvorsen, Robert; Casola, Giovanna; Morrin, Martina.

In: American Journal of Roentgenology, Vol. 195, No. 1, 01.07.2010, p. 117-125.

Research output: Contribution to journalArticle

Fletcher, JG, Chen, MH, Herman, BA, Daniel Johnson, C, Toledano, A, Dachman, AH, Hara, AK, Fidler, JL, Menias, CO, Coakley, KJ, Kuo, M, Horton, KM, Cheema, J, Iyer, R, Siewert, B, Yee, J, Obregon, R, Zimmerman, P, Halvorsen, R, Casola, G & Morrin, M 2010, 'Can radiologist training and testing ensure high performance in CT colonography? Lessons from the national CT colonography trial', American Journal of Roentgenology, vol. 195, no. 1, pp. 117-125. https://doi.org/10.2214/AJR.09.3659
Fletcher, Joel G. ; Chen, Mei Hsiu ; Herman, Benjamin A. ; Daniel Johnson, C. ; Toledano, Alicia ; Dachman, Abraham H. ; Hara, Amy K. ; Fidler, Jeff L. ; Menias, Christine O. ; Coakley, Kevin J. ; Kuo, Mark ; Horton, Karen M. ; Cheema, Jugesh ; Iyer, Revathy ; Siewert, Bettina ; Yee, Judy ; Obregon, Richard ; Zimmerman, Peter ; Halvorsen, Robert ; Casola, Giovanna ; Morrin, Martina. / Can radiologist training and testing ensure high performance in CT colonography? Lessons from the national CT colonography trial. In: American Journal of Roentgenology. 2010 ; Vol. 195, No. 1. pp. 117-125.
@article{79aac08b117b4df7926eb5a6aaed360b,
title = "Can radiologist training and testing ensure high performance in CT colonography? Lessons from the national CT colonography trial",
abstract = "OBJECTIVE. The objective of this article is to describe the experience of the National CT Colonography Trial with radiologist training and qualification testing at CT colonography (CTC) and to correlate this experience with subsequent performance in a prospective screening study. SUBJECTS AND METHODS. Ten inexperienced radiologists participated in a 1-day educational course, during which partial CTC examinations of 27 cases with neoplasia and full CTC examinations of 15 cases were reviewed using primary 2D and 3D search. Subsequently 15 radiologists took a qualification examination composed of 20 CTC cases. Radiologists who did not pass the first qualification examination attended a second day of focused retraining of 30 cases, which was followed by a second qualification examination. The results of the initial and subsequent qualification tests were compared with reader performance in a large prospective screening trial. RESULTS. All radiologists took and passed the qualification examinations. Seven radiologists passed the qualification examination the first time it was offered, and eight radiologists passed after focused retraining. Significantly better sensitivities were obtained on the second versus the first examination for the retrained radiologists (difference = 16{\%}, p < 0.001). There was no significant difference in sensitivities between the groups who passed the qualification examination the first time versus those who passed the second time in the prospective study (88{\%} vs 92{\%}, respectively; p = 0.612). In the prospective study, the odds of correctly identifying diseased cases increased by 1.5 fold for every 50-case increase in reader experience or formal training (p < 0.025). CONCLUSION. A significant difference in performance was observed among radiologists before formalized training, but testing and focused retraining improved radiologist performance, resulting in an overall high sensitivity across radiologists in a subsequent, prospective screening study.",
keywords = "ACRIN, CT, CT colonography, Radiologist training, Reader performance",
author = "Fletcher, {Joel G.} and Chen, {Mei Hsiu} and Herman, {Benjamin A.} and {Daniel Johnson}, C. and Alicia Toledano and Dachman, {Abraham H.} and Hara, {Amy K.} and Fidler, {Jeff L.} and Menias, {Christine O.} and Coakley, {Kevin J.} and Mark Kuo and Horton, {Karen M.} and Jugesh Cheema and Revathy Iyer and Bettina Siewert and Judy Yee and Richard Obregon and Peter Zimmerman and Robert Halvorsen and Giovanna Casola and Martina Morrin",
year = "2010",
month = "7",
day = "1",
doi = "10.2214/AJR.09.3659",
language = "English (US)",
volume = "195",
pages = "117--125",
journal = "American Journal of Roentgenology",
issn = "0361-803X",
publisher = "American Roentgen Ray Society",
number = "1",

}

TY - JOUR

T1 - Can radiologist training and testing ensure high performance in CT colonography? Lessons from the national CT colonography trial

AU - Fletcher, Joel G.

AU - Chen, Mei Hsiu

AU - Herman, Benjamin A.

AU - Daniel Johnson, C.

AU - Toledano, Alicia

AU - Dachman, Abraham H.

AU - Hara, Amy K.

AU - Fidler, Jeff L.

AU - Menias, Christine O.

AU - Coakley, Kevin J.

AU - Kuo, Mark

AU - Horton, Karen M.

AU - Cheema, Jugesh

AU - Iyer, Revathy

AU - Siewert, Bettina

AU - Yee, Judy

AU - Obregon, Richard

AU - Zimmerman, Peter

AU - Halvorsen, Robert

AU - Casola, Giovanna

AU - Morrin, Martina

PY - 2010/7/1

Y1 - 2010/7/1

N2 - OBJECTIVE. The objective of this article is to describe the experience of the National CT Colonography Trial with radiologist training and qualification testing at CT colonography (CTC) and to correlate this experience with subsequent performance in a prospective screening study. SUBJECTS AND METHODS. Ten inexperienced radiologists participated in a 1-day educational course, during which partial CTC examinations of 27 cases with neoplasia and full CTC examinations of 15 cases were reviewed using primary 2D and 3D search. Subsequently 15 radiologists took a qualification examination composed of 20 CTC cases. Radiologists who did not pass the first qualification examination attended a second day of focused retraining of 30 cases, which was followed by a second qualification examination. The results of the initial and subsequent qualification tests were compared with reader performance in a large prospective screening trial. RESULTS. All radiologists took and passed the qualification examinations. Seven radiologists passed the qualification examination the first time it was offered, and eight radiologists passed after focused retraining. Significantly better sensitivities were obtained on the second versus the first examination for the retrained radiologists (difference = 16%, p < 0.001). There was no significant difference in sensitivities between the groups who passed the qualification examination the first time versus those who passed the second time in the prospective study (88% vs 92%, respectively; p = 0.612). In the prospective study, the odds of correctly identifying diseased cases increased by 1.5 fold for every 50-case increase in reader experience or formal training (p < 0.025). CONCLUSION. A significant difference in performance was observed among radiologists before formalized training, but testing and focused retraining improved radiologist performance, resulting in an overall high sensitivity across radiologists in a subsequent, prospective screening study.

AB - OBJECTIVE. The objective of this article is to describe the experience of the National CT Colonography Trial with radiologist training and qualification testing at CT colonography (CTC) and to correlate this experience with subsequent performance in a prospective screening study. SUBJECTS AND METHODS. Ten inexperienced radiologists participated in a 1-day educational course, during which partial CTC examinations of 27 cases with neoplasia and full CTC examinations of 15 cases were reviewed using primary 2D and 3D search. Subsequently 15 radiologists took a qualification examination composed of 20 CTC cases. Radiologists who did not pass the first qualification examination attended a second day of focused retraining of 30 cases, which was followed by a second qualification examination. The results of the initial and subsequent qualification tests were compared with reader performance in a large prospective screening trial. RESULTS. All radiologists took and passed the qualification examinations. Seven radiologists passed the qualification examination the first time it was offered, and eight radiologists passed after focused retraining. Significantly better sensitivities were obtained on the second versus the first examination for the retrained radiologists (difference = 16%, p < 0.001). There was no significant difference in sensitivities between the groups who passed the qualification examination the first time versus those who passed the second time in the prospective study (88% vs 92%, respectively; p = 0.612). In the prospective study, the odds of correctly identifying diseased cases increased by 1.5 fold for every 50-case increase in reader experience or formal training (p < 0.025). CONCLUSION. A significant difference in performance was observed among radiologists before formalized training, but testing and focused retraining improved radiologist performance, resulting in an overall high sensitivity across radiologists in a subsequent, prospective screening study.

KW - ACRIN

KW - CT

KW - CT colonography

KW - Radiologist training

KW - Reader performance

UR - http://www.scopus.com/inward/record.url?scp=77954745028&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77954745028&partnerID=8YFLogxK

U2 - 10.2214/AJR.09.3659

DO - 10.2214/AJR.09.3659

M3 - Article

VL - 195

SP - 117

EP - 125

JO - American Journal of Roentgenology

JF - American Journal of Roentgenology

SN - 0361-803X

IS - 1

ER -