Pre- and post-training session evaluation for interobserver agreement and diagnostic accuracy of probe-based confocal laser endomicroscopy for biliary strictures

Jayant P. Talreja, Brian G. Turner, Frank G. Gress, Sammy Ho, Savreet Sarkaria, Naveen Paddu, Nikola Natov, Sheila Bharmal, Monica Gaidhane, Amrita Sethi, Michel Kahaleh

Research output: Contribution to journalArticle

15 Scopus citations

Abstract

Background and Aim Current diagnostic modalities for indeterminate biliary strictures offer low accuracy. Probe-based confocal laser endomicroscopy (pCLE) permits microscopic assessment of mucosal structures by obtaining real-time high-resolution images of the mucosal layers of the gastrointestinal tract. Previously, an interobserver study demonstrated poor to fair agreement even among experienced confocal endomicroscopy operators. Our objective was to assess interobserver agreement and diagnostic accuracy upon completion of a pCLE training session. Methods Forty de-identified pCLE video clips of indeterminate biliary strictures were sent to five endoscopists at four tertiary care centers for scoring. Observers subsequently attended a teaching session by an expert pCLE user that included 20 training clips and rescored the same pCLE video clips, which were randomized and renumbered. Results Pre-training interobserver agreement for all observers was 'fair' (Κ: 0.31, P-value: <0.0001) and diagnostic accuracy was 72% (55-80%). Post-training interobserver agreement for all observers was 'substantial' (Κ: 0.74, P-value: <0.0001) and diagnostic accuracy was 89% (80-95%). Using a paired t-test, we observed an increase of 17% (95% CI 7.6-26.4) in post-training diagnostic accuracy (t = 5.01, df = 4, P-value 0.007). Conclusions Interobserver agreement and diagnostic accuracy improved after observers underwent training by an expert pCLE user with a specific sequence set. Users should participate in such training programs to maximize diagnostic accuracy of pCLE evaluation.

Original languageEnglish (US)
Pages (from-to)577-580
Number of pages4
JournalDigestive Endoscopy
Volume26
Issue number4
DOIs
StatePublished - Jul 2014
Externally publishedYes

    Fingerprint

Keywords

  • Miami classification
  • biliary stricture
  • confocal endomicroscopy
  • interobserver agreement
  • probe-based confocal laser endomicroscopy (pCLE)

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging
  • Gastroenterology

Cite this

Talreja, J. P., Turner, B. G., Gress, F. G., Ho, S., Sarkaria, S., Paddu, N., Natov, N., Bharmal, S., Gaidhane, M., Sethi, A., & Kahaleh, M. (2014). Pre- and post-training session evaluation for interobserver agreement and diagnostic accuracy of probe-based confocal laser endomicroscopy for biliary strictures. Digestive Endoscopy, 26(4), 577-580. https://doi.org/10.1111/den.12214