Journal Article
. 2015 Nov; 6:56.
doi: 10.4103/2153-3539.168517.

Diagnostic performance on briefly presented digital pathology images

Joseph P Houghton 1 Bruce R Smoller 2 Niamh Leonard 3 Michael R Stevenson 1 Tim Dornan 1 
Affiliations
  • PMID: 26605121
  •     21 References
  •     3 citations

Abstract

Background: Identifying new and more robust assessments of proficiency/expertise (finding new "biomarkers of expertise") in histopathology is desirable for many reasons. Advances in digital pathology permit new and innovative tests such as flash viewing tests and eye tracking and slide navigation analyses that would not be possible with a traditional microscope. The main purpose of this study was to examine the usefulness of time-restricted testing of expertise in histopathology using digital images.

Methods: 19 novices (undergraduate medical students), 18 intermediates (trainees), and 19 experts (consultants) were invited to give their opinion on 20 general histopathology cases after 1 s and 10 s viewing times. Differences in performance between groups were measured and the internal reliability of the test was calculated.

Results: There were highly significant differences in performance between the groups using the Fisher's least significant difference method for multiple comparisons. Differences between groups were consistently greater in the 10-s than the 1-s test. The Kuder-Richardson 20 internal reliability coefficients were very high for both tests: 0.905 for the 1-s test and 0.926 for the 10-s test. Consultants had levels of diagnostic accuracy of 72% at 1 s and 83% at 10 s.

Conclusions: Time-restricted tests using digital images have the potential to be extremely reliable tests of diagnostic proficiency in histopathology. A 10-s viewing test may be more reliable than a 1-s test. Over-reliance on "at a glance" diagnoses in histopathology is a potential source of medical error due to over-confidence bias and premature closure.

Keywords: Digital pathology; expertise; overconfidence bias; premature closure; time-restricted test.

Achieving quality in clinical decision making: cognitive strategies and detection of bias.
Pat Croskerry.
Acad Emerg Med, 2002 Nov 05; 9(11). PMID: 12414468
Informatics in radiology: what can you see in a single glance and how might this guide visual search in medical images?
Trafton Drew, Karla Evans, +2 authors, Jeremy M Wolfe.
Radiographics, 2012 Oct 30; 33(1). PMID: 23104971    Free PMC article.
Review.
Viewpoint-specific scene representations in human parahippocampal cortex.
Russell Epstein, Kim S Graham, Paul E Downing.
Neuron, 2003 Mar 12; 37(5). PMID: 12628176
Lung lesions: correlation between viewing time and detection.
J W Oestmann, R Greene, +3 authors, H J Llewellyn.
Radiology, 1988 Feb 01; 166(2). PMID: 3336720
Distributed and overlapping representations of faces and objects in ventral temporal cortex.
J V Haxby, M I Gobbini, +3 authors, P Pietrini.
Science, 2001 Sep 29; 293(5539). PMID: 11577229
Highly Cited.
The assessment of professional competence: Developments, research and practical implications.
C P Van Der Vleuten.
Adv Health Sci Educ Theory Pract, 1996 Jan 01; 1(1). PMID: 24178994
Highly Cited.
Finding lung nodules with and without comparative visual scanning.
D P Carmody, C F Nodine, H L Kundel.
Percept Psychophys, 1981 Jun 01; 29(6). PMID: 7279589
Neural components of topographical representation.
G K Aguirre, E Zarahn, M D'Esposito.
Proc Natl Acad Sci U S A, 1998 Mar 14; 95(3). PMID: 9448249    Free PMC article.
Review.
The gist of the abnormal: above-chance medical decision making in the blink of an eye.
Karla K Evans, Diane Georgian-Smith, +2 authors, Jeremy M Wolfe.
Psychon Bull Rev, 2013 Jun 19; 20(6). PMID: 23771399    Free PMC article.
Eye-movement study and human performance using telepathology virtual slides: implications for medical education and differences with experience.
Elizabeth A Krupinski, Allison A Tillack, +7 authors, Ronald S Weinstein.
Hum Pathol, 2006 Nov 30; 37(12). PMID: 17129792
Visual search in scenes involves selective and nonselective pathways.
Jeremy M Wolfe, Melissa L-H Võ, Karla K Evans, Michelle R Greene.
Trends Cogn Sci, 2011 Jan 14; 15(2). PMID: 21227734    Free PMC article.
Highly Cited. Review.
Perceptual analysis of the reading of dermatopathology virtual slides by pathology residents.
Claudia Mello-Thoms, Carlos A B Mello, +5 authors, Rebecca Crowley.
Arch Pathol Lab Med, 2012 May 01; 136(5). PMID: 22540304
Eye movements as an index of pathologist visual expertise: a pilot study.
Tad T Brunyé, Patricia A Carney, +3 authors, Joann G Elmore.
PLoS One, 2014 Aug 02; 9(8). PMID: 25084012    Free PMC article.
Tracking with virtual slides: a tool to study diagnostic error in histopathology.
Darren Treanor, Chee Hooi Lim, +2 authors, Phil Quirke.
Histopathology, 2009 Jul 21; 55(1). PMID: 19614765
Visualising scanning patterns of pathologists in the grading of cervical intraepithelial neoplasia.
E S M Tiersma, A A W Peters, H A Mooij, G J Fleuren.
J Clin Pathol, 2003 Aug 29; 56(9). PMID: 12944551    Free PMC article.
Expertise under the microscope: processing histopathological slides.
Thomas Jaarsma, Halszka Jarodzka, +2 authors, Henny P A Boshuizen.
Med Educ, 2014 Feb 18; 48(3). PMID: 24528464
Interpreting chest radiographs without visual search.
H L Kundel, C F Nodine.
Radiology, 1975 Sep 01; 116(3). PMID: 125436
Mouse cursor movement and eye tracking data as an indicator of pathologists' attention when viewing digital whole slide images.
Vignesh Raghunath, Melissa O Braxton, +6 authors, Linda G Shapiro.
J Pathol Inform, 2013 Feb 02; 3. PMID: 23372984    Free PMC article.
An experimental study of pathologist's navigation patterns in virtual microscopy.
Lucia Roa-Peña, Francisco Gómez, Eduardo Romero.
Diagn Pathol, 2010 Nov 23; 5. PMID: 21087502    Free PMC article.
A cortical representation of the local visual environment.
R Epstein, N Kanwisher.
Nature, 1998 Apr 29; 392(6676). PMID: 9560155
Highly Cited.
Holistic component of image perception in mammogram interpretation: gaze-tracking study.
Harold L Kundel, Calvin F Nodine, Emily F Conant, Susan P Weinstein.
Radiology, 2007 Jan 27; 242(2). PMID: 17255410
The Holistic Processing Account of Visual Expertise in Medical Image Perception: A Review.
Heather Sheridan, Eyal M Reingold.
Front Psychol, 2017 Oct 17; 8. PMID: 29033865    Free PMC article.
Review.
Accuracy of Digital Pathologic Analysis vs Traditional Microscopy in the Interpretation of Melanocytic Lesions.
Tracy Onega, Raymond L Barnhill, +9 authors, Joann G Elmore.
JAMA Dermatol, 2018 Aug 25; 154(10). PMID: 30140929    Free PMC article.
The Use of Screencasts with Embedded Whole-Slide Scans and Hyperlinks to Teach Anatomic Pathology in a Supervised Digital Environment.
Mary Wong, Joseph Frye, Stacey Kim, Alberto M Marchevsky.
J Pathol Inform, 2019 Jan 05; 9. PMID: 30607306    Free PMC article.