Journal Article
. 2017 Oct; 153(12):1285-1291.
doi: 10.1001/jamadermatol.2017.3284.

Diagnostic Accuracy of Virtual Pathology vs Traditional Microscopy in a Large Dermatopathology Study

Michael N Kent 1 Thomas G Olsen 1 Theresa A Feeser 1 Katherine C Tesno 1 John C Moad 1 Michael P Conroy 1 Mary Jo Kendrick 1 Sean R Stephenson 1 Michael R Murchland 1 Ayesha U Khan 1 Elizabeth A Peacock 1 Alexa Brumfiel 1 Michael A Bottomley 2 
Affiliations
  • PMID: 29049424
  •     41 References
  •     15 citations

Abstract

Importance: Digital pathology represents a transformative technology that impacts dermatologists and dermatopathologists from residency to academic and private practice. Two concerns are accuracy of interpretation from whole-slide images (WSI) and effect on workflow. Studies of considerably large series involving single-organ systems are lacking.

Objective: To evaluate whether diagnosis from WSI on a digital microscope is inferior to diagnosis of glass slides from traditional microscopy (TM) in a large cohort of dermatopathology cases with attention on image resolution, specifically eosinophils in inflammatory cases and mitotic figures in melanomas, and to measure the workflow efficiency of WSI compared with TM.

Design, Setting, And Participants: Three dermatopathologists established interobserver ground truth consensus (GTC) diagnosis for 499 previously diagnosed cases proportionally representing the spectrum of diagnoses seen in the laboratory. Cases were distributed to 3 different dermatopathologists who diagnosed by WSI and TM with a minimum 30-day washout between methodologies. Intraobserver WSI/TM diagnoses were compared, followed by interobserver comparison with GTC. Concordance, major discrepancies, and minor discrepancies were calculated and analyzed by paired noninferiority testing. We also measured pathologists' read rates to evaluate workflow efficiency between WSI and TM. This retrospective study was caried out in an independent, national, university-affiliated dermatopathology laboratory.

Main Outcomes And Measures: Intraobserver concordance of diagnoses between WSI and TM methods and interobserver variance from GTC, following College of American Pathology guidelines.

Results: Mean intraobserver concordance between WSI and TM was 94%. Mean interobserver concordance was 94% for WSI and GTC and 94% for TM and GTC. Mean interobserver concordance between WSI, TM, and GTC was 91%. Diagnoses from WSI were noninferior to those from TM. Whole-slide image read rates were commensurate with WSI experience, achieving parity with TM by the most experienced user.

Conclusions And Relevance: Diagnosis from WSI was found equivalent to diagnosis from glass slides using TM in this statistically powerful study of 499 dermatopathology cases. This study supports the viability of WSI for primary diagnosis in the clinical setting.

A multiobserver, population-based analysis of histologic dysplasia in melanocytic nevi.
M W Piepkorn, R L Barnhill, +7 authors, R W Sagebiel.
J Am Acad Dermatol, 1994 May 01; 30(5 Pt 1). PMID: 8176008
Whole-slide imaging digital pathology as a platform for teleconsultation: a pilot study using paired subspecialist correlations.
David C Wilbur, Kalil Madi, +22 authors, Wolfgang Klietmann.
Arch Pathol Lab Med, 2009 Dec 08; 133(12). PMID: 19961250    Free PMC article.
Clinical decision making based on histopathologic grading and margin status of dysplastic nevi.
Keith L Duffy, David J Mann, Vesna Petronic-Rosic, Christopher R Shea.
Arch Dermatol, 2012 Feb 22; 148(2). PMID: 22351835
Validation of whole slide imaging for primary diagnosis in surgical pathology.
Thomas W Bauer, Lynn Schoenfield, +3 authors, Walter H Henricks.
Arch Pathol Lab Med, 2013 Jan 18; 137(4). PMID: 23323732
Virtual reality microscope versus conventional microscope regarding time to diagnosis: an experimental study.
Rebecca Randell, Roy A Ruddle, +3 authors, Darren Treanor.
Histopathology, 2012 Aug 14; 62(2). PMID: 22882289
Randomized comparison of virtual microscopy and traditional glass microscopy in diagnostic accuracy among dermatology and pathology residents.
Laine H Koch, James N Lampros, +3 authors, Antoinette F Hood.
Hum Pathol, 2009 Jan 16; 40(5). PMID: 19144382
Reexamining the Threshold for Reexcision of Histologically Transected Dysplastic Nevi.
Nathaniel H Fleming, Barbara M Egbert, Jinah Kim, Susan M Swetter.
JAMA Dermatol, 2016 Aug 20; 152(12). PMID: 27542070
Discordance in the histopathologic diagnosis of melanoma at a melanoma referral center.
B Aika Shoo, Richard W Sagebiel, Mohammed Kashani-Sabet.
J Am Acad Dermatol, 2010 Mar 23; 62(5). PMID: 20303612
Interobserver reproducibility of histological features in cutaneous malignant melanoma.
C Urso, F Rongioletti, +9 authors, M Pippione.
J Clin Pathol, 2005 Oct 29; 58(11). PMID: 16254111    Free PMC article.
Understanding interobserver agreement: the kappa statistic.
Anthony J Viera, Joanne M Garrett.
Fam Med, 2005 May 11; 37(5). PMID: 15883903
Highly Cited.
Digital pathology: current status and future perspectives.
Shaimaa Al-Janabi, André Huisman, Paul J Van Diest.
Histopathology, 2011 Apr 12; 61(1). PMID: 21477260
Review.
Agreement of dermatopathologists in the evaluation of clinically difficult melanocytic lesions: how golden is the 'gold standard'?
R P Braun, D Gutkowicz-Krusin, +12 authors, M Mihm.
Dermatology, 2012 Mar 22; 224(1). PMID: 22433231
Addressing the knowledge gap in clinical recommendations for management and complete excision of clinically atypical nevi/dysplastic nevi: Pigmented Lesion Subcommittee consensus statement.
Caroline C Kim, Susan M Swetter, +11 authors, Suephy C Chen.
JAMA Dermatol, 2014 Nov 20; 151(2). PMID: 25409291
Review.
Digital pathology and image analysis augment biospecimen annotation and biobank quality assurance harmonization.
Bih-Rong Wei, R Mark Simpson.
Clin Biochem, 2013 Dec 24; 47(4-5). PMID: 24362266    Free PMC article.
Statistical methods for assessing observer variability in clinical measures.
P Brennan, A Silman.
BMJ, 1992 Jun 06; 304(6840). PMID: 1611375    Free PMC article.
Highly Cited.
Implementation of large-scale routine diagnostics using whole slide imaging in Sweden: Digital pathology experiences 2006-2013.
Sten Thorstenson, Jesper Molin, Claes Lundström.
J Pathol Inform, 2014 May 21; 5(1). PMID: 24843825    Free PMC article.
Discordance in the histopathologic diagnosis of melanoma and melanocytic nevi between expert pathologists.
E R Farmer, R Gonin, M P Hanna.
Hum Pathol, 1996 Jun 01; 27(6). PMID: 8666360
Review.
Diagnostic time in digital pathology: A comparative study on 400 cases.
Aleksandar Vodovnik.
J Pathol Inform, 2016 Mar 10; 7. PMID: 26955502    Free PMC article.
A comprehensive analysis of a web-based dermatopathology second opinion consultation practice.
Artur Zembowicz, Adeel Ahmad, Stephen R Lyle.
Arch Pathol Lab Med, 2011 Mar 04; 135(3). PMID: 21366464
Tests for equivalence or non-inferiority for paired binary data.
Jen-pei Liu, Huey-miin Hsueh, Eric Hsieh, James J Chen.
Stat Med, 2002 Jan 10; 21(2). PMID: 11782062
Comparative diagnostic accuracy in virtual dermatopathology.
Ellen Mooney, Antoinette F Hood, +2 authors, Gregor B E Jemec.
Skin Res Technol, 2011 Jan 22; 17(2). PMID: 21251087
Dermatologist-level classification of skin cancer with deep neural networks.
Andre Esteva, Brett Kuprel, +4 authors, Sebastian Thrun.
Nature, 2017 Jan 25; 542(7639). PMID: 28117445    Free PMC article.
Highly Cited.
Digital pathology consultations-a new era in digital imaging, challenges and practical applications.
Gonzalo Romero Lauro, William Cable, +4 authors, Liron Pantanowitz.
J Digit Imaging, 2013 Jan 30; 26(4). PMID: 23359091    Free PMC article.
"Virtual microscopy" and the internet as telepathology consultation tools: diagnostic accuracy in evaluating melanocytic skin lesions.
D H Okada, S W Binder, +2 authors, A M Marchevsky.
Am J Dermatopathol, 1999 Dec 23; 21(6). PMID: 10608244
Primary histologic diagnosis using automated whole slide imaging: a validation study.
John R Gilbertson, Jonhan Ho, +3 authors, Anil V Parwani.
BMC Clin Pathol, 2006 Apr 29; 6. PMID: 16643664    Free PMC article.
Favorable long-term outcomes in patients with histologically dysplastic nevi that approach a specimen border.
Thomas L Hocker, Ali Alikhan, Nneka I Comfere, Margot S Peters.
J Am Acad Dermatol, 2012 Nov 07; 68(4). PMID: 23127472
Automated quantification of MART1-verified Ki67 indices by digital image analysis in melanocytic lesions.
Patricia Switten Nielsen, Rikke Riber-Hansen, Jakob Raundahl, Torben Steiniche.
Arch Pathol Lab Med, 2012 Jun 01; 136(6). PMID: 22646269
Virtual microscopy: an evaluation of its validity and diagnostic performance in routine histologic diagnosis of skin tumors.
Patricia Switten Nielsen, Jan Lindebjerg, +3 authors, Bjarne Nielsen.
Hum Pathol, 2010 Sep 28; 41(12). PMID: 20869750
Validating whole slide imaging for diagnostic purposes in pathology: guideline from the College of American Pathologists Pathology and Laboratory Quality Center.
Liron Pantanowitz, John H Sinard, +8 authors, College of American Pathologists Pathology and Laboratory Quality Center.
Arch Pathol Lab Med, 2013 May 03; 137(12). PMID: 23634907    Free PMC article.
Highly Cited. Review.
Virtual reality Powerwall versus conventional microscope for viewing pathology slides: an experimental comparison.
Darren Treanor, Naomi Jordan-Owers, +3 authors, Roy A Ruddle.
Histopathology, 2009 Sep 03; 55(3). PMID: 19723144
Teledermatopathology: a controlled study about diagnostic validity and technical requirements for digital transmission.
Bernd Leinweber, Cesare Massone, +7 authors, Josef Smolle.
Am J Dermatopathol, 2006 Oct 03; 28(5). PMID: 17012916
Review of the current state of whole slide imaging in pathology.
Liron Pantanowitz, Paul N Valenstein, +5 authors, Terence J Colgan.
J Pathol Inform, 2011 Sep 03; 2. PMID: 21886892    Free PMC article.
Highly Cited.
Validation of diagnostic accuracy with whole-slide imaging compared with glass slide review in dermatopathology.
Kabeer K Shah, Julia S Lehman, +3 authors, Carilyn N Wieland.
J Am Acad Dermatol, 2016 Oct 16; 75(6). PMID: 27742174
Evaluating whole slide imaging: A working group opportunity.
Darren Treanor, Brandon D Gallas, Marios A Gavrielides, Stephen M Hewitt.
J Pathol Inform, 2015 Mar 17; 6. PMID: 25774315    Free PMC article.
Feasibility and diagnostic agreement in teledermatopathology using a virtual slide system.
Cesare Massone, H Peter Soyer, +18 authors, Helmut Kerl.
Hum Pathol, 2007 Feb 03; 38(4). PMID: 17270240
Histologic outcomes of excised moderate and severe dysplastic nevi.
Maria V Abello-Poblete, Lilia M Correa-Selm, +2 authors, Babar K Rao.
Dermatol Surg, 2013 Dec 11; 40(1). PMID: 24320231
Evaluation of 2 whole-slide imaging applications in dermatopathology.
Nicole Velez, Drazen Jukic, Jonhan Ho.
Hum Pathol, 2008 Jul 11; 39(9). PMID: 18614200
Image analysis and machine learning in digital pathology: Challenges and opportunities.
Anant Madabhushi, George Lee.
Med Image Anal, 2016 Jul 18; 33. PMID: 27423409    Free PMC article.
Highly Cited. Review.
The Diagnostic Concordance of Whole Slide Imaging and Light Microscopy: A Systematic Review.
Edward Goacher, Rebecca Randell, Bethany Williams, Darren Treanor.
Arch Pathol Lab Med, 2016 Jul 12; 141(1). PMID: 27399211
Systematic Review.
Whole slide images for primary diagnostics in dermatopathology: a feasibility study.
Shaimaa Al-Janabi, André Huisman, +5 authors, Paul J van Diest.
J Clin Pathol, 2011 Oct 28; 65(2). PMID: 22031590
Virtual microscopy using whole-slide imaging as an enabler for teledermatopathology: A paired consultant validation study.
Ayman Al Habeeb, Andrew Evans, Danny Ghazarian.
J Pathol Inform, 2012 Mar 23; 3. PMID: 22439122    Free PMC article.
Accuracy of Digital Pathologic Analysis vs Traditional Microscopy in the Interpretation of Melanocytic Lesions.
Tracy Onega, Raymond L Barnhill, +9 authors, Joann G Elmore.
JAMA Dermatol, 2018 Aug 25; 154(10). PMID: 30140929    Free PMC article.
Long-Range Diagnosis of and Support for Skin Conditions in Field Settings.
Victoria Williams, Carrie Kovarik.
Trop Med Infect Dis, 2018 Oct 03; 3(3). PMID: 30274480    Free PMC article.
Diagnostic Performance of Deep Learning Algorithms Applied to Three Common Diagnoses in Dermatopathology.
Thomas George Olsen, B Hunter Jackson, +5 authors, Rajath E Soans.
J Pathol Inform, 2018 Oct 09; 9. PMID: 30294501    Free PMC article.
Tailored for Real-World: A Whole Slide Image Classification System Validated on Uncurated Multi-Site Data Emulating the Prospective Pathology Workload.
Julianna D Ianni, Rajath E Soans, +9 authors, Jason B Lee.
Sci Rep, 2020 Feb 23; 10(1). PMID: 32081956    Free PMC article.
Validation of Image Quality and Diagnostic Accuracy Using a Mobile Phone Camera Microscope Adaptor Compared With Glass Slide Review in Teledermatopathology.
Caroline W Laggis, Elizabeth E Bailey, +5 authors, Carrie Kovarik.
Am J Dermatopathol, 2019 Oct 22; 42(5). PMID: 31633596    Free PMC article.
Attitudes Toward Artificial Intelligence Within Dermatopathology: An International Online Survey.
Sam Polesie, Phillip H McKee, +4 authors, John Paoli.
Front Med (Lausanne), 2020 Nov 17; 7. PMID: 33195357    Free PMC article.
Recommendations for pathologic practice using digital pathology: consensus report of the Korean Society of Pathologists.
Yosep Chong, Dae Cheol Kim, +5 authors, Medical Informatics Study Group of the Korean Society of Pathologists.
J Pathol Transl Med, 2020 Oct 08; 54(6). PMID: 33027850    Free PMC article.
Review.
Optical coherence tomography imaging of melanoma skin cancer.
Ali Rajabi-Estarabadi, Julie M Bittar, +6 authors, Keyvan Nouri.
Lasers Med Sci, 2018 Dec 13; 34(2). PMID: 30539405
Review.
The performance of digital microscopy for primary diagnosis in human pathology: a systematic review.
Anna Luíza Damaceno Araújo, Lady Paola Aristizábal Arboleda, +13 authors, Alan Roger Santos-Silva.
Virchows Arch, 2019 Jan 28; 474(3). PMID: 30685784
Systematic Review.
A large-scale internal validation study of unsupervised virtual trichrome staining technologies on nonalcoholic steatohepatitis liver biopsies.
Joshua J Levy, Nasim Azizgolshani, +7 authors, Louis J Vaickus.
Mod Pathol, 2020 Dec 11; 34(4). PMID: 33299110    Free PMC article.
Fully digital pathology laboratory routine and remote reporting of oral and maxillofacial diagnosis during the COVID-19 pandemic: a validation study.
Anna Luíza Damaceno Araújo, Gleyson Kleber do Amaral-Silva, +15 authors, Pablo Agustin Vargas.
Virchows Arch, 2021 Mar 14; 479(3). PMID: 33713188    Free PMC article.
Multiplexed Immunohistochemistry and Digital Pathology as the Foundation for Next-Generation Pathology in Melanoma: Methodological Comparison and Future Clinical Applications.
Yannick Van Herck, Asier Antoranz, +4 authors, Francesca Maria Bosisio.
Front Oncol, 2021 Apr 16; 11. PMID: 33854972    Free PMC article.
Review.
Diagnostic concordance and discordance in digital pathology: a systematic review and meta-analysis.
Ayesha S Azam, Islam M Miligy, +4 authors, David R J Snead.
J Clin Pathol, 2020 Sep 17; 74(7). PMID: 32934103    Free PMC article.
Systematic Review.
Virtual Microscopy in Undergraduate Pathology Education: An early transformative experience in clinical reasoning.
Ritu Lakhtakia.
Sultan Qaboos Univ Med J, 2021 Sep 16; 21(3). PMID: 34522409    Free PMC article.
The utility of digital pathology in improving the diagnostic skills of pathology trainees in commonly encountered pigmented cutaneous lesions during the COVID-19 pandemic: A single academic institution experience.
Woo Cheal Cho, Pavandeep Gill, +6 authors, Carlos A Torres-Cabala.
Ann Diagn Pathol, 2021 Aug 22; 54. PMID: 34418768    Free PMC article.