Systematic Review
. 2020 Sep; 74(7):448-455.
doi: 10.1136/jclinpath-2020-206764.

Diagnostic concordance and discordance in digital pathology: a systematic review and meta-analysis

Ayesha S Azam 1 Islam M Miligy 2 Peter K-U Kimani 3 Heeba Maqbool 4 Katherine Hewitt 4 Nasir M Rajpoot 5 David R J Snead 4 
Affiliations
  • PMID: 32934103
  •     41 References
  •     5 citations

Abstract

Background: Digital pathology (DP) has the potential to fundamentally change the way that histopathology is practised, by streamlining the workflow, increasing efficiency, improving diagnostic accuracy and facilitating the platform for implementation of artificial intelligence-based computer-assisted diagnostics. Although the barriers to wider adoption of DP have been multifactorial, limited evidence of reliability has been a significant contributor. A meta-analysis to demonstrate the combined accuracy and reliability of DP is still lacking in the literature.

Objectives: We aimed to review the published literature on the diagnostic use of DP and to synthesise a statistically pooled evidence on safety and reliability of DP for routine diagnosis (primary and secondary) in the context of validation process.

Methods: A comprehensive literature search was conducted through PubMed, Medline, EMBASE, Cochrane Library and Google Scholar for studies published between 2013 and August 2019. The search protocol identified all studies comparing DP with light microscopy (LM) reporting for diagnostic purposes, predominantly including H&E-stained slides. Random-effects meta-analysis was used to pool evidence from the studies.

Results: Twenty-five studies were deemed eligible to be included in the review which examined a total of 10 410 histology samples (average sample size 176). For overall concordance (clinical concordance), the agreement percentage was 98.3% (95% CI 97.4 to 98.9) across 24 studies. A total of 546 major discordances were reported across 25 studies. Over half (57%) of these were related to assessment of nuclear atypia, grading of dysplasia and malignancy. These were followed by challenging diagnoses (26%) and identification of small objects (16%).

Conclusion: The results of this meta-analysis indicate equivalent performance of DP in comparison with LM for routine diagnosis. Furthermore, the results provide valuable information concerning the areas of diagnostic discrepancy which may warrant particular attention in the transition to DP.

Keywords: diagnosis; diagnostic techniques and procedures; pathology; surgical; telepathology.

Diagnostic Accuracy of Virtual Pathology vs Traditional Microscopy in a Large Dermatopathology Study.
Michael N Kent, Thomas G Olsen, +10 authors, Michael A Bottomley.
JAMA Dermatol, 2017 Oct 20; 153(12). PMID: 29049424    Free PMC article.
Guidance for Remote Reporting of Digital Pathology Slides During Periods of Exceptional Service Pressure: An Emergency Response from the UK Royal College of Pathologists.
Bethany Jill Williams, David Brettle, +8 authors, Darren Treanor.
J Pathol Inform, 2020 Jun 02; 11. PMID: 32477618    Free PMC article.
The Diagnostic Concordance of Whole Slide Imaging and Light Microscopy: A Systematic Review.
Edward Goacher, Rebecca Randell, Bethany Williams, Darren Treanor.
Arch Pathol Lab Med, 2016 Jul 12; 141(1). PMID: 27399211
Systematic Review.
US Food and Drug Administration Approval of Whole Slide Imaging for Primary Diagnosis: A Key Milestone Is Reached and New Questions Are Raised.
Andrew J Evans, Thomas W Bauer, +12 authors, Liron Pantanowitz.
Arch Pathol Lab Med, 2018 May 01; 142(11). PMID: 29708429
iPathology cockpit diagnostic station: validation according to College of American Pathologists Pathology and Laboratory Quality Center recommendation at the Hospital Trust and University of Verona.
Matteo Brunelli, Serena Beccari, +8 authors, Albino Eccher.
Diagn Pathol, 2015 Jan 08; 9 Suppl 1. PMID: 25565219    Free PMC article.
Concordance between digital pathology and light microscopy in general surgical pathology: a pilot study of 100 cases.
Joseph P Houghton, Aaron J Ervine, +5 authors, Peter W Hamilton.
J Clin Pathol, 2014 Sep 25; 67(12). PMID: 25248822
Distance reporting in digital pathology: A study on 950 cases.
Aleksandar Vodovnik.
J Pathol Inform, 2015 May 15; 6. PMID: 25969793    Free PMC article.
Whole slide images for primary diagnostics of paediatric pathology specimens: a feasibility study.
Shaimaa Al-Janabi, André Huisman, +2 authors, Paul J van Diest.
J Clin Pathol, 2012 Dec 04; 66(3). PMID: 23204560
Validation of a whole slide imaging system for primary diagnosis in surgical pathology: A community hospital experience.
Thomas P Buck, Rebecca Dilorio, Lauren Havrilla, Dennis G O'Neill.
J Pathol Inform, 2014 Dec 24; 5(1). PMID: 25535591    Free PMC article.
A Systematic Analysis of Discordant Diagnoses in Digital Pathology Compared With Light Microscopy.
Bethany J Williams, Philip DaCosta, Edward Goacher, Darren Treanor.
Arch Pathol Lab Med, 2017 May 04; 141(12). PMID: 28467215
Systematic Review.
Validating whole-slide imaging for consultation diagnoses in surgical pathology.
Thomas W Bauer, Renee J Slaw.
Arch Pathol Lab Med, 2014 May 21; 138(11). PMID: 24840034
Twenty Years of Digital Pathology: An Overview of the Road Travelled, What is on the Horizon, and the Emergence of Vendor-Neutral Archives.
Liron Pantanowitz, Ashish Sharma, +3 authors, Joel Saltz.
J Pathol Inform, 2019 Jan 05; 9. PMID: 30607307    Free PMC article.
Review.
Digital pathology for the primary diagnosis of breast histopathological specimens: an innovative validation and concordance study on digital pathology validation and training.
Bethany Jill Williams, Andrew Hanby, +3 authors, Darren Treanor.
Histopathology, 2017 Sep 25; 72(4). PMID: 28940580
Digital slide viewing for primary reporting in gastrointestinal pathology: a validation study.
Maurice B Loughrey, Paul J Kelly, +5 authors, Peter W Hamilton.
Virchows Arch, 2015 May 20; 467(2). PMID: 25982098
Intra-observer reproducibility of whole slide imaging for the primary diagnosis of breast needle biopsies.
Carolina Reyes, Offiong F Ikpatt, Mehrdad Nadji, Richard J Cote.
J Pathol Inform, 2014 Apr 18; 5(1). PMID: 24741464    Free PMC article.
Validation of multiple whole slide imaging scanners based on the guideline from the College of American Pathologists Pathology and Laboratory Quality Center.
Michael J Thrall, Jana L Wimmer, Mary R Schwartz.
Arch Pathol Lab Med, 2015 May 01; 139(5). PMID: 25927149
Validation of digital microscopy in the histopathological diagnoses of oral diseases.
Anna Luíza Damaceno Araújo, Gleyson Kleber Amaral-Silva, +6 authors, Alan Roger Santos-Silva.
Virchows Arch, 2018 Jun 03; 473(3). PMID: 29858684
Daily Biopsy Diagnosis in Surgical Pathology: Concordance Between Light Microscopy and Whole-Slide Imaging in Real-Life Conditions.
Irène Villa, Marie-Christine Mathieu, +5 authors, Peggy Dartigues.
Am J Clin Pathol, 2018 Feb 17; 149(4). PMID: 29452345
Validation of digital pathology imaging for primary histopathological diagnosis.
David R J Snead, Yee-Wah Tsang, +16 authors, Ian A Cree.
Histopathology, 2015 Sep 27; 68(7). PMID: 26409165
Interobserver variation in the reporting of cervical colposcopic biopsy specimens: comparison of grading systems.
W G McCluggage, H Bharucha, +4 authors, M Y Walsh.
J Clin Pathol, 1996 Oct 01; 49(10). PMID: 8943751    Free PMC article.
Artificial intelligence in digital pathology - new tools for diagnosis and precision oncology.
Kaustav Bera, Kurt A Schalper, +2 authors, Anant Madabhushi.
Nat Rev Clin Oncol, 2019 Aug 11; 16(11). PMID: 31399699    Free PMC article.
Highly Cited. Review.
The performance of digital microscopy for primary diagnosis in human pathology: a systematic review.
Anna Luíza Damaceno Araújo, Lady Paola Aristizábal Arboleda, +13 authors, Alan Roger Santos-Silva.
Virchows Arch, 2019 Jan 28; 474(3). PMID: 30685784
Systematic Review.
Diagnostic time in digital pathology: A comparative study on 400 cases.
Aleksandar Vodovnik.
J Pathol Inform, 2016 Mar 10; 7. PMID: 26955502    Free PMC article.
Validation of Digital Pathology for Primary Histopathological Diagnosis of Routine, Inflammatory Dermatopathology Cases.
Jonathan J Lee, Jaroslaw Jedrych, Liron Pantanowitz, Jonhan Ho.
Am J Dermatopathol, 2017 Aug 02; 40(1). PMID: 28763335
Whole slide imaging equivalency and efficiency study: experience at a large academic center.
Matthew G Hanna, Victor E Reuter, +17 authors, S Joseph Sirintrapun.
Mod Pathol, 2019 Feb 20; 32(7). PMID: 30778169
Digital pathology access and usage in the UK: results from a national survey on behalf of the National Cancer Research Institute's CM-Path initiative.
Bethany Jill Williams, Jessica Lee, Karin A Oien, Darren Treanor.
J Clin Pathol, 2018 Jan 11; 71(5). PMID: 29317516    Free PMC article.
Validation of diagnostic accuracy with whole-slide imaging compared with glass slide review in dermatopathology.
Kabeer K Shah, Julia S Lehman, +3 authors, Carilyn N Wieland.
J Am Acad Dermatol, 2016 Oct 16; 75(6). PMID: 27742174
A Randomized Study Comparing Digital Imaging to Traditional Glass Slide Microscopy for Breast Biopsy and Cancer Diagnosis.
Joann G Elmore, Gary M Longton, +11 authors, Donald L Weaver.
J Pathol Inform, 2017 Apr 07; 8. PMID: 28382226    Free PMC article.
Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology: A Multicenter Blinded Randomized Noninferiority Study of 1992 Cases (Pivotal Study).
Sanjay Mukhopadhyay, Michael D Feldman, +31 authors, Clive R Taylor.
Am J Surg Pathol, 2017 Sep 30; 42(1). PMID: 28961557    Free PMC article.
Whole slide images for primary diagnostics of urinary system pathology: a feasibility study.
Shaimaa Al-Janabi, André Huisman, +3 authors, Paul J van Diest.
J Renal Inj Prev, 2015 Jan 23; 3(4). PMID: 25610886    Free PMC article.
Digital pathology and artificial intelligence will be key to supporting clinical and academic cellular pathology through COVID-19 and future crises: the PathLAKE consortium perspective.
Lisa Browning, Richard Colling, +6 authors, Clare Verrill.
J Clin Pathol, 2020 Jul 06; 74(7). PMID: 32620678    Free PMC article.
Review.
Rayyan-a web and mobile app for systematic reviews.
Mourad Ouzzani, Hossam Hammady, Zbys Fedorowicz, Ahmed Elmagarmid.
Syst Rev, 2016 Dec 07; 5(1). PMID: 27919275    Free PMC article.
Highly Cited.
Whole slide imaging diagnostic concordance with light microscopy for breast needle biopsies.
W Scott Campbell, Steven H Hinrichs, +5 authors, William W West.
Hum Pathol, 2014 Jun 11; 45(8). PMID: 24913758
Breast cancer histologic grading using digital microscopy: concordance and outcome association.
Emad A Rakha, Mohamed Aleskandarani, +4 authors, Leslie W Dalton.
J Clin Pathol, 2018 Mar 15; 71(8). PMID: 29535212
Whole-slide imaging at primary pathological diagnosis: Validation of whole-slide imaging-based primary pathological diagnosis at twelve Japanese academic institutes.
Kazuhiro Tabata, Ichiro Mori, +13 authors, Junya Fukuoka.
Pathol Int, 2017 Oct 06; 67(11). PMID: 28980740
The College of American Pathologists guidelines for whole slide imaging validation are feasible for pediatric pathology: a pediatric pathology practice experience.
Michael A Arnold, Emily Chenever, +9 authors, Thomas Barr.
Pediatr Dev Pathol, 2014 Nov 12; 18(2). PMID: 25387255
Validation of whole slide imaging for primary diagnosis in surgical pathology.
Thomas W Bauer, Lynn Schoenfield, +3 authors, Walter H Henricks.
Arch Pathol Lab Med, 2013 Jan 18; 137(4). PMID: 23323732
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement.
David Moher, Alessandro Liberati, +2 authors, PRISMA Group.
J Clin Epidemiol, 2009 Jul 28; 62(10). PMID: 19631508
Highly Cited.
Validating whole slide imaging for diagnostic purposes in pathology: guideline from the College of American Pathologists Pathology and Laboratory Quality Center.
Liron Pantanowitz, John H Sinard, +8 authors, College of American Pathologists Pathology and Laboratory Quality Center.
Arch Pathol Lab Med, 2013 May 03; 137(12). PMID: 23634907    Free PMC article.
Highly Cited. Review.
Validation of whole slide imaging in the primary diagnosis of gynaecological pathology in a University Hospital.
Jaume Ordi, Paola Castillo, +4 authors, Jose Ramírez.
J Clin Pathol, 2014 Oct 31; 68(1). PMID: 25355520
Validation of whole-slide imaging in the primary diagnosis of liver biopsies in a University Hospital.
Adela Saco, Alba Diaz, +7 authors, Jaume Ordi.
Dig Liver Dis, 2017 Aug 07; 49(11). PMID: 28780052
Digital Pathology: Advantages, Limitations and Emerging Perspectives.
Stephan W Jahn, Markus Plass, Farid Moinfar.
J Clin Med, 2020 Nov 22; 9(11). PMID: 33217963    Free PMC article.
Review.
A large-scale internal validation study of unsupervised virtual trichrome staining technologies on nonalcoholic steatohepatitis liver biopsies.
Joshua J Levy, Nasim Azizgolshani, +7 authors, Louis J Vaickus.
Mod Pathol, 2020 Dec 11; 34(4). PMID: 33299110    Free PMC article.
Evaluation of the Use of Single- and Multi-Magnification Convolutional Neural Networks for the Determination and Quantitation of Lesions in Nonclinical Pathology Studies.
Jogile Kuklyte, Jenny Fitzgerald, +14 authors, Donal O'Shea.
Toxicol Pathol, 2021 Feb 24; 49(4). PMID: 33618634    Free PMC article.
WHO/ISUP grading of clear cell renal cell carcinoma and papillary renal cell carcinoma; validation of grading on the digital pathology platform and perspectives on reproducibility of grade.
Lisa Browning, Richard Colling, Clare Verrill.
Diagn Pathol, 2021 Aug 23; 16(1). PMID: 34419085    Free PMC article.
Diagnostic Pitfalls of Digital Microscopy Versus Light Microscopy in Gastrointestinal Pathology: A Systematic Review.
Wangpan Shi, Petros Georgiou, +6 authors, Safeera Khan.
Cureus, 2021 Sep 23; 13(8). PMID: 34548958    Free PMC article.
Review.