Systematic Review
. 2019 Jan; 474(3):269-287.
doi: 10.1007/s00428-018-02519-z.

The performance of digital microscopy for primary diagnosis in human pathology: a systematic review

Anna Luíza Damaceno Araújo 1 Lady Paola Aristizábal Arboleda 1 Natalia Rangel Palmier 1 Jéssica Montenegro Fonsêca 1 Mariana de Pauli Paglioni 1 Wagner Gomes-Silva 1 Ana Carolina Prado Ribeiro 1 Thaís Bianca Brandão 2 Luciana Estevam Simonato 3 Paul M Speight 4 Felipe Paiva Fonseca 1 Marcio Ajudarte Lopes 1 Oslei Paes de Almeida 1 Pablo Agustin Vargas 1 Cristhian Camilo Madrid Troconis 5 Alan Roger Santos-Silva 6 
Affiliations
  • PMID: 30685784
  •     52 References
  •     12 citations

Abstract

Validation studies of whole slide imaging (WSI) systems produce evidence regarding digital microscopy (DM). This systematic review aimed to provide information about the performance of WSI devices by evaluating intraobserver agreement reported in previously published studies as the best evidence to elucidate whether DM is reliable for primary diagnostic purposes. In addition, this review delineates the reasons for the occurrence of discordant diagnoses. Scopus, MEDLINE/PubMed, and Embase were searched electronically. A total of 13 articles were included. The total sample of 2145 had a majority of 695 (32.4%) cases from dermatopathology, followed by 200 (9.3%) cases from gastrointestinal pathology. Intraobserver agreements showed an excellent concordance, with values ranging from 87% to 98.3% (κ coefficient range 0.8-0.98). Ten studies (77%) reported a total of 128 disagreements. The remaining three studies (23%) did not report the exact number and nature of disagreements. Borderline/challenging cases were the most frequently reported reason for disagreements (53.8%). Six authors reported limitations of the equipment and/or limited image resolution as reasons for the discordant diagnoses. Within these articles, the reported pitfalls were as follows: difficulties in the identification of eosinophilic granular bodies in brain biopsies; eosinophils and nucleated red blood cells; and mitotic figures, nuclear details, and chromatin patterns in neuropathology specimens. The lack of image clarity was reported to be associated with difficulties in the identification of microorganisms (e.g., Candida albicans, Helicobacter pylori, and Giardia lamblia). However, authors stated that the intraobserver variances do not derive from technical limitations of WSI. A lack of clinical information was reported by four authors as a source for disagreements. Two studies (15.4%) reported poor quality of the biopsies, specifically small size of the biopsy material or inadequate routine laboratory processes as reasons for disagreements. One author (7.7%) indicated the lack of immunohistochemistry and special stains as a source for discordance. Furthermore, nine studies (69.2%) did not consider the performance of the digital method-limitations of the equipment, insufficient magnification/limited image resolution-as reasons for disagreements. To summarize the pitfalls of digital pathology practice and better address the root cause of the diagnostic discordance, we suggest a Categorization for Digital Pathology Discrepancies to be used in further validations studies. Among 99 discordances, only 37 (37.3%) had preferred diagnosis rendered by means of WSI. The risk of bias and applicability concerns were judged with the QUADAS-2. Two studies (15.4%) presented an unclear risk of bias in the sample selection domain and 2 (15.4%) presented a high risk of bias in the index test domain. Regarding applicability, all studies included were classified as a low concern in all domains. The included studies were optimally designed to validate WSI for general clinical use, providing evidence with confidence. In general, this systematic review showed a high concordance between diagnoses achieved by using WSI and conventional light microscope (CLM), summarizes difficulties related to specific findings of certain areas of pathology-including dermatopathology, pediatric pathology, neuropathology, and gastrointestinal pathology-and demonstrated that WSI can be used to render primary diagnoses in several subspecialties of human pathology.

Keywords: Intraobserver agreement; Systematic review; Whole slide imaging.

No role for quality scores in systematic reviews of diagnostic accuracy studies.
Penny Whiting, Roger Harbord, Jos Kleijnen.
BMC Med Res Methodol, 2005 May 28; 5. PMID: 15918898    Free PMC article.
Systematic Review.
Bias in sensitivity and specificity caused by data-driven selection of optimal cutoff values: mechanisms, magnitude, and solutions.
Mariska M G Leeflang, Karel G M Moons, Johannes B Reitsma, Aielko H Zwinderman.
Clin Chem, 2008 Feb 09; 54(4). PMID: 18258670
Randomized comparison of virtual microscopy and traditional glass microscopy in diagnostic accuracy among dermatology and pathology residents.
Laine H Koch, James N Lampros, +3 authors, Antoinette F Hood.
Hum Pathol, 2009 Jan 16; 40(5). PMID: 19144382
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement.
David Moher, Alessandro Liberati, +2 authors, PRISMA Group.
PLoS Med, 2009 Jul 22; 6(7). PMID: 19621072    Free PMC article.
Highly Cited.
Ovarian frozen section diagnosis: use of whole-slide imaging shows excellent correlation between virtual slide and original interpretations in a large series of cases.
Margaret A Fallon, David C Wilbur, Manju Prasad.
Arch Pathol Lab Med, 2010 Jul 01; 134(7). PMID: 20586631
Virtual microscopy: an evaluation of its validity and diagnostic performance in routine histologic diagnosis of skin tumors.
Patricia Switten Nielsen, Jan Lindebjerg, +3 authors, Bjarne Nielsen.
Hum Pathol, 2010 Sep 28; 41(12). PMID: 20869750
Interobserver and intraobserver reproducibility in digital and routine microscopic assessment of prostate needle biopsies.
Paula A Rodriguez-Urrego, Angel M Cronin, +4 authors, Samson W Fine.
Hum Pathol, 2010 Oct 26; 42(1). PMID: 20970164
Review of the current state of whole slide imaging in pathology.
Liron Pantanowitz, Paul N Valenstein, +5 authors, Terence J Colgan.
J Pathol Inform, 2011 Sep 03; 2. PMID: 21886892    Free PMC article.
Highly Cited.
Whole slide images for primary diagnostics of gastrointestinal tract pathology: a feasibility study.
Shaimaa Al-Janabi, André Huisman, +4 authors, Paul J van Diest.
Hum Pathol, 2011 Sep 23; 43(5). PMID: 21937077
Whole slide images for primary diagnostics in dermatopathology: a feasibility study.
Shaimaa Al-Janabi, André Huisman, +5 authors, Paul J van Diest.
J Clin Pathol, 2011 Oct 28; 65(2). PMID: 22031590
Comparing digital and optical microscopy diagnoses of breast and prostate core biopsies.
Ana Richelia Jara-Lazaro, Puay Hoon Tan.
Pathology, 2011 Dec 14; 44(1). PMID: 22157691
Validation of diagnostic accuracy using digital slides in routine histopathology.
László Fónyad, Tibor Krenács, +7 authors, Béla Molnár.
Diagn Pathol, 2012 Apr 03; 7. PMID: 22463804    Free PMC article.
Whole-slide imaging: routine pathologic diagnosis.
Toby C Cornish, Ryan E Swapp, Keith J Kaplan.
Adv Anat Pathol, 2012 Apr 14; 19(3). PMID: 22498580
Review.
Concordance between whole-slide imaging and light microscopy for routine surgical pathology.
W Scott Campbell, Subodh M Lele, +3 authors, Steven H Hinrichs.
Hum Pathol, 2012 May 18; 43(10). PMID: 22591912
Comparing virtual with conventional microscopy for the consensus diagnosis of Barrett's neoplasia in the AspECT Barrett's chemoprevention trial pathology audit.
D S A Sanders, H Grabsch, +8 authors, AspECT Trial Management Group andTrial Principal Investigators.
Histopathology, 2012 Jun 22; 61(5). PMID: 22716297
Virtual reality microscope versus conventional microscope regarding time to diagnosis: an experimental study.
Rebecca Randell, Roy A Ruddle, +3 authors, Darren Treanor.
Histopathology, 2012 Aug 14; 62(2). PMID: 22882289
Digital slide images for primary diagnostics in breast pathology: a feasibility study.
S Al-Janabi, A Huisman, S M Willems, P J Van Diest.
Hum Pathol, 2012 Aug 21; 43(12). PMID: 22901465
Whole slide images for primary diagnostics of paediatric pathology specimens: a feasibility study.
Shaimaa Al-Janabi, André Huisman, +2 authors, Paul J van Diest.
J Clin Pathol, 2012 Dec 04; 66(3). PMID: 23204560
Validation of whole slide imaging for primary diagnosis in surgical pathology.
Thomas W Bauer, Lynn Schoenfield, +3 authors, Walter H Henricks.
Arch Pathol Lab Med, 2013 Jan 18; 137(4). PMID: 23323732
Digital pathology consultations-a new era in digital imaging, challenges and practical applications.
Gonzalo Romero Lauro, William Cable, +4 authors, Liron Pantanowitz.
J Digit Imaging, 2013 Jan 30; 26(4). PMID: 23359091    Free PMC article.
Validating whole slide imaging for diagnostic purposes in pathology: guideline from the College of American Pathologists Pathology and Laboratory Quality Center.
Liron Pantanowitz, John H Sinard, +8 authors, College of American Pathologists Pathology and Laboratory Quality Center.
Arch Pathol Lab Med, 2013 May 03; 137(12). PMID: 23634907    Free PMC article.
Highly Cited. Review.
Multi-institutional comparison of whole slide digital imaging and optical microscopy for interpretation of hematoxylin-eosin-stained breast tissue sections.
Savitri Krishnamurthy, Kurt Mathews, +12 authors, Kevin Liang.
Arch Pathol Lab Med, 2013 Aug 21; 137(12). PMID: 23947655
A comparison of cervical histopathology variability using whole slide digitized images versus glass slides: experience with a statewide registry.
Julia C Gage, Nancy Joste, +4 authors, Cosette M Wheeler.
Hum Pathol, 2013 Oct 01; 44(11). PMID: 24075599    Free PMC article.
Validating whole-slide imaging for consultation diagnoses in surgical pathology.
Thomas W Bauer, Renee J Slaw.
Arch Pathol Lab Med, 2014 May 21; 138(11). PMID: 24840034
Whole slide imaging diagnostic concordance with light microscopy for breast needle biopsies.
W Scott Campbell, Steven H Hinrichs, +5 authors, William W West.
Hum Pathol, 2014 Jun 11; 45(8). PMID: 24913758
Validation of whole slide imaging in the primary diagnosis of gynaecological pathology in a University Hospital.
Jaume Ordi, Paola Castillo, +4 authors, Jose Ramírez.
J Clin Pathol, 2014 Oct 31; 68(1). PMID: 25355520
The College of American Pathologists guidelines for whole slide imaging validation are feasible for pediatric pathology: a pediatric pathology practice experience.
Michael A Arnold, Emily Chenever, +9 authors, Thomas Barr.
Pediatr Dev Pathol, 2014 Nov 12; 18(2). PMID: 25387255
Validation of a whole slide imaging system for primary diagnosis in surgical pathology: A community hospital experience.
Thomas P Buck, Rebecca Dilorio, Lauren Havrilla, Dennis G O'Neill.
J Pathol Inform, 2014 Dec 24; 5(1). PMID: 25535591    Free PMC article.
iPathology cockpit diagnostic station: validation according to College of American Pathologists Pathology and Laboratory Quality Center recommendation at the Hospital Trust and University of Verona.
Matteo Brunelli, Serena Beccari, +8 authors, Albino Eccher.
Diagn Pathol, 2015 Jan 08; 9 Suppl 1. PMID: 25565219    Free PMC article.
Whole slide images for primary diagnostics of urinary system pathology: a feasibility study.
Shaimaa Al-Janabi, André Huisman, +3 authors, Paul J van Diest.
J Renal Inj Prev, 2015 Jan 23; 3(4). PMID: 25610886    Free PMC article.
Whole slide imaging: uses and limitations for surgical pathology and teaching.
B F Boyce.
Biotech Histochem, 2015 Apr 23; 90(5). PMID: 25901738
Review.
Validation of multiple whole slide imaging scanners based on the guideline from the College of American Pathologists Pathology and Laboratory Quality Center.
Michael J Thrall, Jana L Wimmer, Mary R Schwartz.
Arch Pathol Lab Med, 2015 May 01; 139(5). PMID: 25927149
Digital slide viewing for primary reporting in gastrointestinal pathology: a validation study.
Maurice B Loughrey, Paul J Kelly, +5 authors, Peter W Hamilton.
Virchows Arch, 2015 May 20; 467(2). PMID: 25982098
Validation of digital pathology imaging for primary histopathological diagnosis.
David R J Snead, Yee-Wah Tsang, +16 authors, Ian A Cree.
Histopathology, 2015 Sep 27; 68(7). PMID: 26409165
Diagnostic time in digital pathology: A comparative study on 400 cases.
Aleksandar Vodovnik.
J Pathol Inform, 2016 Mar 10; 7. PMID: 26955502    Free PMC article.
Validation of Whole-Slide Imaging for Histolopathogical Diagnosis: Current State.
Adela Saco, Jose Ramírez, +2 authors, Jaume Ordi.
Pathobiology, 2016 Apr 23; 83(2-3). PMID: 27099935
Review.
Pitfalls in the use of whole slide imaging for the diagnosis of central nervous system tumors: A pilot study in surgical neuropathology.
Melike Pekmezci, Sanem Pinar Uysal, +2 authors, Han Sung Lee.
J Pathol Inform, 2016 May 25; 7. PMID: 27217975    Free PMC article.
The Diagnostic Concordance of Whole Slide Imaging and Light Microscopy: A Systematic Review.
Edward Goacher, Rebecca Randell, Bethany Williams, Darren Treanor.
Arch Pathol Lab Med, 2016 Jul 12; 141(1). PMID: 27399211
Systematic Review.
Validation of diagnostic accuracy with whole-slide imaging compared with glass slide review in dermatopathology.
Kabeer K Shah, Julia S Lehman, +3 authors, Carilyn N Wieland.
J Am Acad Dermatol, 2016 Oct 16; 75(6). PMID: 27742174
Rayyan-a web and mobile app for systematic reviews.
Mourad Ouzzani, Hossam Hammady, Zbys Fedorowicz, Ahmed Elmagarmid.
Syst Rev, 2016 Dec 07; 5(1). PMID: 27919275    Free PMC article.
Highly Cited.
A Randomized Study Comparing Digital Imaging to Traditional Glass Slide Microscopy for Breast Biopsy and Cancer Diagnosis.
Joann G Elmore, Gary M Longton, +11 authors, Donald L Weaver.
J Pathol Inform, 2017 Apr 07; 8. PMID: 28382226    Free PMC article.
A Systematic Analysis of Discordant Diagnoses in Digital Pathology Compared With Light Microscopy.
Bethany J Williams, Philip DaCosta, Edward Goacher, Darren Treanor.
Arch Pathol Lab Med, 2017 May 04; 141(12). PMID: 28467215
Systematic Review.
Validation of Digital Pathology for Primary Histopathological Diagnosis of Routine, Inflammatory Dermatopathology Cases.
Jonathan J Lee, Jaroslaw Jedrych, Liron Pantanowitz, Jonhan Ho.
Am J Dermatopathol, 2017 Aug 02; 40(1). PMID: 28763335
Validation of whole-slide imaging in the primary diagnosis of liver biopsies in a University Hospital.
Adela Saco, Alba Diaz, +7 authors, Jaume Ordi.
Dig Liver Dis, 2017 Aug 07; 49(11). PMID: 28780052
Diagnostic Efficiency in Digital Pathology: A Comparison of Optical Versus Digital Assessment in 510 Surgical Pathology Cases.
Anne M Mills, Sarah E Gradecki, +5 authors, Helen P Cathro.
Am J Surg Pathol, 2017 Sep 07; 42(1). PMID: 28877052
Digital pathology for the primary diagnosis of breast histopathological specimens: an innovative validation and concordance study on digital pathology validation and training.
Bethany Jill Williams, Andrew Hanby, +3 authors, Darren Treanor.
Histopathology, 2017 Sep 25; 72(4). PMID: 28940580
Belfast Pathology 2017. 10th Joint Meeting of the British Division of the International Academy of Pathology and the Pathological Society of Great Britain & Ireland, 20-23 June 2017.
J Pathol, 2017 Sep 28; 243 Suppl 1. PMID: 28948606
Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology: A Multicenter Blinded Randomized Noninferiority Study of 1992 Cases (Pivotal Study).
Sanjay Mukhopadhyay, Michael D Feldman, +31 authors, Clive R Taylor.
Am J Surg Pathol, 2017 Sep 30; 42(1). PMID: 28961557    Free PMC article.
Whole-slide imaging at primary pathological diagnosis: Validation of whole-slide imaging-based primary pathological diagnosis at twelve Japanese academic institutes.
Kazuhiro Tabata, Ichiro Mori, +13 authors, Junya Fukuoka.
Pathol Int, 2017 Oct 06; 67(11). PMID: 28980740
Diagnostic Accuracy of Virtual Pathology vs Traditional Microscopy in a Large Dermatopathology Study.
Michael N Kent, Thomas G Olsen, +10 authors, Michael A Bottomley.
JAMA Dermatol, 2017 Oct 20; 153(12). PMID: 29049424    Free PMC article.
Validation of digital microscopy in the histopathological diagnoses of oral diseases.
Anna Luíza Damaceno Araújo, Gleyson Kleber Amaral-Silva, +6 authors, Alan Roger Santos-Silva.
Virchows Arch, 2018 Jun 03; 473(3). PMID: 29858684
Dental Students' Perceptions and Performance in Use of Conventional and Virtual Microscopy in Oral Pathology.
Carla I R Fernandes, Roberta F Bonan, +4 authors, Danyel E C Perez.
J Dent Educ, 2018 Aug 03; 82(8). PMID: 30068778
Whole Slide Imaging and Its Applications to Histopathological Studies of Liver Disorders.
Rossana C N Melo, Maximilian W D Raas, +3 authors, Thiago P Silva.
Front Med (Lausanne), 2020 Jan 24; 6. PMID: 31970160    Free PMC article.
Review.
Automated quantitative analysis of Ki-67 staining and HE images recognition and registration based on whole tissue sections in breast carcinoma.
Min Feng, Yang Deng, +10 authors, Hong Bu.
Diagn Pathol, 2020 May 31; 15(1). PMID: 32471471    Free PMC article.
The histopathological diagnosis of atypical meningioma: glass slide versus whole slide imaging for grading assessment.
Serena Ammendola, Elena Bariani, +7 authors, Valeria Barresi.
Virchows Arch, 2020 Dec 12; 478(4). PMID: 33305338    Free PMC article.
Digital Pathology During the COVID-19 Outbreak in Italy: Survey Study.
Simone Giaretto, Salvatore Lorenzo Renne, +19 authors, Luca Di Tommaso.
J Med Internet Res, 2021 Jan 28; 23(2). PMID: 33503002    Free PMC article.
Rapid Validation of Whole-Slide Imaging for Primary Histopathology Diagnosis.
Megan I Samuelson, Stephanie J Chen, +5 authors, Anand Rajan K D.
Am J Clin Pathol, 2021 Jan 30; 155(5). PMID: 33511392    Free PMC article.
Fully digital pathology laboratory routine and remote reporting of oral and maxillofacial diagnosis during the COVID-19 pandemic: a validation study.
Anna Luíza Damaceno Araújo, Gleyson Kleber do Amaral-Silva, +15 authors, Pablo Agustin Vargas.
Virchows Arch, 2021 Mar 14; 479(3). PMID: 33713188    Free PMC article.
Commentary: The Digital Fate of Glomeruli in Renal Biopsy.
Ilaria Girolami, Stefano Marletta, Albino Eccher.
J Pathol Inform, 2021 May 21; 12. PMID: 34012718    Free PMC article.
Application of remote online learning in oral histopathology teaching in China.
Y Zhong, W Sun, +6 authors, Y Xu.
Med Oral Patol Oral Cir Bucal, 2021 Jun 25; 26(4). PMID: 34162817    Free PMC article.
Diagnostic concordance and discordance in digital pathology: a systematic review and meta-analysis.
Ayesha S Azam, Islam M Miligy, +4 authors, David R J Snead.
J Clin Pathol, 2020 Sep 17; 74(7). PMID: 32934103    Free PMC article.
Systematic Review.
WHO/ISUP grading of clear cell renal cell carcinoma and papillary renal cell carcinoma; validation of grading on the digital pathology platform and perspectives on reproducibility of grade.
Lisa Browning, Richard Colling, Clare Verrill.
Diagn Pathol, 2021 Aug 23; 16(1). PMID: 34419085    Free PMC article.
Validation of grading of non-invasive urothelial carcinoma by digital pathology for routine diagnosis.
Richard Colling, Hayleigh Colling, Lisa Browning, Clare Verrill.
BMC Cancer, 2021 Sep 08; 21(1). PMID: 34488682    Free PMC article.
Diagnostic Pitfalls of Digital Microscopy Versus Light Microscopy in Gastrointestinal Pathology: A Systematic Review.
Wangpan Shi, Petros Georgiou, +6 authors, Safeera Khan.
Cureus, 2021 Sep 23; 13(8). PMID: 34548958    Free PMC article.
Review.