Journal Article
. 2015 Sep; 68(7):1063-72.
doi: 10.1111/his.12879.

Validation of digital pathology imaging for primary histopathological diagnosis

David R J Snead 1 Yee-Wah Tsang 1 Aisha Meskiri 2 Peter K Kimani 3 Richard Crossman 3 Nasir M Rajpoot 2 Elaine Blessing 1 Klaus Chen 1 Kishore Gopalakrishnan 1 Paul Matthews 1 Navid Momtahan 1 Sarah Read-Jones 1 Shatrughan Sah 1 Emma Simmons 1 Bidisa Sinha 1 Sari Suortamo 1 Yen Yeo 1 Hesham El Daly 1 Ian A Cree 1 
  • PMID: 26409165
  •     54 citations


Aims: Digital pathology (DP) offers advantages over glass slide microscopy (GS), but data demonstrating a statistically valid equivalent (i.e. non-inferior) performance of DP against GS are required to permit its use in diagnosis. The aim of this study is to provide evidence of non-inferiority.

Methods And Results: Seventeen pathologists re-reported 3017 cases by DP. Of these, 1009 were re-reported by the same pathologist, and 2008 by a different pathologist. Re-examination of 10 138 scanned slides (2.22 terabytes) produced 72 variances between GS and DP reports, including 21 clinically significant variances. Ground truth lay with GS in 12 cases and with DP in nine cases. These results are within the 95% confidence interval for existing intraobserver and interobserver variability, proving that DP is non-inferior to GS. In three cases, the digital platform was deemed to be responsible for the variance, including a gastric biopsy, where Helicobacter pylori only became visible on slides scanned at the ×60 setting, and a bronchial biopsy and penile biopsy, where dysplasia was reported on DP but was not present on GS.

Conclusions: This is one of the largest studies proving that DP is equivalent to GS for the diagnosis of histopathology specimens. Error rates are similar in both platforms, although some problems e.g. detection of bacteria, are predictable.

Keywords: diagnosis; digital pathology; histopathology; validation; whole slide imaging.

Commentary: Can pathologists interpret digital images as well as they interpret microscope slides?
Thomas W Bauer.
J Pathol Inform, 2016 Apr 15; 7. PMID: 27076987    Free PMC article.
Consultation on urological specimens from referred cancer patients using real-time digital microscopy: Optimizing the workflow.
Henrik Holten-Rossing, Lise Grupe Larsen, +2 authors, Ben Vainer.
J Pathol Inform, 2016 Apr 15; 7. PMID: 27076989    Free PMC article.
Summary of third Nordic symposium on digital pathology.
Claes Lundström, Marie Waltersson, Anders Persson, Darren Treanor.
J Pathol Inform, 2016 May 04; 7. PMID: 27141318    Free PMC article.
A model of the spatial tumour heterogeneity in colorectal adenocarcinoma tissue.
Violeta N Kovacheva, David Snead, Nasir M Rajpoot.
BMC Bioinformatics, 2016 Jun 28; 17. PMID: 27342072    Free PMC article.
Emerging Themes in Image Informatics and Molecular Analysis for Digital Pathology.
Rohit Bhargava, Anant Madabhushi.
Annu Rev Biomed Eng, 2016 Jul 16; 18. PMID: 27420575    Free PMC article.
A multisite validation of whole slide imaging for primary diagnosis using standardized data collection and analysis.
Katy Wack, Laura Drogowski, +4 authors, Michael C Montalto.
J Pathol Inform, 2016 Dec 21; 7. PMID: 27994941    Free PMC article.
Enterprise Implementation of Digital Pathology: Feasibility, Challenges, and Opportunities.
D J Hartman, L Pantanowitz, +3 authors, G R Lauro.
J Digit Imaging, 2017 Jan 25; 30(5). PMID: 28116576    Free PMC article. An Open Source, Whole Slide Image-based Pathology Education System.
Paul A Christensen, Nathan E Lee, +3 authors, S Wesley Long.
J Pathol Inform, 2017 Apr 07; 8. PMID: 28382224    Free PMC article.
Making Pathology Diagnoses with Glass or Digital Slides: Which Modality is Inferior?
Jonhan Ho, Liron Pantanowitz.
J Pathol Inform, 2017 May 10; 8. PMID: 28480117    Free PMC article.
Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology: A Multicenter Blinded Randomized Noninferiority Study of 1992 Cases (Pivotal Study).
Sanjay Mukhopadhyay, Michael D Feldman, +31 authors, Clive R Taylor.
Am J Surg Pathol, 2017 Sep 30; 42(1). PMID: 28961557    Free PMC article.
Routine Digital Pathology Workflow: The Catania Experience.
Filippo Fraggetta, Salvatore Garozzo, +2 authors, Esther Diana Rossi.
J Pathol Inform, 2018 Feb 09; 8. PMID: 29416914    Free PMC article.
Commentary: Whole-slide Images - Good Enough for Primary Diagnosis?
Thomas W Bauer.
J Pathol Inform, 2018 Mar 14; 9. PMID: 29531848    Free PMC article.
Constant Quest for Quality: Digital Cytopathology.
Simone L Van Es, Janelle Greaves, +3 authors, Tony Badrick.
J Pathol Inform, 2018 May 04; 9. PMID: 29721361    Free PMC article.
Accuracy of Digital Pathologic Analysis vs Traditional Microscopy in the Interpretation of Melanocytic Lesions.
Tracy Onega, Raymond L Barnhill, +9 authors, Joann G Elmore.
JAMA Dermatol, 2018 Aug 25; 154(10). PMID: 30140929    Free PMC article.
Conventional Microscopical versus Digital Whole-Slide Imaging-Based Diagnosis of Thin-Layer Cervical Specimens: A Validation Study.
Odille Bongaerts, Carla Clevers, +7 authors, Marius Nap.
J Pathol Inform, 2018 Sep 11; 9. PMID: 30197818    Free PMC article.
Novel digital signatures of tissue phenotypes for predicting distant metastasis in colorectal cancer.
Korsuk Sirinukunwattana, David Snead, +5 authors, Nasir Rajpoot.
Sci Rep, 2018 Sep 14; 8(1). PMID: 30209315    Free PMC article.
Deep Learning for Whole Slide Image Analysis: An Overview.
Neofytos Dimitriou, Ognjen Arandjelović, Peter D Caie.
Front Med (Lausanne), 2019 Dec 12; 6. PMID: 31824952    Free PMC article.
Artificial Intelligence in Lung Cancer Pathology Image Analysis.
Shidan Wang, Donghan M Yang, +7 authors, Guanghua Xiao.
Cancers (Basel), 2019 Oct 31; 11(11). PMID: 31661863    Free PMC article.
Resolution-agnostic tissue segmentation in whole-slide histopathology images with convolutional neural networks.
Péter Bándi, Maschenka Balkenhol, +2 authors, Geert Litjens.
PeerJ, 2019 Dec 25; 7. PMID: 31871843    Free PMC article.
ConvPath: A software tool for lung adenocarcinoma digital pathological image analysis aided by a convolutional neural network.
Shidan Wang, Tao Wang, +15 authors, Guanghua Xiao.
EBioMedicine, 2019 Nov 27; 50. PMID: 31767541    Free PMC article.
On the Edge of a Digital Pathology Transformation: Views from a Cellular Pathology Laboratory Focus Group.
Casmir Turnquist, Sharon Roberts-Gant, +5 authors, Clare Verrill.
J Pathol Inform, 2020 Jan 04; 10. PMID: 31897354    Free PMC article.
Usefulness of rapid on-site evaluation specimens from endoscopic ultrasound-guided fine-needle aspiration for cancer gene panel testing: A retrospective study.
Tetsuya Ishizawa, Naohiko Makino, +6 authors, Yoshiyuki Ueno.
PLoS One, 2020 Jan 31; 15(1). PMID: 31999789    Free PMC article.
Automated Osteosclerosis Grading of Clinical Biopsies Using Infrared Spectroscopic Imaging.
Rupali Mankar, Carlos E Bueso-Ramos, +4 authors, David Mayerich.
Anal Chem, 2019 Dec 04; 92(1). PMID: 31793292    Free PMC article.
Proliferation Tumour Marker Network (PTM-NET) for the identification of tumour region in Ki67 stained breast cancer whole slide images.
Jesuchristopher Joseph, Martine P Roudier, +8 authors, William J Howat.
Sci Rep, 2019 Sep 08; 9(1). PMID: 31492872    Free PMC article.
A Novel Digital Score for Abundance of Tumour Infiltrating Lymphocytes Predicts Disease Free Survival in Oral Squamous Cell Carcinoma.
Muhammad Shaban, Syed Ali Khurram, +6 authors, Nasir M Rajpoot.
Sci Rep, 2019 Sep 19; 9(1). PMID: 31527658    Free PMC article.
Whole slide imaging compared with light microscopy for primary diagnosis in surgical neuropathology: a validation study.
Ali Alassiri, Amna Almutrafi, +5 authors, Walid Khalbuss.
Ann Saudi Med, 2020 Feb 07; 40(1). PMID: 32026707    Free PMC article.
Introduction to digital pathology and computer-aided pathology.
Soojeong Nam, Yosep Chong, +5 authors, Heounjeong Go.
J Pathol Transl Med, 2020 Feb 13; 54(2). PMID: 32045965    Free PMC article.
Semi-Supervised Nests of Melanocytes Segmentation Method Using Convolutional Autoencoders.
Dariusz Kucharski, Pawel Kleczek, +2 authors, Marek Gorgon.
Sensors (Basel), 2020 Mar 15; 20(6). PMID: 32168748    Free PMC article.
Current status of pathological image analysis technology in pharmaceutical companies: a questionnaire survey of the Japan Pharmaceutical Manufacturers Association.
Tsuyoshi Yoshikawa, Yasushi Horai, +4 authors, Masaharu Tanaka.
J Toxicol Pathol, 2020 May 20; 33(2). PMID: 32425346    Free PMC article.
Validation of a digital pathology system including remote review during the COVID-19 pandemic.
Matthew G Hanna, Victor E Reuter, +21 authors, Meera Hameed.
Mod Pathol, 2020 Jun 24; 33(11). PMID: 32572154    Free PMC article.
Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners.
Kazuhiro Tabata, Naohiro Uraoka, +10 authors, Yukako Yagi.
Diagn Pathol, 2019 Jun 27; 14(1). PMID: 31238983    Free PMC article.
Twenty Years of Digital Pathology: An Overview of the Road Travelled, What is on the Horizon, and the Emergence of Vendor-Neutral Archives.
Liron Pantanowitz, Ashish Sharma, +3 authors, Joel Saltz.
J Pathol Inform, 2019 Jan 05; 9. PMID: 30607307    Free PMC article.
Validation of Whole-slide Digitally Imaged Melanocytic Lesions: Does Z-Stack Scanning Improve Diagnostic Accuracy?
Bart Sturm, David Creytens, +9 authors, Jeroen A W M van der Laak.
J Pathol Inform, 2019 Apr 12; 10. PMID: 30972225    Free PMC article.
Display Characteristics and Their Impact on Digital Pathology: A Current Review of Pathologists' Future "Microscope".
Jacob T Abel, Peter Ouillette, +7 authors, David S McClintock.
J Pathol Inform, 2020 Oct 13; 11. PMID: 33042602    Free PMC article.
Recommendations for pathologic practice using digital pathology: consensus report of the Korean Society of Pathologists.
Yosep Chong, Dae Cheol Kim, +5 authors, Medical Informatics Study Group of the Korean Society of Pathologists.
J Pathol Transl Med, 2020 Oct 08; 54(6). PMID: 33027850    Free PMC article.
A narrative review of digital pathology and artificial intelligence: focusing on lung cancer.
Taro Sakamoto, Tomoi Furukawa, +8 authors, Junya Fukuoka.
Transl Lung Cancer Res, 2020 Nov 20; 9(5). PMID: 33209648    Free PMC article.
Digital Pathology: Advantages, Limitations and Emerging Perspectives.
Stephan W Jahn, Markus Plass, Farid Moinfar.
J Clin Med, 2020 Nov 22; 9(11). PMID: 33217963    Free PMC article.
The performance of digital microscopy for primary diagnosis in human pathology: a systematic review.
Anna Luíza Damaceno Araújo, Lady Paola Aristizábal Arboleda, +13 authors, Alan Roger Santos-Silva.
Virchows Arch, 2019 Jan 28; 474(3). PMID: 30685784
Systematic Review.
Automatic ganglion cell detection for improving the efficiency and accuracy of hirschprung disease diagnosis.
Ariel Greenberg, Asaf Aizic, +3 authors, Dov Hershkovitz.
Sci Rep, 2021 Feb 10; 11(1). PMID: 33558593    Free PMC article.
Discrepancies in digital hematopathology diagnoses for consultation and expert panel analysis.
Michiel van den Brand, Peet T G A Nooijen, +6 authors, Konnie M Hebeda.
Virchows Arch, 2020 Aug 26; 478(3). PMID: 32840673    Free PMC article.
Remote Reporting from Home for Primary Diagnosis in Surgical Pathology: A Tertiary Oncology Center Experience during the COVID-19 Pandemic.
Vidya Rao, Rajiv Kumar, +17 authors, Sangeeta Desai.
J Pathol Inform, 2021 May 21; 12. PMID: 34012707    Free PMC article.
Verification and Validation of Digital Pathology (Whole Slide Imaging) for Primary Histopathological Diagnosis: All Wales Experience.
M Babawale, A Gunavardhan, +24 authors, Muhammad Aslam.
J Pathol Inform, 2021 May 21; 12. PMID: 34012708    Free PMC article.
Selection of Representative Histologic Slides in Interobserver Reproducibility Studies: Insights from Expert Review for Ovarian Carcinoma Subtype Classification.
Marios A Gavrielides, Brigitte M Ronnett, +2 authors, Jeffrey D Seidman.
J Pathol Inform, 2021 May 21; 12. PMID: 34012719    Free PMC article.
What Is New in Helicobacter pylori Diagnosis. An Overview.
Maria Pina Dore, Giovanni Mario Pes.
J Clin Med, 2021 Jun 03; 10(10). PMID: 34068062    Free PMC article.
Diagnostic concordance and discordance in digital pathology: a systematic review and meta-analysis.
Ayesha S Azam, Islam M Miligy, +4 authors, David R J Snead.
J Clin Pathol, 2020 Sep 17; 74(7). PMID: 32934103    Free PMC article.
Systematic Review.
Tissue block staining and domestic adhesive tape yield qualified integral sections of adult mouse orbits and eyeballs.
Zhongmin Li, Martin Ungerer, +3 authors, Goetz Muench.
PLoS One, 2021 Aug 05; 16(8). PMID: 34347814    Free PMC article.
Integrated digital pathology at scale: A solution for clinical diagnostics and cancer research at a large academic medical center.
Peter J Schüffler, Luke Geneslaw, +29 authors, Thomas J Fuchs.
J Am Med Inform Assoc, 2021 Jul 15; 28(9). PMID: 34260720    Free PMC article.
WHO/ISUP grading of clear cell renal cell carcinoma and papillary renal cell carcinoma; validation of grading on the digital pathology platform and perspectives on reproducibility of grade.
Lisa Browning, Richard Colling, Clare Verrill.
Diagn Pathol, 2021 Aug 23; 16(1). PMID: 34419085    Free PMC article.
Comparative Assessment of Digital Pathology Systems for Primary Diagnosis.
Sathyanarayanan Rajaganesan, Rajiv Kumar, +5 authors, Sangeeta Desai.
J Pathol Inform, 2021 Aug 28; 12. PMID: 34447605    Free PMC article.
Validation of grading of non-invasive urothelial carcinoma by digital pathology for routine diagnosis.
Richard Colling, Hayleigh Colling, Lisa Browning, Clare Verrill.
BMC Cancer, 2021 Sep 08; 21(1). PMID: 34488682    Free PMC article.
Diagnostic Pitfalls of Digital Microscopy Versus Light Microscopy in Gastrointestinal Pathology: A Systematic Review.
Wangpan Shi, Petros Georgiou, +6 authors, Safeera Khan.
Cureus, 2021 Sep 23; 13(8). PMID: 34548958    Free PMC article.
Integrating digital pathology into clinical practice.
Matthew G Hanna, Orly Ardon, +3 authors, Meera R Hameed.
Mod Pathol, 2021 Oct 03;. PMID: 34599281
Artificial Intelligence in Brain Tumour Surgery-An Emerging Paradigm.
Simon Williams, Hugo Layard Horsfall, +5 authors, Hani J Marcus.
Cancers (Basel), 2021 Oct 14; 13(19). PMID: 34638495    Free PMC article.
A Survival Guide for the Rapid Transition to a Fully Digital Workflow: The "Caltagirone Example".
Filippo Fraggetta, Alessandro Caputo, +3 authors, Vincenzo L'Imperio.
Diagnostics (Basel), 2021 Oct 24; 11(10). PMID: 34679614    Free PMC article.