Journal Article
. 2006 Apr; 6:4.
doi: 10.1186/1472-6890-6-4.

Primary histologic diagnosis using automated whole slide imaging: a validation study

John R Gilbertson 1 Jonhan Ho  Leslie Anthony  Drazen M Jukic  Yukako Yagi  Anil V Parwani  
  • PMID: 16643664
  •     18 References
  •     63 citations


Background: Only prototypes 5 years ago, high-speed, automated whole slide imaging (WSI) systems (also called digital slide systems, virtual microscopes or wide field imagers) are becoming increasingly capable and robust. Modern devices can capture a slide in 5 minutes at spatial sampling periods of less than 0.5 micron/pixel. The capacity to rapidly digitize large numbers of slides should eventually have a profound, positive impact on pathology. It is important, however, that pathologists validate these systems during development, not only to identify their limitations but to guide their evolution.

Methods: Three pathologists fully signed out 25 cases representing 31 parts. The laboratory information system was used to simulate real-world sign-out conditions including entering a full diagnostic field and comment (when appropriate) and ordering special stains and recuts. For each case, discrepancies between diagnoses were documented by committee and a "consensus" report was formed and then compared with the microscope-based, sign-out report from the clinical archive.

Results: In 17 of 25 cases there were no discrepancies between the individual study pathologist reports. In 8 of the remaining cases, there were 12 discrepancies, including 3 in which image quality could be at least partially implicated. When the WSI consensus diagnoses were compared with the original sign-out diagnoses, no significant discrepancies were found. Full text of the pathologist reports, the WSI consensus diagnoses, and the original sign-out diagnoses are available as an attachment to this publication.

Conclusion: The results indicated that the image information contained in current whole slide images is sufficient for pathologists to make reliable diagnostic decisions and compose complex diagnostic reports. This is a very positive result; however, this does not mean that WSI is as good as a microscope. Virtually every slide had focal areas in which image quality (focus and dynamic range) was less than perfect. In some cases, there was evidence of over-compression and regions made "soft" by less than perfect focus. We expect systems will continue to get better, image quality and speed will continue to improve, but that further validation studies will be needed to guide development of this promising technology.

Teaching medical histology at the University of South Carolina School of Medicine: Transition to virtual slides and virtual microscopes.
Charles A Blake, Holly A Lavoie, Clarke F Millette.
Anat Rec B New Anat, 2003 Nov 25; 275(1). PMID: 14628320
Use of robotic telepathology for frozen-section diagnosis: a retrospective trial of a telepathology system for intraoperative consultation.
Keith J Kaplan, Jeanette R Burgess, +3 authors, Renata B Greenspan.
Mod Pathol, 2002 Nov 14; 15(11). PMID: 12429799
Implementation of virtual microscope slides in the annual pathobiology of cancer workshop laboratory.
Fred R Dee, John M Lehman, +2 authors, Michael B Cohen.
Hum Pathol, 2003 Jun 07; 34(5). PMID: 12792915
Automated complete slide digitization: a medium for simultaneous viewing by multiple pathologists.
F J Leong, J O McGee.
J Pathol, 2001 Dec 18; 195(4). PMID: 11745684
Routine surgical telepathology in the Department of Veterans Affairs: experience-related improvements in pathologist performance in 2200 cases.
B E Dunn, H Choi, +3 authors, R S Weinstein.
Telemed J, 2000 Jul 25; 5(4). PMID: 10908448
An array microscope for ultrarapid virtual slide processing and telepathology. Design, fabrication, and validation study.
Ronald S Weinstein, Michael R Descour, +15 authors, Peter H Bartels.
Hum Pathol, 2005 Jan 26; 35(11). PMID: 15668886
The virtual case: a new method to completely digitize cytological and histological slides.
F Demichelis, M Barbareschi, P Dalla Palma, S Forti.
Virchows Arch, 2002 Aug 22; 441(2). PMID: 12189506
Development and evaluation of the virtual pathology slide: a new tool in telepathology.
Sean S P Costello, Daniel J Johnston, Peter A Dervan, Daniel G O'Shea.
J Med Internet Res, 2003 Jul 15; 5(2). PMID: 12857667    Free PMC article.
Development and experience with an integrated system for transplantation telepathology.
M I Minervini, Y Yagi, +6 authors, A Demetris.
Hum Pathol, 2002 Jan 05; 32(12). PMID: 11774166
The Virtual Slide Set - a curriculum development system for digital microscopy.
Katsura Fujita, Rebecca S Crowley.
AMIA Annu Symp Proc, 2004 Jan 20;. PMID: 14728351    Free PMC article.
Development and preliminary evaluation of the VPS ReplaySuite: a virtual double-headed microscope for pathology.
Dan J Johnston, Sean P Costello, Peter A Dervan, Daniel G O'Shea.
BMC Med Inform Decis Mak, 2005 Apr 23; 5. PMID: 15845147    Free PMC article.
Compression guidelines for diagnostic telepathology.
D J Foran, P P Meer, T Papathomas, I Marsic.
IEEE Trans Inf Technol Biomed, 1997 Mar 01; 1(1). PMID: 11020810
Digital storage of glass slides for quality assurance in histopathology and cytopathology.
Francesca Demichelis, Vincenzo Della Mea, +2 authors, Carlo Alberto Beltrami.
J Telemed Telecare, 2002 Jul 05; 8(3). PMID: 12097174
Virtual microscopy for learning and assessment in pathology.
Rakesh K Kumar, Gary M Velan, +3 authors, Denis Wakefield.
J Pathol, 2004 Oct 08; 204(5). PMID: 15470688
The Virtual Microscope.
R Ferreira, B Moon, +4 authors, A Demarzo.
Proc AMIA Annu Fall Symp, 1997 Jan 01;. PMID: 9357666    Free PMC article.
Comparison of cytology proficiency testing: glass slides vs. virtual slides.
MariBeth Gagnon, Stanley Inhorn, +6 authors, Rhonda Whalen.
Acta Cytol, 2004 Dec 08; 48(6). PMID: 15581163
The image pyramid system--an unbiased, inexpensive and broadly accessible method of telepathology.
Péter Gombás, Jeremy N Skepper, László Hegyi.
Pathol Oncol Res, 2002 May 08; 8(1). PMID: 11994767
Digital slide and virtual microscopy based routine and telepathology evaluation of routine gastrointestinal biopsy specimens.
B Molnar, L Berczi, +4 authors, Z Tulassay.
J Clin Pathol, 2003 Jun 05; 56(6). PMID: 12783970    Free PMC article.
Histology, imaging and new diagnostic work-flows in pathology.
John Gilbertson, Yukako Yagi.
Diagn Pathol, 2008 Aug 05; 3 Suppl 1. PMID: 18673502    Free PMC article.
Telepathology in emerging countries pilot project between Italy and Egypt.
Essam Ayad, Francesco Sicurello.
Diagn Pathol, 2008 Aug 05; 3 Suppl 1. PMID: 18673508    Free PMC article.
Reading virtual slide using web viewers: results of subjective experience with three different solutions.
Marcial García Rojo, Antonio J Gallardo, +4 authors, Jose Sacristán.
Diagn Pathol, 2008 Aug 05; 3 Suppl 1. PMID: 18673512    Free PMC article.
Organizational model for a telepathology system.
Roberto Mencarelli, Adriano Marcolongo, Alessio Gasparetto.
Diagn Pathol, 2008 Aug 05; 3 Suppl 1. PMID: 18673521    Free PMC article.
Whole-slide imaging digital pathology as a platform for teleconsultation: a pilot study using paired subspecialist correlations.
David C Wilbur, Kalil Madi, +22 authors, Wolfgang Klietmann.
Arch Pathol Lab Med, 2009 Dec 08; 133(12). PMID: 19961250    Free PMC article.
Cytologic evaluation of image-guided fine needle aspiration biopsies via robotic microscopy: A validation study.
Guoping Cai, Lisa A Teot, +4 authors, Anil V Parwani.
J Pathol Inform, 2010 Sep 02; 1. PMID: 20805959    Free PMC article.
Development and use of a genitourinary pathology digital teaching set for trainee education.
Li Li, Bryan J Dangott, Anil V Parwani.
J Pathol Inform, 2010 Sep 02; 1. PMID: 20805961    Free PMC article.
The pathology informatics curriculum wiki: Harnessing the power of user-generated content.
Ji Yeon Kim, Thomas M Gudewicz, Anand S Dighe, John R Gilbertson.
J Pathol Inform, 2010 Sep 02; 1. PMID: 20805963    Free PMC article.
Virtual telepathology in Egypt, applications of WSI in Cairo University.
Essam Ayad.
Diagn Pathol, 2011 Apr 22; 6 Suppl 1. PMID: 21489180    Free PMC article.
Recent advances in standards for Collaborative Digital Anatomic Pathology.
Christel Daniel, François Macary, +4 authors, Vincenzo Della Mea.
Diagn Pathol, 2011 Apr 22; 6 Suppl 1. PMID: 21489187    Free PMC article.
Quantitative image analysis in the assessment of diffuse large B-cell lymphoma.
Devon S Chabot-Richards, David R Martin, +2 authors, Kristin E Hunt.
Mod Pathol, 2011 Aug 16; 24(12). PMID: 21841768    Free PMC article.
Review of the current state of whole slide imaging in pathology.
Liron Pantanowitz, Paul N Valenstein, +5 authors, Terence J Colgan.
J Pathol Inform, 2011 Sep 03; 2. PMID: 21886892    Free PMC article.
Highly Cited.
The accuracy of dynamic predictive autofocusing for whole slide imaging.
Richard R McKay, Vipul A Baxi, Michael C Montalto.
J Pathol Inform, 2011 Oct 05; 2. PMID: 21969919    Free PMC article.
Implementation of whole slide imaging in surgical pathology: A value added approach.
Mike Isaacs, Jochen K Lennerz, +3 authors, John D Pfeifer.
J Pathol Inform, 2011 Oct 05; 2. PMID: 21969920    Free PMC article.
Autofocus methods of whole slide imaging systems and the introduction of a second-generation independent dual sensor scanning method.
Michael C Montalto, Richard R McKay, Robert J Filkins.
J Pathol Inform, 2011 Nov 08; 2. PMID: 22059145    Free PMC article.
High-definition hematoxylin and eosin staining in a transition to digital pathology.
Jamie D Martina, Christopher Simmons, Drazen M Jukic.
J Pathol Inform, 2011 Nov 08; 2. PMID: 22059146    Free PMC article.
Conflicting physiological and genomic cardiopulmonary effects of recruitment maneuvers in murine acute lung injury.
Armand Mekontso Dessap, Guillaume Voiriot, +8 authors, Joe G N Garcia.
Am J Respir Cell Mol Biol, 2011 Dec 03; 46(4). PMID: 22135358    Free PMC article.
Development of multigene expression signature maps at the protein level from digitized immunohistochemistry slides.
Gregory J Metzger, Stephen C Dankbar, +3 authors, Stephen C Schmechel.
PLoS One, 2012 Mar 23; 7(3). PMID: 22438942    Free PMC article.
Referenceless image quality evaluation for whole slide imaging.
Noriaki Hashimoto, Pinky A Bautista, +2 authors, Yukako Yagi.
J Pathol Inform, 2012 Apr 25; 3. PMID: 22530177    Free PMC article.
Diagnosis of dysplasia in upper gastro-intestinal tract biopsies through digital microscopy.
Dorina Gui, Galen Cortina, +4 authors, Sarah Dry.
J Pathol Inform, 2012 Oct 02; 3. PMID: 23024886    Free PMC article.
A core curriculum for clinical fellowship training in pathology informatics.
David S McClintock, Bruce P Levy, +10 authors, John R Gilbertson.
J Pathol Inform, 2012 Oct 02; 3. PMID: 23024890    Free PMC article.
Development of a teledermatopathology consultation system using virtual slides.
Ikunori Nakayama, Tsubasa Matsumura, +5 authors, Takashi Sawai.
Diagn Pathol, 2012 Dec 15; 7. PMID: 23237667    Free PMC article.
Application of whole slide image markup and annotation for pathologist knowledge capture.
Walter S Campbell, Kirk W Foster, Steven H Hinrichs.
J Pathol Inform, 2013 Apr 20; 4. PMID: 23599902    Free PMC article.
Digital pathology: Attitudes and practices in the Canadian pathology community.
Magdaleni Bellis, Shereen Metias, +3 authors, George M Yousef.
J Pathol Inform, 2013 Apr 20; 4. PMID: 23599903    Free PMC article.
β-Catenin signaling in hepatocellular cancer: Implications in inflammation, fibrosis, and proliferation.
Jung Min Lee, Jing Yang, +5 authors, Satdarshan P Monga.
Cancer Lett, 2013 Sep 28; 343(1). PMID: 24071572    Free PMC article.
A comparison of cervical histopathology variability using whole slide digitized images versus glass slides: experience with a statewide registry.
Julia C Gage, Nancy Joste, +4 authors, Cosette M Wheeler.
Hum Pathol, 2013 Oct 01; 44(11). PMID: 24075599    Free PMC article.
Evaluation of mitotic activity index in breast cancer using whole slide digital images.
Shaimaa Al-Janabi, Henk-Jan van Slooten, +3 authors, Mehdi Jiwa.
PLoS One, 2014 Jan 05; 8(12). PMID: 24386102    Free PMC article.
0.5 gigapixel microscopy using a flatbed scanner.
Guoan Zheng, Xiaoze Ou, Changhuei Yang.
Biomed Opt Express, 2014 Jan 28; 5(1). PMID: 24466471    Free PMC article.
Mapping stain distribution in pathology slides using whole slide imaging.
Fang-Cheng Yeh, Qing Ye, +3 authors, Chien Ho.
J Pathol Inform, 2014 Mar 29; 5(1). PMID: 24672736    Free PMC article.
Intra-observer reproducibility of whole slide imaging for the primary diagnosis of breast needle biopsies.
Carolina Reyes, Offiong F Ikpatt, Mehrdad Nadji, Richard J Cote.
J Pathol Inform, 2014 Apr 18; 5(1). PMID: 24741464    Free PMC article.
Implementation of large-scale routine diagnostics using whole slide imaging in Sweden: Digital pathology experiences 2006-2013.
Sten Thorstenson, Jesper Molin, Claes Lundström.
J Pathol Inform, 2014 May 21; 5(1). PMID: 24843825    Free PMC article.
Automated grading of renal cell carcinoma using whole slide imaging.
Fang-Cheng Yeh, Anil V Parwani, Liron Pantanowitz, Chien Ho.
J Pathol Inform, 2014 Sep 06; 5(1). PMID: 25191622    Free PMC article.
Digital Pathology: Data-Intensive Frontier in Medical Imaging: Health-information sharing, specifically of digital pathology, is the subject of this paper which discusses how sharing the rich images in pathology can stretch the capabilities of all otherwise well-practiced disciplines.
Lee A D Cooper, Alexis B Carter, +10 authors, Joel H Saltz.
Proc IEEE Inst Electr Electron Eng, 2012 Apr 01; 100(4). PMID: 25328166    Free PMC article.
Validation of a whole slide imaging system for primary diagnosis in surgical pathology: A community hospital experience.
Thomas P Buck, Rebecca Dilorio, Lauren Havrilla, Dennis G O'Neill.
J Pathol Inform, 2014 Dec 24; 5(1). PMID: 25535591    Free PMC article.
21(st) century workflow: A proposal.
Jeffrey L Fine.
J Pathol Inform, 2014 Dec 24; 5(1). PMID: 25535592    Free PMC article.
Observer performance in the use of digital and optical microscopy for the interpretation of tissue-based biomarkers.
Marios A Gavrielides, Catherine Conway, +2 authors, Stephen M Hewitt.
Anal Cell Pathol (Amst), 2014 Jan 01; 2014. PMID: 25763314    Free PMC article.
Evaluating whole slide imaging: A working group opportunity.
Darren Treanor, Brandon D Gallas, Marios A Gavrielides, Stephen M Hewitt.
J Pathol Inform, 2015 Mar 17; 6. PMID: 25774315    Free PMC article.
MIEN1 promotes oral cancer progression and implicates poor overall survival.
Smrithi Rajendiran, Marilyne Kpetemey, +5 authors, Jamboor K Vishwanatha.
Cancer Biol Ther, 2015 May 23; 16(6). PMID: 25996585    Free PMC article.
Multireader multicase reader studies with binary agreement data: simulation, analysis, validation, and sizing.
Weijie Chen, Adam Wunderlich, Nicholas Petrick, Brandon D Gallas.
J Med Imaging (Bellingham), 2015 Jul 15; 1(3). PMID: 26158051    Free PMC article.
Comparison of the manual, semiautomatic, and automatic selection and leveling of hot spots in whole slide images for Ki-67 quantification in meningiomas.
Zaneta Swiderska, Anna Korzynska, +6 authors, Bartlomiej Grala.
Anal Cell Pathol (Amst), 2015 Aug 05; 2015. PMID: 26240787    Free PMC article.
Exploring virtual reality technology and the Oculus Rift for the examination of digital pathology slides.
Navid Farahani, Robert Post, +7 authors, Liron Pantanowitz.
J Pathol Inform, 2016 May 25; 7. PMID: 27217972    Free PMC article.
Nanoscale refractive index fluctuations detected via sparse spectral microscopy.
John E Chandler, Lusik Cherkezyan, Hariharan Subramanian, Vadim Backman.
Biomed Opt Express, 2016 May 28; 7(3). PMID: 27231596    Free PMC article.
Performance of residents using digital images versus glass slides on certification examination in anatomical pathology: a mixed methods pilot study.
Lorna Mirham, Christopher Naugler, +13 authors, George M Yousef.
CMAJ Open, 2016 Jun 10; 4(1). PMID: 27280119    Free PMC article.
Comparing whole slide digital images versus traditional glass slides in the detection of common microscopic features seen in dermatitis.
Nikki S Vyas, Michael Markow, +5 authors, Drazen M Jukic.
J Pathol Inform, 2016 Aug 27; 7. PMID: 27563489    Free PMC article.
Single-frame rapid autofocusing for brightfield and fluorescence whole slide imaging.
Jun Liao, Liheng Bian, +5 authors, Guoan Zheng.
Biomed Opt Express, 2016 Nov 30; 7(11). PMID: 27896014    Free PMC article.
A multisite validation of whole slide imaging for primary diagnosis using standardized data collection and analysis.
Katy Wack, Laura Drogowski, +4 authors, Michael C Montalto.
J Pathol Inform, 2016 Dec 21; 7. PMID: 27994941    Free PMC article.
Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology: A Multicenter Blinded Randomized Noninferiority Study of 1992 Cases (Pivotal Study).
Sanjay Mukhopadhyay, Michael D Feldman, +31 authors, Clive R Taylor.
Am J Surg Pathol, 2017 Sep 30; 42(1). PMID: 28961557    Free PMC article.
Diagnostic Accuracy of Virtual Pathology vs Traditional Microscopy in a Large Dermatopathology Study.
Michael N Kent, Thomas G Olsen, +10 authors, Michael A Bottomley.
JAMA Dermatol, 2017 Oct 20; 153(12). PMID: 29049424    Free PMC article.
Emerging paradigm of virtual-microscopy for histopathology diagnosis: survey of US and Canadian oral pathology trainees.
Ngozi N Nwizu, Adepitan Owosho, Kalu U E Ogbureke.
BDJ Open, 2018 Apr 03; 3. PMID: 29607083    Free PMC article.
Convolutional neural networks for whole slide image superresolution.
Lopamudra Mukherjee, Adib Keikhosravi, Dat Bui, Kevin W Eliceiri.
Biomed Opt Express, 2018 Nov 22; 9(11). PMID: 30460134    Free PMC article.
Precise Identification of Cell and Tissue Features Important for Histopathologic Diagnosis by a Whole Slide Imaging System.
Thomas W Bauer, Cynthia Behling, +6 authors, Jinsong Qiu.
J Pathol Inform, 2020 Mar 11; 11. PMID: 32154040    Free PMC article.
Validation of an Automated Quantitative Digital Pathology Approach for Scoring TMEM, a Prognostic Biomarker for Metastasis.
David Entenberg, Maja H Oktay, +7 authors, John S Condeelis.
Cancers (Basel), 2020 Apr 05; 12(4). PMID: 32244564    Free PMC article.
Validating whole slide imaging for diagnostic purposes in pathology: guideline from the College of American Pathologists Pathology and Laboratory Quality Center.
Liron Pantanowitz, John H Sinard, +8 authors, College of American Pathologists Pathology and Laboratory Quality Center.
Arch Pathol Lab Med, 2013 May 03; 137(12). PMID: 23634907    Free PMC article.
Highly Cited. Review.
Validation of a digital pathology system including remote review during the COVID-19 pandemic.
Matthew G Hanna, Victor E Reuter, +21 authors, Meera Hameed.
Mod Pathol, 2020 Jun 24; 33(11). PMID: 32572154    Free PMC article.
Localization of Nuclei in Breast Cancer Using Whole Slide Imaging System Supported by Morphological Features and Shape Formulas.
Anil Kumar, Manish Prateek.
Cancer Manag Res, 2020 Jul 02; 12. PMID: 32606950    Free PMC article.
Rapid and robust whole slide imaging based on LED-array illumination and color-multiplexed single-shot autofocusing.
Shaowei Jiang, Zichao Bian, +4 authors, Guoan Zheng.
Quant Imaging Med Surg, 2019 Jul 10; 9(5). PMID: 31281778    Free PMC article.
Immune contexture analysis in immuno-oncology: applications and challenges of multiplex fluorescent immunohistochemistry.
Reshma Shakya, Tam Hong Nguyen, Nigel Waterhouse, Rajiv Khanna.
Clin Transl Immunology, 2020 Oct 20; 9(10). PMID: 33072322    Free PMC article.
Recommendations for pathologic practice using digital pathology: consensus report of the Korean Society of Pathologists.
Yosep Chong, Dae Cheol Kim, +5 authors, Medical Informatics Study Group of the Korean Society of Pathologists.
J Pathol Transl Med, 2020 Oct 08; 54(6). PMID: 33027850    Free PMC article.
Evolution of the liver biopsy and its future.
Dhanpat Jain, Richard Torres, +3 authors, Vasilis Vasiliou.
Transl Gastroenterol Hepatol, 2021 Apr 08; 6. PMID: 33824924    Free PMC article.
Verification and Validation of Digital Pathology (Whole Slide Imaging) for Primary Histopathological Diagnosis: All Wales Experience.
M Babawale, A Gunavardhan, +24 authors, Muhammad Aslam.
J Pathol Inform, 2021 May 21; 12. PMID: 34012708    Free PMC article.
Machine learning-based image analysis for accelerating the diagnosis of complicated preneoplastic and neoplastic ductal lesions in breast biopsy tissues.
Shinya Sato, Satoshi Maki, +11 authors, Yohei Miyagi.
Breast Cancer Res Treat, 2021 May 03; 188(3). PMID: 33934277
Integrated digital pathology at scale: A solution for clinical diagnostics and cancer research at a large academic medical center.
Peter J Schüffler, Luke Geneslaw, +29 authors, Thomas J Fuchs.
J Am Med Inform Assoc, 2021 Jul 15; 28(9). PMID: 34260720    Free PMC article.
Digital pathology: a tool for 21st century neuropathology.
Miguel Guzman, Alexander R Judkins.
Brain Pathol, 2009 Mar 18; 19(2). PMID: 19290997    Free PMC article.