Journal Article
. 2016 Aug;7().
doi: 10.4103/2153-3539.186902.

Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases

Andrew Janowczyk 1 Anant Madabhushi 1 
Affiliations
  • PMID: 27563488
  •     27 References
  •     145 citations

Abstract

Background: Deep learning (DL) is a representation learning approach ideally suited for image analysis challenges in digital pathology (DP). The variety of image analysis tasks in the context of DP includes detection and counting (e.g., mitotic events), segmentation (e.g., nuclei), and tissue classification (e.g., cancerous vs. non-cancerous). Unfortunately, issues with slide preparation, variations in staining and scanning across sites, and vendor platforms, as well as biological variance, such as the presentation of different grades of disease, make these image analysis tasks particularly challenging. Traditional approaches, wherein domain-specific cues are manually identified and developed into task-specific "handcrafted" features, can require extensive tuning to accommodate these variances. However, DL takes a more domain agnostic approach combining both feature discovery and implementation to maximally discriminate between the classes of interest. While DL approaches have performed well in a few DP related image analysis tasks, such as detection and tissue classification, the currently available open source tools and tutorials do not provide guidance on challenges such as (a) selecting appropriate magnification, (b) managing errors in annotations in the training (or learning) dataset, and (c) identifying a suitable training set containing information rich exemplars. These foundational concepts, which are needed to successfully translate the DL paradigm to DP tasks, are non-trivial for (i) DL experts with minimal digital histology experience, and (ii) DP and image processing experts with minimal DL experience, to derive on their own, thus meriting a dedicated tutorial.

Aims: This paper investigates these concepts through seven unique DP tasks as use cases to elucidate techniques needed to produce comparable, and in many cases, superior to results from the state-of-the-art hand-crafted feature-based classification approaches.

Results: Specifically, in this tutorial on DL for DP image analysis, we show how an open source framework (Caffe), with a singular network architecture, can be used to address: (a) nuclei segmentation (F-score of 0.83 across 12,000 nuclei), (b) epithelium segmentation (F-score of 0.84 across 1735 regions), (c) tubule segmentation (F-score of 0.83 from 795 tubules), (d) lymphocyte detection (F-score of 0.90 across 3064 lymphocytes), (e) mitosis detection (F-score of 0.53 across 550 mitotic events), (f) invasive ductal carcinoma detection (F-score of 0.7648 on 50 k testing patches), and (g) lymphoma classification (classification accuracy of 0.97 across 374 images).

Conclusion: This paper represents the largest comprehensive study of DL approaches in DP to date, with over 1200 DP images used during evaluation. The supplemental online material that accompanies this paper consists of step-by-step instructions for the usage of the supplied source code, trained models, and input data.

Keywords: Classification; deep learning; detection; digital histology; machine learning; segmentation.

Breast cancer histopathology image analysis: a review.
Mitko Veta, Josien P W Pluim, Paul J van Diest, Max A Viergever.
IEEE Trans Biomed Eng, 2014 Apr 25; 61(5). PMID: 24759275
Review.
Methods for nuclei detection, segmentation, and classification in digital histopathology: a review-current status and future potential.
Humayun Irshad, Antoine Veillard, Ludovic Roux, Daniel Racoceanu.
IEEE Rev Biomed Eng, 2014 May 08; 7. PMID: 24802905
Highly Cited. Review.
A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images.
Jun Xu, Xiaofei Luo, +2 authors, Anant Madabhushi.
Neurocomputing, 2017 Feb 06; 191. PMID: 28154470    Free PMC article.
Highly Cited.
Mitosis detection in breast cancer histology images with deep neural networks.
Dan C Cireşan, Alessandro Giusti, Luca M Gambardella, Jürgen Schmidhuber.
Med Image Comput Comput Assist Interv, 2014 Mar 01; 16(Pt 2). PMID: 24579167
Highly Cited.
A resolution adaptive deep hierarchical (RADHicaL) learning scheme applied to nuclear segmentation of digital pathology images.
Andrew Janowczyk, Scott Doyle, Hannah Gilmore, Anant Madabhushi.
Comput Methods Biomech Biomed Eng Imaging Vis, 2018 May 08; 6(3). PMID: 29732269    Free PMC article.
Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images.
Jun Xu, Lei Xiang, +4 authors, Anant Madabhushi.
IEEE Trans Med Imaging, 2015 Jul 25; 35(1). PMID: 26208307    Free PMC article.
Highly Cited.
Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features.
Haibo Wang, Angel Cruz-Roa, +6 authors, Anant Madabhushi.
J Med Imaging (Bellingham), 2015 Jul 15; 1(3). PMID: 26158062    Free PMC article.
A boosted Bayesian multiresolution classifier for prostate cancer detection from digitized needle biopsies.
Scott Doyle, Michael Feldman, John Tomaszewski, Anant Madabhushi.
IEEE Trans Biomed Eng, 2010 Jun 24; 59(5). PMID: 20570758
Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images.
Korsuk Sirinukunwattana, Shan E Ahmed Raza, +3 authors, Nasir M Rajpoot.
IEEE Trans Med Imaging, 2016 Feb 11; 35(5). PMID: 26863654
Highly Cited.
Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases.
Andrew Janowczyk, Anant Madabhushi.
J Pathol Inform, 2016 Aug 27; 7. PMID: 27563488    Free PMC article.
Highly Cited.
Systematic analysis of breast cancer morphology uncovers stromal features associated with survival.
Andrew H Beck, Ankur R Sangoi, +6 authors, Daphne Koller.
Sci Transl Med, 2011 Nov 11; 3(108). PMID: 22072638
Highly Cited.
Quantification of histochemical staining by color deconvolution.
A C Ruifrok, D A Johnston.
Anal Quant Cytol Histol, 2001 Sep 04; 23(4). PMID: 11531144
Highly Cited.
Gleason grading and prognostic factors in carcinoma of the prostate.
Peter A Humphrey.
Mod Pathol, 2004 Feb 21; 17(3). PMID: 14976540
Review.
Assessment of algorithms for mitosis detection in breast cancer histopathology images.
Mitko Veta, Paul J van Diest, +26 authors, Josien P W Pluim.
Med Image Anal, 2014 Dec 31; 20(1). PMID: 25547073
Comparison of the prognostic value of Scarff-Bloom-Richardson and Nottingham histological grades in a series of 825 cases of breast cancer: major importance of the mitotic count as a component of both grading systems.
C Genestie, B Zafrani, +5 authors, X Sastre-Garau.
Anticancer Res, 1998 May 06; 18(1B). PMID: 9568179
Histopathological image analysis: a review.
Metin N Gurcan, Laura E Boucheron, +3 authors, B Yener.
IEEE Rev Biomed Eng, 2009 Jan 01; 2. PMID: 20671804    Free PMC article.
Highly Cited. Review.
NUCLEI SEGMENTATION VIA SPARSITY CONSTRAINED CONVOLUTIONAL REGRESSION.
Yin Zhou, Hang Chang, Kenneth E Barner, Bahram Parvin.
Proc IEEE Int Symp Biomed Imaging, 2015 Apr 01; 2015. PMID: 28101301    Free PMC article.
Deep learning.
Yann LeCun, Yoshua Bengio, Geoffrey Hinton.
Nature, 2015 May 29; 521(7553). PMID: 26017442
Highly Cited. Review.
Mitosis detection in breast cancer histological images An ICPR 2012 contest.
Ludovic Roux, Daniel Racoceanu, +7 authors, Metin N Gurcan.
J Pathol Inform, 2013 Jul 17; 4. PMID: 23858383    Free PMC article.
Automated Grading of Gliomas using Deep Learning in Digital Pathology Images: A modular approach with ensemble of convolutional neural networks.
Mehmet Günhan Ertosun, Daniel L Rubin.
AMIA Annu Symp Proc, 2015 Jan 01; 2015. PMID: 26958289    Free PMC article.
Segmentation and classification of colon glands with deep convolutional neural networks and total variation regularization.
Philipp Kainz, Michael Pfeiffer, Martin Urschler.
PeerJ, 2017 Oct 12; 5. PMID: 29018612    Free PMC article.
Learning to detect cells using non-overlapping extremal regions.
Carlos Arteta, Victor Lempitsky, J Alison Noble, Andrew Zisserman.
Med Image Comput Comput Assist Interv, 2013 Jan 05; 15(Pt 1). PMID: 23285570
Emerging Themes in Image Informatics and Molecular Analysis for Digital Pathology.
Rohit Bhargava, Anant Madabhushi.
Annu Rev Biomed Eng, 2016 Jul 16; 18. PMID: 27420575    Free PMC article.
Review.
Expectation-maximization-driven geodesic active contour with overlap resolution (EMaGACOR): application to lymphocyte segmentation on breast cancer histopathology.
Hussain Fatakdawala, Jun Xu, +5 authors, Anant Madabhushi.
IEEE Trans Biomed Eng, 2010 Feb 23; 57(7). PMID: 20172780
Multi-field-of-view strategy for image-based outcome prediction of multi-parametric estrogen receptor-positive breast cancer histopathology: Comparison to Oncotype DX.
Ajay Basavanhally, Michael Feldman, +4 authors, Anant Madabhushi.
J Pathol Inform, 2011 Jan 01; 2. PMID: 22811953    Free PMC article.
A quantitative histomorphometric classifier (QuHbIC) identifies aggressive versus indolent p16-positive oropharyngeal squamous cell carcinoma.
James S Lewis, Sahirzeeshan Ali, +2 authors, Anant Madabhushi.
Am J Surg Pathol, 2013 Oct 23; 38(1). PMID: 24145650    Free PMC article.
WND-CHARM: Multi-purpose image classification using compound image transforms.
Nikita Orlov, Lior Shamir, +3 authors, Ilya G Goldberg.
Pattern Recognit Lett, 2008 Oct 30; 29(11). PMID: 18958301    Free PMC article.
A deep learning based strategy for identifying and associating mitotic activity with gene expression derived risk categories in estrogen receptor positive breast cancers.
David Romo-Bucheli, Andrew Janowczyk, +2 authors, Anant Madabhushi.
Cytometry A, 2017 Feb 14; 91(6). PMID: 28192639    Free PMC article.
Relevance of deep learning to facilitate the diagnosis of HER2 status in breast cancer.
Michel E Vandenberghe, Marietta L J Scott, +3 authors, Craig Barker.
Sci Rep, 2017 Apr 06; 7. PMID: 28378829    Free PMC article.
Training a cell-level classifier for detecting basal-cell carcinoma by combining human visual attention maps with low-level handcrafted features.
Germán Corredor, Jon Whitney, +2 authors, Eduardo Romero.
J Med Imaging (Bellingham), 2017 Apr 07; 4(2). PMID: 28382314    Free PMC article.
The Need for Careful Data Collection for Pattern Recognition in Digital Pathology.
Raphaël Marée.
J Pathol Inform, 2017 May 10; 8. PMID: 28480122    Free PMC article.
Training Nuclei Detection Algorithms with Simple Annotations.
Henning Kost, André Homeyer, +2 authors, Horst Karl Hahn.
J Pathol Inform, 2017 Jun 07; 8. PMID: 28584683    Free PMC article.
Gland segmentation in prostate histopathological images.
Malay Singh, Emarene Mationg Kalaw, +3 authors, Hwee Kuan Lee.
J Med Imaging (Bellingham), 2017 Jun 28; 4(2). PMID: 28653016    Free PMC article.
Deep Learning for Classification of Colorectal Polyps on Whole-slide Images.
Bruno Korbar, Andrea M Olofson, +5 authors, Saeed Hassanpour.
J Pathol Inform, 2017 Aug 23; 8. PMID: 28828201    Free PMC article.
Automatic cellularity assessment from post-treated breast surgical specimens.
Mohammad Peikari, Sherine Salama, Sharon Nofech-Mozes, Anne L Martel.
Cytometry A, 2017 Oct 05; 91(11). PMID: 28976721    Free PMC article.
A novel machine learning approach reveals latent vascular phenotypes predictive of renal cancer outcome.
Nathan Ing, Fangjin Huang, +9 authors, Beatrice S Knudsen.
Sci Rep, 2017 Oct 19; 7(1). PMID: 29038551    Free PMC article.
Prediction of recurrence in early stage non-small cell lung cancer using computer extracted nuclear features from digital H&E images.
Xiangxue Wang, Andrew Janowczyk, +5 authors, Anant Madabhushi.
Sci Rep, 2017 Oct 21; 7(1). PMID: 29051570    Free PMC article.
Development of CD3 cell quantitation algorithms for renal allograft biopsy rejection assessment utilizing open source image analysis software.
Andres Moon, Geoffrey H Smith, +3 authors, Alton B Brad Farris.
Virchows Arch, 2017 Nov 09; 472(2). PMID: 29116389
A deep learning method for classifying mammographic breast density categories.
Aly A Mohamed, Wendie A Berg, +3 authors, Shandong Wu.
Med Phys, 2017 Nov 22; 45(1). PMID: 29159811    Free PMC article.
Glandular Morphometrics for Objective Grading of Colorectal Adenocarcinoma Histology Images.
Ruqayya Awan, Korsuk Sirinukunwattana, +6 authors, Nasir Rajpoot.
Sci Rep, 2017 Dec 06; 7(1). PMID: 29203775    Free PMC article.
Automatic labeling of molecular biomarkers of immunohistochemistry images using fully convolutional networks.
Fahime Sheikhzadeh, Rabab K Ward, Dirk van Niekerk, Martial Guillaud.
PLoS One, 2018 Jan 20; 13(1). PMID: 29351281    Free PMC article.
Application of deep learning to the classification of images from colposcopy.
Masakazu Sato, Koji Horie, +4 authors, Harushige Yokota.
Oncol Lett, 2018 Feb 20; 15(3). PMID: 29456725    Free PMC article.
Deep learning based tissue analysis predicts outcome in colorectal cancer.
Dmitrii Bychkov, Nina Linder, +7 authors, Johan Lundin.
Sci Rep, 2018 Feb 23; 8(1). PMID: 29467373    Free PMC article.
Highly Cited.
Predicting cancer outcomes from histology and genomics using convolutional networks.
Pooya Mobadersany, Safoora Yousefi, +5 authors, Lee A D Cooper.
Proc Natl Acad Sci U S A, 2018 Mar 14; 115(13). PMID: 29531073    Free PMC article.
Highly Cited.
A Review on the Applications of Crowdsourcing in Human Pathology.
Roshanak Alialy, Sasan Tavakkol, +4 authors, Cyrus Shahabi.
J Pathol Inform, 2018 Mar 14; 9. PMID: 29531847    Free PMC article.
Review.
Advanced Morphologic Analysis for Diagnosing Allograft Rejection: The Case of Cardiac Transplant Rejection.
Eliot G Peyster, Anant Madabhushi, Kenneth B Margulies.
Transplantation, 2018 Mar 24; 102(8). PMID: 29570167    Free PMC article.
Review.
A deep-learning classifier identifies patients with clinical heart failure using whole-slide images of H&E tissue.
Jeffrey J Nirschl, Andrew Janowczyk, +4 authors, Anant Madabhushi.
PLoS One, 2018 Apr 04; 13(4). PMID: 29614076    Free PMC article.
Label-free quantitative evaluation of breast tissue using Spatial Light Interference Microscopy (SLIM).
Hassaan Majeed, Tan Huu Nguyen, +2 authors, Gabriel Popescu.
Sci Rep, 2018 May 04; 8(1). PMID: 29720678    Free PMC article.
Association of Pathological Fibrosis With Renal Survival Using Deep Neural Networks.
Vijaya B Kolachalama, Priyamvada Singh, +6 authors, Vipul C Chitalia.
Kidney Int Rep, 2018 May 05; 3(2). PMID: 29725651    Free PMC article.
Artificial intelligence in radiology.
Ahmed Hosny, Chintan Parmar, +2 authors, Hugo J W L Aerts.
Nat Rev Cancer, 2018 May 20; 18(8). PMID: 29777175    Free PMC article.
Highly Cited. Review.
High-throughput adaptive sampling for whole-slide histopathology image analysis (HASHI) via convolutional neural networks: Application to invasive breast cancer detection.
Angel Cruz-Roa, Hannah Gilmore, +6 authors, Fabio González.
PLoS One, 2018 May 26; 13(5). PMID: 29795581    Free PMC article.
Quantitative nuclear histomorphometry predicts oncotype DX risk categories for early stage ER+ breast cancer.
Jon Whitney, German Corredor, +6 authors, Anant Madabhushi.
BMC Cancer, 2018 Jun 01; 18(1). PMID: 29848291    Free PMC article.
Precision histology: how deep learning is poised to revitalize histomorphology for personalized cancer care.
Ugljesa Djuric, Gelareh Zadeh, Kenneth Aldape, Phedias Diamandis.
NPJ Precis Oncol, 2018 Jun 07; 1(1). PMID: 29872706    Free PMC article.
Highly Cited.
Advances in the computational and molecular understanding of the prostate cancer cell nucleus.
Neil M Carleton, George Lee, Anant Madabhushi, Robert W Veltri.
J Cell Biochem, 2018 Jun 21; 119(9). PMID: 29923622    Free PMC article.
Review.
Multi-tissue and multi-scale approach for nuclei segmentation in H&E stained images.
Massimo Salvi, Filippo Molinari.
Biomed Eng Online, 2018 Jun 22; 17(1). PMID: 29925379    Free PMC article.
Environmental properties of cells improve machine learning-based phenotype recognition accuracy.
Timea Toth, Tamas Balassa, +6 authors, Peter Horvath.
Sci Rep, 2018 Jul 06; 8(1). PMID: 29973621    Free PMC article.
Gastric Pathology Image Classification Using Stepwise Fine-Tuning for Deep Neural Networks.
Jia Qu, Nobuyuki Hiruta, +3 authors, Hidenori Sakanashi.
J Healthc Eng, 2018 Jul 24; 2018. PMID: 30034677    Free PMC article.
Predicting Infectious Disease Using Deep Learning and Big Data.
Sangwon Chae, Sungjun Kwon, Donghyun Lee.
Int J Environ Res Public Health, 2018 Aug 01; 15(8). PMID: 30060525    Free PMC article.
Enabling Precision Cardiology Through Multiscale Biology and Systems Medicine.
Kipp W Johnson, Khader Shameer, +5 authors, Joel T Dudley.
JACC Basic Transl Sci, 2017 Jun 26; 2(3). PMID: 30062151    Free PMC article.
Review.
Deep neural network based histological scoring of lung fibrosis and inflammation in the mouse model system.
Fabian Heinemann, Gerald Birk, Tanja Schoenberger, Birgit Stierstorfer.
PLoS One, 2018 Aug 24; 13(8). PMID: 30138413    Free PMC article.
Identifying the morphologic basis for radiomic features in distinguishing different Gleason grades of prostate cancer on MRI: Preliminary findings.
Gregory Penzias, Asha Singanamalli, +13 authors, Anant Madabhushi.
PLoS One, 2018 Sep 01; 13(8). PMID: 30169514    Free PMC article.
Image analysis with deep learning to predict breast cancer grade, ER status, histologic subtype, and intrinsic subtype.
Heather D Couture, Lindsay A Williams, +6 authors, Marc Niethammer.
NPJ Breast Cancer, 2018 Sep 06; 4. PMID: 30182055    Free PMC article.
A Lightweight Convolutional Neural Network Based on Visual Attention for SAR Image Target Classification.
Jiaqi Shao, Changwen Qu, Jianwei Li, Shujuan Peng.
Sensors (Basel), 2018 Sep 14; 18(9). PMID: 30208646    Free PMC article.
Machine Learning Methods for Histopathological Image Analysis.
Daisuke Komura, Shumpei Ishikawa.
Comput Struct Biotechnol J, 2018 Oct 03; 16. PMID: 30275936    Free PMC article.
Highly Cited. Review.
Diagnostic Performance of Deep Learning Algorithms Applied to Three Common Diagnoses in Dermatopathology.
Thomas George Olsen, B Hunter Jackson, +5 authors, Rajath E Soans.
J Pathol Inform, 2018 Oct 09; 9. PMID: 30294501    Free PMC article.
Medical Image Analysis using Convolutional Neural Networks: A Review.
Syed Muhammad Anwar, Muhammad Majid, +3 authors, Muhammad Khurram Khan.
J Med Syst, 2018 Oct 10; 42(11). PMID: 30298337
Review.
Open access image repositories: high-quality data to enable machine learning research.
F Prior, J Almeida, +4 authors, J Saltz.
Clin Radiol, 2019 May 02; 75(1). PMID: 31040006    Free PMC article.
Role of deep learning in infant brain MRI analysis.
Mahmoud Mostapha, Martin Styner.
Magn Reson Imaging, 2019 Jun 24; 64. PMID: 31229667    Free PMC article.
Review.
Artificial intelligence in digital pathology - new tools for diagnosis and precision oncology.
Kaustav Bera, Kurt A Schalper, +2 authors, Anant Madabhushi.
Nat Rev Clin Oncol, 2019 Aug 11; 16(11). PMID: 31399699    Free PMC article.
Highly Cited. Review.
Panoptic View of Prognostic Models for Personalized Breast Cancer Management.
Geetanjali Saini, Karuna Mittal, +3 authors, Ritu Aneja.
Cancers (Basel), 2019 Sep 11; 11(9). PMID: 31500225    Free PMC article.
Review.
Automated and Manual Quantification of Tumour Cellularity in Digital Slides for Tumour Burden Assessment.
Shazia Akbar, Mohammad Peikari, +3 authors, Anne L Martel.
Sci Rep, 2019 Oct 03; 9(1). PMID: 31576001    Free PMC article.
Bringing Open Data to Whole Slide Imaging.
Sébastien Besson, Roger Leigh, +12 authors, Jason R Swedlow.
Digit Pathol (2019), 2019 Oct 04; 2019. PMID: 31579322    Free PMC article.
Prediction of BAP1 Expression in Uveal Melanoma Using Densely-Connected Deep Classification Networks.
Muyi Sun, Wei Zhou, +7 authors, Gustav Stålhammar.
Cancers (Basel), 2019 Oct 19; 11(10). PMID: 31623293    Free PMC article.
Quantitative nuclear histomorphometric features are predictive of Oncotype DX risk categories in ductal carcinoma in situ: preliminary findings.
Haojia Li, Jon Whitney, +4 authors, Anant Madabhushi.
Breast Cancer Res, 2019 Oct 19; 21(1). PMID: 31623652    Free PMC article.
Automated detection and quantification of breast cancer brain metastases in an animal model using democratized machine learning tools.
Dina Sikpa, Jérémie P Fouquet, +3 authors, Martin Lepage.
Sci Rep, 2019 Nov 24; 9(1). PMID: 31758004    Free PMC article.
Comparing Artificial Intelligence Platforms for Histopathologic Cancer Diagnosis.
Andrew A Borkowski, Catherine P Wilson, +4 authors, Stephen M Mastorides.
Fed Pract, 2019 Nov 27; 36(10). PMID: 31768096    Free PMC article.
Deep Learning for Whole Slide Image Analysis: An Overview.
Neofytos Dimitriou, Ognjen Arandjelović, Peter D Caie.
Front Med (Lausanne), 2019 Dec 12; 6. PMID: 31824952    Free PMC article.
Review.
Machine-based detection and classification for bone marrow aspirate differential counts: initial development focusing on nonneoplastic cells.
Ramraj Chandradevan, Ahmed A Aljudi, +5 authors, David L Jaye.
Lab Invest, 2019 Oct 02; 100(1). PMID: 31570774    Free PMC article.
Real-time intraoperative diagnosis by deep neural network driven multiphoton virtual histology.
Sixian You, Yi Sun, +5 authors, Stephen A Boppart.
NPJ Precis Oncol, 2019 Dec 25; 3. PMID: 31872065    Free PMC article.
Digital Microscopy, Image Analysis, and Virtual Slide Repository.
Famke Aeffner, Hibret A Adissu, +8 authors, Kristin Wilson.
ILAR J, 2018 Dec 12; 59(1). PMID: 30535284    Free PMC article.
A novel model for malaria prediction based on ensemble algorithms.
Mengyang Wang, Hui Wang, +9 authors, Jun Ma.
PLoS One, 2019 Dec 27; 14(12). PMID: 31877185    Free PMC article.
Feasibility of fully automated classification of whole slide images based on deep learning.
Kyung-Ok Cho, Sung Hak Lee, Hyun-Jong Jang.
Korean J Physiol Pharmacol, 2020 Jan 08; 24(1). PMID: 31908578    Free PMC article.
Whole-Slide Image Focus Quality: Automatic Assessment and Impact on AI Cancer Detection.
Timo Kohlberger, Yun Liu, +5 authors, Martin C Stumpe.
J Pathol Inform, 2020 Jan 11; 10. PMID: 31921487    Free PMC article.
Improved small blob detection in 3D images using jointly constrained deep learning and Hessian analysis.
Yanzhe Xu, Teresa Wu, +2 authors, Kevin M Bennett.
Sci Rep, 2020 Jan 17; 10(1). PMID: 31941994    Free PMC article.
A deep learning image-based intrinsic molecular subtype classifier of breast tumors reveals tumor heterogeneity that may affect survival.
Mustafa I Jaber, Bing Song, +5 authors, Christopher W Szeto.
Breast Cancer Res, 2020 Jan 30; 22(1). PMID: 31992350    Free PMC article.
Deep Learning Algorithms for Corneal Amyloid Deposition Quantitation in Familial Amyloidosis.
Klaus Kessel, Jaakko Mattila, +2 authors, Johan Lundin.
Ocul Oncol Pathol, 2020 Feb 01; 6(1). PMID: 32002407    Free PMC article.
Policy Implications of Artificial Intelligence and Machine Learning in Diabetes Management.
David T Broome, C Beau Hilton, Neil Mehta.
Curr Diab Rep, 2020 Feb 03; 20(2). PMID: 32008107
Review.
Bioinformatics analysis of whole slide images reveals significant neighborhood preferences of tumor cells in Hodgkin lymphoma.
Jennifer Hannig, Hendrik Schäfer, +6 authors, Ina Koch.
PLoS Comput Biol, 2020 Jan 22; 16(1). PMID: 31961873    Free PMC article.
Fluorescence-based quantification of nucleocytoplasmic transport.
Joshua B Kelley, Bryce M Paschal.
Methods, 2018 Nov 13; 157. PMID: 30419335    Free PMC article.
Tailored for Real-World: A Whole Slide Image Classification System Validated on Uncurated Multi-Site Data Emulating the Prospective Pathology Workload.
Julianna D Ianni, Rajath E Soans, +9 authors, Jason B Lee.
Sci Rep, 2020 Feb 23; 10(1). PMID: 32081956    Free PMC article.
An End-to-end System for Automatic Characterization of Iba1 Immunopositive Microglia in Whole Slide Imaging.
Alexander D Kyriazis, Shahriar Noroozizadeh, +9 authors, Guy Nir.
Neuroinformatics, 2018 Nov 09; 17(3). PMID: 30406865
Convolutional neural networks can accurately distinguish four histologic growth patterns of lung adenocarcinoma in digital slides.
Arkadiusz Gertych, Zaneta Swiderska-Chadaj, +7 authors, Beatrice S Knudsen.
Sci Rep, 2019 Feb 08; 9(1). PMID: 30728398    Free PMC article.
Highly Cited.
Trace, Machine Learning of Signal Images for Trace-Sensitive Mass Spectrometry: A Case Study from Single-Cell Metabolomics.
Zhichao Liu, Erika P Portero, +4 authors, Peter Nemes.
Anal Chem, 2019 Apr 02; 91(9). PMID: 30929422    Free PMC article.
Osteoporosis Recognition in Rats under Low-Power Lens Based on Convexity Optimization Feature Fusion.
Jie Cai, Wen-Guang He, +2 authors, Tian-Xiu Wu.
Sci Rep, 2019 Jul 31; 9(1). PMID: 31358772    Free PMC article.
Machine learning and feature selection for drug response prediction in precision oncology applications.
Mehreen Ali, Tero Aittokallio.
Biophys Rev, 2018 Aug 12; 11(1). PMID: 30097794    Free PMC article.
Review.
Spatial Architecture and Arrangement of Tumor-Infiltrating Lymphocytes for Predicting Likelihood of Recurrence in Early-Stage Non-Small Cell Lung Cancer.
Germán Corredor, Xiangxue Wang, +9 authors, Anant Madabhushi.
Clin Cancer Res, 2018 Sep 12; 25(5). PMID: 30201760    Free PMC article.
Path R-CNN for Prostate Cancer Diagnosis and Gleason Grading of Histological Images.
Wenyuan Li, Jiayun Li, +5 authors, Corey W Arnold.
IEEE Trans Med Imaging, 2018 Oct 20; 38(4). PMID: 30334752    Free PMC article.
Applications of machine learning in drug discovery and development.
Jessica Vamathevan, Dominic Clark, +8 authors, Shanrong Zhao.
Nat Rev Drug Discov, 2019 Apr 13; 18(6). PMID: 30976107    Free PMC article.
Highly Cited. Review.
HistoQC: An Open-Source Quality Control Tool for Digital Pathology Slides.
Andrew Janowczyk, Ren Zuo, +2 authors, Anant Madabhushi.
JCO Clin Cancer Inform, 2019 Apr 17; 3. PMID: 30990737    Free PMC article.
The Use of Deep Learning to Predict Stroke Patient Mortality.
Songhee Cheon, Jungyoon Kim, Jihye Lim.
Int J Environ Res Public Health, 2019 May 31; 16(11). PMID: 31141892    Free PMC article.
Deep learning techniques for detecting preneoplastic and neoplastic lesions in human colorectal histological images.
Paola Sena, Rita Fioresi, +3 authors, Luca Roncucci.
Oncol Lett, 2019 Dec 04; 18(6). PMID: 31788084    Free PMC article.
Pathology Image Analysis Using Segmentation Deep Learning Algorithms.
Shidan Wang, Donghan M Yang, +2 authors, Guanghua Xiao.
Am J Pathol, 2019 Jun 15; 189(9). PMID: 31199919    Free PMC article.
Review.
Detection and Classification of Novel Renal Histologic Phenotypes Using Deep Neural Networks.
Susan Sheehan, Seamus Mawe, +2 authors, J Matthew Mahoney.
Am J Pathol, 2019 Jun 21; 189(9). PMID: 31220455    Free PMC article.
Limited Number of Cases May Yield Generalizable Models, a Proof of Concept in Deep Learning for Colon Histology.
Lorne Holland, Dongguang Wei, +6 authors, Hooman H Rashidi.
J Pathol Inform, 2020 Mar 17; 11. PMID: 32175170    Free PMC article.
Pan-cancer diagnostic consensus through searching archival histopathology images using artificial intelligence.
Shivam Kalra, H R Tizhoosh, +8 authors, Liron Pantanowitz.
NPJ Digit Med, 2020 Mar 21; 3. PMID: 32195366    Free PMC article.
Quantitative Assessment of the Effects of Compression on Deep Learning in Digital Pathology Image Analysis.
Yijiang Chen, Andrew Janowczyk, Anant Madabhushi.
JCO Clin Cancer Inform, 2020 Mar 11; 4. PMID: 32155093    Free PMC article.
Glioma Grading via Analysis of Digital Pathology Images Using Machine Learning.
Saima Rathore, Tamim Niazi, Muhammad Aksam Iftikhar, Ahmad Chaddad.
Cancers (Basel), 2020 Mar 07; 12(3). PMID: 32131409    Free PMC article.
Computationally Derived Image Signature of Stromal Morphology Is Prognostic of Prostate Cancer Recurrence Following Prostatectomy in African American Patients.
Hersh K Bhargava, Patrick Leo, +11 authors, Anant Madabhushi.
Clin Cancer Res, 2020 Mar 07; 26(8). PMID: 32139401    Free PMC article.
Artificial intelligence driven next-generation renal histomorphometry.
Briana A Santo, Avi Z Rosenberg, Pinaki Sarder.
Curr Opin Nephrol Hypertens, 2020 Mar 25; 29(3). PMID: 32205581    Free PMC article.
Review.
Validation of machine learning models to detect amyloid pathologies across institutions.
Juan C Vizcarra, Marla Gearing, +3 authors, David A Gutman.
Acta Neuropathol Commun, 2020 Apr 30; 8(1). PMID: 32345363    Free PMC article.
Accurate diagnosis of lymphoma on whole-slide histopathology images using deep learning.
Charlotte Syrykh, Arnaud Abreu, +7 authors, Pierre Brousset.
NPJ Digit Med, 2020 May 08; 3. PMID: 32377574    Free PMC article.
Enhancing the Value of Histopathological Assessment of Allograft Biopsy Monitoring.
Michelle A Wood-Trageser, Andrew J Lesniak, Anthony J Demetris.
Transplantation, 2019 Feb 16; 103(7). PMID: 30768568    Free PMC article.
Review.
Report on computational assessment of Tumor Infiltrating Lymphocytes from the International Immuno-Oncology Biomarker Working Group.
Mohamed Amgad, Elisabeth Specht Stovgaard, +66 authors, International Immuno-Oncology Biomarker Working Group.
NPJ Breast Cancer, 2020 May 16; 6. PMID: 32411818    Free PMC article.
Review.
Artificial Intelligence and Digital Microscopy Applications in Diagnostic Hematopathology.
Hanadi El Achi, Joseph D Khoury.
Cancers (Basel), 2020 Apr 01; 12(4). PMID: 32224980    Free PMC article.
Review.
Deep-Learning-Based Characterization of Tumor-Infiltrating Lymphocytes in Breast Cancers From Histopathology Images and Multiomics Data.
Zixiao Lu, Siwen Xu, +5 authors, Kun Huang.
JCO Clin Cancer Inform, 2020 May 27; 4. PMID: 32453636    Free PMC article.
Computer-aided diagnosis in the era of deep learning.
Heang-Ping Chan, Lubomir M Hadjiiski, Ravi K Samala.
Med Phys, 2020 May 18; 47(5). PMID: 32418340    Free PMC article.
Review.
Cardiac tissue engineering: state-of-the-art methods and outlook.
Anh H Nguyen, Paul Marsh, +4 authors, Hung Cao.
J Biol Eng, 2019 Jul 13; 13. PMID: 31297148    Free PMC article.
Review.
Dataset of segmented nuclei in hematoxylin and eosin stained histopathology images of ten cancer types.
Le Hou, Rajarsi Gupta, +5 authors, Joel H Saltz.
Sci Data, 2020 Jun 21; 7(1). PMID: 32561748    Free PMC article.
Impact of pre-analytical variables on deep learning accuracy in histopathology.
Andrew D Jones, John Paul Graff, +8 authors, Hooman H Rashidi.
Histopathology, 2019 Feb 26; 75(1). PMID: 30801768    Free PMC article.
Learning from irregularly sampled data for endomicroscopy super-resolution: a comparative study of sparse and dense approaches.
Agnieszka Barbara Szczotka, Dzhoshkun Ismail Shakir, +3 authors, Tom Vercauteren.
Int J Comput Assist Radiol Surg, 2020 May 18; 15(7). PMID: 32415459    Free PMC article.
Deep Learning With Sampling in Colon Cancer Histology.
Mary Shapcott, Katherine J Hewitt, Nasir Rajpoot.
Front Bioeng Biotechnol, 2019 Apr 12; 7. PMID: 30972333    Free PMC article.
Automated histologic diagnosis of CNS tumors with machine learning.
Siri Sahib S Khalsa, Todd C Hollon, +7 authors, Daniel A Orringer.
CNS Oncol, 2020 Jul 01; 9(2). PMID: 32602745    Free PMC article.
Artificial intelligence in digital breast pathology: Techniques and applications.
Asmaa Ibrahim, Paul Gamble, +4 authors, Emad A Rakha.
Breast, 2020 Jan 15; 49. PMID: 31935669    Free PMC article.
Review.
Deep learning-based image analysis methods for brightfield-acquired multiplex immunohistochemistry images.
Danielle J Fassler, Shahira Abousamra, +10 authors, Joel Saltz.
Diagn Pathol, 2020 Jul 30; 15(1). PMID: 32723384    Free PMC article.
Relevant Applications of Generative Adversarial Networks in Drug Design and Discovery: Molecular De Novo Design, Dimensionality Reduction, and De Novo Peptide and Protein Design.
Eugene Lin, Chieh-Hsin Lin, Hsien-Yuan Lane.
Molecules, 2020 Jul 28; 25(14). PMID: 32708785    Free PMC article.
Review.
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images.
Gabriele Campanella, Matthew G Hanna, +7 authors, Thomas J Fuchs.
Nat Med, 2019 Jul 17; 25(8). PMID: 31308507    Free PMC article.
Highly Cited.
Non-disruptive collagen characterization in clinical histopathology using cross-modality image synthesis.
Adib Keikhosravi, Bin Li, +3 authors, Kevin W Eliceiri.
Commun Biol, 2020 Aug 02; 3(1). PMID: 32737412    Free PMC article.
Time Series Analysis and Forecasting with Automated Machine Learning on a National ICD-10 Database.
Victor Olsavszky, Mihnea Dosius, Cristian Vladescu, Johannes Benecke.
Int J Environ Res Public Health, 2020 Jul 16; 17(14). PMID: 32664331    Free PMC article.
Deep Learning in Medical Image Analysis.
Heang-Ping Chan, Ravi K Samala, Lubomir M Hadjiiski, Chuan Zhou.
Adv Exp Med Biol, 2020 Feb 08; 1213. PMID: 32030660    Free PMC article.
Review.
Clinically applicable histopathological diagnosis system for gastric cancer detection using deep learning.
Zhigang Song, Shuangmei Zou, +21 authors, Huaiyin Shi.
Nat Commun, 2020 Aug 29; 11(1). PMID: 32855423    Free PMC article.
Artificial Intelligence in Pathology.
Hye Yoon Chang, Chan Kwon Jung, +4 authors, Tae-Yeong Kwak.
J Pathol Transl Med, 2019 Jan 03; 53(1). PMID: 30599506    Free PMC article.
Highly Cited.
Artificial Intelligence and Digital Pathology: Challenges and Opportunities.
Hamid Reza Tizhoosh, Liron Pantanowitz.
J Pathol Inform, 2019 Jan 05; 9. PMID: 30607305    Free PMC article.
Highly Cited. Review.
The Use of Screencasts with Embedded Whole-Slide Scans and Hyperlinks to Teach Anatomic Pathology in a Supervised Digital Environment.
Mary Wong, Joseph Frye, Stacey Kim, Alberto M Marchevsky.
J Pathol Inform, 2019 Jan 05; 9. PMID: 30607306    Free PMC article.
Twenty Years of Digital Pathology: An Overview of the Road Travelled, What is on the Horizon, and the Emergence of Vendor-Neutral Archives.
Liron Pantanowitz, Ashish Sharma, +3 authors, Joel Saltz.
J Pathol Inform, 2019 Jan 05; 9. PMID: 30607307    Free PMC article.
Review.
Computer-Aided Laser Dissection: A Microdissection Workflow Leveraging Image Analysis Tools.
Jason D Hipp, Donald J Johann, +12 authors, Michael A Tangrea.
J Pathol Inform, 2019 Jan 10; 9. PMID: 30622835    Free PMC article.
Quantitative Characterization of CD8+ T Cell Clustering and Spatial Heterogeneity in Solid Tumors.
Chang Gong, Robert A Anders, +7 authors, Aleksander S Popel.
Front Oncol, 2019 Jan 23; 8. PMID: 30666298    Free PMC article.
Detection and classification of cancer in whole slide breast histopathology images using deep convolutional networks.
Baris Gecer, Selim Aksoy, +3 authors, Joann G Elmore.
Pattern Recognit, 2019 Jan 27; 84. PMID: 30679879    Free PMC article.
Blinded Visual Scoring of Images Using the Freely-available Software Blinder.
Steven D Cothren, Joel N Meyer, Jessica H Hartman.
Bio Protoc, 2019 Feb 15; 8(23). PMID: 30761327    Free PMC article.
Convolutional neural network initialized active contour model with adaptive ellipse fitting for nuclear segmentation on breast histopathological images.
Jun Xu, Lei Gong, +4 authors, Anant Madabhushi.
J Med Imaging (Bellingham), 2019 Mar 07; 6(1). PMID: 30840729    Free PMC article.
Introduction to Digital Image Analysis in Whole-slide Imaging: A White Paper from the Digital Pathology Association.
Famke Aeffner, Mark D Zarella, +11 authors, Douglas Bowman.
J Pathol Inform, 2019 Apr 16; 10. PMID: 30984469    Free PMC article.
Highly Cited. Review.
Construction and Utilization of a Neural Network Model to Predict Current Procedural Terminology Codes from Pathology Report Texts.
Jay J Ye.
J Pathol Inform, 2019 May 07; 10. PMID: 31057982    Free PMC article.
Rapid and robust whole slide imaging based on LED-array illumination and color-multiplexed single-shot autofocusing.
Shaowei Jiang, Zichao Bian, +4 authors, Guoan Zheng.
Quant Imaging Med Surg, 2019 Jul 10; 9(5). PMID: 31281778    Free PMC article.
Segmentation of Glomeruli Within Trichrome Images Using Deep Learning.
Shruti Kannan, Laura A Morgan, +9 authors, Vijaya B Kolachalama.
Kidney Int Rep, 2019 Jul 19; 4(7). PMID: 31317118    Free PMC article.
Otorhinolaryngology and Artificial Intelligence.
Turgut Karlıdağ.
Turk Arch Otorhinolaryngol, 2019 Jul 31; 57(2). PMID: 31360921    Free PMC article.
Staining Invariant Features for Improving Generalization of Deep Convolutional Neural Networks in Computational Pathology.
Sebastian Otálora, Manfredo Atzori, +2 authors, Henning Müller.
Front Bioeng Biotechnol, 2019 Sep 12; 7. PMID: 31508414    Free PMC article.
A bird's-eye view of deep learning in bioimage analysis.
Erik Meijering.
Comput Struct Biotechnol J, 2020 Oct 01; 18. PMID: 32994890    Free PMC article.
Review.
Immune contexture analysis in immuno-oncology: applications and challenges of multiplex fluorescent immunohistochemistry.
Reshma Shakya, Tam Hong Nguyen, Nigel Waterhouse, Rajiv Khanna.
Clin Transl Immunology, 2020 Oct 20; 9(10). PMID: 33072322    Free PMC article.
Review.
Application of Big Data Technology for COVID-19 Prevention and Control in China: Lessons and Recommendations.
Jun Wu, Jian Wang, +2 authors, Qiuyan Fan.
J Med Internet Res, 2020 Oct 02; 22(10). PMID: 33001836    Free PMC article.
Integrative Data Augmentation with U-Net Segmentation Masks Improves Detection of Lymph Node Metastases in Breast Cancer Patients.
Yong Won Jin, Shuo Jia, Ahmed Bilal Ashraf, Pingzhao Hu.
Cancers (Basel), 2020 Oct 16; 12(10). PMID: 33053723    Free PMC article.
Automated detection of COVID-19 using ensemble of transfer learning with deep convolutional neural network based on CT scans.
Parisa Gifani, Ahmad Shalbaf, Majid Vafaeezadeh.
Int J Comput Assist Radiol Surg, 2020 Nov 17; 16(1). PMID: 33191476    Free PMC article.
Joint reconstruction and classification of tumor cells and cell interactions in melanoma tissue sections with synthesized training data.
Alexander Effland, Erich Kobler, +6 authors, Martin Rumpf.
Int J Comput Assist Radiol Surg, 2019 Feb 20; 14(4). PMID: 30779021    Free PMC article.
Direct Cellularity Estimation on Breast Cancer Histopathology Images Using Transfer Learning.
Ziang Pei, Shuangliang Cao, Lijun Lu, Wufan Chen.
Comput Math Methods Med, 2019 Jul 10; 2019. PMID: 31281408    Free PMC article.
Automated detection and delineation of hepatocellular carcinoma on multiphasic contrast-enhanced MRI using deep learning.
Khaled Bousabarah, Brian Letzen, +7 authors, MingDe Lin.
Abdom Radiol (NY), 2020 Jun 06; 46(1). PMID: 32500237    Free PMC article.
Reimagining T Staging Through Artificial Intelligence and Machine Learning Image Processing Approaches in Digital Pathology.
Kaustav Bera, Ian Katz, Anant Madabhushi.
JCO Clin Cancer Inform, 2020 Nov 10; 4. PMID: 33166198    Free PMC article.
Artificial Intelligence Tools for Refining Lung Cancer Screening.
J Luis Espinoza, Le Thanh Dong.
J Clin Med, 2020 Dec 03; 9(12). PMID: 33261057    Free PMC article.
Review.
The Utility of Deep Learning in Breast Ultrasonic Imaging: A Review.
Tomoyuki Fujioka, Mio Mori, +10 authors, Ukihide Tateishi.
Diagnostics (Basel), 2020 Dec 10; 10(12). PMID: 33291266    Free PMC article.
Review.
Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases.
Andrew Janowczyk, Anant Madabhushi.
J Pathol Inform, 2016 Aug 27; 7. PMID: 27563488    Free PMC article.
Highly Cited.
Artificial intelligence in automatic classification of invasive ductal carcinoma breast cancer in digital pathology images.
Mohammad Abdolahi, Mohammad Salehi, Iman Shokatian, Reza Reiazi.
Med J Islam Repub Iran, 2021 Jan 14; 34. PMID: 33437736    Free PMC article.
Artificial intelligence neuropathologist for glioma classification using deep learning on hematoxylin and eosin stained slide images and molecular markers.
Lei Jin, Feng Shi, +10 authors, Jinsong Wu.
Neuro Oncol, 2020 Jul 15; 23(1). PMID: 32663285    Free PMC article.
Feature-driven local cell graph (FLocK): New computational pathology-based descriptors for prognosis of lung cancer and HPV status of oropharyngeal cancers.
Cheng Lu, Can Koyuncu, +8 authors, Anant Madabhushi.
Med Image Anal, 2020 Dec 23; 68. PMID: 33352373    Free PMC article.

;. PMID: 33574288
Deep learning in cancer pathology: a new generation of clinical biomarkers.
Amelie Echle, Niklas Timon Rindtorff, +3 authors, Jakob Nikolas Kather.
Br J Cancer, 2020 Nov 19; 124(4). PMID: 33204028    Free PMC article.
Review.
A comprehensive survey of image segmentation: clustering methods, performance parameters, and benchmark datasets.
Himanshu Mittal, Avinash Chandra Pandey, +3 authors, Garv Modwel.
Multimed Tools Appl, 2021 Feb 16;. PMID: 33584121    Free PMC article.
Deep learning powers cancer diagnosis in digital pathology.
Yunjie He, Hong Zhao, Stephen T C Wong.
Comput Med Imaging Graph, 2021 Jan 17; 88. PMID: 33453648    Free PMC article.
Review.
Deep Learning in Head and Neck Tumor Multiomics Diagnosis and Analysis: Review of the Literature.
Xi Wang, Bin-Bin Li.
Front Genet, 2021 Mar 02; 12. PMID: 33643386    Free PMC article.
Review.
A multi-phase deep CNN based mitosis detection framework for breast cancer histopathological images.
Anabia Sohail, Asifullah Khan, +2 authors, Saranjam Khan.
Sci Rep, 2021 Mar 20; 11(1). PMID: 33737632    Free PMC article.
Deep Multi-Magnification Networks for multi-class breast cancer image segmentation.
David Joon Ho, Dig V K Yarlagadda, +6 authors, Thomas J Fuchs.
Comput Med Imaging Graph, 2021 Jan 24; 88. PMID: 33485058    Free PMC article.
Deep Learning-Based Image Classification in Differentiating Tufted Astrocytes, Astrocytic Plaques, and Neuritic Plaques.
Shunsuke Koga, Nikhil B Ghayal, Dennis W Dickson.
J Neuropathol Exp Neurol, 2021 Feb 12; 80(4). PMID: 33570124    Free PMC article.
Application of Single-Cell Approaches to Study Myeloproliferative Neoplasm Biology.
Daniel Royston, Adam J Mead, Bethan Psaila.
Hematol Oncol Clin North Am, 2021 Mar 02; 35(2). PMID: 33641869    Free PMC article.
Review.
Digital diagnostics and artificial intelligence in prostate cancer treatment in 5 years from now.
Alessia Cimadamore, Liang Cheng, +2 authors, Rodolfo Montironi.
Transl Androl Urol, 2021 Apr 15; 10(3). PMID: 33850784    Free PMC article.
A review and comparison of breast tumor cell nuclei segmentation performances using deep convolutional neural networks.
Andrew Lagree, Majidreza Mohebpour, +8 authors, William T Tran.
Sci Rep, 2021 Apr 15; 11(1). PMID: 33850222    Free PMC article.
Histopathological Classification of Canine Cutaneous Round Cell Tumors Using Deep Learning: A Multi-Center Study.
Massimo Salvi, Filippo Molinari, +7 authors, Luca Aresu.
Front Vet Sci, 2021 Apr 20; 8. PMID: 33869320    Free PMC article.