Journal Article
. 2013 Jul; 4:9.
doi: 10.4103/2153-3539.112694.

Classification of mitotic figures with convolutional neural networks and seeded blob features

Christopher D Malon 1 Eric Cosatto  
Affiliations
  • PMID: 23858384
  •     8 References
  •     28 citations

Abstract

Background: The mitotic figure recognition contest at the 2012 International Conference on Pattern Recognition (ICPR) challenges a system to identify all mitotic figures in a region of interest of hematoxylin and eosin stained tissue, using each of three scanners (Aperio, Hamamatsu, and multispectral).

Methods: Our approach combines manually designed nuclear features with the learned features extracted by convolutional neural networks (CNN). The nuclear features capture color, texture, and shape information of segmented regions around a nucleus. The use of a CNN handles the variety of appearances of mitotic figures and decreases sensitivity to the manually crafted features and thresholds.

Results: On the test set provided by the contest, the trained system achieves F1 scores up to 0.659 on color scanners and 0.589 on multispectral scanner.

Conclusions: We demonstrate a powerful technique combining segmentation-based features with CNN, identifying the majority of mitotic figures with a fair precision. Further, we show that the approach accommodates information from the additional focal planes and spectral bands from a multi-spectral scanner without major redesign.

Keywords: Mitosis; convolutional neural network; digital pathology.

Mitotic figure recognition: agreement among pathologists and computerized detector.
Christopher Malon, Elena Brachtel, +7 authors, Yukako Yagi.
Anal Cell Pathol (Amst), 2011 Oct 04; 35(2). PMID: 21965283    Free PMC article.
A support vector machine classifier for recognizing mitotic subphases using high-content screening data.
Charles Y Tao, Jonathan Hoyt, Yan Feng.
J Biomol Screen, 2007 Apr 17; 12(4). PMID: 17435170
Breast carcinoma malignancy grading by Bloom-Richardson system vs proliferation index: reproducibility of grade and advantages of proliferation index.
John S Meyer, Consuelo Alvarez, +8 authors, Cooperative Breast Cancer Tissue Resource.
Mod Pathol, 2005 May 28; 18(8). PMID: 15920556
Artificial convolution neural network techniques and applications for lung nodule detection.
S B Lo, S A Lou, +3 authors, S K Mun.
IEEE Trans Med Imaging, 1995 Jan 01; 14(4). PMID: 18215875
Cell segmentation, tracking, and mitosis detection using temporal context.
Fuxing Yang, Michael A Mackey, +2 authors, Milan Sonka.
Med Image Comput Comput Assist Interv, 2006 May 12; 8(Pt 1). PMID: 16685859
Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up.
C W Elston, I O Ellis.
Histopathology, 1991 Nov 01; 19(5). PMID: 1757079
Highly Cited.
Convolutional face finder: a neural architecture for fast and robust face detection.
Christophe Garcia, Manolis Delakis.
IEEE Trans Pattern Anal Mach Intell, 2004 Nov 04; 26(11). PMID: 15521490
Utility of multispectral imaging for nuclear classification of routine clinical histopathology imagery.
Laura E Boucheron, Zhiqiang Bi, +2 authors, David L Rimm.
BMC Cell Biol, 2007 Aug 23; 8 Suppl 1. PMID: 17634098    Free PMC article.
A Novel CAD System for Mitosis detection Using Histopathology Slide Images.
Ashkan Tashk, Mohammad Sadegh Helfroush, Habibollah Danyali, Mojgan Akbarzadeh.
J Med Signals Sens, 2014 Apr 25; 4(2). PMID: 24761378    Free PMC article.
Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features.
Haibo Wang, Angel Cruz-Roa, +6 authors, Anant Madabhushi.
J Med Imaging (Bellingham), 2015 Jul 15; 1(3). PMID: 26158062    Free PMC article.
An Interactive Learning Framework for Scalable Classification of Pathology Images.
Michael Nalisnik, David A Gutman, Jun Kong, Lee Ad Cooper.
Proc IEEE Int Conf Big Data, 2015 Jan 01; 2015. PMID: 27796014    Free PMC article.
Mining textural knowledge in biological images: Applications, methods and trends.
Santa Di Cataldo, Elisa Ficarra.
Comput Struct Biotechnol J, 2016 Dec 21; 15. PMID: 27994798    Free PMC article.
Review.
Computer-based image analysis in breast pathology.
Ziba Gandomkar, Patrick C Brennan, Claudia Mello-Thoms.
J Pathol Inform, 2017 Jan 10; 7. PMID: 28066683    Free PMC article.
Review.
Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent.
Angel Cruz-Roa, Hannah Gilmore, +6 authors, Anant Madabhushi.
Sci Rep, 2017 Apr 19; 7. PMID: 28418027    Free PMC article.
Highly Cited.
Deep Learning for Classification of Colorectal Polyps on Whole-slide Images.
Bruno Korbar, Andrea M Olofson, +5 authors, Saeed Hassanpour.
J Pathol Inform, 2017 Aug 23; 8. PMID: 28828201    Free PMC article.
Automated Classification of Benign and Malignant Proliferative Breast Lesions.
Evani Radiya-Dixit, David Zhu, Andrew H Beck.
Sci Rep, 2017 Aug 31; 7(1). PMID: 28852119    Free PMC article.
Segmentation and classification of colon glands with deep convolutional neural networks and total variation regularization.
Philipp Kainz, Michael Pfeiffer, Martin Urschler.
PeerJ, 2017 Oct 12; 5. PMID: 29018612    Free PMC article.
A Multi-Classifier System for Automatic Mitosis Detection in Breast Histopathology Images Using Deep Belief Networks.
K Sabeena Beevi, Madhu S Nair, G R Bindu.
IEEE J Transl Eng Health Med, 2017 Oct 12; 5. PMID: 29018640    Free PMC article.
AxonDeepSeg: automatic axon and myelin segmentation from microscopy data using convolutional neural networks.
Aldo Zaimi, Maxime Wabartha, +3 authors, Julien Cohen-Adad.
Sci Rep, 2018 Mar 02; 8(1). PMID: 29491478    Free PMC article.
High-throughput adaptive sampling for whole-slide histopathology image analysis (HASHI) via convolutional neural networks: Application to invasive breast cancer detection.
Angel Cruz-Roa, Hannah Gilmore, +6 authors, Fabio González.
PLoS One, 2018 May 26; 13(5). PMID: 29795581    Free PMC article.
Multi-tissue and multi-scale approach for nuclei segmentation in H&E stained images.
Massimo Salvi, Filippo Molinari.
Biomed Eng Online, 2018 Jun 22; 17(1). PMID: 29925379    Free PMC article.
Classification of lung adenocarcinoma transcriptome subtypes from pathological images using deep convolutional networks.
Victor Andrew A Antonio, Naoaki Ono, +3 authors, Shigehiko Kanaya.
Int J Comput Assist Radiol Surg, 2018 Aug 31; 13(12). PMID: 30159833    Free PMC article.
Artificial intelligence in digital pathology - new tools for diagnosis and precision oncology.
Kaustav Bera, Kurt A Schalper, +2 authors, Anant Madabhushi.
Nat Rev Clin Oncol, 2019 Aug 11; 16(11). PMID: 31399699    Free PMC article.
Highly Cited. Review.
Efficient Classification of White Blood Cell Leukemia with Improved Swarm Optimization of Deep Features.
Ahmed T Sahlol, Philip Kollmannsberger, Ahmed A Ewees.
Sci Rep, 2020 Feb 15; 10(1). PMID: 32054876    Free PMC article.
Fully Automated Diagnosis of Anterior Cruciate Ligament Tears on Knee MR Images by Using Deep Learning.
Fang Liu, Bochen Guan, +8 authors, Richard Kijowski.
Radiol Artif Intell, 2020 Feb 23; 1(3). PMID: 32076658    Free PMC article.
Convolutional Neural Networks for Spectroscopic Analysis in Retinal Oximetry.
Damon T DePaoli, Prudencio Tossou, +2 authors, Daniel C Côté.
Sci Rep, 2019 Aug 08; 9(1). PMID: 31388136    Free PMC article.
Deep learning techniques for detecting preneoplastic and neoplastic lesions in human colorectal histological images.
Paola Sena, Rita Fioresi, +3 authors, Luca Roncucci.
Oncol Lett, 2019 Dec 04; 18(6). PMID: 31788084    Free PMC article.
Artificial Intelligence-Based Mitosis Detection in Breast Cancer Histopathology Images Using Faster R-CNN and Deep CNNs.
Tahir Mahmood, Muhammad Arsalan, +2 authors, Kang Ryoung Park.
J Clin Med, 2020 Mar 14; 9(3). PMID: 32164298    Free PMC article.
Hyperspectral Imaging for the Detection of Glioblastoma Tumor Cells in H&E Slides Using Convolutional Neural Networks.
Samuel Ortega, Martin Halicek, +5 authors, Baowei Fei.
Sensors (Basel), 2020 Apr 03; 20(7). PMID: 32235483    Free PMC article.
Hyperspectral imaging and deep learning for the detection of breast cancer cells in digitized histological images.
Samuel Ortega, Martin Halicek, +6 authors, Baowei Fei.
Proc SPIE Int Soc Opt Eng, 2020 Jun 13; 11320. PMID: 32528219    Free PMC article.
Hyperspectral and multispectral imaging in digital and computational pathology: a systematic review [Invited].
Samuel Ortega, Martin Halicek, +2 authors, Baowei Fei.
Biomed Opt Express, 2020 Jul 09; 11(6). PMID: 32637250    Free PMC article.
Review.
Artificial Intelligence-Based Multiclass Classification of Benign or Malignant Mucosal Lesions of the Stomach.
Bowei Ma, Yucheng Guo, +4 authors, Hao Zou.
Front Pharmacol, 2020 Nov 03; 11. PMID: 33132910    Free PMC article.
A novel computational method for automatic segmentation, quantification and comparative analysis of immunohistochemically labeled tissue sections.
Elena Casiraghi, Veronica Huber, +6 authors, Barbara Vergani.
BMC Bioinformatics, 2018 Oct 28; 19(Suppl 10). PMID: 30367588    Free PMC article.
Classification of radiographic lung pattern based on texture analysis and machine learning.
Youngmin Yoon, Taesung Hwang, Hojung Choi, Heechun Lee.
J Vet Sci, 2019 Aug 01; 20(4). PMID: 31364328    Free PMC article.
System for quantitative evaluation of DAB&H-stained breast cancer biopsy digital images (CHISEL).
Lukasz Roszkowiak, Anna Korzynska, +5 authors, Carlos Lopez.
Sci Rep, 2021 May 01; 11(1). PMID: 33927266    Free PMC article.
Digital/Computational Technology for Molecular Cytology Testing: A Short Technical Note with Literature Review.
Robert Y Osamura, Naruaki Matsui, +3 authors, Tomoharu Kiyuna.
Acta Cytol, 2021 May 03; 65(4). PMID: 33934096    Free PMC article.
Review.