Journal Article
. 2013 Jul; 4:8.
doi: 10.4103/2153-3539.112693.

Mitosis detection in breast cancer histological images An ICPR 2012 contest

Ludovic Roux 1 Daniel Racoceanu  Nicolas Loménie  Maria Kulikova  Humayun Irshad  Jacques Klossa  Frédérique Capron  Catherine Genestie  Gilles Le Naour  Metin N Gurcan  
Affiliations
  • PMID: 23858383
  •     10 References
  •     43 citations

Abstract

Introduction: In the framework of the Cognitive Microscope (MICO) project, we have set up a contest about mitosis detection in images of H and E stained slides of breast cancer for the conference ICPR 2012. Mitotic count is an important parameter for the prognosis of breast cancer. However, mitosis detection in digital histopathology is a challenging problem that needs a deeper study. Indeed, mitosis detection is difficult because mitosis are small objects with a large variety of shapes, and they can thus be easily confused with some other objects or artefacts present in the image. We added a further dimension to the contest by using two different slide scanners having different resolutions and producing red-green-blue (RGB) images, and a multi-spectral microscope producing images in 10 different spectral bands and 17 layers Z-stack. 17 teams participated in the study and the best team achieved a recall rate of 0.7 and precision of 0.89.

Context: Several studies on automatic tools to process digitized slides have been reported focusing mainly on nuclei or tubule detection. Mitosis detection is a challenging problem that has not yet been addressed well in the literature.

Aims: Mitotic count is an important parameter in breast cancer grading as it gives an evaluation of the aggressiveness of the tumor. However, consistency, reproducibility and agreement on mitotic count for the same slide can vary largely among pathologists. An automatic tool for this task may help for reaching a better consistency, and at the same time reducing the burden of this demanding task for the pathologists.

Subjects And Methods: Professor Frιdιrique Capron team of the pathology department at Pitiι-Salpκtriθre Hospital in Paris, France, has selected a set of five slides of breast cancer. The slides are stained with H and E. They have been scanned by three different equipments: Aperio ScanScope XT slide scanner, Hamamatsu NanoZoomer 2.0-HT slide scanner and 10 bands multispectral microscope. The data set is made up of 50 high power fields (HPF) coming from 5 different slides scanned at ×40 magnification. There are 10 HPFs/slide. The pathologist has annotated all the mitotic cells manually. A HPF has a size of 512 μm × 512 μm (that is an area of 0.262 mm (2) , which is a surface equivalent to that of a microscope field diameter of 0.58 mm. These 50 HPFs contain a total of 326 mitotic cells on images of both scanners, and 322 mitotic cells on the multispectral microscope.

Results: Up to 129 teams have registered to the contest. However, only 17 teams submitted their detection of mitotic cells. The performance of the best team is very promising, with F-measure as high as 0.78. However, the database we provided is by far too small for a good assessment of reliability and robustness of the proposed algorithms.

Conclusions: Mitotic count is an important criterion in the grading of many types of cancers, however, very little research has been made on automatic mitotic cell detection, mainly because of a lack of available data. A main objective of this contest was to propose a database of mitotic cells on digitized breast cancer histopathology slides to initiate works on automated mitotic cell detection. In the future, we would like to extend this database to have much more images from different patients and also for different types of cancers. In addition, mitotic cells should be annotated by several pathologists to reflect the partial agreement among them.

Keywords: Automated mitotic cell detection; H and E stained histological slides; breast cancer.

Histopathological image analysis: a review.
Metin N Gurcan, Laura E Boucheron, +3 authors, B Yener.
IEEE Rev Biomed Eng, 2009 Jan 01; 2. PMID: 20671804    Free PMC article.
Highly Cited. Review.
Breast carcinoma malignancy grading by Bloom-Richardson system vs proliferation index: reproducibility of grade and advantages of proliferation index.
John S Meyer, Consuelo Alvarez, +8 authors, Cooperative Breast Cancer Tissue Resource.
Mod Pathol, 2005 May 28; 18(8). PMID: 15920556
Computer-aided prognosis of neuroblastoma: detection of mitosis and karyorrhexis cells in digitized histological images.
Olcay Sertel, Umit V Catalyurek, Hiroyuki Shimada, Metin N Gurcan.
Annu Int Conf IEEE Eng Med Biol Soc, 2009 Dec 08; 2009. PMID: 19963746
Automated mitosis detection of stem cell populations in phase-contrast microscopy images.
Seungil Huh, Dai Fei Elmer Ker, +2 authors, Takeo Kanade.
IEEE Trans Med Imaging, 2011 Mar 02; 30(3). PMID: 21356609
Harmonic filters for 3D multichannel data: rotation invariant detection of mitoses in colorectal cancer.
Matthias Schlachter, Marco Reisert, +5 authors, Olaf Ronneberger.
IEEE Trans Med Imaging, 2010 Jun 10; 29(8). PMID: 20529733
Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up.
C W Elston, I O Ellis.
Histopathology, 1991 Nov 01; 19(5). PMID: 1757079
Highly Cited.
A semi-Markov model for mitosis segmentation in time-lapse phase contrast microscopy image sequences of stem cell populations.
An-An Liu, Kang Li, Takeo Kanade.
IEEE Trans Med Imaging, 2011 Sep 29; 31(2). PMID: 21954199
Multi-resolution graph-based analysis of histopathological whole slide images: application to mitotic cell extraction and visualization.
Vincent Roullier, Olivier Lézoray, Vinh-Thong Ta, Abderrahim Elmoataz.
Comput Med Imaging Graph, 2011 May 24; 35(7-8). PMID: 21600733
Counting mitoses by image processing in Feulgen stained breast cancer sections: the influence of resolution.
J A Beliën, J P Baak, P J van Diest, A H van Ginkel.
Cytometry, 1997 Jun 01; 28(2). PMID: 9181303
Mitotic figure recognition: agreement among pathologists and computerized detector.
Christopher Malon, Elena Brachtel, +7 authors, Yukako Yagi.
Anal Cell Pathol (Amst), 2011 Oct 04; 35(2). PMID: 21965283    Free PMC article.
Mapping spatial heterogeneity in the tumor microenvironment: a new era for digital pathology.
Andreas Heindl, Sidra Nawaz, Yinyin Yuan.
Lab Invest, 2015 Jan 20; 95(4). PMID: 25599534
Review.
Beyond immune density: critical role of spatial heterogeneity in estrogen receptor-negative breast cancer.
Sidra Nawaz, Andreas Heindl, Konrad Koelble, Yinyin Yuan.
Mod Pathol, 2015 Feb 28; 28(6). PMID: 25720324
Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features.
Haibo Wang, Angel Cruz-Roa, +6 authors, Anant Madabhushi.
J Med Imaging (Bellingham), 2015 Jul 15; 1(3). PMID: 26158062    Free PMC article.
Quantitative analysis of nuclear shape in oral squamous cell carcinoma is useful for predicting the chemotherapeutic response.
Maki Ogura, Yoichiro Yamamoto, +2 authors, Manabu Fukumoto.
Med Mol Morphol, 2015 Oct 07; 49(2). PMID: 26439725
Robust Nucleus/Cell Detection and Segmentation in Digital Pathology and Microscopy Images: A Comprehensive Review.
Fuyong Xing, Lin Yang.
IEEE Rev Biomed Eng, 2016 Jan 08; 9. PMID: 26742143    Free PMC article.
Highly Cited. Review.
Invasive ductal breast carcinoma detector that is robust to image magnification in whole digital slides.
Matthew Balazsi, Paula Blanco, +2 authors, Miguel N Burnier.
J Med Imaging (Bellingham), 2016 May 27; 3(2). PMID: 27226977    Free PMC article.
Adaptive Dimensionality Reduction with Semi-Supervision (AdDReSS): Classifying Multi-Attribute Biomedical Data.
George Lee, David Edmundo Romo Bucheli, Anant Madabhushi.
PLoS One, 2016 Jul 16; 11(7). PMID: 27421116    Free PMC article.
Mitosis Counting in Breast Cancer: Object-Level Interobserver Agreement and Comparison to an Automatic Method.
Mitko Veta, Paul J van Diest, +2 authors, Josien P W Pluim.
PLoS One, 2016 Aug 17; 11(8). PMID: 27529701    Free PMC article.
Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases.
Andrew Janowczyk, Anant Madabhushi.
J Pathol Inform, 2016 Aug 27; 7. PMID: 27563488    Free PMC article.
Highly Cited.
Automated Segmentation of Nuclei in Breast Cancer Histopathology Images.
Maqlin Paramanandam, Michael O'Byrne, +4 authors, Vikram Pakrashi.
PLoS One, 2016 Sep 21; 11(9). PMID: 27649496    Free PMC article.
Image Montaging for Creating a Virtual Pathology Slide: An Innovative and Economical Tool to Obtain a Whole Slide Image.
Spoorthi Ravi Banavar, Prashanthi Chippagiri, +2 authors, Premalatha Bidadi Rajashekaraiah.
Anal Cell Pathol (Amst), 2016 Oct 18; 2016. PMID: 27747147    Free PMC article.
Imagining the future of bioimage analysis.
Erik Meijering, Anne E Carpenter, +2 authors, Jean-Christophe Olivo-Marin.
Nat Biotechnol, 2016 Dec 08; 34(12). PMID: 27926723
A deep learning based strategy for identifying and associating mitotic activity with gene expression derived risk categories in estrogen receptor positive breast cancers.
David Romo-Bucheli, Andrew Janowczyk, +2 authors, Anant Madabhushi.
Cytometry A, 2017 Feb 14; 91(6). PMID: 28192639    Free PMC article.
Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent.
Angel Cruz-Roa, Hannah Gilmore, +6 authors, Anant Madabhushi.
Sci Rep, 2017 Apr 19; 7. PMID: 28418027    Free PMC article.
Highly Cited.
SlideJ: An ImageJ plugin for automated processing of whole slide images.
Vincenzo Della Mea, Giulia L Baroni, David Pilutti, Carla Di Loreto.
PLoS One, 2017 Jul 07; 12(7). PMID: 28683129    Free PMC article.
A Multi-Classifier System for Automatic Mitosis Detection in Breast Histopathology Images Using Deep Belief Networks.
K Sabeena Beevi, Madhu S Nair, G R Bindu.
IEEE J Transl Eng Health Med, 2017 Oct 12; 5. PMID: 29018640    Free PMC article.
Deep learning based tissue analysis predicts outcome in colorectal cancer.
Dmitrii Bychkov, Nina Linder, +7 authors, Johan Lundin.
Sci Rep, 2018 Feb 23; 8(1). PMID: 29467373    Free PMC article.
Highly Cited.
Machine Learning Methods for Histopathological Image Analysis.
Daisuke Komura, Shumpei Ishikawa.
Comput Struct Biotechnol J, 2018 Oct 03; 16. PMID: 30275936    Free PMC article.
Highly Cited. Review.
Computational pathology definitions, best practices, and recommendations for regulatory guidance: a white paper from the Digital Pathology Association.
Esther Abels, Liron Pantanowitz, +9 authors, Cleopatra Kozlowski.
J Pathol, 2019 Jul 30; 249(3). PMID: 31355445    Free PMC article.
Review.
Translational AI and Deep Learning in Diagnostic Pathology.
Ahmed Serag, Adrian Ion-Margineanu, +5 authors, Peter Hamilton.
Front Med (Lausanne), 2019 Oct 22; 6. PMID: 31632973    Free PMC article.
Review.
A large-scale dataset for mitotic figure assessment on whole slide images of canine cutaneous mast cell tumor.
Christof A Bertram, Marc Aubreville, +2 authors, Robert Klopfleisch.
Sci Data, 2019 Nov 23; 6(1). PMID: 31754105    Free PMC article.
Artificial Intelligence-Based Mitosis Detection in Breast Cancer Histopathology Images Using Faster R-CNN and Deep CNNs.
Tahir Mahmood, Muhammad Arsalan, +2 authors, Kang Ryoung Park.
J Clin Med, 2020 Mar 14; 9(3). PMID: 32164298    Free PMC article.
Value of Public Challenges for the Development of Pathology Deep Learning Algorithms.
Douglas Joseph Hartman, Jeroen A W M Van Der Laak, Metin N Gurcan, Liron Pantanowitz.
J Pathol Inform, 2020 Apr 23; 11. PMID: 32318315    Free PMC article.
Fully unsupervised symmetry-based mitosis detection in time-lapse cell microscopy.
Topaz Gilad, Jose Reyes, +2 authors, Tammy Riklin Raviv.
Bioinformatics, 2018 Dec 28; 35(15). PMID: 30590471    Free PMC article.
Hyperspectral imaging and deep learning for the detection of breast cancer cells in digitized histological images.
Samuel Ortega, Martin Halicek, +6 authors, Baowei Fei.
Proc SPIE Int Soc Opt Eng, 2020 Jun 13; 11320. PMID: 32528219    Free PMC article.
Accuracy and efficiency of an artificial intelligence tool when counting breast mitoses.
Liron Pantanowitz, Douglas Hartman, +8 authors, Soo Youn Cho.
Diagn Pathol, 2020 Jul 06; 15(1). PMID: 32622359    Free PMC article.
Hyperspectral and multispectral imaging in digital and computational pathology: a systematic review [Invited].
Samuel Ortega, Martin Halicek, +2 authors, Baowei Fei.
Biomed Opt Express, 2020 Jul 09; 11(6). PMID: 32637250    Free PMC article.
Review.
Predict Ki-67 Positive Cells in H&E-Stained Images Using Deep Learning Independently From IHC-Stained Images.
Yiqing Liu, Xi Li, +8 authors, Yupeng Chen.
Front Mol Biosci, 2020 Sep 10; 7. PMID: 32903653    Free PMC article.
Deep Learning for Semantic Segmentation vs. Classification in Computational Pathology: Application to Mitosis Analysis in Breast Cancer Grading.
Gabriel Jiménez, Daniel Racoceanu.
Front Bioeng Biotechnol, 2019 Jul 10; 7. PMID: 31281813    Free PMC article.
NuSeT: A deep learning tool for reliably separating and analyzing crowded cells.
Linfeng Yang, Rajarshi P Ghosh, +5 authors, Jan T Liphardt.
PLoS Comput Biol, 2020 Sep 15; 16(9). PMID: 32925919    Free PMC article.
A bird's-eye view of deep learning in bioimage analysis.
Erik Meijering.
Comput Struct Biotechnol J, 2020 Oct 01; 18. PMID: 32994890    Free PMC article.
Review.
Deep learning algorithms out-perform veterinary pathologists in detecting the mitotically most active tumor region.
Marc Aubreville, Christof A Bertram, +9 authors, Andreas Maier.
Sci Rep, 2020 Oct 07; 10(1). PMID: 33020510    Free PMC article.
Computer-Aided Histopathological Image Analysis Techniques for Automated Nuclear Atypia Scoring of Breast Cancer: a Review.
Asha Das, Madhu S Nair, S David Peter.
J Digit Imaging, 2020 Jan 29; 33(5). PMID: 31989390    Free PMC article.
Review.
A large-scale optical microscopy image dataset of potato tuber for deep learning based plant cell assessment.
Sumona Biswas, Shovan Barma.
Sci Data, 2020 Oct 29; 7(1). PMID: 33110087    Free PMC article.
Machine learning approaches for pathologic diagnosis.
Daisuke Komura, Shumpei Ishikawa.
Virchows Arch, 2019 Jun 22; 475(2). PMID: 31222375
Review.
A completely annotated whole slide image dataset of canine breast cancer to aid human breast cancer research.
Marc Aubreville, Christof A Bertram, +3 authors, Robert Klopfleisch.
Sci Data, 2020 Nov 29; 7(1). PMID: 33247116    Free PMC article.
Machine learning techniques for mitoses classification.
Shima Nofallah, Sachin Mehta, +6 authors, Linda Shapiro.
Comput Med Imaging Graph, 2020 Dec 11; 87. PMID: 33302246    Free PMC article.
Deep learning powers cancer diagnosis in digital pathology.
Yunjie He, Hong Zhao, Stephen T C Wong.
Comput Med Imaging Graph, 2021 Jan 17; 88. PMID: 33453648    Free PMC article.
Review.
Artificial Intelligence in COVID-19 Ultrastructure.
Mohamed Y Elwazir, Somaya Hosny.
J Microsc Ultrastruct, 2021 Feb 25; 8(4). PMID: 33623737    Free PMC article.
Review.
A multi-phase deep CNN based mitosis detection framework for breast cancer histopathological images.
Anabia Sohail, Asifullah Khan, +2 authors, Saranjam Khan.
Sci Rep, 2021 Mar 20; 11(1). PMID: 33737632    Free PMC article.
A Review of Computer-Aided Expert Systems for Breast Cancer Diagnosis.
Xin Yu Liew, Nazia Hameed, Jeremie Clos.
Cancers (Basel), 2021 Jul 03; 13(11). PMID: 34199444    Free PMC article.
Review.
CAD systems for colorectal cancer from WSI are still not ready for clinical acceptance.
Sara P Oliveira, Pedro C Neto, +7 authors, Jaime S Cardoso.
Sci Rep, 2021 Jul 15; 11(1). PMID: 34257363    Free PMC article.
A Two-Phase Mitosis Detection Approach Based on U-Shaped Network.
Wenjing Lu.
Biomed Res Int, 2021 Oct 16; 2021. PMID: 34651044    Free PMC article.