Journal Article
. 2020 Jun; 11320:.
doi: 10.1117/12.2548609.

Hyperspectral imaging and deep learning for the detection of breast cancer cells in digitized histological images

Samuel Ortega 1 Martin Halicek 1 Himar Fabelo 2 Raul Guerra 2 Carlos Lopez 3 Marylene Lejaune 3 Fred Godtliebsen 4 Gustavo M Callico 2 Baowei Fei 1 
  • PMID: 32528219
  •     15 References


In recent years, hyperspectral imaging (HSI) has been shown as a promising imaging modality to assist pathologists in the diagnosis of histological samples. In this work, we present the use of HSI for discriminating between normal and tumor breast cancer cells. Our customized HSI system includes a hyperspectral (HS) push-broom camera, which is attached to a standard microscope, and home-made software system for the control of image acquisition. Our HS microscopic system works in the visible and near-infrared (VNIR) spectral range (400 - 1000 nm). Using this system, 112 HS images were captured from histologic samples of human patients using 20× magnification. Cell-level annotations were made by an expert pathologist in digitized slides and were then registered with the HS images. A deep learning neural network was developed for the HS image classification, which consists of nine 2D convolutional layers. Different experiments were designed to split the data into training, validation and testing sets. In all experiments, the training and the testing set correspond to independent patients. The results show an area under the curve (AUCs) of more than 0.89 for all the experiments. The combination of HSI and deep learning techniques can provide a useful tool to aid pathologists in the automatic detection of cancer cells on digitized pathologic images.

Keywords: Hyperspectral; deep learning; histological; microscopy.

Detecting brain tumor in pathological slides using hyperspectral imaging.
Samuel Ortega, Himar Fabelo, +3 authors, Roberto Sarmiento.
Biomed Opt Express, 2018 Mar 20; 9(2). PMID: 29552415    Free PMC article.
Mitosis detection in breast cancer histological images An ICPR 2012 contest.
Ludovic Roux, Daniel Racoceanu, +7 authors, Metin N Gurcan.
J Pathol Inform, 2013 Jul 17; 4. PMID: 23858383    Free PMC article.
Image analysis and machine learning in digital pathology: Challenges and opportunities.
Anant Madabhushi, George Lee.
Med Image Anal, 2016 Jul 18; 33. PMID: 27423409    Free PMC article.
Highly Cited. Review.
Anatomical pathology is at a crossroads.
Thomas James Flotte, Debra Ann Bell.
Pathology, 2018 Apr 19; 50(4). PMID: 29665965
Multispectral band selection and spatial characterization: Application to mitosis detection in breast cancer histopathology.
H Irshad, A Gouaillard, L Roux, D Racoceanu.
Comput Med Imaging Graph, 2014 May 17; 38(5). PMID: 24831181
Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer.
Babak Ehteshami Bejnordi, Mitko Veta, +67 authors, Rui Venâncio.
JAMA, 2017 Dec 14; 318(22). PMID: 29234806    Free PMC article.
Highly Cited.
Toward automatic mitotic cell detection and segmentation in multispectral histopathological images.
Cheng Lu, Mrinal Mandal.
IEEE J Biomed Health Inform, 2014 Mar 13; 18(2). PMID: 24608059
Medical hyperspectral imaging: a review.
Guolan Lu, Baowei Fei.
J Biomed Opt, 2014 Jan 21; 19(1). PMID: 24441941    Free PMC article.
Highly Cited. Review.
Quantitative analysis of liver tumors at different stages using microscopic hyperspectral imaging technology.
Jiansheng Wang, Qingli Li.
J Biomed Opt, 2018 Oct 03; 23(10). PMID: 30277033
Utility of multispectral imaging for nuclear classification of routine clinical histopathology imagery.
Laura E Boucheron, Zhiqiang Bi, +2 authors, David L Rimm.
BMC Cell Biol, 2007 Aug 23; 8 Suppl 1. PMID: 17634098    Free PMC article.
Hyperspectral Imaging and K-Means Classification for Histologic Evaluation of Ductal Carcinoma In Situ.
Yasser Khouj, Jeremy Dawson, James Coad, Linda Vona-Davis.
Front Oncol, 2018 Feb 23; 8. PMID: 29468139    Free PMC article.
Melanoma and Melanocyte Identification from Hyperspectral Pathology Images Using Object-Based Multiscale Analysis.
Qian Wang, Qingli Li, +3 authors, Yiting Wang.
Appl Spectrosc, 2018 Jun 12; 72(10). PMID: 29888955
Direct Cellularity Estimation on Breast Cancer Histopathology Images Using Transfer Learning.
Ziang Pei, Shuangliang Cao, Lijun Lu, Wufan Chen.
Comput Math Methods Med, 2019 Jul 10; 2019. PMID: 31281408    Free PMC article.
Classification of mitotic figures with convolutional neural networks and seeded blob features.
Christopher D Malon, Eric Cosatto.
J Pathol Inform, 2013 Jul 17; 4. PMID: 23858384    Free PMC article.
Digital pathology: semper ad meliora.
Simone L Van Es.
Pathology, 2018 Dec 14; 51(1). PMID: 30522785