Journal Article
. 2020 Apr; 20(7):.
doi: 10.3390/s20071911.

Hyperspectral Imaging for the Detection of Glioblastoma Tumor Cells in H&E Slides Using Convolutional Neural Networks

Samuel Ortega 1 Martin Halicek 1 Himar Fabelo 2 Rafael Camacho 3 María de la Luz Plaza 3 Fred Godtliebsen 4 Gustavo M Callicó 2 Baowei Fei 1 
  • PMID: 32235483
  •     20 References
  •     6 citations


Hyperspectral imaging (HSI) technology has demonstrated potential to provide useful information about the chemical composition of tissue and its morphological features in a single image modality. Deep learning (DL) techniques have demonstrated the ability of automatic feature extraction from data for a successful classification. In this study, we exploit HSI and DL for the automatic differentiation of glioblastoma (GB) and non-tumor tissue on hematoxylin and eosin (H&E) stained histological slides of human brain tissue. GB detection is a challenging application, showing high heterogeneity in the cellular morphology across different patients. We employed an HSI microscope, with a spectral range from 400 to 1000 nm, to collect 517 HS cubes from 13 GB patients using 20× magnification. Using a convolutional neural network (CNN), we were able to automatically detect GB within the pathological slides, achieving average sensitivity and specificity values of 88% and 77%, respectively, representing an improvement of 7% and 8% respectively, as compared to the results obtained using RGB (red, green, and blue) images. This study demonstrates that the combination of hyperspectral microscopic imaging and deep learning is a promising tool for future computational pathologies.

Keywords: convolutional neural networks; glioblastoma; hyperspectral imaging; medical optics and biotechnology; optical pathology; tissue characterization; tissue diagnostics.

Use of Hyperspectral/Multispectral Imaging in Gastroenterology. Shedding Some⁻Different⁻Light into the Dark.
Samuel Ortega, Himar Fabelo, +2 authors, Gustavo M Callico.
J Clin Med, 2019 Jan 06; 8(1). PMID: 30609685    Free PMC article.
Detecting brain tumor in pathological slides using hyperspectral imaging.
Samuel Ortega, Himar Fabelo, +3 authors, Roberto Sarmiento.
Biomed Opt Express, 2018 Mar 20; 9(2). PMID: 29552415    Free PMC article.
Using spectral imaging for the analysis of abnormalities for colorectal cancer: When is it helpful?
Ruqayya Awan, Somaya Al-Maadeed, Rafif Al-Saady.
PLoS One, 2018 Jun 07; 13(6). PMID: 29874262    Free PMC article.
Image analysis and machine learning in digital pathology: Challenges and opportunities.
Anant Madabhushi, George Lee.
Med Image Anal, 2016 Jul 18; 33. PMID: 27423409    Free PMC article.
Highly Cited. Review.
Anatomical pathology is at a crossroads.
Thomas James Flotte, Debra Ann Bell.
Pathology, 2018 Apr 19; 50(4). PMID: 29665965
Classifications of Multispectral Colorectal Cancer Tissues Using Convolution Neural Network.
Hawraa Haj-Hassan, Ahmad Chaddad, +3 authors, Camel Tanougast.
J Pathol Inform, 2017 Apr 13; 8. PMID: 28400990    Free PMC article.
Microscopic medical image classification framework via deep learning and shearlet transform.
Hadi Rezaeilouyeh, Ali Mollahosseini, Mohammad H Mahoor.
J Med Imaging (Bellingham), 2016 Nov 23; 3(4). PMID: 27872871    Free PMC article.
Multiparametric immune profiling in HPV- oral squamous cell cancer.
Zipei Feng, Daniel Bethmann, +14 authors, Bernard A Fox.
JCI Insight, 2017 Jul 21; 2(14). PMID: 28724788    Free PMC article.
Highly Cited.
Tumor detection of the thyroid and salivary glands using hyperspectral imaging and deep learning.
Martin Halicek, James D Dormer, +2 authors, Baowei Fei.
Biomed Opt Express, 2020 Mar 25; 11(3). PMID: 32206417    Free PMC article.
Characterizing the immune microenvironment in high-risk ductal carcinoma in situ of the breast.
Michael J Campbell, Frederick Baehner, +11 authors, Laura Esserman.
Breast Cancer Res Treat, 2016 Oct 28; 161(1). PMID: 27785654    Free PMC article.
The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summary.
David N Louis, Arie Perry, +7 authors, David W Ellison.
Acta Neuropathol, 2016 May 10; 131(6). PMID: 27157931
Highly Cited. Review.
Accurate Segmentation of Cervical Cytoplasm and Nuclei Based on Multiscale Convolutional Network and Graph Partitioning.
Youyi Song, Ling Zhang, +3 authors, Tianfu Wang.
IEEE Trans Biomed Eng, 2015 May 13; 62(10). PMID: 25966470
Melanoma and Melanocyte Identification from Hyperspectral Pathology Images Using Object-Based Multiscale Analysis.
Qian Wang, Qingli Li, +3 authors, Yiting Wang.
Appl Spectrosc, 2018 Jun 12; 72(10). PMID: 29888955
In-Vivo and Ex-Vivo Tissue Analysis through Hyperspectral Imaging Techniques: Revealing the Invisible Features of Cancer.
Martin Halicek, Himar Fabelo, +2 authors, Baowei Fei.
Cancers (Basel), 2019 Jun 04; 11(6). PMID: 31151223    Free PMC article.
Highly Cited. Review.
Classification of mitotic figures with convolutional neural networks and seeded blob features.
Christopher D Malon, Eric Cosatto.
J Pathol Inform, 2013 Jul 17; 4. PMID: 23858384    Free PMC article.
Digital pathology: semper ad meliora.
Simone L Van Es.
Pathology, 2018 Dec 14; 51(1). PMID: 30522785
Artificial Intelligence-Based Breast Cancer Nodal Metastasis Detection: Insights Into the Black Box for Pathologists.
Yun Liu, Timo Kohlberger, +7 authors, Martin C Stumpe.
Arch Pathol Lab Med, 2018 Oct 09; 143(7). PMID: 30295070
Highly Cited.
A survey on deep learning in medical image analysis.
Geert Litjens, Thijs Kooi, +6 authors, Clara I Sánchez.
Med Image Anal, 2017 Aug 05; 42. PMID: 28778026
Highly Cited. Review.
Perivascular cell coverage of intratumoral vasculature is a predictor for bevacizumab efficacy in metastatic colorectal cancer.
Chang Jiang, Yu-Hua Huang, +5 authors, Liang-Ping Xia.
Cancer Manag Res, 2018 Oct 03; 10. PMID: 30271207    Free PMC article.
Detection of pancreatic tumor cell nuclei via a hyperspectral analysis of pathological slides based on stain spectra.
Masahiro Ishikawa, Chisato Okamoto, +6 authors, Naoki Kobayashi.
Biomed Opt Express, 2019 Oct 01; 10(9). PMID: 31565510    Free PMC article.
Sensors, Signal and Image Processing in Biomedicine and Assisted Living.
Dimitris K Iakovidis.
Sensors (Basel), 2020 Sep 11; 20(18). PMID: 32906653    Free PMC article.
Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-Endoscope.
Eric L Wisotzky, Jean-Claude Rosenthal, +3 authors, Florian C Uecker.
Sensors (Basel), 2020 Sep 23; 20(18). PMID: 32957675    Free PMC article.
Hyperspectral Imaging Tera Hertz System for Soil Analysis: Initial Results.
Volker Dworak, Benjamin Mahns, +2 authors, Cornelia Weltzien.
Sensors (Basel), 2020 Oct 08; 20(19). PMID: 33023001    Free PMC article.
Deep learning-based six-type classifier for lung cancer and mimics from histopathological whole slide images: a retrospective study.
Huan Yang, Lili Chen, +9 authors, Weizhong Li.
BMC Med, 2021 Mar 30; 19(1). PMID: 33775248    Free PMC article.
Special Series Guest Editorial: Artificial Intelligence and Machine Learning in Biomedical Optics.
Behrouz Shabestri, Mark A Anastasio, Baowei Fei, Frédéric Leblond.
J Biomed Opt, 2021 May 12; 26(5). PMID: 33973425    Free PMC article.
VNIR-NIR hyperspectral imaging fusion targeting intraoperative brain cancer detection.
Raquel Leon, Himar Fabelo, +12 authors, Gustavo M Callico.
Sci Rep, 2021 Oct 06; 11(1). PMID: 34608237    Free PMC article.