. 2017 Nov; 194:19-35.
doi: 10.1016/j.trsl.2017.10.010.

Digital image analysis in breast pathology-from image processing techniques to artificial intelligence

Stephanie Robertson 1 Hossein Azizpour 2 Kevin Smith 2 Johan Hartman 3 
  • PMID: 29175265
  •     31 citations


Breast cancer is the most common malignant disease in women worldwide. In recent decades, earlier diagnosis and better adjuvant therapy have substantially improved patient outcome. Diagnosis by histopathology has proven to be instrumental to guide breast cancer treatment, but new challenges have emerged as our increasing understanding of cancer over the years has revealed its complex nature. As patient demand for personalized breast cancer therapy grows, we face an urgent need for more precise biomarker assessment and more accurate histopathologic breast cancer diagnosis to make better therapy decisions. The digitization of pathology data has opened the door to faster, more reproducible, and more precise diagnoses through computerized image analysis. Software to assist diagnostic breast pathology through image processing techniques have been around for years. But recent breakthroughs in artificial intelligence (AI) promise to fundamentally change the way we detect and treat breast cancer in the near future. Machine learning, a subfield of AI that applies statistical methods to learn from data, has seen an explosion of interest in recent years because of its ability to recognize patterns in data with less need for human instruction. One technique in particular, known as deep learning, has produced groundbreaking results in many important problems including image classification and speech recognition. In this review, we will cover the use of AI and deep learning in diagnostic breast pathology, and other recent developments in digital image analysis.

Trends in Pathology Graduate Medical Education Programs and Positions, 2001 to 2017.
Aldis H Petriceks, Darren Salmi.
Acad Pathol, 2018 Apr 07; 5. PMID: 29623293    Free PMC article.
Intra-operative spectroscopic assessment of surgical margins during breast conserving surgery.
Dustin W Shipp, Emad A Rakha, +3 authors, Ioan Notingher.
Breast Cancer Res, 2018 Jul 11; 20(1). PMID: 29986750    Free PMC article.
Why imaging data alone is not enough: AI-based integration of imaging, omics, and clinical data.
Andreas Holzinger, Benjamin Haibe-Kains, Igor Jurisica.
Eur J Nucl Med Mol Imaging, 2019 Jun 17; 46(13). PMID: 31203421
Programmed Cell Death Ligand 1 in Breast Cancer: Technical Aspects, Prognostic Implications, and Predictive Value.
Federica Miglietta, Gaia Griguolo, Valentina Guarneri, Maria Vittoria Dieci.
Oncologist, 2019 Aug 25; 24(11). PMID: 31444294    Free PMC article.
Strategies to Reduce the Expert Supervision Required for Deep Learning-Based Segmentation of Histopathological Images.
Yves-Rémi Van Eycke, Adrien Foucart, Christine Decaestecker.
Front Med (Lausanne), 2019 Nov 05; 6. PMID: 31681779    Free PMC article.
Machine Learning Analysis for Quantitative Discrimination of Dried Blood Droplets.
Lama Hamadeh, Samia Imran, +3 authors, David J Fairhurst.
Sci Rep, 2020 Feb 26; 10(1). PMID: 32094359    Free PMC article.
The use of digital pathology and image analysis in clinical trials.
Robert Pell, Karin Oien, +6 authors, UK National Cancer Research Institute (NCRI) Cellular-Molecular Pathology (CM-Path) quality assurance working group.
J Pathol Clin Res, 2019 Feb 16; 5(2). PMID: 30767396    Free PMC article.
Deep Learning Model as a New Trend in Computer-aided Diagnosis of Tumor Pathology for Lung Cancer.
Lei Cong, Wanbing Feng, +2 authors, Wei Xiao.
J Cancer, 2020 Apr 15; 11(12). PMID: 32284758    Free PMC article.
Deep learning in gastric tissue diseases: a systematic review.
Wanderson Gonçalves E Gonçalves, Marcelo Henrique de Paula Dos Santos, +2 authors, Gilderlanio Santana de Araújo.
BMJ Open Gastroenterol, 2020 Apr 28; 7(1). PMID: 32337060    Free PMC article.
Systematic Review.
Impact of pre-analytical variables on deep learning accuracy in histopathology.
Andrew D Jones, John Paul Graff, +8 authors, Hooman H Rashidi.
Histopathology, 2019 Feb 26; 75(1). PMID: 30801768    Free PMC article.
Independent Prognostic Value of Intratumoral Heterogeneity and Immune Response Features by Automated Digital Immunohistochemistry Analysis in Early Hormone Receptor-Positive Breast Carcinoma.
Dovile Zilenaite, Allan Rasmusson, +5 authors, Arvydas Laurinavicius.
Front Oncol, 2020 Jul 03; 10. PMID: 32612954    Free PMC article.
Artificial intelligence in digital breast pathology: Techniques and applications.
Asmaa Ibrahim, Paul Gamble, +4 authors, Emad A Rakha.
Breast, 2020 Jan 15; 49. PMID: 31935669    Free PMC article.
Artificial Intelligence: A Primer for Breast Imaging Radiologists.
Manisha Bahl.
J Breast Imaging, 2020 Aug 18; 2(4). PMID: 32803154    Free PMC article.
Histopathological Classification of Breast Cancer Images Using a Multi-Scale Input and Multi-Feature Network.
Taimoor Shakeel Sheikh, Yonghee Lee, Migyung Cho.
Cancers (Basel), 2020 Jul 30; 12(8). PMID: 32722111    Free PMC article.
Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models.
Zabit Hameed, Sofia Zahia, +2 authors, Ana María Vanegas.
Sensors (Basel), 2020 Aug 09; 20(16). PMID: 32764398    Free PMC article.
Artificial Intelligence and Digital Pathology: Challenges and Opportunities.
Hamid Reza Tizhoosh, Liron Pantanowitz.
J Pathol Inform, 2019 Jan 05; 9. PMID: 30607305    Free PMC article.
Highly Cited. Review.
The Use of Screencasts with Embedded Whole-Slide Scans and Hyperlinks to Teach Anatomic Pathology in a Supervised Digital Environment.
Mary Wong, Joseph Frye, Stacey Kim, Alberto M Marchevsky.
J Pathol Inform, 2019 Jan 05; 9. PMID: 30607306    Free PMC article.
Quantitative Characterization of CD8+ T Cell Clustering and Spatial Heterogeneity in Solid Tumors.
Chang Gong, Robert A Anders, +7 authors, Aleksander S Popel.
Front Oncol, 2019 Jan 23; 8. PMID: 30666298    Free PMC article.
Artificial Intelligence in Clinical Health Care Applications: Viewpoint.
Michael van Hartskamp, Sergio Consoli, +2 authors, Anja van de Stolpe.
Interact J Med Res, 2019 Apr 06; 8(2). PMID: 30950806    Free PMC article.
Physician perspectives on integration of artificial intelligence into diagnostic pathology.
Shihab Sarwar, Anglin Dent, +4 authors, Phedias Diamandis.
NPJ Digit Med, 2019 Jul 16; 2. PMID: 31304375    Free PMC article.
Pathology Trainees' Experience and Attitudes on Use of Digital Whole Slide Images.
Joann G Elmore, Hannah Shucard, +6 authors, Donald L Weaver.
Acad Pathol, 2020 Oct 23; 7. PMID: 33088907    Free PMC article.
Sparse coding of pathology slides compared to transfer learning with deep neural networks.
Will Fischer, Sanketh S Moudgalya, +2 authors, Garrett T Kenyon.
BMC Bioinformatics, 2018 Dec 24; 19(Suppl 18). PMID: 30577746    Free PMC article.
Breast cancer outcome prediction with tumour tissue images and machine learning.
Riku Turkki, Dmitrii Byckhov, +8 authors, Nina Linder.
Breast Cancer Res Treat, 2019 May 24; 177(1). PMID: 31119567    Free PMC article.
Tumour heterogeneity and the evolutionary trade-offs of cancer.
Jean Hausser, Uri Alon.
Nat Rev Cancer, 2020 Feb 26; 20(4). PMID: 32094544
Artificial intelligence and computational pathology.
Miao Cui, David Y Zhang.
Lab Invest, 2021 Jan 18; 101(4). PMID: 33454724    Free PMC article.
The emergence of new trends in clinical laboratory diagnosis.
Mohammed A Alaidarous.
Saudi Med J, 2020 Nov 02; 41(11). PMID: 33130836    Free PMC article.
Artificial intelligence (AI) in medicine, current applications and future role with special emphasis on its potential and promise in pathology: present and future impact, obstacles including costs and acceptance among pathologists, practical and philosophical considerations. A comprehensive review.
Zubair Ahmad, Shabina Rahim, Maha Zubair, Jamshid Abdul-Ghafar.
Diagn Pathol, 2021 Mar 19; 16(1). PMID: 33731170    Free PMC article.
Deep Multi-Magnification Networks for multi-class breast cancer image segmentation.
David Joon Ho, Dig V K Yarlagadda, +6 authors, Thomas J Fuchs.
Comput Med Imaging Graph, 2021 Jan 24; 88. PMID: 33485058    Free PMC article.
Tutorial: guidance for quantitative confocal microscopy.
James Jonkman, Claire M Brown, +2 authors, Alison J North.
Nat Protoc, 2020 Apr 03; 15(5). PMID: 32235926
A review on recent advancements in diagnosis and classification of cancers using artificial intelligence.
Priyanka Ramesh, Ramanathan Karuppasamy, Shanthi Veerappapillai.
Biomedicine (Taipei), 2021 Apr 16; 10(3). PMID: 33854922    Free PMC article.
Deep Learning-Based Prediction Model for Breast Cancer Recurrence Using Adjuvant Breast Cancer Cohort in Tertiary Cancer Center Registry.
Ji-Yeon Kim, Yong Seok Lee, +10 authors, Young-Hyuck Im.
Front Oncol, 2021 May 22; 11. PMID: 34017679    Free PMC article.