Journal Article
. 2019 Jul; 21(1):83.
doi: 10.1186/s13058-019-1165-5.

A whole slide image-based machine learning approach to predict ductal carcinoma in situ (DCIS) recurrence risk

Sergey Klimov 1 Islam M Miligy 2 Arkadiusz Gertych 3 Yi Jiang 4 Michael S Toss 2 Padmashree Rida 1 Ian O Ellis 2 Andrew Green 2 Uma Krishnamurti 5 Emad A Rakha 6 Ritu Aneja 7 
  • PMID: 31358020
  •     73 References
  •     8 citations


Background: Breast ductal carcinoma in situ (DCIS) represent approximately 20% of screen-detected breast cancers. The overall risk for DCIS patients treated with breast-conserving surgery stems almost exclusively from local recurrence. Although a mastectomy or adjuvant radiation can reduce recurrence risk, there are significant concerns regarding patient over-/under-treatment. Current clinicopathological markers are insufficient to accurately assess the recurrence risk. To address this issue, we developed a novel machine learning (ML) pipeline to predict risk of ipsilateral recurrence using digitized whole slide images (WSI) and clinicopathologic long-term outcome data from a retrospectively collected cohort of DCIS patients (n = 344) treated with lumpectomy at Nottingham University Hospital, UK.

Methods: The cohort was split case-wise into training (n = 159, 31 with 10-year recurrence) and validation (n = 185, 26 with 10-year recurrence) sets. The sections from primary tumors were stained with H&E, then digitized and analyzed by the pipeline. In the first step, a classifier trained manually by pathologists was applied to digital slides to annotate the areas of stroma, normal/benign ducts, cancer ducts, dense lymphocyte region, and blood vessels. In the second step, a recurrence risk classifier was trained on eight select architectural and spatial organization tissue features from the annotated areas to predict recurrence risk.

Results: The recurrence classifier significantly predicted the 10-year recurrence risk in the training [hazard ratio (HR) = 11.6; 95% confidence interval (CI) 5.3-25.3, accuracy (Acc) = 0.87, sensitivity (Sn) = 0.71, and specificity (Sp) = 0.91] and independent validation [HR = 6.39 (95% CI 3.0-13.8), p < 0.0001;Acc = 0.85, Sn = 0.5, Sp = 0.91] cohorts. Despite the limitations of our cohorts, and in some cases inferior sensitivity performance, our tool showed superior accuracy, specificity, positive predictive value, concordance, and hazard ratios relative to tested clinicopathological variables in predicting recurrences (p < 0.0001). Furthermore, it significantly identified patients that might benefit from additional therapy (validation cohort p = 0.0006).

Conclusions: Our machine learning-based model fills an unmet clinical need for accurately predicting the recurrence risk for lumpectomy-treated DCIS patients.

Keywords: Biomarker; DCIS; Digital image analysis; Machine learning; Prognosis; Recurrence prediction.

Breast fibroblasts modulate epithelial cell proliferation in three-dimensional in vitro co-culture.
Andrea Sadlonova, Zdenek Novak, +6 authors, Andra R Frost.
Breast Cancer Res, 2005 Jan 12; 7(1). PMID: 15642169    Free PMC article.
Proposed prognostic score for breast carcinoma on fine needle aspiration based on nuclear grade, cellular dyscohesion and bare atypical nuclei.
Fang Fan, Asraa L Namiq, Ossama W Tawfik, Patricia A Thomas.
Diagn Cytopathol, 2006 Jul 20; 34(8). PMID: 16850493
Anatomic markers of human premalignancy and risk of breast cancer.
D L Page, W D Dupont.
Cancer, 1990 Sep 15; 66(6 Suppl). PMID: 2205361
Correlation of histopathologic features of ductal carcinoma in situ of the breast with the oncotype DX DCIS score.
Adriana Knopfelmacher, Jana Fox, +2 authors, Susan Fineberg.
Mod Pathol, 2015 Jun 27; 28(9). PMID: 26111975
Classification of breast cancer histology images using Convolutional Neural Networks.
Teresa Araújo, Guilherme Aresta, +5 authors, Aurélio Campilho.
PLoS One, 2017 Jun 02; 12(6). PMID: 28570557    Free PMC article.
Highly Cited.
Quantification of histochemical staining by color deconvolution.
A C Ruifrok, D A Johnston.
Anal Quant Cytol Histol, 2001 Sep 04; 23(4). PMID: 11531144
Highly Cited.
The wonderful colors of the hematoxylin-eosin stain in diagnostic surgical pathology.
John K C Chan.
Int J Surg Pathol, 2014 Jan 11; 22(1). PMID: 24406626
Fine needle aspiration of breast carcinoma: a preliminary cytoprognostic study.
J Mouriquand, D Pasquier.
Acta Cytol, 1980 Mar 01; 24(2). PMID: 6245554
Blood flow, oxygen and nutrient supply, and metabolic microenvironment of human tumors: a review.
P Vaupel, F Kallinowski, P Okunieff.
Cancer Res, 1989 Dec 01; 49(23). PMID: 2684393
Highly Cited. Review.
Convolutional neural networks can accurately distinguish four histologic growth patterns of lung adenocarcinoma in digital slides.
Arkadiusz Gertych, Zaneta Swiderska-Chadaj, +7 authors, Beatrice S Knudsen.
Sci Rep, 2019 Feb 08; 9(1). PMID: 30728398    Free PMC article.
Highly Cited.
Distribution of myofibroblast cells and microvessels around invasive ductal carcinoma of the breast and comparing with the adjacent range of their normal-to-DCIS zones.
Shahriar Dabiri, Amin Talebi, +2 authors, Hossein Safizadeh.
Arch Iran Med, 2013 Jan 31; 16(2). PMID: 23360631
Association of Radiotherapy With Survival in Women Treated for Ductal Carcinoma In Situ With Lumpectomy or Mastectomy.
Vasily Giannakeas, Victoria Sopik, Steven A Narod.
JAMA Netw Open, 2019 Jan 16; 1(4). PMID: 30646103    Free PMC article.
Prognostic and predictive molecular markers in DCIS: a review.
Sharon Nofech-Mozes, Jacqueline Spayne, Eileen Rakovitch, Wedad Hanna.
Adv Anat Pathol, 2005 Oct 08; 12(5). PMID: 16210921
Protocol for the examination of specimens from patients with ductal carcinoma in situ of the breast.
Susan C Lester, Shikha Bose, +11 authors, Members of the Cancer Committee, College of American Pathologists.
Arch Pathol Lab Med, 2009 Jan 07; 133(1). PMID: 19123730
Atypical hyperplastic lesions of the female breast. A long-term follow-up study.
D L Page, W D Dupont, L W Rogers, M S Rados.
Cancer, 1985 Jun 01; 55(11). PMID: 2986821
Highly Cited.
Cytological grading of breast carcinoma--a feasible proposition?
C M Hunt, I O Ellis, +3 authors, R W Blamey.
Cytopathology, 1990 Jan 01; 1(5). PMID: 2101675
Progression from ductal carcinoma in situ to invasive breast cancer: revisited.
Catherine F Cowell, Britta Weigelt, +4 authors, Jorge S Reis-Filho.
Mol Oncol, 2013 Jul 31; 7(5). PMID: 23890733    Free PMC article.
Highly Cited. Review.
Weakly supervised histopathology cancer image segmentation and classification.
Yan Xu, Jun-Yan Zhu, +2 authors, Zhuowen Tu.
Med Image Anal, 2014 Mar 19; 18(3). PMID: 24637156
Stain Normalization using Sparse AutoEncoders (StaNoSA): Application to digital pathology.
Andrew Janowczyk, Ajay Basavanhally, Anant Madabhushi.
Comput Med Imaging Graph, 2016 Jul 05; 57. PMID: 27373749    Free PMC article.
Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features.
Kun-Hsing Yu, Ce Zhang, +4 authors, Michael Snyder.
Nat Commun, 2016 Aug 17; 7. PMID: 27527408    Free PMC article.
Highly Cited.
A multigene expression assay to predict local recurrence risk for ductal carcinoma in situ of the breast.
Lawrence J Solin, Robert Gray, +13 authors, Sunil Badve.
J Natl Cancer Inst, 2013 May 04; 105(10). PMID: 23641039    Free PMC article.
Highly Cited.
Finding the balance between over- and under-treatment of ductal carcinoma in situ (DCIS).
Emma J Groen, Lotte E Elshof, +4 authors, Jelle Wesseling.
Breast, 2016 Sep 28; 31. PMID: 27671693
Tumor cell (dys)cohesion as a prognostic factor in aspirate smears of breast carcinoma.
G H Yu, R S Cajulis, D V De Frias.
Am J Clin Pathol, 1998 Mar 12; 109(3). PMID: 9495204
Cost Effectiveness of the Oncotype DX DCIS Score for Guiding Treatment of Patients With Ductal Carcinoma In Situ.
Ann C Raldow, David Sher, +2 authors, Rinaa S Punglia.
J Clin Oncol, 2016 Sep 14; 34(33). PMID: 27621393
Nuclear inclusions and pseudoinclusions: friends or foes of the surgical pathologist?
Yiu-Tung Ip, Marco Antonio Dias Filho, John K C Chan.
Int J Surg Pathol, 2010 Nov 18; 18(6). PMID: 21081532
The significance of the Van Nuys prognostic index in the management of ductal carcinoma in situ.
Onur Gilleard, Andrew Goodman, +2 authors, Julie Dunn.
World J Surg Oncol, 2008 Jun 20; 6. PMID: 18564426    Free PMC article.
Different types of tumor vessels in breast cancer: morphology and clinical value.
Marina A Senchukova, Natalia V Nikitenko, +2 authors, Alexander A Stadnikov.
Springerplus, 2015 Sep 26; 4. PMID: 26405632    Free PMC article.
OpenSlide: A vendor-neutral software foundation for digital pathology.
Adam Goode, Benjamin Gilbert, +2 authors, Mahadev Satyanarayanan.
J Pathol Inform, 2013 Nov 19; 4. PMID: 24244884    Free PMC article.
Ductal Carcinoma In Situ Biology, Biomarkers, and Diagnosis.
Kylie L Gorringe, Stephen B Fox.
Front Oncol, 2017 Nov 08; 7. PMID: 29109942    Free PMC article.
Histological markers that predict clinical recurrence in ductal carcinoma in situ of the breast: an Australian population-based study.
Elena Provenzano, John L Hopper, +3 authors, Jane E Armes.
Pathology, 2004 Jun 19; 36(3). PMID: 15203725
Clinical significance of tumor-infiltrating lymphocytes in breast cancer.
Sasha E Stanton, Mary L Disis.
J Immunother Cancer, 2016 Oct 26; 4. PMID: 27777769    Free PMC article.
Highly Cited. Review.
Multigene Expression Assay and Benefit of Radiotherapy After Breast Conservation in Ductal Carcinoma in Situ.
Eileen Rakovitch, Sharon Nofech-Mozes, +16 authors, Lawrence Paszat.
J Natl Cancer Inst, 2017 Apr 01; 109(4). PMID: 30053207    Free PMC article.
Rational individualised selection of adjuvant therapy for ductal carcinoma in situ.
Henry M Kuerer.
Lancet Oncol, 2010 Dec 15; 12(1). PMID: 21145285
Angiogenesis and invasive recurrence in ductal carcinoma in situ of the breast.
Nee Beng Teo, B S Shoker, +3 authors, C Holcombe.
Eur J Cancer, 2002 Dec 31; 39(1). PMID: 12504656
A novel machine learning approach reveals latent vascular phenotypes predictive of renal cancer outcome.
Nathan Ing, Fangjin Huang, +9 authors, Beatrice S Knudsen.
Sci Rep, 2017 Oct 19; 7(1). PMID: 29038551    Free PMC article.
Quantitative nuclear morphometry by image analysis for prediction of recurrence of ductal carcinoma in situ of the breast.
A Hoque, S M Lippman, +13 authors, W N Hittelman.
Cancer Epidemiol Biomarkers Prev, 2001 Apr 17; 10(3). PMID: 11303595
Ductal carcinoma in situ of the breast (DCIS) with heterogeneity of nuclear grade: prognostic effects of quantitative nuclear assessment.
Judith-Anne W Chapman, Naomi A Miller, +5 authors, David E Axelrod.
BMC Cancer, 2007 Sep 12; 7. PMID: 17845726    Free PMC article.
Mammary ductal carcinoma in situ: a fresh look at architectural patterns.
Gabriel Scripcaru, Ibrahim M Zardawi.
Int J Surg Oncol, 2012 Apr 11; 2012. PMID: 22489268    Free PMC article.
Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors.
F E Harrell, K L Lee, D B Mark.
Stat Med, 1996 Feb 28; 15(4). PMID: 8668867
Highly Cited. Review.
Risk of recurrence of ductal carcinoma in situ by oncotype Dx technology: some concerns.
Michael D Lagios, Melvin J Silverstein.
Cancer, 2014 Jan 03; 120(7). PMID: 24382657
A new pathological system for grading DCIS with improved prediction of local recurrence: results from the UKCCCR/ANZ DCIS trial.
S E Pinder, C Duggan, +6 authors, UK Coordinating Committee on Cancer Research (UKCCCR) Ductal Carcinoma In Situ (DCIS) Working Party.
Br J Cancer, 2010 Jun 03; 103(1). PMID: 20517310    Free PMC article.
Temporal analysis of intratumoral metabolic heterogeneity characterized by textural features in cervical cancer.
Fei Yang, Maria A Thomas, Farrokh Dehdashti, Perry W Grigsby.
Eur J Nucl Med Mol Imaging, 2013 Jan 24; 40(5). PMID: 23340594    Free PMC article.
Tumor characteristics as predictors of local recurrence after treatment of ductal carcinoma in situ: a meta-analysis.
Shi-Yi Wang, Tatyana Shamliyan, Beth A Virnig, Robert Kane.
Breast Cancer Res Treat, 2011 Feb 18; 127(1). PMID: 21327465
Systematic Review.
National Institutes of Health State-of-the-Science Conference statement: Diagnosis and Management of Ductal Carcinoma In Situ September 22-24, 2009.
Carmen J Allegra, Denise R Aberle, +11 authors, Robin Zon.
J Natl Cancer Inst, 2010 Jan 15; 102(3). PMID: 20071686
Systematic Review.
Cytologic grading of invasive breast carcinoma. Correlation with clinicopathologic variables and predictive value of nodal metastasis.
E Taniguchi, Q Yang, +7 authors, K Kakudo.
Acta Cytol, 2000 Aug 10; 44(4). PMID: 10934952
Biological Markers in DCIS and Risk of Breast Recurrence: A Systematic Review.
Sara A Lari, Henry M Kuerer.
J Cancer, 2011 May 10; 2. PMID: 21552384    Free PMC article.
Heterochromatin instability in cancer: from the Barr body to satellites and the nuclear periphery.
Dawn M Carone, Jeanne B Lawrence.
Semin Cancer Biol, 2012 Jun 23; 23(2). PMID: 22722067    Free PMC article.
Ductal carcinoma in situ and the emergence of diversity during breast cancer evolution.
D Craig Allred, Yun Wu, +7 authors, Dan Medina.
Clin Cancer Res, 2008 Jan 29; 14(2). PMID: 18223211
Highly Cited.
Cytopathological grading, as a predictor of histopathological grade, in ductal carcinoma (NOS) of breast, on air-dried Diff-Quik smears.
M Z Khan, A Haleem, H Al Hassani, H Kfoury.
Diagn Cytopathol, 2003 Sep 25; 29(4). PMID: 14506669
Nomogram for predicting the risk of local recurrence after breast-conserving surgery for ductal carcinoma in situ.
Udo Rudloff, Lindsay M Jacks, +4 authors, Kimberly J Van Zee.
J Clin Oncol, 2010 Jul 14; 28(23). PMID: 20625132
Trends in Treatment Patterns and Outcomes for Ductal Carcinoma In Situ.
Mathias Worni, Igor Akushevich, +4 authors, E Shelley Hwang.
J Natl Cancer Inst, 2015 Oct 02; 107(12). PMID: 26424776    Free PMC article.
Computational pathology: an emerging definition.
David N Louis, Georg K Gerber, +11 authors, Jeffrey A Golden.
Arch Pathol Lab Med, 2014 Aug 30; 138(9). PMID: 25171694
Using cross-validation to evaluate predictive accuracy of survival risk classifiers based on high-dimensional data.
Richard M Simon, Jyothi Subramanian, Ming-Chung Li, Supriya Menezes.
Brief Bioinform, 2011 Feb 18; 12(3). PMID: 21324971    Free PMC article.
Beyond immune density: critical role of spatial heterogeneity in estrogen receptor-negative breast cancer.
Sidra Nawaz, Andreas Heindl, Konrad Koelble, Yinyin Yuan.
Mod Pathol, 2015 Feb 28; 28(6). PMID: 25720324
A critical appraisal of six modern classifications of ductal carcinoma in situ of the breast (DCIS): correlation with grade of associated invasive carcinoma.
A G Douglas-Jones, S K Gupta, +2 authors, R E Mansel.
Histopathology, 1996 Nov 01; 29(5). PMID: 8951484
Ductal carcinoma in situ of the breast: morphological and molecular features implicated in progression.
Dirce M Carraro, Eliana V Elias, Victor P Andrade.
Biosci Rep, 2014 Feb 01; 34(1). PMID: 27919043    Free PMC article.
Machine learning approaches to analyze histological images of tissues from radical prostatectomies.
Arkadiusz Gertych, Nathan Ing, +7 authors, Beatrice S Knudsen.
Comput Med Imaging Graph, 2015 Sep 13; 46 Pt 2. PMID: 26362074    Free PMC article.
Histologic grading of breast cancer.
E R Fisher, C Redmond, B Fisher.
Pathol Annu, 1980 Jan 01; 15(Pt 1). PMID: 7443307
Prognostic value of cytological grading of fine-needle aspirates from breast carcinomas.
I A Robinson, G McKee, +4 authors, M W Kissin.
Lancet, 1994 Apr 16; 343(8903). PMID: 7909010
Interstitial lung disease: A quantitative study using the adaptive multiple feature method.
R Uppaluri, E A Hoffman, +2 authors, G McLennan.
Am J Respir Crit Care Med, 1999 Feb 02; 159(2). PMID: 9927367
Ten-year results comparing mastectomy to excision and radiation therapy for ductal carcinoma in situ of the breast.
M J Silverstein, A Barth, +4 authors, P Gamagami.
Eur J Cancer, 1995 Jan 01; 31A(9). PMID: 7577065
Characterization of chromatin distribution in cell nuclei.
I T Young, P W Verbeek, B H Mayall.
Cytometry, 1986 Sep 01; 7(5). PMID: 3757694
Cancer statistics, 2016.
Rebecca L Siegel, Kimberly D Miller, Ahmedin Jemal.
CA Cancer J Clin, 2016 Jan 09; 66(1). PMID: 26742998
Highly Cited.
Columnar cell lesions and subsequent breast cancer risk: a nested case-control study.
Sarah A Aroner, Laura C Collins, +3 authors, Rulla M Tamimi.
Breast Cancer Res, 2010 Aug 10; 12(4). PMID: 20691043    Free PMC article.
Mortality among women with ductal carcinoma in situ of the breast in the population-based surveillance, epidemiology and end results program.
V L Ernster, J Barclay, +2 authors, R Ballard-Barbash.
Arch Intern Med, 2000 Apr 13; 160(7). PMID: 10761960
Computational pathology: challenges and promises for tissue analysis.
Thomas J Fuchs, Joachim M Buhmann.
Comput Med Imaging Graph, 2011 Apr 13; 35(7-8). PMID: 21481567
Percent change of perfusion skewness and kurtosis: a potential imaging biomarker for early treatment response in patients with newly diagnosed glioblastomas.
Hye Jin Baek, Ho Sung Kim, +2 authors, Young Joong Kim.
Radiology, 2012 Jul 10; 264(3). PMID: 22771885
Effect of quantitative nuclear image features on recurrence of Ductal Carcinoma In Situ (DCIS) of the breast.
David E Axelrod, Naomi A Miller, +5 authors, Judith-Anne W Chapman.
Cancer Inform, 2008 Sep 10; 6. PMID: 18779878    Free PMC article.
Computer-Aided Breast Cancer Diagnosis Based on the Analysis of Cytological Images of Fine Needle Biopsies.
Pawel Filipczuk, Thomas Fevens, Adam Krzyzak, Roman Monczak.
IEEE Trans Med Imaging, 2013 Aug 06; 32(12). PMID: 23912498
Collagen density promotes mammary tumor initiation and progression.
Paolo P Provenzano, David R Inman, +5 authors, Patricia J Keely.
BMC Med, 2008 Apr 30; 6. PMID: 18442412    Free PMC article.
Highly Cited.
Breast Cancer Mortality After a Diagnosis of Ductal Carcinoma In Situ.
Steven A Narod, Javaid Iqbal, +2 authors, Ping Sun.
JAMA Oncol, 2015 Aug 21; 1(7). PMID: 26291673
Highly Cited.
Classification of ductal carcinoma in situ by image analysis of calcifications from digital mammograms.
J Parker, D R Dance, +3 authors, S Humphreys.
Br J Radiol, 1995 Feb 01; 68(806). PMID: 7735745
Journey toward computer-aided diagnosis: role of image texture analysis.
G D Tourassi.
Radiology, 1999 Nov 07; 213(2). PMID: 10551208
Panoptic View of Prognostic Models for Personalized Breast Cancer Management.
Geetanjali Saini, Karuna Mittal, +3 authors, Ritu Aneja.
Cancers (Basel), 2019 Sep 11; 11(9). PMID: 31500225    Free PMC article.
Connecting Histopathology Imaging and Proteomics in Kidney Cancer through Machine Learning.
Francisco Azuaje, Sang-Yoon Kim, Daniel Perez Hernandez, Gunnar Dittmar.
J Clin Med, 2019 Sep 29; 8(10). PMID: 31557788    Free PMC article.
Artificial intelligence in digital breast pathology: Techniques and applications.
Asmaa Ibrahim, Paul Gamble, +4 authors, Emad A Rakha.
Breast, 2020 Jan 15; 49. PMID: 31935669    Free PMC article.
Prognostic value of histopathological DCIS features in a large-scale international interrater reliability study.
Emma J Groen, Jan Hudecek, +29 authors, Grand Challenge PRECISION consortium.
Breast Cancer Res Treat, 2020 Aug 01; 183(3). PMID: 32734520    Free PMC article.
Derivation of a nuclear heterogeneity image index to grade DCIS.
Mary-Kate Hayward, J Louise Jones, +5 authors, Valerie M Weaver.
Comput Struct Biotechnol J, 2020 Dec 29; 18. PMID: 33363702    Free PMC article.
Prognostic Score-Based Stratification Analysis Reveals Universal Benefits of Radiotherapy on Lowering the Risk of Ipsilateral Breast Event for Ductal Carcinoma In Situ Patients with Different Risk Levels.
Libo Yang, Dongli Lu, +5 authors, Hong Bu.
Ann Surg Oncol, 2020 Aug 15; 28(2). PMID: 32794031
Unmasking the immune microecology of ductal carcinoma in situ with deep learning.
Priya Lakshmi Narayanan, Shan E Ahmed Raza, +10 authors, Yinyin Yuan.
NPJ Breast Cancer, 2021 Mar 03; 7(1). PMID: 33649333    Free PMC article.
Predicting Metastasis Risk in Pancreatic Neuroendocrine Tumors Using Deep Learning Image Analysis.
Sergey Klimov, Yue Xue, +7 authors, Ritu Aneja.
Front Oncol, 2021 Mar 16; 10. PMID: 33718106    Free PMC article.