Journal Article
. 2013 Apr; 33(5):702-14.
doi: 10.1177/0272989X13481110.

Comparing Bayesian and frequentist approaches for multiple outcome mixed treatment comparisons

Hwanhee Hong 1 Bradley P Carlin 1 Tatyana A Shamliyan 2 Jean F Wyman 2 Rema Ramakrishnan 2 Fran├žois Sainfort 2 Robert L Kane 2 
  • PMID: 23549384
  •     23 citations


Objectives: Bayesian statistical methods are increasingly popular as a tool for meta-analysis of clinical trial data involving both direct and indirect treatment comparisons. However, appropriate selection of prior distributions for unknown model parameters and checking of consistency assumptions required for modeling remain particularly challenging. We compared Bayesian and traditional frequentist statistical methods for mixed treatment comparisons with multiple binary outcomes.

Data: We searched major electronic bibliographic databases, Food and Drug Administration reviews, trial registries, and research grant databases up to December 2011 to find randomized studies published in English that examined drugs for female urgency urinary incontinence (UI) on continence, improvement in UI, and treatment discontinuation due to harm.

Methods: We describe and fit fixed and random effects models in both Bayesian and frequentist statistical frameworks. In a hierarchical model of 8 treatments, we separately analyze 1 safety and 2 efficacy outcomes. We produce Bayesian and frequentist treatment ranks and odds ratios across all drug v placebo comparisons, as well as Bayesian probabilities that each drug is best overall through a weighted scoring rule that trades off efficacy and safety.

Results: In our study, Bayesian and frequentist random effects models generally suggest the same drugs as most attractive, although neither suggests any significant differences between drugs. However, the Bayesian methods more consistently identify one drug (propiverine) as best overall, produce interval estimates that are generally better at capturing all sources of uncertainty in the data, and also permit attractive "rankograms" that visually capture the probability that each drug assumes each possible rank.

Conclusions: Bayesian methods are more flexible and their results more clinically interpretable, but they require more careful development and specialized software.

Keywords: Bayesian meta-analysis; comparative effectiveness; hierarchical models; nephrology; systematic reviews.

A Bayesian mixed-treatment comparison meta-analysis of treatments for alcohol dependence and implications for planning future trials.
Stacia M DeSantis, Huirong Zhu.
Med Decis Making, 2014 Jun 18; 34(7). PMID: 24935915    Free PMC article.
Longitudinal Data Analysis Using Bayesian-frequentist Hybrid Random Effects Model.
Le Chen, Ao Yuan, Aiyi Liu, Guanjie Chen.
J Appl Stat, 2014 Aug 22; 41(9). PMID: 25143663    Free PMC article.
Network meta-analysis using R: a review of currently available automated packages.
Binod Neupane, Danielle Richer, +2 authors, Joseph Beyene.
PLoS One, 2014 Dec 30; 9(12). PMID: 25541687    Free PMC article.
Cardiovascular safety of new oral anticoagulants: re-analysis of 27 randomized trials based on Bayesian network meta-analysis.
Andrea Messori.
Br J Clin Pharmacol, 2015 Jan 24; 80(1). PMID: 25612539    Free PMC article.
A Bayesian missing data framework for generalized multiple outcome mixed treatment comparisons.
Hwanhee Hong, Haitao Chu, Jing Zhang, Bradley P Carlin.
Res Synth Methods, 2015 Nov 05; 7(1). PMID: 26536149    Free PMC article.
Efficacy, tolerability, and safety of aripiprazole once-monthly versus other long-acting injectable antipsychotic therapies in the maintenance treatment of schizophrenia: a mixed treatment comparison of double-blind randomized clinical trials.
Istvan M Majer, Fiona Gaughran, +2 authors, Maarten Treur.
J Mark Access Health Policy, 2015 Jan 01; 3. PMID: 27123183    Free PMC article.
An investigation of the impact of using different methods for network meta-analysis: a protocol for an empirical evaluation.
Amalia Emily Karahalios, Georgia Salanti, +5 authors, Joanne E Mckenzie.
Syst Rev, 2017 Jun 26; 6(1). PMID: 28646922    Free PMC article.
Using structural equation modeling for network meta-analysis.
Yu-Kang Tu, Yun-Chun Wu.
BMC Med Res Methodol, 2017 Jul 16; 17(1). PMID: 28709406    Free PMC article.
Comparison of anti-malarial drugs efficacy in the treatment of uncomplicated malaria in African children and adults using network meta-analysis.
Solange Whegang Youdom, Rachida Tahar, Leonardo K Basco.
Malar J, 2017 Aug 05; 16(1). PMID: 28774303    Free PMC article.
Multivariate and network meta-analysis of multiple outcomes and multiple treatments: rationale, concepts, and examples.
Richard D Riley, Dan Jackson, +4 authors, Ian R White.
BMJ, 2017 Sep 15; 358. PMID: 28903924    Free PMC article.
Systematic reviews and cancer research: a suggested stepwise approach.
George A Kelley, Kristi S Kelley.
BMC Cancer, 2018 Mar 04; 18(1). PMID: 29499652    Free PMC article.
Systematic Review.
Bayesian inference for network meta-regression using multivariate random effects with applications to cholesterol lowering drugs.
Hao Li, Ming-Hui Chen, +4 authors, Andrew M Tershakovec.
Biostatistics, 2018 Jun 19; 20(3). PMID: 29912318    Free PMC article.
Clinical evidence for association of neoadjuvant chemotherapy or chemoradiotherapy with efficacy and safety in patients with resectable esophageal carcinoma (NewEC study).
Hai-Yu Zhou, Shao-Peng Zheng, +13 authors, Yun-Fang Yu.
EClinicalMedicine, 2020 Jul 09; 24. PMID: 32637899    Free PMC article.
Comparison of Poly (ADP-ribose) Polymerase Inhibitors (PARPis) as Maintenance Therapy for Platinum-Sensitive Ovarian Cancer: Systematic Review and Network Meta-Analysis.
Amos Stemmer, Inbal Shafran, Salomon M Stemmer, Daliah Tsoref.
Cancers (Basel), 2020 Oct 22; 12(10). PMID: 33081005    Free PMC article.
Systemic treatments for metastatic cutaneous melanoma.
Sandro Pasquali, Andreas V Hadjinicolaou, +2 authors, Simone Mocellin.
Cochrane Database Syst Rev, 2018 Feb 07; 2. PMID: 29405038    Free PMC article.
Highly Cited. Systematic Review.
Comparative Efficacy and Safety of PD-1/PD-L1 Inhibitors for Patients with Solid Tumors: A Systematic Review and Bayesian Network Meta-analysis.
Qingyuan Huang, Yuzhen Zheng, +3 authors, Haiquan Chen.
J Cancer, 2021 Jan 15; 12(4). PMID: 33442411    Free PMC article.
Comparative efficacy of different ultrasound-guided ablation for the treatment of benign thyroid nodules: Systematic review and network meta-analysis of randomized controlled trials.
Linye He, Wanjun Zhao, +3 authors, Jingqiang Zhu.
PLoS One, 2021 Jan 21; 16(1). PMID: 33471820    Free PMC article.
Systematic Review.
A network meta-analysis for neoadjuvant and adjuvant treatments for resectable squamous cell carcinoma of esophagus.
Yunpeng Zhao, Yongqiang Wang, +3 authors, Xiaogang Zhao.
Sci Rep, 2021 Mar 26; 11(1). PMID: 33762694    Free PMC article.
Bayesian Methods for Meta-Analyses of Binary Outcomes: Implementations, Examples, and Impact of Priors.
Fahad M Al Amer, Christopher G Thompson, Lifeng Lin.
Int J Environ Res Public Health, 2021 Apr 04; 18(7). PMID: 33801771    Free PMC article.
Meta-analysis of rare adverse events in randomized clinical trials: Bayesian and frequentist methods.
Hwanhee Hong, Chenguang Wang, Gary L Rosner.
Clin Trials, 2020 Dec 02; 18(1). PMID: 33258698    Free PMC article.
Risk of recurrence among patients with HR-positive, HER2-negative, early breast cancer receiving adjuvant endocrine therapy: A systematic review and meta-analysis.
Elizabeth M Salvo, Abril Oliva Ramirez, +4 authors, Imtiaz A Samjoo.
Breast, 2021 Mar 08; 57. PMID: 33677313    Free PMC article.
Systematic Review.
A Bayesian dose-response meta-analysis model: A simulations study and application.
Tasnim Hamza, Andrea Cipriani, +3 authors, Georgia Salanti.
Stat Methods Med Res, 2021 Jan 29; 30(5). PMID: 33504274    Free PMC article.
Comparisons of Efficacy and Safety between Triple (Inhaled Corticosteroid/Long-Acting Muscarinic Antagonist/Long-Acting Beta-Agonist) Therapies in Chronic Obstructive Pulmonary Disease: Systematic Review and Bayesian Network Meta-Analysis.
Hyun Woo Lee, Hyung Jun Kim, Eun Jin Jang, Chang-Hoon Lee.
Respiration, 2021 May 11; 100(7). PMID: 33971649    Free PMC article.