Skip to main content
Journal cover image

An improved method for bivariate meta-analysis when within-study correlations are unknown.

Publication ,  Journal Article
Hong, C; D Riley, R; Chen, Y
Published in: Res Synth Methods
March 2018

Multivariate meta-analysis, which jointly analyzes multiple and possibly correlated outcomes in a single analysis, is becoming increasingly popular in recent years. An attractive feature of the multivariate meta-analysis is its ability to account for the dependence between multiple estimates from the same study. However, standard inference procedures for multivariate meta-analysis require the knowledge of within-study correlations, which are usually unavailable. This limits standard inference approaches in practice. Riley et al proposed a working model and an overall synthesis correlation parameter to account for the marginal correlation between outcomes, where the only data needed are those required for a separate univariate random-effects meta-analysis. As within-study correlations are not required, the Riley method is applicable to a wide variety of evidence synthesis situations. However, the standard variance estimator of the Riley method is not entirely correct under many important settings. As a consequence, the coverage of a function of pooled estimates may not reach the nominal level even when the number of studies in the multivariate meta-analysis is large. In this paper, we improve the Riley method by proposing a robust variance estimator, which is asymptotically correct even when the model is misspecified (ie, when the likelihood function is incorrect). Simulation studies of a bivariate meta-analysis, in a variety of settings, show a function of pooled estimates has improved performance when using the proposed robust variance estimator. In terms of individual pooled estimates themselves, the standard variance estimator and robust variance estimator give similar results to the original method, with appropriate coverage. The proposed robust variance estimator performs well when the number of studies is relatively large. Therefore, we recommend the use of the robust method for meta-analyses with a relatively large number of studies (eg, m≥50). When the sample size is relatively small, we recommend the use of the robust method under the working independence assumption. We illustrate the proposed method through 2 meta-analyses.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Res Synth Methods

DOI

EISSN

1759-2887

Publication Date

March 2018

Volume

9

Issue

1

Start / End Page

73 / 88

Location

England

Related Subject Headings

  • Stomach Neoplasms
  • Statistics as Topic
  • Sample Size
  • Research Design
  • Neuroblastoma
  • N-Myc Proto-Oncogene Protein
  • Multivariate Analysis
  • Models, Statistical
  • Meta-Analysis as Topic
  • Likelihood Functions
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Hong, C., D Riley, R., & Chen, Y. (2018). An improved method for bivariate meta-analysis when within-study correlations are unknown. Res Synth Methods, 9(1), 73–88. https://doi.org/10.1002/jrsm.1274
Hong, Chuan, Richard D Riley, and Yong Chen. “An improved method for bivariate meta-analysis when within-study correlations are unknown.Res Synth Methods 9, no. 1 (March 2018): 73–88. https://doi.org/10.1002/jrsm.1274.
Hong C, D Riley R, Chen Y. An improved method for bivariate meta-analysis when within-study correlations are unknown. Res Synth Methods. 2018 Mar;9(1):73–88.
Hong, Chuan, et al. “An improved method for bivariate meta-analysis when within-study correlations are unknown.Res Synth Methods, vol. 9, no. 1, Mar. 2018, pp. 73–88. Pubmed, doi:10.1002/jrsm.1274.
Hong C, D Riley R, Chen Y. An improved method for bivariate meta-analysis when within-study correlations are unknown. Res Synth Methods. 2018 Mar;9(1):73–88.
Journal cover image

Published In

Res Synth Methods

DOI

EISSN

1759-2887

Publication Date

March 2018

Volume

9

Issue

1

Start / End Page

73 / 88

Location

England

Related Subject Headings

  • Stomach Neoplasms
  • Statistics as Topic
  • Sample Size
  • Research Design
  • Neuroblastoma
  • N-Myc Proto-Oncogene Protein
  • Multivariate Analysis
  • Models, Statistical
  • Meta-Analysis as Topic
  • Likelihood Functions