Outcome selection bias in meta-analysis

Williamson, P. R.; Gamble, C.; Altman, D. G.; Hutton, J. L.
October 2005
Statistical Methods in Medical Research;Oct2005, Vol. 14 Issue 5, p515
Academic Journal
journal article
Publication bias has been previously identified as a threat to the validity of a meta-analysis. Recently, new evidence has documented an additional threat to validity, the selective reporting of trial outcomes within published studies. Several diseases have several possible measures of outcome. Some articles might report only a selection of those outcomes, perhaps those with statistically significant results. In this article, we review this problem while addressing the questions: what is within-study selective reporting? how common is it? why is it done? how can it mislead? how can it be detected?, and finally, what is the solution? We recommend that both publication bias and selective reporting should be routinely investigated in systematic reviews.


Related Articles

  • The proper sequence for correcting correlation coefficients for range restriction and unreliability. STAUFFER, JOSEPH M.; MENDOZA, JORGE L . // Psychometrika;Mar2001, Vol. 66 Issue 1, p63 

    Corrections of correlations for range restriction (i.e., selection) and unreliability are common in psychometric work. The current rule of thumb for determining the order in which to apply these corrections looks to the nature of the reliability estimate (i.e., restricted or unrestricted). While...

  • Sensitivity analysis and application in Meta-analysis. YANG Fei-fei; XIAO Hua-yong; HUANG Ben-ru // Basic Sciences Journal of Textile Universities / Fangzhi Gaoxia;mar2014, Vol. 27 Issue 1, p103 

    According to the background of Meta-analysis and the calculation method of effect size of two categorical data and measurement data,the quantification of Meta-analysis sensitivity is discussed. With the aid of quantitative sensitivity in engineering, the quantitative index of Meta-analysis...

  • Purse-string approximation is superior to primary skin closure following stoma reversal: a systematic review and meta-analysis. McCartan, D.; Burke, J.; Walsh, S.; Coffey, J. // Techniques in Coloproctology;Aug2013, Vol. 17 Issue 4, p345 

    Background: The incidence of surgical site infection (SSI) following stoma reversal can reach 40 %. A recent variation on primary linear closure (PLC) is purse-string approximation (PSA), where the skin is approximated via a purse-string suture but not closed. The optimal technique remains to be...

  • jNMFMA: a joint non-negative matrix factorization meta-analysis of transcriptomics data. Wang, Hong-Qiang; Zheng, Chun-Hou; Zhao, Xing-Ming // Bioinformatics;Feb2015, Vol. 31 Issue 4, p572 

    Motivation: Tremendous amount of omics data being accumulated poses a pressing challenge of meta-analyzing the heterogeneous data for mining new biological knowledge. Most existing methods deal with each gene independently, thus often resulting in high false positive rates in detecting...

  • A Meta-Analysis of Adolescent Psychosocial Smoking Prevention Programs Published Between 1978 and 1997 in the United States. Myunghee Song Hwang; Yeagley, Kathleen Lux; Petosa, Rick // Health Education & Behavior;Dec2004, Vol. 31 Issue 6, p702 

    The article focuses on a meta-analysis study about adolescent psychosocial smoking prevention programs in the U.S. established between 1978 and 1997. The main objective of the researchers was to determine the underlying factors behind the inconsistent results of the programs and make use of the...

  • Numbers needed to treat derived from meta-analysis: a word of caution.  // ACP Journal Club;Jul/Aug2003, Vol. 139 Issue 1, pA-15 

    Comments on an editorial by Doctor Arthur Marx and Doctor Heiner Bucher in the March/April 2003 issue of 'ACP Journal Club' about meta-analysis. Baseline risk of included trials.

  • Appropriate Critical Percentages for the Schmidt and Hunter Meta-Analysis Procedure: Comparative Evaluation of Type I Error Rate and Power. Rasmussen, Jefrey Lee; Loher, Brian T. // Journal of Applied Psychology;Nov88, Vol. 73 Issue 4, p683 

    Recent investigations have shown that the Schmidt and Hunter 75% meta-analysis procedure (S&H-75%) does not have adequate control of the Type I error rate. This lack of control has caused two problems: First, the S&H-75% displays an erratic relationship between the likelihood to detect...

  • Meta-Analysis: What's all the Fuss about? Barrilleaux-Pizzolatto, Allayne; Chhokar, Jagdeep S. // American Business Review;Jun85, Vol. 3 Issue 1, p15 

    Presents a paper which introduces the idea of meta-analysis. Definition of meta-analysis as something which involves the statistical aggregation of individual studies; Details of the process of meta-analysis; Cumulation of information extracted during meta-analysis.

  • Meta-analyzing dependent correlations: An SPSS macro and an R script. Cheung, Shu; Chan, Darius // Behavior Research Methods;Jun2014, Vol. 46 Issue 2, p331 

    The presence of dependent correlation is a common problem in meta-analysis. Cheung and Chan (, ) have shown that samplewise-adjusted procedures perform better than the more commonly adopted simple within-sample mean procedures. However, samplewise-adjusted procedures have rarely been applied in...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics