Methodological Issues in Systematic Reviews and Meta-Analyses of Observational Studies in Orthopaedic Research

Simunovic, Nicole; Sprague, Sheila; Bhandari, Mohit
May 2009
Journal of Bone & Joint Surgery, American Volume;May2009 Supplement 3, Vol. 91-A, p87
Academic Journal
The validity and applicability of a systematic review depends on the quality of the primary studies that are included and the quality of the methods used to conduct the review itself. Sometimes, observational studies represent the best available evidence. Subject to selection, information, and confounding biases, observational studies are thought to overestimate treatment or exposure effects. A systematic review of observational data must therefore attempt to minimize or prevent these sources of bias by developing explicit but also broad inclusion and exclusion criteria focused on extracting the best available evidence relevant to the review question. Systematic reviews must also make use of an expansive search strategy, with use of multiple resources, to demonstrate the reproducibility of selection and quality-assessment criteria, to perform a quantitative analysis and adjustment for confounding where appropriate, and to explore possible reasons for differences between the results of the primary studies. In this paper, we address the advantages and limitations of systematic reviews and meta-analyses of observational studies and suggest solutions at the design phase of protocol development.


Related Articles

  • Meta-analysis of individual participant data: rationale, conduct, and reporting. Riley, Richard D.; Lambert, Paul C.; Abo-Zaid, Ghada // BMJ: British Medical Journal (Overseas & Retired Doctors Edition;3/6/2010, Vol. 340 Issue 7745, p521 

    The article explores the rationale for the use of individual participant data instead of aggregate data in meta-analyses and outlines how to conduct such a type of study. It discusses the meaning of the term "individual participant data" and explains an individual participant data meta-analysis....

  • Metaanalyses—highest level of empirical evidence? Maier, Wolfgang; Möller, Hans-Jürgen // European Archives of Psychiatry & Clinical Neuroscience;2005, Vol. 255 Issue 6, p369 

    The article argues that metaanalyses cannot provide the highest level of evidence in evidence-based medicine. It explains how different methodological conditions will produce different results. It emphasizes that the results of metaanalyses depend on the method of how to identify the included...

  • Metaanalyse mit Originaldaten: Ein Vorschlag zur Forschungssynthese in der Soziologie. Klein, Thomas; Kopp, Johannes; Rapp, Ingmar // Zeitschrift für Soziologie;jun2013, Vol. 42 Issue 3, p222 

    Meta-analysis is a method of quantitatively summarizing findings from different studies and has mainly been employed in experimentally oriented disciplines. A major problem of meta-analysis in sociology is that studies rarely employ experimental designs with randomization which preclude...

  • Reasons or excuses for avoiding meta-analysis in forest plots. Ioannidis, John P.; Patsopoulos, Nikolaos A.; Rothstein, Hannah R. // BMJ: British Medical Journal (International Edition);6/21/2008, Vol. 336 Issue 7658, p1413 

    The article focuses on systematic reviews and meta-analysis. It explains that reviews often conclude that a meta-analysis would be an inappropriate measure and discusses the advantages and disadvantages of forest plots, a type of quantitative study. The methods of studying clinical heterogeneity...

  • Analyzing Meta-Analysis: Potential Problems, an Unsuccessful Replication, and Evaluation Criteria. Bullock, R. J.; Svyantek, Daniel J. // Journal of Applied Psychology;Feb85, Vol. 70 Issue 1, p108 

    This article identifies some potential problems in meta-analysis research and suggests 14 specific criteria for evaluating the quality of meta-analysis research. The analysis is based on a review and replication of a meta-analysis research study. Our replication of the Terpstra (1981) study on...

  • Implications of Methodological Advances for the Practice of Personnel Selection: How Practitioners Benefit from Meta-analysis. Huy Le; In-Sue Oh; Shaffer, Jonathan; Schmidt, Frank // Academy of Management Perspectives;Aug2007, Vol. 21 Issue 3, p6 

    We discuss how meta-analysis, a method for synthesizing research findings, can meaningfully impact personnel selection practices. Specifically, we review important changes in professional and legal practices from the past 30 years resulting from meta-analytic findings. The implications of using...

  • The Value of Personnel Selection: Reflections on Some Remarkable Claims. Schmitt, Neal // Academy of Management Perspectives;Aug2007, Vol. 21 Issue 3, p19 

    This article discusses the process of personnel selection and its reflection of 100 years of psychological application. Research on individual difference measures looked on how scores were used to determine some job performance measure. This research design produced a correlation between test...

  • Preregistration: when shall we start the real discussion? Vandenbroucke, Jan P. // European Journal of Public Health;Aug2015, Vol. 25 Issue 4, p555 

    The author discusses the issue on the protocols preregistration of the epidemiologic studies. Topics discussed include the advantages and disadvantages of preregistration in the randomized controlled trial (RCT), the systematic review of RCT, and the issue of possible failure and fraud on the...

  • The Methodology of the Systematic Review and Meta-analysis. Patelarou, Evridiki; Brokalaki, Hero // Nosileftiki;Apr2010, Vol. 49 Issue 2, p122 

    Meta-analysis is a term that refers to the statistical analysis of a dataset derived from several individual studies, aimed at summarizing the current knowledge and reaching more definitive conclusions on a research topic. Meta-analysis includes all the steps of a systematic review, but...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics