Skip to Main Content

Systematic Reviews

A type of literature review that uses a systematic and rigorous approach to identify, select, appraise, and synthesize all available evidence on a particular topic.

Typology of Reviews

There are other types of reviews, and some are often mistaken for systematic reviews. Some may even call themselves 'systematic reviews.' However, understanding the scope of other reviews and methods can help one distinguish between them and a systematic review proper. Here are some common review types:

  • Meta-analysis
    • Technique that statistically combines the results of quantitative studies to provide a more precise effect of the results. May be a component of a systematic review.
  • Literature review
    • Generic term: published materials that provide examination of recent or current literature. Can cover a wide range of subjects at various levels of completeness and comprehensiveness. May include research findings.
  • Scoping review
    • Preliminary assessment of potential size and scope of available research literature. Aims to identify nature and extent of research evidence (usually including ongoing research).
  • Rapid review
    • Assessment of what is already known about a policy or practice issue, by using systematic review methods to search and critically appraise existing research.
  • Umbrella review
    • Specifically refers to reviews compiling evidence from multiple reviews into one accessible and usable document. Focuses on broad condition or problem for which there are competing interventions and highlights reviews that address these interventions and their results.
  • Systematized review
    • Attempts to include elements of the systematic review process while stopping short of a systematic review. Typically conducted as a postgraduate student assignment.

The above definitions are taken from A typology of reviews: an analysis of 14 review types and associated methodologies.The document is listed below. 

Meta-Analysis

Meta-analysis is the use of statistical methods to summarise the results of independent studies. By combining information from all relevant studies, meta-analyses can provide more precise estimates of the effects of health care than those derived from the individual studies included within a review. Meta-analyses also facilitate investigations of the consistency of evidence across studies, and the exploration of differences across studies (Cochrane Handbook, 1.2.2). More information on meta-analyses can be found in Cochrane Handbook, Chapter 9.

meta-analysis goes beyond critique and integration and conducts secondary statistical analyses on the outcomes of similar studies. Systematic reviews may use quantitative methods to synthesize and summarize the results.

An advantage of a meta-analysis is the ability to be completely objective in evaluating research findings. Not all topics, however, have sufficient research evidence to allow a meta-analysis to be conducted. In that case, an integrative review is an appropriate strategy.  

 

Literature Reviews

Literatures reviews focus on the existing literature of a subject. They lack the rigorous systematic methodology of systematic reviews. They rarely conduct exhaustive search strategies and do not publish the search strategy (although there are exceptions due to the general nature of literature reviews.) Literature reviews may examine the literature that is the most commonly cited within a certain time frame. Synthesis according to some criteria is typically employed. Literature reviews can take many forms: theses, dissertations, a component within a research paper, or lab report. Please see the University of North Carolina at Chapel Hill's information on literature reviews here. 

Scoping Review or (Mapping Review)

In general, scoping reviews are commonly used for ‘reconnaissance’ – to clarify working definitions and conceptual boundaries of a topic or field. Scoping reviews are useful for when a body of literature has not yet been comprehensively reviewed, or exhibits a complex or heterogeneous nature not amenable to a more precise systematic review of the evidence. While scoping reviews may be conducted to determine the value and probable scope of a full systematic review, they may also be undertaken as exercises in and of themselves to summarize and disseminate research findings, to identify research gaps, and to make recommendations for future research.

From Peters, MD, Godfrey, CM, Khalil, H, McInerney, P, Parker, D & Soares, CB 2015, 'Guidance for conducting systematic scoping reviews', International Journal of Evidence-Based Healthcare, vol. 13, no. 3, pp. 141-146:

Rapid reviews

Rapid reviews utilize systematic review methodology, but they have a more streamlined process for possible time constraints. Defining the limitations and the drawbacks of implementing a streamlined process (and a process that may not incorporate all the components of a systematic review for transparency and systematization) must be described. To learn more about rapid reviews, check out the link below. 

Umbrella Review

An Umbrella review is a synthesis of existing reviews, only including the highest level of evidence such as systematic reviews and meta-analyes. It specifically refers to a review that compiles evidence from multiple reviews into one accessible and usable document. Umbrella reviews focus on either a broad condition or problem for which there are competing interventions. These reviews can highlight the different interventions and their results.

Methodology paperAromataris, E, Fernandez, R, Godfrey, CM, Holly, C, Khalil, H & Tungpunkom, P 2015, 'Summarizing systematic reviews: Methodological development, conduct and reporting of an umbrella review approach', Int J Evid Based Healthc, vol. 13, no. 3, pp. 132-140.

Systematized reviews

A systematized review attempts to include elements of the systematic review process while stopping short of the systematic review. Systematized reviews are typically conducted as a postgraduate student assignment, in recognition that they are not able to draw upon the resources required for a full systematic review (such as having two reviewers for extensive literature screening).