Skip to Main Content

Systematic reviews

A guide that outlines the process for conducting a systematic review.

Systematic review - Definition

A systematic review is a type of secondary evidence that summarises research that has already been published.

Systematic reviews, according to Wright, et al., are defined as a:

“review of the evidence on a clearly formulated question that uses systematic and explicit methods to identify, select and critically appraise relevant primary research, and to extract and analyze data from the studies that are included in the review.”

What are Systematic Reviews? (3:23 min) by Cochrane (YouTube)

Evidence based practice

When conducting a systematic review it is important to ask a question that can be answered through use of evidence, rather than subjective judgment. In evidence based practice, systematic reviews are considered one of the highest levels of information.

A systematic review may sometimes include a meta-analysis. A meta-analysis is the use of statistical methods to combine data from studies included in a systematic review. Not all systematic reviews include a meta-analysis.

 

Pyramid of evidence based practice. Case reports, case studies, cohort studies, randomized control trials and systematic reviews at the top of the pyramid because they have stronger evidence and fewer articles

Diagram of circles showing all review articles as the outer circle, systematic reviews as a much smaller circle within that and meta-analyses as an even smaller circle within the systemaic reviews circle

 

 

 

 

 

 

 

 

Image: What's In a Name?: the Difference Between a Systematic Review and a Literature Review and Why It Matters (pdf) by Lynn Kysh / CC-BY 4.0

Image: What's In a Name?: the Difference Between a Systematic Review and a Literature Review and Why It Matters (pdf) by Lynn Kysh / CC-BY 4.0

What type of review is right for you?

Types of evidence synthesis

Evidence synthesis refers to any method of identifying, selecting, and combining results from multiple studies. Types of evidence synthesis include: 

Literature (Narrative) Review

A broad term referring to reviews with a wide scope and non-standardized methodology.

  • Search strategies, comprehensiveness, and time range covered vary and do not follow an established protocol.

Rapid Review

Applies systematic review methodology within a time-constrained setting.

  • Employs methodological “shortcuts” (limiting search terms for example) at the risk of introducing bias.
  • Useful for addressing issues needing quick decisions.
  • See Evidence summaries: the evolution of a rapid review approach for methodological guidance.

Scoping Review or Systematic Map

Systematically and transparently collects and categorizes existing evidence on a broad topic or set of research questions.

  • Seeks to identify research gaps and opportunities for evidence synthesis.
  • May critically evaluate existing evidence, but does not attempt to synthesize the results in the way a systematic review would.
  • May take longer than a systematic review.
  • See Scoping studies: towards a methodological framework for methodological guidance.
  • See Environmental Evidence Journal Systematic Maps and Guidance on Systematic Maps—CIFOR.

Umbrella Review

Reviews other systematic reviews on a topic.

  • Often defines a broader question than is typical of a traditional systematic review.
  • Most useful when there are competing interventions to consider.

Systematic Review

A methodical and comprehensive literature synthesis focused on a well-formulated research question.

  • Aims to identify and synthesize all of the scholarly research on a particular topic, including both published and unpublished studies.
  • Conducted in an unbiased, reproducible way to provide evidence for practice and policy-making and to identify gaps in research.
  • May involve a meta-analysis.
  • Much more time-intensive than traditional literature reviews.

Meta-Analysis

A statistical technique for combining the findings from disparate quantitative studies.

  • Uses statistical methods to objectively evaluate, synthesize, and summarize results.
  • May be conducted independently or as part of a systematic review

"What type of review is right for you?" by Cornell University Library is licensed under CC BY 4.0

Further reading

Grant, M. J., & Booth, A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91-108. https://doi.org/10.1111/j.1471-1842.2009.00848.x

Review methodology decision tree

Cornell University Library has developed a decision tree that assists in identifying the types of reviews.

Decision tree: text version

Do you want to gather all the evidence on a particular research topic?

No: Do a Literature (Narrative) Review.

Yes: Do you have 3 or more people to work on the review?

No: More intensive reviews usually require a multi-person team for unbiased article screening.

Yes: Do you have 12–18 months to complete a review?

No: Do a Rapid Review.

Yes: Do you have a broad topic or multiple research questions?

Yes: Do a Scoping Review.

No: Do you want to review other published systematic reviews on your topic?

Yes: Do an Umbrella Review.

No: Do you have a well-formulated research question?

No: Systematic reviews are conducted in an unbiased, reproducible way to provide evidence for practice and policy-making and to identify gaps in research. They require a well-formulated research question.

Yes: Do a Systematic Review.

Will you use statistical methods to objectively evaluate, synthesize, and summarize results?  

No: A meta-analysis will not be needed.

Yes: Do a Meta-Analysis.

Related guides