Skip to main content
It looks like you're using Internet Explorer 11 or older. This website works best with modern browsers such as the latest versions of Chrome, Firefox, Safari, and Edge. If you continue with this browser, you may see unexpected results.

Systematic Review

Resources for conducting a systematic review research.

Managing the Process

Black hand checking boxes from a checklist

Image by Move2clouds

Further reading:

How to write a great research paper using reporting guidelines - A toolkit for writing research from the EQUATOR Network.

Reporting Guidelines

One of the first hurdles to get over when writing up a research plan or reporting the results of your study is finding the appropriate reporting guideline.

  • The EQUATOR wizard will help you choose the right reporting guideline for your work. A few examples for generic study types are listed below. 
  • The EQUATOR search will allow you to browse a library of reporting guidelines, or search for a specific checklist.

 (Click image to navigate to EQUATOR main)

Logo of the Equator network displaying a green ball with its shadow

Logos of Endnote, Zotero, Mendeley and Papers

Image by Riphah International University

Citation Management Tools

Citation management is essential in a systematic review. There are a number of citation management tools available that are compatible with many of the databases and resources you'll use.  Visit the citation management guide to get started. It only takes a few minutes to set up an account with such tools as ZoteroMendeley and Endnote Online. For more advanced features, you may consider purchasing the desktop version of Endnote

Endnote Resources

Below you will find selected resources to assist you with various functions on Endnote.

Zotero Resources

A screenshot on where to find that link in an EBSCO database

 

Downloading large results from EBSCO

In EBSCO databases, find a link called "Email a link to download exported results." This will allow you to download the results in RIS file format and import that RIS file into Zotero.

Tool library sign in a room full of tools

Image by Vancouver Tool Library

Tools

For more tools, check out:

  • Systematic Review Toolbox, a searchable resource to help reviewers find appropriate tools.
  • Harrison, H., Griffin, S. J., Kuhn, I., & Usher-Smith, J. A. (2020). Software tools to support title and abstract screening for systematic reviews in healthcare: An evaluation. BMC Medical Research Methodology, 20. https://doi.org/10.1186/s12874-020-0897-3

FREE_______________________________

Authorship Order

Deduplication

  • Systematic Review Assistant (SRA) offers users a reliable program to remove duplicate records with greater sensitivity and specificity than EndNote. SRA aimed to reduce the amount of time taken to produce systematic reviews by maximizing the efficiency of the various review stages such as optimizing search strategies and screening, finding full text articles, and removing duplicate citations. This application can save researchers and information specialists time and avoid research waste. For more information, visit the OMICTOOLS ' web site and a review article.

Screening

  • Excel is the most basic tool for the management of the screening and data extraction stages of the systematic review process. Customized workbooks and spreadsheets can be designed for the review process, and lists of references can be exported from citation managers into Excel format for screening.
  • Evidence synthesis tools for Campbell authors - a list of tools for review, screening, data extraction and analysis. 
  • Distiller is designed for screening and data extraction phases of systematic reviews. Free for student as a single user for one project for 1 semester with no collaboration with other users.
  • PICO Portal - A systematic review platform that leverages artificial intelligence to accelerate research and innovation. Useful for deduplication, screening and collaboration with researchers from different organizations. Watch video tutorials before you get started.
  • Rayyan is a free online tool that can be used for independent screening and coding of studies in a systematic review. Rayyan uses tagging and filtering to code and organize references. Citations can be uploaded from RefMan, EndNote, BibTex, CSV or zip file formats.
  • RevMan is used by Cochrane reviewers to manage the data extraction and analysis process. It is a free tool that is geared toward Cochrane-like reviews.
  • RobotAnalyst is a free online tool "for searching and screening reference collections obtained from literature database queries. It combines search engine functionality with machine learning and text mining technology, including topic modelling and relevancy feedback-based text classification models, to minimise the human workload involved in identifying relevant references."
  • GradePro is used to create summary of findings tables. Free for single-users and non-profits. 
  • Search result formatting - a method for formatting a list of search results in a Word document in which each numbered record contains an openURL link resolver link.
  • Sysrev - a collaborative web-based application that uses machine learning to optimize systematic literature reviews. It helps facilitate screening, collaborative extraction of data from academic articles and abstracts, PDF documents.The free platform supports open access/public projects only. There is a fee to apply privacy settings.
  • CADIMA - Try this open access tool for all stages of your systematic review project! 

Kohl, C., McIntosh, E. J., Unger, S., Haddaway, N. R., Kecke, S., Schiemann, J., & Wilhelm, R. (2018). Online tools supporting the conduct and reporting of systematic reviews and systematic maps: A case study on CADIMA and review of existing toolsEnvironmental Evidence, 7, 8. https://doi.org/10.1186/s13750-018-0115-5

Data Extraction

  • SRDR+ (Systematic Review Data Repository) - a free tool for data extraction, management, and archival during systematic reviews.

Retraction Watch

Writing

  • Academic Phrasebank - Get some inspiration and find some terms and phrases for writing your research paper.
  • Outwrite can be used for writing your manuscript. Automated high-quality spelling, grammar and rephrasing corrections using artificial intelligence (AI) to improve the flow of your writing. Free and subscription plans available starting from $10/month.
  • RevManHAL is an extension to RevMan to automate the writing of systematic reviews (created by the Cochrane Collaboration Schizophrenia Group). 
  • Oxford English Dictionary - Use to locate word variants.

Text mining

Visualization

  • CitNetExplorer is a software tool for visualizing and analyzing citation networks of scientific publications. The tool allows citation networks to be imported directly from the Web of Science database. Citation networks can be explored interactively, for instance by drilling down into a network and by identifying clusters of closely related publications.

References:

FEE BASED_________________________________

Supporting several stages of the review process

  • Covidence - Create and maintain your systematic review throughout screening, selection and extraction phases (starting from $240 per year). 
  • Distiller is designed for screening and data extraction phases of systematic reviews (starting from $15/month for students and $75/month for faculty). 
  • EPPI-Reviewer is a web-based program used to manage your systematic review through all stages of the process from bibliographic management, screening, coding and synthesis (starting from $14/month).
  • CMA (Comprehensive Meta-Analysis) is a software that will compute effect size, treatment effects and create forest plots (starting from $125/year).    
  • SUMARI is (System for the Unified Management, Assessment and Review of Information) is the Joanna Briggs Institute's premier software for the systematic review of evidence. It is designed to facilitate the entire review process, from protocol development, team management, study selection, critical appraisal, data extraction, data synthesis and writing a systematic review report (annual subscription is $130). 

Translation services AND MORE (grant application, protocol development, etc.)

  • Systematic Review Consultants - a team of freelance information specialists, systematic reviewers, health economists, and research analysts providing a wide range of services for all stages of the systematic review. They offer flexible rates and service levels based on your available time, skills, and resources. Contact Dr. Farhad Shokraneh Shokraneh (farhad@SystematicReview.info) for further information. 

 

Quality Assessment Tools

 

Which one to choose? Read the article below for further guidance.

  • Munthe-Kaas, H. M., Glenton, C., Booth, A., Noyes, J., & Lewin, S. (2019). Systematic mapping of existing tools to appraise methodological strengths and limitations of qualitative research: First stage in the development of the CAMELOT tool. BMC Medical Research Methodology, 19(1), 113. https://doi.org/10.1186/s12874-019-0728-6. See Additional file 3 for a list of included critical appraisal tools.

  • Zeng, X., Zhang, Y., Kwong, J. S. W., Zhang, C., Li, S., Sun, F., Niu, Y., & Du, L. (2015). The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: A systematic review. Journal of Evidence-Based Medicine, 8(1), 2–10. https://doi.org/10.1111/jebm.12141

  • Seehra, J., Pandis, N., Koletsi, D., & Fleming, P. S. (2016). Use of quality assessment tools in systematic reviews was varied and inconsistent. Journal of Clinical Epidemiology, 69, 179-184.e5. https://doi.org/10.1016/j.jclinepi.2015.06.023

A sign with multiple directional plates with names if various subject disciplines

Image by http://www.open.edu

 

 

Disciplinary Resources