Skip to Main Content

Systematic Reviews

A type of literature review that uses a systematic and rigorous approach to identify, select, appraise, and synthesize all available evidence on a particular topic.

Searching

A preliminary search is about planning and developing your protocol. It helps the research team understand what the review would/should entail, and the preliminary search will also give an estimate for the time and funding commitment necessary for the investigation. Researchers should assume an exhaustive search will identify about 2-3 times more the number of citations than the preliminary search. 

1. Searching for research trends 

  • You need to see a sample of the research trends within the research area. You don’t know the general scope of the literature until you run a preliminary search. You must also sample these results for information for the background and objectives' section in the protocol.

  • A sampling of the preliminary results also helps you formulate the research question. The research question must be shaped by the pre-existing literature because enough pre-existing literature must exist in the first place to attempt to answer the research question.

2. Look to see if a systematic or scoping review already exists

  • Look to see if someone has already published a systematic/scoping review on your topic. This is again to analyze the research trends, but it is also important to not duplicate work that is already done. 

3. Identifying preliminary MeSH/Subject Headings and keywords/keyphrases

  • You can identify the preliminary MeSH/subject headings, keywords, and key phrases you will need in your exhaustive search strategy. You will have more terms in your final search, but you must identify the basic subject headings and keywords you will need. This is the information that goes in your Search Methods section of your protocol. What goes in this Search Methods section of the protocol are the terms you found during your preliminary searching phase.

4. Getting test articles

  • Select 5-10 test articles from the preliminary search to use to test your future, exhaustive search strategy (i.e. the search to get your citations for your review). These 5-10 test articles should be articles that *should* make it to the end of review based on inclusion/exclusion criteria. 
  • Researchers may have access to journal subscriptions. Being familiar with a journal and finding articles on the team's topic helps to see what research exists. It can help the information specialist find relevant subject headings and keywords for the search strategy. Additionally, the search strategy that is developed should be able to retrieve these articles that are known to directly address the team's research question.

5. Preparatory contacting of experts

  • One of the goals of contacting experts is to identify unregistered studies with unpublished results. It is important to find experts on the research question because they will know what the current climate is on the research topic. Finally, the research team could benefit from this networking for later stages in the review. 

The Exhaustive Search 


This is the search designed by a librarian trained on how to design searches for systematic reviews. One goal of an exhaustive search is to identify all publications and as much grey literature as possible that meet study requirements. At least three databases should be utilized to conduct an exhaustive search. Another goal is to document and report the exhaustive search in such a way that it can be replicated for updates and reproduced by others after publication. See the Texas Medical Center Library's S.R. Database and Resources Libguide.

Study types and other considerations


There are many things to consider when searching for and identifying the literature relevant to the research question. Researchers should be familiar with the study types and their uses for systematic reviews. 

 

Randomized Clinical Trials (RCTs): A study where there is an initial research question, and there are controls for population and the intervention to be studied. 'Randomized' refers to the population participants, where groups are divided into categories that either receive the studied intervention and those who receive the contemporary treatment or placebo. 

Dissertations and unpublished research: The importance of searching for dissertations come into play when there is little research on a new or emerging topic. Additionally, within the published research there may already be problematic bias. Searching within these resources again helps reduce bias within the review. 

Non-English studies: There may also be geographical bias in studies. It is important to search non-English studies to identify all the relevant literature for a topic. 

Hand Search 

Hand searching identifies grey literature like conference proceedings, abstracts for posters, and presented papers not indexed in online databases. Sources to hand search include: subject specific professional association websites; included studies' bibliographies; and topic review bibliographies. Hand searching can be done within research centers such as archives that house information resources out of circulation. It is important to document all sources searched by hand. Information regarding the number of hand searched resources used and where resources are located should be reported within the PRISMA Flow Diagram.

1. Clarification of the data

Some systematic reviews involve a meta-analysis. There may be questions regarding the data produced from the study. Contacting experts to clarify data findings helps develop better accuracy and transparency of the information that will be generated from the systematic review.

2. Images

There are some systematic reviews, which require image analysis. Images that are used within published journals may not be easily synthesized or examined. The quality of the original image published in the journal article could make analysis difficult. Contacting the researchers for the raw data images will help the systematic review team better conduct image synthetization and analysis. 

3. New developments 

A systematic review can take 1-2 years. After the search strategy is developed the search has to be deduplicated. When a search is reran, some new articles may be retrieved. Being in contact with the experts helps the systematic review team know what other research is out there, so that information can be put into the review for the principle of transparency. 

Caveats for searching

It is important to search three to five databases. The databases and how many you choose to search depends on the topic of the systematic review. Ultimately, be sure you consult with a librarian or information specialist before undertaking your searches for studies.