Using AI for literature reviews: what works and what to check

A literature review is one of the slowest parts of a PhD. You search databases, skim hundreds of abstracts, read dozens of papers closely, and then try to build a clear story out of all of it. AI tools now promise to speed up almost every one of these steps. Some of that promise is real. Some of it can quietly damage your work if you are not careful.

This post explains where AI actually helps in a literature review, where it tends to fail, and a simple set of checks you can use so that the final review is still accurate, complete, and your own.

Why researchers are turning to AI for literature reviews

The number of papers published every year keeps growing. In most active fields, it is no longer realistic to read everything that looks relevant. Researchers use AI tools mainly to handle three problems:

  • Volume – too many papers to screen by hand.
  • Language – dense technical writing that takes time to digest, especially outside your core area.
  • Structure – turning a pile of notes into organized themes and a logical outline.

AI can help with all three. But a literature review is not just a summary of papers. It is a judgment about what is known, what is uncertain, and where the gaps are. That judgment is still your job.

What works: where AI adds real value

1. Finding papers you might have missed

AI-assisted search tools (for example Semantic Scholar, Elicit, Consensus, and citation-map tools such as Connected Papers or ResearchRabbit) let you search with a plain-language question instead of exact keywords. Citation-map tools show how papers are connected, which helps you find older foundational work and newer follow-up studies.

This is most useful early on, when you are still learning the vocabulary of a field. A semantic search can surface papers that use different terms for the same idea – something a strict keyword search in a traditional database may miss.

Good practice: Use AI search to widen your net, then confirm coverage with a standard database for your field (Web of Science, Scopus, PubMed, IEEE Xplore, or similar). AI tools do not always index the same set of journals, and coverage of paywalled or very recent papers can be incomplete.

2. First-pass screening of abstracts

When you have hundreds of search results, AI can help sort them into "clearly relevant", "maybe", and "clearly not relevant" based on your inclusion criteria. This saves time on the obvious cases.

Good practice: Write your inclusion and exclusion criteria down first. Give the same criteria to the AI tool. Then manually check a sample of the papers it rejected. If it is excluding papers you would have kept, adjust your criteria or stop relying on it for screening.

3. Summarizing and explaining difficult papers

Language models are good at rewriting dense text in simpler words. If you upload a paper (where your institution's policy and the publisher's terms allow this), you can ask for a short summary of the aim, method, main results, and stated limitations. You can also ask it to explain a method or a term you are not familiar with.

Good practice: Treat the summary as a reading guide, not a replacement for reading. Always go back to the paper for any point you plan to cite.

4. Extracting information into a table

For a systematic or structured review, you often need the same details from every paper: sample size, materials, conditions, methods, key results. AI tools can help pull these into a table.

Good practice: Spot-check every extracted number against the original paper. Extraction errors are common with tables, figures, units, and values that appear in supplementary material.

5. Organizing themes and drafting an outline

Once you have your own notes, AI can help you group them into themes, suggest a logical order for sections, and point out where your notes seem thin. This is often where it is most helpful, because you are giving it your content and asking it to help with structure.

Good practice: Keep the outline tied to your notes and your sources. If the AI suggests a theme you have no papers for, that is a prompt to go search – not a section to fill with general statements.

6. Improving clarity of your own writing

AI can help tighten sentences, fix grammar, and improve flow. This is especially helpful for researchers writing in a second language.

Good practice: Check that edits have not changed the meaning. A "smoother" sentence can easily become a stronger or vaguer claim than the evidence supports.

What to check: common failure points

1. Fabricated or incorrect references

This is the most serious risk. General chat-based language models can produce references that look real – plausible authors, journal names, years, and titles – but do not exist, or that mix details from different papers. This has been widely reported and is a well-known limitation of these tools.

What to check:

  • Never copy a reference from an AI answer into your reference list without finding the original paper.
  • Look up every DOI. Confirm the title, authors, journal, and year match.
  • Import references from the publisher or database into your reference manager (Zotero, Mendeley, EndNote), not from the AI output.

2. Misrepresented findings

Even when a paper is real, an AI summary can get the finding wrong. Typical errors include:

  • Overstating a result (for example, turning "may improve" into "improves").
  • Ignoring conditions or limitations the authors stated.
  • Mixing up the paper's own results with results it cited from others.
  • Reporting a number with the wrong unit or from the wrong sample.

What to check: For every claim you attribute to a paper, find the exact sentence, table, or figure in that paper that supports it. If you cannot find it, do not use the claim.

3. Gaps in coverage

AI tools only see what they have indexed or what you give them. Some may miss very recent papers, conference proceedings, theses, patents, non-English work, or papers behind paywalls. A review built only from AI search results may look complete but leave out important work.

What to check:

  • Run searches in at least one standard database for your field.
  • Check the reference lists of key papers and recent review articles ("backward" searching).
  • Check who has cited those key papers ("forward" searching).
  • Ask your supervisor or senior colleagues which papers they consider essential, and confirm those are in your review.

4. Bias toward highly cited or popular work

Ranking systems often push highly cited papers to the top. That is useful, but it can hide newer work, negative results, or studies from smaller groups. A review that only reflects the most popular papers may miss real disagreements in the field.

What to check: Deliberately look for recent papers and for studies that report contradicting or null results. A good literature review shows where the evidence disagrees, not just where it agrees.

5. Confidentiality and data privacy

Uploading unpublished manuscripts, grant proposals, reviewer material, or internal data into a public AI tool can breach confidentiality agreements or institutional rules. Peer review material in particular is usually confidential.

What to check: Read your institution's and funder's AI policy. Use tools approved by your institution for sensitive material. When in doubt, do not upload it.

6. Journal and university policies on AI use

Many publishers and universities now have policies on AI use in research writing. Common points include that AI tools cannot be listed as authors, and that substantial AI use should be disclosed. Details differ between publishers and institutions, and they change over time.

What to check: Read the current author guidelines for your target journal and your university's thesis regulations before you submit. Keep a short record of which tools you used and for what, so disclosure is easy.

Writing better prompts for literature work

How you ask matters. Vague prompts such as "write a literature review on X" invite general, unsupported text. Specific prompts that work on material you provide give much more reliable results.

Prompts that tend to work well

  • For summaries: "Using only the attached paper, list the research aim, the method, the three main results, and the limitations the authors state. Quote the sentence that supports each point."
  • For comparison: "Here are my notes on five papers. Compare their methods and results in a table. Mark any point where the papers disagree."
  • For structure: "Group these notes into three to five themes. For each theme, list which papers belong to it. Do not add papers that are not in my notes."
  • For gaps: "Based only on these summaries, which questions do these papers leave open? Which conditions or methods have not been tested?"
  • For terms: "Explain this method in simple language for a first-year PhD student, and tell me which parts I should confirm in a textbook or review article."

Prompts to avoid

  • "Give me ten references on X." – This is where fabricated citations most often appear.
  • "Write the literature review section for my thesis." – The output will be generic, may contain unsupported claims, and may not meet your university's rules.
  • "What is the latest research on X?" – A general model may not know about recent work, and may not say so clearly.

A useful habit is to ask the tool to quote or point to the exact source text for every claim. This does not guarantee accuracy, but it makes checking much faster, because you know exactly where to look.

A practical workflow for using AI safely

Here is a simple workflow that uses AI where it helps and keeps you in control of the parts that matter.

Step 1: Define your question and criteria yourself

Write a clear review question and your inclusion/exclusion criteria before using any tool. This keeps the AI working toward your goal, not its own interpretation.

Step 2: Search broadly, then confirm

Use AI search and citation maps to explore. Then run structured searches in standard databases. Record your search terms, databases, and dates so the search can be repeated.

Step 3: Screen with AI, audit by hand

Let AI help sort abstracts, then manually review a sample of its decisions – especially the rejected ones.

Step 4: Read the key papers yourself

Use AI summaries to decide what to read in depth. Then read those papers fully. This is where your understanding of the field is built.

Step 5: Extract and verify

Use AI to draft a data-extraction table, then check every value against the source.

Step 6: Build the structure from your notes

Ask AI to help organize your notes into themes and an outline. Keep every section linked to specific papers.

Step 7: Write in your own voice, then edit

Write the synthesis yourself – the comparison, critique, and identification of gaps. Use AI for language editing afterward, and check that meaning has not changed.

Step 8: Final reference and claim check

Before submission, go through every citation: does the paper exist, are the details correct, and does it actually support the sentence it is attached to?

Quick checklist before you submit

  • Every reference has been checked against the original source (title, authors, journal, year, DOI).
  • Every claim attributed to a paper can be traced to a specific sentence, table, or figure in that paper.
  • Searches were run in at least one standard database, not only in AI tools.
  • Backward and forward citation searches were done for key papers.
  • Recent work and contradicting results have been included where relevant.
  • No confidential or unpublished material was uploaded to unapproved tools.
  • Journal and university AI policies have been checked, and AI use is disclosed where required.
  • The synthesis, critique, and research gaps are written in your own words and reflect your own judgment.

Final thoughts

AI tools can make a literature review faster, especially in searching, screening, summarizing, and organizing. Used well, they give you more time for the part that matters most: thinking critically about the evidence and explaining what it means for your research question.

The key rule is simple: use AI to help you find and organize, but verify everything you cite. Your name is on the review. Its accuracy, fairness, and conclusions are your responsibility – and that is also what makes it valuable.

If you have questions or want to share how you use AI in your own literature reviews, leave a comment below.