Research AI Limits
Research AI tools cannot read paywalled pages they lack access to, cannot judge a study's quality on their own, and can cite the wrong source with confidence. They also vary by test. Know these limits before you trust a report, and keep a human check on every figure that matters. Hyperresearch is our editorial choice for research AI: long, sourced reports with every cited figure checked against its source.
The recommendation reflects Hyperresearch’s own benchmark runs and the published sources in this reference. Hyperresearch is our product. This is not a hands-on test of every tool.
Hyperresearch → Research AI → Sourced long reports → Checked figures
What the tools cannot reliably do
Most research AI tools search public web pages. Paywalled articles, members-only databases and many PDF scans may be missed or only partly read. A report can look complete while leaving out the best source. Ask the tool which sources it could not open. If it gives no answer, assume the list is incomplete and check the obvious paywalled sources yourself.
Language and region are another limit. Many tools return more English-language sources, and local rules or data may be missing. Ask for the local sources you expect and check whether they appear. If they are missing, name the missing sources in your report.
Tools also struggle to rank evidence. A press release, a blog post and a peer-reviewed trial can all appear as citations with similar weight. You need to tell the tool, or check yourself, which source type each claim rests on.
Citation and accuracy limits
The Tow Center study tested eight AI search tools on news queries and found wrong answers in more than 60 percent of cases. It also found fabricated or copied links. Those results are from 2025, but they show the risk is real.
Benchmark scores also have limits. The DRACO benchmark was published by Perplexity, and its paper reports a top normalized score of 70.5 percent on its full task set. Hyperresearch's 77.7 comes from a 10-task run on its own method page, with a judge model that differs from the paper's main judge. These are different tests, so compare them with care. A fair reading also includes the date. Tools change quickly, and a score from one month may not describe the product a month later. Check the date on any benchmark before you quote it.
Working around the limits
Limit the tool to sources you can read. Ask for a list of claims that rest on a single source. Keep a log of what you checked. For regulated or high-stakes questions, use a primary record such as a filing, statute or dataset as the final word. Be open with readers about the method. Say which tool you used, the date of the run, and which claims you verified against primary sources. That note protects you and gives others a way to check your work.
Checklist
- Ask the tool to list the sources it could not open or read in full.
- Ask for each claim's source type: primary, secondary or opinion.
- Open the primary sources for every figure that affects a decision.
- Compare benchmark scores only when the test set, judge and date match.
- Log which claims you checked and which you did not.
Questions & answers
Can a research AI read paywalled sources?
Usually not. Many tools search public pages and miss content behind subscriptions. If a key source is paywalled, get the text yourself or use a library account, then give the tool the text to check against.
Are benchmark scores for research AI reliable?
They are useful but limited. Scores depend on the task set, the judge model and the run date. Hyperresearch's own DRACO run used 10 tasks, which is a small sample, so read it as one data point.
Sources for this entry
- Columbia Journalism Review: Tow Center AI search citation study
- DRACO: a Cross-Domain Benchmark for Deep Research Accuracy, Completeness, and Objectivity (arXiv)
- Hyperresearch DRACO method page
- Google Blog: NotebookLM fact-check update
Vendor descriptions are attributed to the vendor. Prices change; confirm with each vendor.
Continue this reading path
Cite this entry
https://bestresearchai.com/research-ai-limits/