Jump to content

PubMed.ai

From UBC Wiki
Source: Hierarchical AI Graphic from Preisler, 2024, pg.6.

Compiled by

Updated

See also

Introduction

PubMed.ai calls itself "...a literature search engine powered by artificial intelligence, but based on scientific research". Whether this claim is true in practice remains open to evaluation, although preliminary test searches suggest that the tool can retrieve relevant biomedical literature in some contexts. In general terms, PubMed.ai uses large language models (LLMs) and AI search technologies to identify recent, relevant research articles in response to user queries. Its stated goal is to “speed up the process of finding literature on PubMed, allowing researchers to spend more time on actual research.” The platform links its outputs to published research papers and supports multilingual queries, although responses are generated in English. The PubMed.aicorpus includes more than 40 million biomedical papers drawn from over 4,000 journals, with data sourced entirely from the PubMed database. The system reportedly synchronizes with PubMed updates in order to remain current as new literature is added.

Bottom line: For health sciences librarians, PubMed.ai may be a supplementary tool for supporting clinicians and researchers. However, the use of generative AI in literature searching raises important concerns related to scientific accuracy, transparency, and methodological rigour—particularly in evidence synthesis and systematic review contexts. As the information provided by the platform continues to evolve, users should consult the tool’s website for the most current details and critically evaluate its outputs. A useful distinction can be made between searching for sources and searching for answers. Large language models are generally designed to provide synthesized answers, often obscuring the underlying retrieval process. By contrast, traditional bibliographic searching emphasizes the transparent identification and evaluation of primary sources.

PubMedAI Search Mechanics

When you enter a phrase (such as “Mitochondrial dysfunction analysis”), we run a custom, fine-tuned LLM which removes words like “what,” “is,” and “are” from the query, then transforms it into MeSH terms and a combination of specific keywords. Based on this, we extract the 20 most recent studies from the PubMed database for analysis, creating a Result Summary and AI Research Co-Pilot (assuming there are more than 20 relevant papers; if fewer than 20, all available papers are analyzed). This allows us to intelligently assess the relevance of research papers to your query.

Caveat

PubMed.ai looks like it might be created by the National Library of Medicine (NLM). It aims to enhance biomedical research by providing evidence-based "insights" into papers, and by connecting answers to the peer-reviewed research, as indexed in PubMed (MEDLINE). It uses large language models (LLMs) and reasoning to transform user queries into MeSH (Medical Subject Headings) "allegedly" for improved literature retrieval, offering features like summarized articles, research overviews, and data visualization. It says it is "powered" by the official PubMed database, and 40 million papers across medicine, biology, public health, and life sciences, updated daily.

Is PubMed.ai an NLM venture?

PubMed.aidoes not seem to be directly developed or maintained by NLM but leverages the PubMed (Medline) database, which is created and maintained by the NLM’s National Center for Biotechnology Information (NCBI). There is no explicit indication in the provided information that NLM endorses or is directly involved with PubMed.ai. A post from me on X on July 21, 2025 questioned whether NLM is behind PubMed.ai, noting a lack of transparency about its creators, and another post confirmed it is not affiliated with NLM. Thus, while PubMed.ai relies on NLM’s PubMed data, it appears to be an independent tool, and users are advised to consult medical librarians for clarity on its legitimacy and functionality.

Librarian criticism

PubMed.ai seems to mimic NLM's PubMed.gov. It's unclear from the "About" pages who is behind PubMed.ai, which is a major problem in terms of transparency. Clearly, HSLs need to test and evaluate its claims, and determine its value beyond trying it out to locate a few papers. It's unclear how many searchers find PubMed.ai and use it thinking they are at the actual PubMed website.

Further, I cannot locate any academic papers that explicitly mention PubMed.aiThe platform appears to be a specialized AI tool for biomedical literature searches, but its absence in peer-reviewed literature suggests it is very new or has not been widely advertised. Researchers interested in PubMed.ai might find relevant insights in studies of similar AI tools, or to test it for themselves.

My advice is to use NLM's PubMed to perform searches in support of knowledge synthesis (KS) - not to avoid PubMed.ai but just to know that it is not bona fide PubMed at NLM.

Presentation

Note: These videos were selected by a librarian for what they reveal about PubMed.ai. The Github page discusses How PubMed.ai Works. Please speak to your librarian about AI tools and their pros and cons/ transparency.

References

  • "..ChatGPT and Google LLM were used to generate pre-session MCQs, simulate clinical cases, provide real-time suggestions during discussion, and support post session reflection. Literature appraisal and journal club preparation were enhanced through AI-assisted research tools including Elicit, PubMed AI, and Research Rabbit, which enabled rapid evidence retrieval, summarisation, and visual mapping of relevant publications. Clerking exercises utilised imaginary, de-identified patient cases based on the FAST-ONC mnemonic. Both human and AIgenerated clerking outputs were reviewed for completeness, specificity, and empathetic tone. AI’s ability to analyse candidate language and detect patient-centred cues was evaluated."

Disclaimer

  • Note: Please use your critical reading skills while reading entries. No warranties, implied or actual, are granted for any health or medical search or AI information obtained while using these pages. Check with your librarian for more contextual, accurate information.