Otto-SR
Compiled by
Updated
See also
IntroductionOtto-SR is an AI-powered platform designed to automate and enhance the process of conducting systematic reviews (SRs). As of August 2025, the tool has not been released publicly. Otto-SR is led by a University of Toronto medical student, Christian Cao; see his medRxiv paper. In 2025, consulting SRs is key in patient care and evidence-based decision-making. Although this had been true in fields such as public health and medicine for a while, it is increasingly so in disciplines in the social and applied sciences. For its part, Otto-SR uses large language models (LLMs), such as OpenAI's GPT-4.1 for screening and o3-mini for data extraction, to perform tasks such as literature screening and data extraction. In the company's published medrXiv paper, the authors state that the tool outperformed human-led SR workflows, achieving 96.7% sensitivity and 97.9% specificity in screening (compared to 81.7% and 98.1% for humans) and 93.1% accuracy in data extraction (compared to 79.7% for humans). The company says that the tool can complete reviews significantly faster than a year-long process typical for human researchers. In its testing, it updated 12 Cochrane reviews in two days, identifying 78% more relevant studies than human screening. The platform emphasizes transparency through explainable AI (XAI), providing source-linked reasoning for decisions, and is research-grade reproducible, having benchmarked publications such as the Annals of Internal Medicine. Developed by a team from Harvard, MIT, the University of Toronto, and former Stripe engineers, Otto-SR is advised by experts like George M. Church and collaborates with Cochrane France. It’s currently in preview, available to early sign-ups at ottosr.com. Bottom line: For health sciences librarians, otto-SR might support their work with health professionals but we just don't know. However, its underlying AI technologies raises concerns for those interested in scientific accuracy, transparency and rigour in performing reviews. Note information provided to you on this page is changing, so check the tool's website for the current information (or discuss with a librarian). I like to elucidate the distinction between searching for sources and searching for answers; LLMs provide the second while hiding the first. Presentation (audio) generated by AIWho is behind Otto-SR?
Librarian criticismNote: Despite speaking to developers, and offering suggestions, I cannot make an assessment of Otto-SR as of this writing (July 29th, 2025) as I do not have access to it. However, they did offer to share a beta version when available. See also
References
Disclaimer
|
