Jump to content

Knowledge synthesis (KS)

From UBC Wiki
Cao et al (2025) paper on using otto-SR in knowledge synthesis

Compiled by

Updated

See also

Introduction

Knowledge synthesis (KS) (also, evidence synthesis or research synthesis) — "...is the process of searching, integrating, analyzing, and consolidating information from multiple sources of scientific information to create a coherent understanding or new insights". KS goes beyond simple summarization by critically evaluating and combining data found in primary research studies often with the goal to address complex problems or inform decision-making. KS is used in a range of scientific fields to inform policy development and evidence-based practice.

The Canadian Institutes of Health Research (CIHR) defines knowledge synthesis as: "...the contextualization and integration of research findings of individual research studies within the larger body of knowledge on the topic. A synthesis must be reproducible and transparent in its methods, using quantitative and/or qualitative methods, and will often take the form of a systematic review. Such an investigation will follow the methods developed by organizations such as Cochrane and the Joanna Briggs Institute."

Machine learning and AI in knowledge synthesis

"... current evidence does not support GenAI use in evidence synthesis without human involvement or oversight. However, for most tasks other than searching, GenAI may have a role in assisting humans with evidence synthesis." — Clark et al (2025).

Artificial intelligence (AI), machine learning and natural language processing are increasingly used in screening and extraction processes in evidence synthesis. Several studies (e.g., Dennstadt, 2024) reveal reduced workloads in screening using AI without affecting the quality of decisions made or sensitivity (number of correctly identified relevant studies divided by total number of relevant studies).

Platforms such as EPPI-Reviewer and DistillerSR incorporate machine learning and text mining tools, which semiautomate screening by prioritizing studies according to relevance. These tools rely on prior development of inclusion criteria and humans manually screening a portion of the documents to train the system. Covidence, for example, uses machine learning to text mine the remaining documents and sort/prioritize these according to relevance. Researchers then focus on screening the most relevant studies until a predetermined completion or stopping point is reached. Machine learning and artificial intelligence can also be combined with other innovative approaches described here.

In 2025, there is a pressing need, in some quarters, to use AI in expert searching. To understand the key issues, see Glanville (2025). The role of AI tools in developing search strategies and identifying evidence for systematic reviews. Webinar. Evidence Synthesis Ireland.

Evidence synthesis (ES)

Evidence synthesis is, along with research synthesis, a synonym for knowledge synthesis. It is a broad term referring to different types of reviews that systematically compile and analyze information from multiple documents such as studies or reports on a similar topic to develop an overall understanding of the results. These reviews are the cornerstone of evidence-based decision-making in health care. Since the 1990s, systematic reviews of interventions, which examine the benefits and harms of health interventions such as medical treatments, have been the predominant form of evidence synthesis. As the field has evolved, clinicians and other decision makers need answers to questions that go beyond the benefits and harms of interventions. This has led to the development of diverse types of evidence syntheses, each tailored to specific health-related questions. A scoping review by Pollock et al (https://osf.io/znjeg/) leading to the Evidence Synthesis Taxonomy Initiative identified over 1,000 different terms used to describe different types of evidence syntheses.

AI Tools and Technologies for KS

Key Aspects of Knowledge Synthesis

  • Purpose: To generate actionable insights, identify patterns, or resolve conflicting information by synthesizing diverse data sources.
  • Methods: Systematic reviews: structured reviews of literature to answer specific research questions.
  • Meta-analysis: Statistical integration of quantitative data from multiple studies.
  • Narrative synthesis (literature reviews): Qualitative integration of findings, often used when data is heterogeneous.
  • Scoping reviews: Broad mapping of existing knowledge to identify gaps or trends.
  • Thematic analysis: Identifying themes across qualitative data.

Key steps in KS

  1. Define the research question or problem.
  2. Locate and collect relevant data or studies (often systematically). (see Expert searching)
  3. Assess the quality and relevance of sources.
  4. Integrate findings through comparison, analysis, or transformation.
  5. Present results in a clear, usable format (e.g., reports, frameworks, or visualizations).

Applications of KS by domain

Healthcare

  • Synthesizing clinical trial data to inform treatment guidelines.

Policy

  • Combining studies to develop evidence-based policies.

Education

  • Integrating pedagogical research to improve teaching methods.

Business

  • Synthesizing market data to guide strategic decisions.

Top 10 methods papers in KS

Librarian guidance

References

Disclaimer

  • Note: Please use your critical reading skills while reading entries. No warranties, implied or actual, are granted for any health or medical search or AI information obtained while using these pages. Check with your librarian for more contextual, accurate information.