Skip Navigation
Skip to contents

J Korean Acad Nurs : Journal of Korean Academy of Nursing


Articles

Page Path
HOME > J Korean Acad Nurs > Ahead-of print articles > Article
Editorial
Methodological rigor and research integrity in evidence synthesis for nursing
Jinkyung Park1,2orcid, Joohyun Chung3orcid

DOI: https://doi.org/10.4040/jkan.26148
Published online: November 16, 2026

1College of Nursing, Chonnam National University, Gwangju, South Korea

2Research Institute of Nursing Science, Chonnam National University, Gwangju, South Korea

3Elaine Marieb College of Nursing, University of Massachusetts Amherst, Amherst, MA, USA

Corresponding author: Joohyun Chung Elaine Marieb College of Nursing, University of Massachusetts Amherst, 651 N Pleasant St, Amherst, MA 01003, USA E-mail: joohyunchung@umass.edu
• Received: September 15, 2026   • Revised: October 1, 2026   • Accepted: October 2, 2026

© 2026 Korean Society of Nursing Science

This is an Open Access article distributed under the terms of the Creative Commons Attribution NoDerivs License (http://creativecommons.org/licenses/by-nd/4.0) If the original work is properly cited and retained without any modification or reproduction, it can be used and re-distributed in any format and medium.

  • 41 Views
  • 0 Download
As evidence-based practice gains prominence, evidence syntheses—including systematic reviews (SRs), meta-analyses (MAs), integrative reviews (IRs), and scoping reviews (ScRs)—have become increasingly prominent in nursing scholarship. Yet an analysis of articles published in the Journal of Korean Academy of Nursing (JKAN) from 2015 to 2024 found that these reviews accounted for only 6.8% of its articles, compared with 36.4% in the International Journal of Nursing Studies and 19.6% in the Journal of Advanced Nursing [1]. For JKAN, this disparity presents a challenge that extends beyond increasing the number of reviews to promoting syntheses that address meaningful, relevant questions.
At the same time, concerns have arisen about the proliferation of redundant, formulaic reviews that prioritize procedural completion over substantive scholarly contribution [2]. The rapid integration of artificial intelligence (AI) and large language models (LLMs) into literature searching, screening, and data extraction has intensified these concerns [3]. In response, Cochrane, the Campbell Collaboration, JBI, and the Collaboration for Environmental Evidence have emphasized human accountability, critical oversight, and transparency in AI-assisted evidence synthesis [3].
This editorial therefore examines three complementary dimensions of research integrity in evidence synthesis: methodological rigor, interpretive integrity, and contribution to knowledge.
Methodological rigor underpins trustworthy evidence synthesis, but it is not synonymous with complete reporting or scholarly contribution. Assessment therefore requires two distinct questions: Was the review conducted appropriately and reported transparently? Are its conclusions warranted and meaningful?
First, methodological trustworthiness concerns the identification, evaluation, and synthesis of evidence, encompassing both the rigor of the review process and the suitability of the synthesis method. Each design—SR (with or without MA), ScR, IR, and umbrella review—serves a distinct scholarly purpose, addresses different types of questions, and requires specific appraisal approaches. The design should therefore be selected to match the review aims (Table 1) [4-7]. To support trustworthiness and transparency, protocols should be registered before the review begins in established international registries, such as PROSPERO or the Open Science Framework, and relevant reporting guidelines, including the 2020 Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement and its extension for scoping reviews, should be followed. However, registration and reporting checklists support transparent reporting but do not by themselves demonstrate methodological rigor.
Second, interpretive integrity concerns whether conclusions remain within the epistemic boundaries of the review design and available evidence. Even a methodologically sound review can overinterpret its findings. Conclusions should thus reflect the intended purpose of the synthesis design (Table 1) and be proportionate to the strength, volume, and certainty of the evidence. A summary table of included studies is not, in itself, evidence synthesis, just as a registration number does not guarantee originality. Interpretive integrity requires conclusions that are justified by the review findings and meaningful within the relevant knowledge context.
ScRs are increasingly common in nursing research and offer considerable value. This growth is not inherently problematic; concerns arise when scoping methodology is used to answer questions that require other forms of inference or when conclusions exceed the interpretive scope of a mapping-oriented design [8,9]. A ScR aims to map the extent, characteristics, concepts, and boundaries of a body of evidence and identify gaps or areas for further inquiry [8]. However, ScRs may be misapplied to narrow research questions for which they are less suitable, partly because a design requiring neither critical appraisal nor statistical synthesis may appear to be a simpler alternative [9]. If a ScR neither formally evaluates the validity of the included evidence nor synthesizes comparative effects, a claim that a technology “should be implemented” in clinical practice exceeds the review’s inferential capacity [9]. Levac et al. [8] described stakeholder consultation as essential to developing a ScR and as the source of its utility and credibility, yet most published ScRs omit it [8,9]. ScRs should therefore seek the views of patients, caregivers, clinical nurses, and policy makers; authors are encouraged to report whether they did so and how these views influenced their conclusions.
The increasing use of AI and LLMs may reduce the substantial manual workload of literature searching, deduplication, screening, extraction, classification, and preliminary summarization. Four major evidence synthesis organizations emphasize that human reviewers retain responsibility for the synthesis and that AI applications involving substantive judgment require appropriate oversight and transparent reporting. Their Responsible AI in Evidence SynthEsis (RAISE) guidance recommends specifying which tasks were delegated to AI, which tools and versions were used, and how the outputs were verified [3]. As review procedures become more amenable to automation, researchers’ scholarly contributions should shift toward work that cannot be reduced to literature processing: formulating meaningful questions, making defensible methodological decisions, interpreting conflicting findings, contextualizing evidence, identifying inappropriate inferences, and taking responsibility for final knowledge claims. Automation should reduce mechanical workload, not replace scholarly reasoning.
Methodological rigor is a prerequisite for evidence synthesis, not its ultimate purpose. Synthesis should move beyond aggregating individual findings to critically interpreting patterns, inconsistencies, theoretical foundations, historical developments, and relevant clinical contexts, generating insight and new understanding rather than information alone. JKAN will continue to welcome evidence syntheses, emphasizing methodologically sound reviews that address meaningful questions and inform evolving clinical practice rather than the number of reviews published. We aim to advance nursing scholarship by promoting evidence syntheses grounded in research integrity and deep scholarly reflection, beyond mere fulfillment of procedural requirements.

Conflicts of Interest

Jinkyung Park serves as deputy editor and Joohyun Chung as editor of the Journal of Korean Academy of Nursing but have no role in the decision to publish this article. Except for that, no other potential conflict of interest relevant to this article was reported.

Acknowledgements

None.

Funding

None.

Data Sharing Statement

Data sharing is not applicable because no new data were created or analyzed for this article.

Disclosure and declaration of AI use

None.

Author Contributions

Conceptualization, Investigation, Methodology, Writing–original draft, Writing–review and editing, and final approval of the manuscript: JP, JC.

Table 1.
Key features of major evidence synthesis designs
Design Primary scholarly purpose Typical question framework Role of critical appraisal Key methodological/reporting guideline
Systematic review (with or without meta-analysis) Verify intervention effectiveness, efficacy, and safety and inform practice guidelines and policies Commonly PICO; narrow and specific Mandatory (risk of bias) PRISMA 2020 [4] and relevant methodological guidance
Scoping review Map the extent, conceptual boundaries, and trends of a body of literature and identify research gaps Commonly PCC; exploratory and iterative Not universally required; determined by the review purpose PRISMA-ScR [5]
Integrative review Understand complex, multifaceted phenomena across empirical and theoretical literature Broad and concept-driven Recommended, with approaches suited to the diverse evidence included Whittemore and Knafl process [6]
Umbrella review Synthesize published systematic reviews and meta-analyses into a higher-order evidence map Broad, PICO-based or related frameworks Appraisal of the included reviews JBI umbrella review guidance [7]

PCC, population, concept, context; PICO, population/patient/problem, intervention, comparison, outcome; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; PRISMA-ScR, Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews.

Figure & Data

REFERENCES

    Citations

    Citations to this article as recorded by  

      • ePub LinkePub Link
      • Cite
        CITE
        export Copy Download
        Close
        Download Citation
        Download a citation file in RIS format that can be imported by all major citation management software, including EndNote, ProCite, RefWorks, and Reference Manager.

        Format:
        • RIS — For EndNote, ProCite, RefWorks, and most other reference management software
        • BibTeX — For JabRef, BibDesk, and other BibTeX-specific software
        Include:
        • Citation for the content below
        Methodological rigor and research integrity in evidence synthesis for nursing
        Close
      • XML DownloadXML Download
      We recommend
      Methodological rigor and research integrity in evidence synthesis for nursing
      Methodological rigor and research integrity in evidence synthesis for nursing
      Design Primary scholarly purpose Typical question framework Role of critical appraisal Key methodological/reporting guideline
      Systematic review (with or without meta-analysis) Verify intervention effectiveness, efficacy, and safety and inform practice guidelines and policies Commonly PICO; narrow and specific Mandatory (risk of bias) PRISMA 2020 [4] and relevant methodological guidance
      Scoping review Map the extent, conceptual boundaries, and trends of a body of literature and identify research gaps Commonly PCC; exploratory and iterative Not universally required; determined by the review purpose PRISMA-ScR [5]
      Integrative review Understand complex, multifaceted phenomena across empirical and theoretical literature Broad and concept-driven Recommended, with approaches suited to the diverse evidence included Whittemore and Knafl process [6]
      Umbrella review Synthesize published systematic reviews and meta-analyses into a higher-order evidence map Broad, PICO-based or related frameworks Appraisal of the included reviews JBI umbrella review guidance [7]
      Table 1. Key features of major evidence synthesis designs

      PCC, population, concept, context; PICO, population/patient/problem, intervention, comparison, outcome; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; PRISMA-ScR, Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews.


      J Korean Acad Nurs : Journal of Korean Academy of Nursing
      Close layer
      TOP