好色先生

好色先生

Explore the latest content from across our publications
Join The AAN

Log In

Forgot Password?
Create New Account

Loading... please wait

Abstract Details

Teaching Critical Appraisal of Research to Residents with an Artificial Intelligence-integrated No-prep Journal Club
好色先生, Research, and Methodology
P7 - Poster Session 7 (8:00 AM-9:00 AM)
15-009

This qualitative study explores neurology residents’ learning of critical appraisal through engagement with an AI-integrated, no-prep journal club.
As artificial intelligence (AI) becomes increasingly integrated into scientific research, critical appraisal remains a foundational skill for residents practicing evidence-based medicine. Traditional journal club formats involve pre-session preparation, which can be challenging for resident physicians with limited time. To address these challenges, we implemented a no-prep journal club curriculum that required residents and faculty to critique AI outputs.
We conducted four monthly AI-integrated no-prep journal clubs in early 2025, collecting data via focused ethnography and semi-structured interviews. Ethnographic data included session summaries and ChatGPT transcripts. ChatGPT transcripts were graded for prompt quality. Interviews were conducted one-on-one via Zoom. Summaries and interview transcripts were coded descriptively and thematically analyzed using grounded theory.
Ethnography revealed inconsistent prompt quality and general distrust of outputs. However, residents expressed areas of uncertainty and collaborated in problem-solving while relying on faculty scaffolding to contextualize AI outputs. Based on a grading rubric, prompt quality of ChatGPT interactions varied across sessions (Mean = 70%, SD = 22.5%) with no clear improvement. Five neurology PGY 2-4 residents were interviewed, and several themes were identified. Residents described AI as a helpful scaffold for study design but perceived it as untrustworthy without faculty input. Residents with little prior experience with AI reported increased adoption and confidence using it to support research literacy and clinical decision-making. Residents also requested more instruction on how to use AI tools effectively.

The AI-integrated no-prep journal club format offered an interactive environment to practice critical appraisal and prompt engineering, though prompt quality was variable. Future iterations should consider incorporating dedicated instruction on AI use and individual rather than group-based interactions with AI to enhance engagement with prompt engineering.
Authors/Disclosures
Sally Elting, BA
PRESENTER 		Ms. Elting has nothing to disclose.
Laura Solano Miss Solano has nothing to disclose.
Roy E. Strowd III, MD, FAAN (Wake Forest School Of Medicine) Dr. Strowd has received personal compensation for serving as an employee of Kaplan. Dr. Strowd has received personal compensation in the range of $500-$4,999 for serving as a Consultant for Monteris Medical, Inc. Dr. Strowd has received personal compensation in the range of $500-$4,999 for serving as a Consultant for Novocure. The institution of Dr. Strowd has received personal compensation in the range of $500-$4,999 for serving as a Consultant for SpringWorks . Dr. Strowd has received personal compensation in the range of $5,000-$9,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for 好色先生. The institution of Dr. Strowd has received research support from Southeastern Brain Tumor Foundation. The institution of Dr. Strowd has received research support from Jazz Pharmaceuticals. The institution of Dr. Strowd has received research support from National Institutes of Health. The institution of Dr. Strowd has received research support from Alpha Omega Alpha. The institution of Dr. Strowd has received research support from American Board of Psychiatry and Neurology. Dr. Strowd has received publishing royalties from a publication relating to health care. Dr. Strowd has received publishing royalties from a publication relating to health care.
Katherine Fu, MD (University of California, Los Angeles) Dr. Fu has received personal compensation in the range of $10,000-$49,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for 好色先生: Neurology Journal . Dr. Fu has received research support from 好色先生. Dr. Fu has received personal compensation in the range of $0-$499 for serving as a Edmond J. Safra Fellowship Reviewer with The Michael J. Fox Foundation.