In Brief: Validity of Case Summaries in Written Examinations of Clinical Reasoning.

Abstract:

:Construct: The purpose of this study was to provide initial evidence of the validity of written case summaries as assessments of clinical problem representation in a classroom setting. BACKGROUND:To solve clinical problems, clinicians must gain a clear representation of the issues. In the clinical setting, oral case presentations-or summaries-are used to assess learners' ability to gather, synthesize, and "translate" pertinent case information. This ability can be assessed in Objective Structured Clinical Examination and Virtual Patient settings using oral or written case summaries. Evidence of their validity in these settings includes adequate interrater agreement and moderate correlation with other assessments of clinical reasoning. We examined the use of written case summaries in a classroom setting as part of an examination designed to assess clinical reasoning. APPROACH:We developed and implemented written examinations for 2 preclerkship general practice courses in Years 4 and 5 of a 7-year curriculum. Examinations included 8 case summary questions in Year 4 and 5 in Year 5. Seven hundred students participated. Cases were scored using 3 criteria: extraction of pertinent findings, semantic quality, and global ratings. We examined the item parameters (using classical test theory) and generalizability of case summary items. We computed correlations between case summary scores and scores on other questions within the examination. RESULTS:Item parameters were acceptable (average item difficulty = 0.49-0.73 and 0.59-0.68 in Years 4 and 5; average point-biserials = 0.21-0.24 and 0.18-0.21). Scores were moderately generalizable (G coefficients = 0.40-0.50), with case-specificity a substantial source of measurement error (10.2%-19.5% of variance). Scoring and rater had small effects. Correlations with related constructs were low to moderate. CONCLUSIONS:There is good evidence regarding the scoring and generalizability of written case summaries for assessment of clinical problem representation. Further evidence regarding the extrapolation and implications of these assessments is warranted.

journal_name

Teach Learn Med

authors

Dory V,Gagnon R,Charlin B,Vanpee D,Leconte S,Duyver C,Young M,Loye N

doi

10.1080/10401334.2016.1190730

subject

Has Abstract

pub_date

2016-10-01 00:00:00

pages

375-384

issue

4

eissn

1040-1334

issn

1532-8015

journal_volume

28

pub_type

杂志文章
  • Early career mentoring for translational researchers: mentee perspectives on challenges and issues.

    abstract:BACKGROUND:The education and training of early career biomedical translational researchers often involves formal mentoring by more experienced colleagues. PURPOSES:This study investigated the nature of these mentoring relationships from the perspective of mentees. The objective was to understand the challenges and iss...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2014.883983

    authors: Keller TE,Collier PJ,Blakeslee JE,Logan K,McCracken K,Morris C

    更新日期:2014-01-01 00:00:00

  • Impact of group size on the effectiveness of a resuscitation simulation curriculum for medical students.

    abstract:BACKGROUND:Simulation requires involvement from participants. However, it is unknown to what extent simulation effectiveness is a function of the number of participants. PURPOSE:This study assessed the impact of varying group size on medical students' subjective experience of simulation and on postsimulation exam perf...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1080/10401334.2011.586920

    authors: Rezmer J,Begaz T,Treat R,Tews M

    更新日期:2011-07-01 00:00:00

  • e-Professionalism: a new frontier in medical education.

    abstract:BACKGROUND:This article, prepared by the Association of Professors of Gynecology and Obstetrics Undergraduate Medical Education Committee, discusses the evolving challenges facing medical educators posed by social media and a new form of professionalism that has been termed e-professionalism. SUMMARY:E-professionalism...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2013.770741

    authors: Kaczmarczyk JM,Chuang A,Dugoff L,Abbott JF,Cullimore AJ,Dalrymple J,Davis KR,Hueppchen NA,Katz NT,Nuthalapaty FS,Pradhan A,Wolf A,Casey PM

    更新日期:2013-01-01 00:00:00

  • Attending Emergency Physicians' Perceptions of a Programmatic Workplace-Based Assessment System: The McMaster Modular Assessment Program (McMAP).

    abstract::Construct: The McMaster Modular Assessment Program (McMAP) is a programmatic workplace-based assessment (WBA) system that provides emergency medicine trainees with competency judgments through frequent task-specific and global daily assessments. Background: The longevity of McMAP relative to other programmatic WBA sys...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1574581

    authors: Acai A,Li SA,Sherbino J,Chan TM

    更新日期:2019-08-01 00:00:00

  • Evaluating the Implementation and Impact of a Motivational Interviewing Workshop on Medical Student Knowledge and Social Cognitions Towards Counseling Patients on Lifestyle Behaviors.

    abstract::Problem: Although motivational interviewing is an effective patient-centered counseling method that healthcare providers can adopt to promote positive behavior change among patients, motivational interviewing is not routinely taught in medical schools. Intervention: A 3.5-hour motivational interviewing workshop was de...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1681273

    authors: D'Urzo KA,Flood SM,Baillie C,Skelding S,Dobrowolski S,Houlden RL,Tomasone JR

    更新日期:2020-04-01 00:00:00

  • Attitudes of affiliate faculty members toward medical student summative evaluation for clinical clerkships: a qualitative analysis.

    abstract:BACKGROUND:Summative evaluation of medical students is a critical component of the educational process. Despite extensive literature on evaluation, few studies have centered on affiliate faculty members' attitudes toward summative evaluation of students, though it has been suggested that these attitudes influence their...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.641478

    authors: Wang KE,Fitzpatrick C,George D,Lane L

    更新日期:2012-01-01 00:00:00

  • Team-based learning from theory to practice: faculty reactions to the innovation.

    abstract:BACKGROUND:Limited studies have examined the factors associated with the implementation of team-based learning (TBL). PURPOSE:The purpose of this study was to identify faculty reactions (successes and challenges) associated with the implementation of a modified TBL in undergraduate anatomy teaching. METHOD:To obtain ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2013.797343

    authors: Sutherland S,Bahramifarid N,Jalali A

    更新日期:2013-01-01 00:00:00

  • An innovative process for faculty development in residency training.

    abstract:BACKGROUND:For programs to accomplish the goals of the Accreditation Council of Graduate Medical Education (ACGME) Outcome Project, faculty must be trained to deliver and assess education that is level-specific, competency-based, standardized, integrated, and easily accessible. DESCRIPTION:An innovative faculty develo...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.692280

    authors: Narayan AP,Whicker SA,McGann KA

    更新日期:2012-01-01 00:00:00

  • Medical student perceptions of factors affecting productivity of problem-based learning tutorial groups: does culture influence the outcome?

    abstract:BACKGROUND:The popularization of problem-based learning (PBL) has drawn attention to the motivational and cognitive skills necessary for medical students in group learning. This study identifies the effect of motivational and cognitive factors on group productivity of PBL tutorial groups. DESCRIPTION:A self-administer...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1501_11

    authors: Das Carlo M,Swadi H,Mpofu D

    更新日期:2003-01-01 00:00:00

  • Competency in electrocardiogram interpretation among graduating medical students.

    abstract:BACKGROUND:The ability to accurately interpret electrocardiogram (ECG) abnormalities is a core competency for graduating medical students (GMS). Incorrect interpretation of ECG findings can result in adverse patient outcomes. To our knowledge, there has been no published study evaluating the level of competency in ECG ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2014.918882

    authors: Jablonover RS,Lundberg E,Zhang Y,Stagnaro-Green A

    更新日期:2014-01-01 00:00:00

  • Teaching geriatric assessment in home visits: the family physician/geriatrician attachment.

    abstract:BACKGROUND:Geriatric clinical clerkships in Israel teach mostly about the hospitalized elder patient with almost no ambulatory experience. Meanwhile, primary care physicians provide most of the health care to the elderly in the community. This article describes an innovation in the curriculum of the 5th-year family med...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1502_09

    authors: Tandeter H,Peleg R,Menahem S,Biderman A,Fried VA

    更新日期:2003-04-01 00:00:00

  • A novel advance directives course provides a transformative learning experience for medical students.

    abstract:BACKGROUND:Inadequate physician training may be a barrier to physician-patient discussions of advance directives (ADs). DESCRIPTION:The purpose of this study was to determine the effects of an ADs course, which includes completing a directive, on medical students' perceived knowledge of and preparedness for discussing...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401331003656678

    authors: Mueller PS,Litin SC,Hook CC,Creagan ET,Cha SS,Beckman TJ

    更新日期:2010-04-01 00:00:00

  • Relationship between specialty choice and medical student temperament and character assessed with Cloninger Inventory.

    abstract:BACKGROUND:Multiple variables affect medical specialty choice, including temperament, sociodemographic factors, and personal experiences. Many studies address specific variables for specific specialties, but few assess the relative impact of each factor. PURPOSE:To identify the relative influence of temperament in cho...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1602_6

    authors: Vaidya NA,Sierles FS,Raida MD,Fakhoury FJ,Przybeck TR,Cloninger CR

    更新日期:2004-04-01 00:00:00

  • Griev_Ing: death notification skills and applications for fourth-year medical students.

    abstract:BACKGROUND AND PURPOSE:Our study examined whether GRIEV_ING improved death notification skills of medical students, whether pretesting with simulated survivors primed learners and improved results of the intervention, and whether feedback on the simulated encounter improved student performance. METHODS:GRIEV_ING train...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330903018450

    authors: Hobgood CD,Tamayo-Sarver JH,Hollar DW Jr,Sawning S

    更新日期:2009-07-01 00:00:00

  • Medical education and the arts: a survey of U.S. medical schools.

    abstract:BACKGROUND:Although the literary arts initiated the movement to include the humanities in medical education, little is known about the incorporation of other art forms. PURPOSE:A study was designed to determine the variety of arts-related activities in U.S. medical schools. METHODS:Questionnaires were mailed twice to...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1404_11

    authors: Strickland MA,Gambala CT,Rodenhauser P

    更新日期:2002-10-01 00:00:00

  • Effect of Pause Procedures on Participant Reflection and Commitment-to-Change in Continuing Medical Education.

    abstract::Problem: Conferences are the most common form of continuing medical education (CME), but their effect on clinician practice is inconsistent. Reflection is a critical step in the process of practice change among clinicians and may lead to improved outcomes following conference-based CME. However, reflection requires ti...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2020.1779070

    authors: Ratelle JT,Wittich CM,Yu RC,Newman JS,Jenkins SM,Beckman TJ

    更新日期:2020-10-01 00:00:00

  • A new oral health elective for medical students at the University of Washington.

    abstract:BACKGROUND:Oral health is an important but inadequately addressed area in medical school curricula. Primary care practitioners are in an ideal position to help prevent oral disease but lack the knowledge to do so. PURPOSES:We developed an oral health elective that targeted 1st- and 2nd-year medical students as part of...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1804_11

    authors: Mouradian WE,Reeves A,Kim S,Lewis C,Keerbs A,Slayton RL,Gupta D,Oskouian R,Schaad D,Kalet T,Marshall SG

    更新日期:2006-10-01 00:00:00

  • A guide to performing pelvic speculum exams: a patient-centered approach to reducing iatrogenic effects.

    abstract:PURPOSE:Current training in the United States for pelvic speculum examinations (PSEs) has a primary focus on the physician-centered goal of visualizing the cervix but may not inform practitioners of potential iatrogenic effects. Such oversight leaves trainees unprepared and unskilled in preventing and addressing advers...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2013.827969

    authors: Williams AA,Williams M

    更新日期:2013-01-01 00:00:00

  • Building Collaboration: A Scoping Review of Cultural Competency and Safety Education and Training for Healthcare Students and Professionals in Canada.

    abstract::Phenomenon: This scoping literature review summarizes current Canadian health science education and training aimed to lessen health gaps between Aboriginal and non-Aboriginal peoples. APPROACH:Keyword searches of peer-reviewed and gray literature databases, websites, and resources recommended by local Aboriginal comm...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,评审

    doi:10.1080/10401334.2016.1234960

    authors: Guerra O,Kurtz D

    更新日期:2017-04-01 00:00:00

  • Trainees' perceptions of practitioner competence during patient transfer.

    abstract:BACKGROUND:Technical and communicative skills are both important features for one's perception of practitioner competence. PURPOSE:This research examines how trainees' perceptions of practitioner competence change as they view health care practitioners who vary in their technical and communicative skill proficiencies....

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.664528

    authors: Grierson L,Dubrowski A,So S,Kistner N,Carnahan H

    更新日期:2012-01-01 00:00:00

  • Standard Setting Methods for Pass/Fail Decisions on High-Stakes Objective Structured Clinical Examinations: A Validity Study.

    abstract:UNLABELLED:CONSTRUCT: Authentic standard setting methods will demonstrate high convergent validity evidence of their outcomes, that is, cutoff scores and pass/fail decisions, with most other methods when compared with each other. BACKGROUND:The objective structured clinical examination (OSCE) was established for valid...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2015.1044749

    authors: Yousuf N,Violato C,Zuberi RW

    更新日期:2015-01-01 00:00:00

  • Refugee Health Curriculum in Undergraduate Medical Education (UME): A Scoping Review.

    abstract::Phenomenon: An increasing number of refugees in recent years has led to changes in healthcare delivery. Historically, health care providers did not receive systematic and longitudinal training in refugee health. There is increasing interest among educators in developing educational opportunities for medical students t...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2020.1779071

    authors: Rashid M,Cervantes AD,Goez H

    更新日期:2020-10-01 00:00:00

  • A critical intervention in lesbian, gay, bisexual, and transgender health: knowledge and attitude outcomes among second-year medical students.

    abstract:BACKGROUND:Lesbian, gay, bisexual, and transgender (LGBT) persons represent an underserved population susceptible to health care disparities. DESCRIPTION:In February 2004, we implemented an LGBT health curriculum for students at the University of California at San Francisco. Confidential matched questionnaires elicite...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330802199567

    authors: Kelley L,Chou CL,Dibble SL,Robertson PA

    更新日期:2008-07-01 00:00:00

  • Collaborative Reflection Under the Microscope: Using Conversation Analysis to Study the Transition From Case Presentation to Discussion in GP Residents' Experience Sharing Sessions.

    abstract:UNLABELLED:PHENOMENON: In higher education, reflection sessions are often used when participants learn in the workplace. In the Netherlands, all General Practitioner training programs include regular meetings called Exchange of Experiences, in which General Practitioner trainees are expected to learn collaboratively fr...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2015.1107486

    authors: Veen M,de la Croix A

    更新日期:2016-01-01 00:00:00

  • Faculty views of reimbursement changes and clinical training: a survey of award-winning clinical teachers.

    abstract:BACKGROUND:Prominent authorities believe that managed care and governmental policies are compromising the clinical education of future physicians. PURPOSE:This study sought the views of clinical teachers to quantify the extent to which managed care and governmental policies have changed clinical education. METHODS:Qu...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1402_03

    authors: Woolliscroft JO,Harrison RV,Anderson MB

    更新日期:2002-04-01 00:00:00

  • Cheating in OSCEs: The Impact of Simulated Security Breaches on OSCE Performance.

    abstract::Construct: Valid score interpretation is important for constructs in performance assessments such as objective structured clinical examinations (OSCEs). An OSCE is a type of performance assessment in which a series of standardized patients interact with the student or candidate who is scored by either the standardized...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1080/10401334.2016.1202832

    authors: Gotzmann A,De Champlain A,Homayra F,Fotheringham A,de Vries I,Forgie M,Pugh D

    更新日期:2017-01-01 00:00:00

  • A teaching oath: a commitment to medical students' learning and development.

    abstract:BACKGROUND:There are several oaths and affirmations that are integrated into the academic customs of the health sciences, such as the Hippocratic Oath and the Ethical Affirmation for Scientists. What current oaths do not communicate is that teaching and learning are the foundation of the professions. SUMMARY:We articu...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.664987

    authors: Cottrell S,Gill A,Crow S,Saizow R,Nelson EA,Shumway JM

    更新日期:2012-01-01 00:00:00

  • The Relationship between Cognitively-Based Clinical Empathy and Attitudes toward Death and Dying in Medical Students.

    abstract:THEORY:Empathy has a potentially complicated relationship with dealing with death and dying. Having clinical empathy can improve interactions with dying, but educational interventions aimed at fostering empathy may cause medical students to connect emotionally with dying patients and behave unprofessionally out of self...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2020.1794881

    authors: Ünlü G,Uludağ A

    更新日期:2020-08-11 00:00:00

  • A comparison of faculty-led small group learning in combination with computer-based instruction versus computer-based instruction alone on identifying simulated pulmonary sounds.

    abstract:BACKGROUND:Computer-based learning has gained widespread acceptance in medical curricula, but can it replace faculty-led teaching. PURPOSE:To investigate the effectiveness of independent computer-based learning of pulmonary auscultation alone and in combination with faculty-led teaching. METHODS:The first method invo...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1601_6

    authors: Karnath BM,Das Carlo M,Holden MD

    更新日期:2004-01-01 00:00:00

  • An evidence-based domestic violence education program for internal medicine residents.

    abstract:BACKGROUND:Domestic violence (DV) is prevalent but often unrecognized, and it is a challenge to teach. This article presents an evidence-based DV education program for medical residents and incorporates it into a women's medicine curriculum. DESCRIPTION:An initial 3-hr seminar included video and case discussion, liter...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1504_09

    authors: Korenstein D,Thomas DC,Foldes C,Ross J,Halm E,McGinn T

    更新日期:2003-10-01 00:00:00