Comparing a script concordance examination to a multiple-choice examination on a core internal medicine clerkship.

Abstract:

BACKGROUND:Script concordance (SC) questions, in which a learner is given a brief clinical scenario then asked if additional information makes one hypothesis more or less likely, with answers compared to a panel of experts, are designed to reflect a learner's clinical reasoning. PURPOSE:The purpose is to compare reliability, validity, and learner satisfaction between a three-option modified SC examination to a multiple-choice question (MCQ) examination among medical students during a 3rd-year internal medicine clerkship, to compare reliability and learner satisfaction of SC between medical students and a convenience sample of house staff, and to compare learner satisfaction with SC between 1st- and 4th-quarter medical students. METHODS:Using a prospective cohort design, we compared the reliability of 20-item SC and MCQ examinations, sequentially administered on the same day. To measure validity, scores were compared to scores on the National Board of Medical Examiners (NBME) subject examination in medicine and to a clinical performance measure. SC and MCQ were also administered to a convenience sample of internal medicine house staff. Medical student and house staff were anonymously surveyed regarding satisfaction with the examinations. RESULTS:There were 163 students who completed the examinations. With students, the initial reliability of the SC was half that of MCQ (KR20 0.19 vs. 0.41), but with house staff (n = 15), reliability was the same (KR20 = 0.52 for both examinations). SC performance correlated with student clinical performance, whereas MCQ did not (r = .22, p = .005 vs. .11, p = .159). Students reported that SC questions were no more difficult and were answered more quickly than MCQ questions. Both exams were considered easier than NBME, and all 3 were considered equally fair. More students preferred MCQ over SC (55.8% vs. 18.0%), whereas house staff preferred SC (46% vs. 23%; p = .03). CONCLUSIONS:This SC examination was feasible and was more valid than the MCQ examination because of better correlation with clinical performance, despite being initially less reliable and less preferred by students. SC was more reliable and preferred when administered to house staff.

journal_name

Teach Learn Med

authors

Kelly W,Durning S,Denton G

doi

10.1080/10401334.2012.692239

subject

Has Abstract

pub_date

2012-01-01 00:00:00

pages

187-93

issue

3

eissn

1040-1334

issn

1532-8015

journal_volume

24

pub_type

杂志文章
  • Relationship between dean's letter rankings and later evaluations by residency program directors.

    abstract:BACKGROUND:It is not known how well dean's letter rankings predict later performance in residency. PURPOSE:To assess the accuracy of dean's letter rankings to predict clinical performance in internship. METHOD:Participants were medical students who graduated from the University of Rochester School of Medicine and Den...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330701366523

    authors: Lurie SJ,Lambert DR,Grady-Weliky TA

    更新日期:2007-07-01 00:00:00

  • Building Collaboration: A Scoping Review of Cultural Competency and Safety Education and Training for Healthcare Students and Professionals in Canada.

    abstract::Phenomenon: This scoping literature review summarizes current Canadian health science education and training aimed to lessen health gaps between Aboriginal and non-Aboriginal peoples. APPROACH:Keyword searches of peer-reviewed and gray literature databases, websites, and resources recommended by local Aboriginal comm...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,评审

    doi:10.1080/10401334.2016.1234960

    authors: Guerra O,Kurtz D

    更新日期:2017-04-01 00:00:00

  • Faculty views of reimbursement changes and clinical training: a survey of award-winning clinical teachers.

    abstract:BACKGROUND:Prominent authorities believe that managed care and governmental policies are compromising the clinical education of future physicians. PURPOSE:This study sought the views of clinical teachers to quantify the extent to which managed care and governmental policies have changed clinical education. METHODS:Qu...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1402_03

    authors: Woolliscroft JO,Harrison RV,Anderson MB

    更新日期:2002-04-01 00:00:00

  • Student Perceptions of M.D.-Ph.D. Programs: A Qualitative Identification of Barriers Facing Prospective M.D.-Ph.D. Applicants.

    abstract::Phenomenon: Despite a high degree of interest in research among matriculating M.D. students, very few apply to combined M.D.-Ph.D. training programs. Even fewer of those applicants are female, leading to a gender disparity among M.D.-Ph.D. trainees. We used a qualitative approach to understand why students choose not ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1598414

    authors: Kersbergen CJ,Bowen CJ,Dykema AG,Koretzky MO,Tang O,Beach MC

    更新日期:2020-01-01 00:00:00

  • Collaborative Reflection Under the Microscope: Using Conversation Analysis to Study the Transition From Case Presentation to Discussion in GP Residents' Experience Sharing Sessions.

    abstract:UNLABELLED:PHENOMENON: In higher education, reflection sessions are often used when participants learn in the workplace. In the Netherlands, all General Practitioner training programs include regular meetings called Exchange of Experiences, in which General Practitioner trainees are expected to learn collaboratively fr...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2015.1107486

    authors: Veen M,de la Croix A

    更新日期:2016-01-01 00:00:00

  • A "medical student practice profile" as the foundation for a case-based curriculum revision.

    abstract:BACKGROUND:In 2001, the Keck School of Medicine of the University of Southern California initiated a major curriculum reform with fully integrated teaching of the basic sciences. DESCRIPTION:The new curriculum integrated a set of selected clinical cases called the student practice profile (SPP). The SPP cases were des...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2010.512834

    authors: Abbott A,Sullivan M,Nyquist J,Mylona E,Taylor C

    更新日期:2010-10-01 00:00:00

  • Mindfulness Meditation and Interprofessional Cardiopulmonary Resuscitation: A Mixed-Methods Pilot Study.

    abstract:PROBLEM:Mindfulness training includes mindfulness meditation, which has been shown to improve both attention and self-awareness. Medical providers in the intensive care unit often deal with difficult situations with strong emotions, life-and-death decisions, and both interpersonal and interprofessional conflicts. The e...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2018.1462186

    authors: Kelm DJ,Ridgeway JL,Gas BL,Mohan M,Cook DA,Nelson DR,Benzo RP

    更新日期:2018-10-01 00:00:00

  • Assessing residents' competency in care management: report of a consensus conference.

    abstract:BACKGROUND:Residency programs must prepare physicians to practice in the current health care environment. This mandate is reflected in 3 of the 6 competency domains now required by the Accreditation Council for Graduate Medical Education: systems-based practice, interpersonal skills and communication, and practice-base...

    journal_title:Teaching and learning in medicine

    pub_type: 共识发展会议,杂志文章,评审

    doi:10.1207/s15328015tlm1601_16

    authors: Frohna JG,Kalet A,Kachur E,Zabar S,Cox M,Halpern R,Hewson MG,Yedidia MJ,Williams BC

    更新日期:2004-01-01 00:00:00

  • Refugee Health Curriculum in Undergraduate Medical Education (UME): A Scoping Review.

    abstract::Phenomenon: An increasing number of refugees in recent years has led to changes in healthcare delivery. Historically, health care providers did not receive systematic and longitudinal training in refugee health. There is increasing interest among educators in developing educational opportunities for medical students t...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2020.1779071

    authors: Rashid M,Cervantes AD,Goez H

    更新日期:2020-10-01 00:00:00

  • Alliance for clinical education perspective paper: recommendations for redesigning the "final year" of medical school.

    abstract:BACKGROUND:Although medical school typically lasts 4 years, little attention has been devoted to the structure of the educational experience that takes place during the final year of medical school. SUMMARY:In this perspectives paper, we outline goals for the 4th year of medical school to facilitate a transition from ...

    journal_title:Teaching and learning in medicine

    pub_type: 社论

    doi:10.1080/10401334.2014.945027

    authors: Reddy ST,Chao J,Carter JL,Drucker R,Katz NT,Nesbit R,Roman B,Wallenstein J,Beck GL

    更新日期:2014-01-01 00:00:00

  • Trainees' perceptions of practitioner competence during patient transfer.

    abstract:BACKGROUND:Technical and communicative skills are both important features for one's perception of practitioner competence. PURPOSE:This research examines how trainees' perceptions of practitioner competence change as they view health care practitioners who vary in their technical and communicative skill proficiencies....

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.664528

    authors: Grierson L,Dubrowski A,So S,Kistner N,Carnahan H

    更新日期:2012-01-01 00:00:00

  • A review of U.S. Medical schools' promotion standards for educational excellence.

    abstract::Phenomenon: Given the growing number of medical science educators, an examination of institutions' promotion criteria related to educational excellence and scholarship is timely. This study investigates the extent to which medical schools' promotion criteria align with published standards for documenting and evaluatin...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1686983

    authors: Hoffman LA,Lufler RS,Brown KM,DeVeau K,DeVaul N,Fatica LM,Mussell J,Byram JN,Dunham SM,Wilson AB

    更新日期:2020-04-01 00:00:00

  • A comparison of in-class learner engagement across lecture, problem-based learning, and team learning using the STROBE classroom observation tool.

    abstract:BACKGROUND:Having recently introduced team learning into the preclinical medical curriculum, evidence of the relative impact of this instructional method on in-class learner engagement was sought. PURPOSE:To compare patterns of engagement behaviors among learners in class sessions across 3 distinct instructional metho...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1702_4

    authors: Kelly PA,Haidet P,Schneider V,Searle N,Seidel CL,Richards BF

    更新日期:2005-04-01 00:00:00

  • Benefits of testable concept maps for learning about pathogenesis of disease.

    abstract:BACKGROUND:Concept maps can assist learning by integrating new information with existing cognitive structure to facilitate meaningful understanding. The benefits of testable concept maps to illustrate cause-and-effect sequences in the pathogenesis of disease have not yet been determined. PURPOSE:A controlled trial was...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2011.561700

    authors: Kumar S,Dee F,Kumar R,Velan G

    更新日期:2011-04-01 00:00:00

  • A controlled trial to compare the teaching quality of clinical-skills training faculty: the clinician-educator career path in China.

    abstract:BACKGROUND:Full-time clinician educators are becoming more predominant in China, yet their effect is unknown. PURPOSES:The purpose of this study was to compare the teaching quality of full-time (FT) faculty with that of part-time (PT) faculty in one Chinese medical school. METHODS:In 3 consecutive years, 881 3rd year...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1080/10401334.2014.892393

    authors: Zeng J,Zuo C,Wang Y

    更新日期:2014-01-01 00:00:00

  • e-Professionalism: a new frontier in medical education.

    abstract:BACKGROUND:This article, prepared by the Association of Professors of Gynecology and Obstetrics Undergraduate Medical Education Committee, discusses the evolving challenges facing medical educators posed by social media and a new form of professionalism that has been termed e-professionalism. SUMMARY:E-professionalism...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2013.770741

    authors: Kaczmarczyk JM,Chuang A,Dugoff L,Abbott JF,Cullimore AJ,Dalrymple J,Davis KR,Hueppchen NA,Katz NT,Nuthalapaty FS,Pradhan A,Wolf A,Casey PM

    更新日期:2013-01-01 00:00:00

  • How good is good? Students and assessors' perceptions of qualitative markers of performance.

    abstract:BACKGROUND:Qualitative markers of performance are routinely used for medical student assessment, though the extent to which such markers can be readily translated to actionable pieces of information remains uncertain. PURPOSE:To explore (a) the perceived value to be indicated by descriptor phrases commonly used for de...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.741545

    authors: Ma HK,Min C,Neville A,Eva K

    更新日期:2013-01-01 00:00:00

  • Relationship between specialty choice and medical student temperament and character assessed with Cloninger Inventory.

    abstract:BACKGROUND:Multiple variables affect medical specialty choice, including temperament, sociodemographic factors, and personal experiences. Many studies address specific variables for specific specialties, but few assess the relative impact of each factor. PURPOSE:To identify the relative influence of temperament in cho...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1602_6

    authors: Vaidya NA,Sierles FS,Raida MD,Fakhoury FJ,Przybeck TR,Cloninger CR

    更新日期:2004-04-01 00:00:00

  • Is medicine altruistic? A query from the medical school admissions office.

    abstract:BACKGROUND:Applicants to medical school often state that they are motivated by a desire to help others. Admissions officers must evaluate these claims, but assessment of altruism is difficult and imprecise. SUMMARY:A purely utilitarian moral philosophy denies the possibility of altruism. However, the Enlightenment phi...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1801_10

    authors: Bardes CL

    更新日期:2006-01-01 00:00:00

  • The feasibility and acceptability of implementing formal evaluation sessions and using descriptive vocabulary to assess student performance on a clinical clerkship.

    abstract:BACKGROUND:A systematized approach to descriptive evaluation of clinical performance using a vocabulary of global descriptors in the setting of formal evaluation and feedback sessions has been shown to be reliable and valid. The feasibility of this method beyond the institution at which it was developed has not been st...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1401_3

    authors: Battistone MJ,Milne C,Sande MA,Pangaro LN,Hemmer PA,Shomaker TS

    更新日期:2002-01-01 00:00:00

  • The Development and Impact of a Social Media and Professionalism Course for Medical Students.

    abstract:PROBLEM:Inappropriate social media behavior can have detrimental effects on students' future opportunities, but medical students are given little opportunity to reflect upon ways of integrating their social media identities with their newly forming professional identities. INTERVENTION:In 2012, a required educational ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1275971

    authors: Gomes AW,Butera G,Chretien KC,Kind T

    更新日期:2017-07-01 00:00:00

  • Resident perceptions of the educational value of night float rotations.

    abstract:BACKGROUND:Night float rotations are being increasingly used in the era of resident physician work-hour regulations, but their impact on resident education is not clear. PURPOSE:Our objective was to clarify resident perceptions of the educational aspects of night float rotations. METHODS:An anonymous survey of intern...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2010.488203

    authors: Luks AM,Smith CS,Robins L,Wipf JE

    更新日期:2010-07-01 00:00:00

  • Team-based learning from theory to practice: faculty reactions to the innovation.

    abstract:BACKGROUND:Limited studies have examined the factors associated with the implementation of team-based learning (TBL). PURPOSE:The purpose of this study was to identify faculty reactions (successes and challenges) associated with the implementation of a modified TBL in undergraduate anatomy teaching. METHOD:To obtain ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2013.797343

    authors: Sutherland S,Bahramifarid N,Jalali A

    更新日期:2013-01-01 00:00:00

  • A longitudinal investigation of medical student attitudes toward the medically indigent.

    abstract:BACKGROUND:Studies have shown that medical student attitudes decline as students progress through school. Controversy persists about the meaning and generalizability of these findings because studies have not been longitudinal and many were conducted prior to an influx of female students. Much of medical education occu...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm0904_2

    authors: Crandall SJ,Volk RJ,Cacy D

    更新日期:1997-01-01 00:00:00

  • Realizing the promise and importance of performance-based assessment.

    abstract::Work-based assessment (WBA) is the assessment of trainees and physicians across the educational continuum of day-to-day competencies and practices in authentic, clinical environments. What distinguishes WBA from other assessment modalities is that it enables the evaluation of performance in context. In this perspectiv...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,评审

    doi:10.1080/10401334.2013.842912

    authors: Kogan JR,Holmboe E

    更新日期:2013-01-01 00:00:00

  • Academic advancement of authors receiving tutoring from a medical journal.

    abstract:BACKGROUND:Although publishing in scientific journals has an educational component, the educational role of journals in medicine has not been evaluated. PURPOSE:To assess whether tutoring authors in a medical scientific journal could be related to their long-term scientific publications and academic advancement. METH...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1802_6

    authors: Marusic M,Markulin H,Lukic IK,Marusic A

    更新日期:2006-04-01 00:00:00

  • Development of a communication curriculum for emergency medicine residents.

    abstract:BACKGROUND:The Accreditation Council for Graduate Medical Education requires residency training programs to develop methods to teach and assess communication skills in residents to ensure competence as a practitioner. In response, we piloted a communication curriculum for emergency medicine residents. We describe the c...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330903228604

    authors: Sullivan C,Ellison SR,Quaintance J,Arnold L,Godrey P

    更新日期:2009-10-01 00:00:00

  • Comparison of clinical skills of 3rd-year students who completed structured clinical skills program with 6th-year students who acquired clinical skills in unsystematic way.

    abstract:BACKGROUND:The timing and methods of teaching clinical skills are some of the main concerns of medical education. PURPOSE:The aim of this study was to compare clinical skills of the 3rd and 6th-year students who acquired clinical skills training within different years and methods. METHODS:Randomly chosen students wer...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1701_5

    authors: Güldal D,Ozçakar N,Yeniçeri N,Dontlu C,Ulusel B

    更新日期:2005-01-01 00:00:00

  • An Institutional Approach to Fostering Inclusion and Addressing Racial Bias: Implications for Diversity in Academic Medicine.

    abstract::Issue: While an increasingly diverse workforce of clinicians, researchers, and educators will be needed to address the nation's future healthcare challenges, underrepresented in medicine (UIM) perspectives remain relatively absent from academic medicine. Evidence: Prior studies have identified differential experiences...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1670665

    authors: Diaz T,Navarro JR,Chen EH

    更新日期:2020-01-01 00:00:00

  • Grading Practices and Distributions Across Internal Medicine Clerkships.

    abstract:THEORY:Clerkship evaluation and grading practices vary widely between U.S. medical schools. Grade inflation continues to exist, and grade distribution is likely to be different among U.S. medical schools. HYPOTHESES:Increasing the number of available grades curtails "grade inflation." METHOD:A national survey of all ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1164605

    authors: Fazio SB,Torre DM,DeFer TM

    更新日期:2016-07-01 00:00:00