A novel student-led approach to multiple-choice question generation and online database creation, with targeted clinician input.

Abstract:

PROBLEM:Multiple-choice questions (MCQs) are the main method of assessing medical student knowledge. As a result there is a high demand from medical students for formative MCQs. However, teaching staff rarely have the time or incentive to develop high-quality formative questions, focusing instead on material for high-stakes assessments. INTERVENTION:We have developed a novel student-led approach involving an interactive online question database, created by medical students for medical students. We adopted a staged approach to create an online bank of formative MCQ questions. First, students write MCQs following a standardized format. Questions are then peer-reviewed by other students, discussing relevant clinical topics, guidelines, and journals to improve question quality. The questions are then scrutinized by specialist doctors and academics. Next, questions are piloted online. Finally, question performance is evaluated statistically. This 5-stage student-led process produced a bank of more than 200 MCQs in three months. CONTEXT:This intervention was carried out by two final-year medical student leads at Cardiff University School of Medicine, UK. Final-year students were recruited to write and peer-review questions, and senior content specialists were recruited from the department. After piloting and evaluation of the questions, the question bank was made available as a learning resource to all medical students at Cardiff University. OUTCOME:Objective analysis of the created MCQs (discrimination indices and distractor analysis) indicated that the random sample of questions piloted were of high quality. When the questions were made available as online tests to approximately 600 students, usage data revealed that 2,800 tests were taken over a 3-month period, indicating that the resource was popular. In addition, subjective feedback from students question writers/reviewers was gathered via free text feedback forms and was invariably positive. We plan to continue the question generation process in Cardiff and would encourage other medical schools to adopt this approach. LESSONS LEARNED:Our 5-stage approach can generate a large volume of high-quality MCQs, addressing the demand from students for formative MCQ questions, with minimal teaching staff input. The project's benefits go beyond the creation of the resource, as involving students in the writing, review, and presentation of questions itself is useful pedagogically.

journal_name

Teach Learn Med

authors

Harris BH,Walsh JL,Tayyaba S,Harris DA,Wilson DJ,Smith PE

doi

10.1080/10401334.2015.1011651

subject

Has Abstract

pub_date

2015-01-01 00:00:00

pages

182-8

issue

2

eissn

1040-1334

issn

1532-8015

journal_volume

27

pub_type

杂志文章
  • Common Ground: Frameworks for Teaching Improvisational Ability in Medical Education.

    abstract::Issue: The practice of medicine is intrinsically unpredictable. Clinicians must respond skillfully to this uncertainty; therefore, medical educators are using improvisational theater training methods to teach improvisational ability in areas such as communication and professionalism. This teaching approach is called "...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2018.1537880

    authors: Fu B

    更新日期:2019-06-01 00:00:00

  • The effect of resident duty-hours restrictions on internal medicine clerkship experiences: surveys of medical students and clerkship directors.

    abstract:UNLABELLED:PHENOMENON: Medical students receive much of their inpatient teaching from residents who now experience restructured teaching services to accommodate the 2011 duty-hour regulations (DHR). The effect of DHR on medical student educational experiences is unknown. We examined medical students' and clerkship dire...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2014.979187

    authors: Kogan JR,Lapin J,Aagaard E,Boscardin C,Aiyer MK,Cayea D,Cifu A,Diemer G,Durning S,Elnicki M,Fazio SB,Khan AR,Lang VJ,Mintz M,Nixon LJ,Paauw D,Torre DM,Hauer KE

    更新日期:2015-01-01 00:00:00

  • Standardized sign-out reduces intern perception of medical errors on the general internal medicine ward.

    abstract:BACKGROUND:Prior research on reducing variation in housestaff handoff procedures have depended on proprietary checkout software. Use of low-technology standardization techniques has not been widely studied. PURPOSE:We wished to determine if standardizing the process of intern sign-out using low-technology sign-out too...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330902791354

    authors: Salerno SM,Arnett MV,Domanski JP

    更新日期:2009-04-01 00:00:00

  • Two techniques for teaching the estimation of prior probabilities.

    abstract:BACKGROUND:Studies indicate that practicing clinicians do not employ quantitative techniques in diagnosis. If evidence-based approaches to clinical care are to succeed, there is a need to develop pedagogical tools to introduce the relevant techniques in clinical medicine. DESCRIPTION:This article describes 2 heuristic...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1203_4

    authors: Upshur RE

    更新日期:2000-07-01 00:00:00

  • Trainees' perceptions of practitioner competence during patient transfer.

    abstract:BACKGROUND:Technical and communicative skills are both important features for one's perception of practitioner competence. PURPOSE:This research examines how trainees' perceptions of practitioner competence change as they view health care practitioners who vary in their technical and communicative skill proficiencies....

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.664528

    authors: Grierson L,Dubrowski A,So S,Kistner N,Carnahan H

    更新日期:2012-01-01 00:00:00

  • Evaluating the Implementation and Impact of a Motivational Interviewing Workshop on Medical Student Knowledge and Social Cognitions Towards Counseling Patients on Lifestyle Behaviors.

    abstract::Problem: Although motivational interviewing is an effective patient-centered counseling method that healthcare providers can adopt to promote positive behavior change among patients, motivational interviewing is not routinely taught in medical schools. Intervention: A 3.5-hour motivational interviewing workshop was de...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1681273

    authors: D'Urzo KA,Flood SM,Baillie C,Skelding S,Dobrowolski S,Houlden RL,Tomasone JR

    更新日期:2020-04-01 00:00:00

  • The patient safety OSCE for PGY-1 residents: a centralized response to the challenge of culture change.

    abstract:BACKGROUND:Accreditation and Institute of Medicine mandates require retooling of graduate medical education curriculum and assessment processes. This Objective Structured Clinical Exam (OSCE) focused on patient safety-specific skills important to stakeholders from multiple institutions. PURPOSES:A 10-station OSCE was ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330802573837

    authors: Wagner DP,Hoppe RB,Lee CP

    更新日期:2009-01-01 00:00:00

  • Teaching geriatric assessment in home visits: the family physician/geriatrician attachment.

    abstract:BACKGROUND:Geriatric clinical clerkships in Israel teach mostly about the hospitalized elder patient with almost no ambulatory experience. Meanwhile, primary care physicians provide most of the health care to the elderly in the community. This article describes an innovation in the curriculum of the 5th-year family med...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1502_09

    authors: Tandeter H,Peleg R,Menahem S,Biderman A,Fried VA

    更新日期:2003-04-01 00:00:00

  • Relationship between specialty choice and medical student temperament and character assessed with Cloninger Inventory.

    abstract:BACKGROUND:Multiple variables affect medical specialty choice, including temperament, sociodemographic factors, and personal experiences. Many studies address specific variables for specific specialties, but few assess the relative impact of each factor. PURPOSE:To identify the relative influence of temperament in cho...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1602_6

    authors: Vaidya NA,Sierles FS,Raida MD,Fakhoury FJ,Przybeck TR,Cloninger CR

    更新日期:2004-04-01 00:00:00

  • Examining the medical student body: peer physical exams and genital, rectal, or breast exams.

    abstract:BACKGROUND:Some medical schools have replaced all student practice peer physical examinations in the curriculum with examinations of standardized patients (SPs). PURPOSE:To assess attitudes of medical students toward practicing physical examinations with classmates, including genital, rectal, or female breast componen...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1704_5

    authors: Power DV,Center BA

    更新日期:2005-10-01 00:00:00

  • Seeing Is Believing: Evaluating a Point-of-Care Ultrasound Curriculum for 1st-Year Medical Students.

    abstract:PROBLEM:Point-of-care ultrasound has been a novel addition to undergraduate medical education at a few medical schools. The impact is not fully understood, and few rigorous assessments of educational outcomes exist. This study assessed the impact of a point-of-care ultrasound curriculum on image acquisition, interpreta...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1172012

    authors: Nelson BP,Hojsak J,Dei Rossi E,Karani R,Narula J

    更新日期:2017-01-01 00:00:00

  • Medical subinternship: student experience on a resident uncovered hospitalist service.

    abstract:BACKGROUND:Studies demonstrating the value of hospitalists to medical student education have been performed in traditional resident covered ward service settings (RCWS). PURPOSE:To compare medical subinterns' experiences on an RCWS to that on a resident uncovered hospitalist service (RUHS). METHODS:We assessed studen...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330701797974

    authors: O'Leary KJ,Chadha V,Fleming VM,Martin GJ,Baker DW

    更新日期:2008-01-01 00:00:00

  • First aid and basic life support skills training early in the medical curriculum: curriculum issues, outcomes, and confidence of students.

    abstract:BACKGROUND:The importance of training physicians and other health care professionals in first aid and basic life support (BLS) is now widely recognized. The Faculty of Medicine and Health Sciences of the United Arab Emirates University have been offering formal training in these skills to 1st-year medical students sinc...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1304_05

    authors: Das M,Elzubeir M

    更新日期:2001-10-01 00:00:00

  • Medical education and the arts: a survey of U.S. medical schools.

    abstract:BACKGROUND:Although the literary arts initiated the movement to include the humanities in medical education, little is known about the incorporation of other art forms. PURPOSE:A study was designed to determine the variety of arts-related activities in U.S. medical schools. METHODS:Questionnaires were mailed twice to...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1404_11

    authors: Strickland MA,Gambala CT,Rodenhauser P

    更新日期:2002-10-01 00:00:00

  • Outcomes of a teaching scholars program to promote leadership in faculty development.

    abstract:BACKGROUND:Provision of adequate opportunities for faculty to receive training in teaching skills requires persons with faculty development expertise to provide this training. PURPOSE:In this study, we examined outcomes of a teaching scholars program (TSP) aimed at promoting leaders in faculty development in teaching ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1703_8

    authors: Rosenbaum ME,Lenoch S,Ferguson KJ

    更新日期:2005-07-01 00:00:00

  • An Institutional Approach to Fostering Inclusion and Addressing Racial Bias: Implications for Diversity in Academic Medicine.

    abstract::Issue: While an increasingly diverse workforce of clinicians, researchers, and educators will be needed to address the nation's future healthcare challenges, underrepresented in medicine (UIM) perspectives remain relatively absent from academic medicine. Evidence: Prior studies have identified differential experiences...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1670665

    authors: Diaz T,Navarro JR,Chen EH

    更新日期:2020-01-01 00:00:00

  • A comprehensive medical student career development program improves medical student satisfaction with career planning.

    abstract::In 1999, the University of Michigan Medical School (UMMS) initiated a new career development program (CDP). The CDP incorporates the 4-phase career development model described by the Association of American Medical Colleges (AAMC) Careers in Medicine (CiM). The CDP offers self-assessment exercises with guidance from t...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330709336624

    authors: Zink BJ,Hammoud MM,Middleton E,Moroney D,Schigelone A

    更新日期:2007-01-01 00:00:00

  • Code status discussions: agreement between internal medicine residents and hospitalized patients.

    abstract:BACKGROUND:Medical residents frequently participate in code status discussions, yet their competency in this role has not been evaluated. PURPOSE:The objective is to determine the quality of code status discussions from the perspective of both resident and patient. METHODS:We conducted a cross-sectional survey of con...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2010.512537

    authors: Loertscher LL,Beckman TJ,Cha SS,Reed DA

    更新日期:2010-10-01 00:00:00

  • A controlled trial of team-based learning in an ambulatory medicine clerkship for medical students.

    abstract:BACKGROUND:Team-based learning (TBL) has been studied in several preclinical settings, but there is less evidence for its effectiveness in clinical curricula. PURPOSE:We compared the impact of TBL versus usual small group lecture (SGL) on knowledge objectives in a clinical clerkship. METHODS:We used an unblinded cros...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1080/10401334.2011.536888

    authors: Thomas PA,Bowen CW

    更新日期:2011-01-01 00:00:00

  • The Development and Impact of a Social Media and Professionalism Course for Medical Students.

    abstract:PROBLEM:Inappropriate social media behavior can have detrimental effects on students' future opportunities, but medical students are given little opportunity to reflect upon ways of integrating their social media identities with their newly forming professional identities. INTERVENTION:In 2012, a required educational ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1275971

    authors: Gomes AW,Butera G,Chretien KC,Kind T

    更新日期:2017-07-01 00:00:00

  • Can a brief clinical practicum influence physicians' communications with patients about alcohol and drug problems? Results of a long-term follow-up.

    abstract:BACKGROUND:A survey was conducted in 1996 to assess the perceptions of medical school graduates concerning alcohol and drug problems among their patients, and their attitudes and comfort toward addressing these issues. Survey questionnaires were sent to all individuals who graduated from Wright State University School ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1202_2

    authors: Siegal HA,Cole PA,Li L,Eddy MF

    更新日期:2000-04-01 00:00:00

  • The Action Research Program: Experiential Learning in Systems-Based Practice for First-Year Medical Students.

    abstract:PROBLEM:Systems-based practice focuses on the organization, financing, and delivery of medical services. The American Association of Medical Colleges has recommended that systems-based practice be incorporated into medical schools' curricula. However, experiential learning in systems-based practice, including practical...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1146606

    authors: Ackerman SL,Boscardin C,Karliner L,Handley MA,Cheng S,Gaither TW,Hagey J,Hennein L,Malik F,Shaw B,Trinidad N,Zahner G,Gonzales R

    更新日期:2016-01-01 00:00:00

  • Impact of group size on the effectiveness of a resuscitation simulation curriculum for medical students.

    abstract:BACKGROUND:Simulation requires involvement from participants. However, it is unknown to what extent simulation effectiveness is a function of the number of participants. PURPOSE:This study assessed the impact of varying group size on medical students' subjective experience of simulation and on postsimulation exam perf...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1080/10401334.2011.586920

    authors: Rezmer J,Begaz T,Treat R,Tews M

    更新日期:2011-07-01 00:00:00

  • Early career mentoring for translational researchers: mentee perspectives on challenges and issues.

    abstract:BACKGROUND:The education and training of early career biomedical translational researchers often involves formal mentoring by more experienced colleagues. PURPOSES:This study investigated the nature of these mentoring relationships from the perspective of mentees. The objective was to understand the challenges and iss...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2014.883983

    authors: Keller TE,Collier PJ,Blakeslee JE,Logan K,McCracken K,Morris C

    更新日期:2014-01-01 00:00:00

  • Pimping: perspectives of 4th year medical students.

    abstract:BACKGROUND:A well-known phenomenon among U.S. medical students known as pimping, or the pedagogical device of questioning students in the clinical setting, receives virtually no attention in medical literature. PURPOSE:Identifying 4th-year medical students' relevant knowledge and attitudes about pimping may help educa...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1702_14

    authors: Wear D,Kokinova M,Keck-McNulty C,Aultman J

    更新日期:2005-04-01 00:00:00

  • A controlled trial to compare the teaching quality of clinical-skills training faculty: the clinician-educator career path in China.

    abstract:BACKGROUND:Full-time clinician educators are becoming more predominant in China, yet their effect is unknown. PURPOSES:The purpose of this study was to compare the teaching quality of full-time (FT) faculty with that of part-time (PT) faculty in one Chinese medical school. METHODS:In 3 consecutive years, 881 3rd year...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1080/10401334.2014.892393

    authors: Zeng J,Zuo C,Wang Y

    更新日期:2014-01-01 00:00:00

  • Learning in a High-Stress Clinical Environment: Stressors Associated with Medical Students' Clerkship Training on Labor and Delivery.

    abstract::Phenomenon: Obstetrics and gynecology can be a high-stress clinical environment for medical students due to the specialty's fast-paced and unpredictable nature. Little is known about learning stressors for medical students on the obstetrics and gynecology clerkship to inform stress-reducing interventions and improve l...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1575742

    authors: Johnson NR,Pelletier A,Chen X,Manning-Geist BL

    更新日期:2019-08-01 00:00:00

  • Effect of a global longitudinal pathway on medical students' attitudes toward the medically indigent.

    abstract:BACKGROUND:The increase in people with insufficient health insurance has largely been fueled by a record influx of immigrants, who often live in medically underserved areas of inner cities. An increase in the desire of medical students to practice in underserved areas is needed to counter low physician-to-population ra...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1803_7

    authors: Godkin MA,Savageau JA,Fletcher KE

    更新日期:2006-07-01 00:00:00

  • The Influence of Students' Perceptions of Learning Environment on Coping with Academic Challenges: A Structural Equation Modeling Study.

    abstract::Theory: Self-compassion has been identified as a promising interventional target enabling medical learners to respond effectively to stressors and challenges of medical training. Determining factors in the learning environment that support self-compassion is critical for developing such interventions. What is already ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1667241

    authors: Rashid M,Guo Q,Babenko O

    更新日期:2020-04-01 00:00:00

  • Validity Evidence for a Residency Admissions Standardized Assessment Letter for Pediatrics.

    abstract::Construct: This study aims to provide validity evidence for the standardized Assessment Letter for Pediatrics as a measure of competencies expected of a 1st-year pediatrics resident as part of a pediatric residency admissions process. BACKGROUND:The Narrative Letter of Recommendation is a frequently used tool in the ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2017.1367297

    authors: Bajwa NM,Yudkowsky R,Belli D,Vu NV,Park YS

    更新日期:2018-04-01 00:00:00