Abstract:
:Construct: Valid score interpretation is important for constructs in performance assessments such as objective structured clinical examinations (OSCEs). An OSCE is a type of performance assessment in which a series of standardized patients interact with the student or candidate who is scored by either the standardized patient or a physician examiner. BACKGROUND:In high-stakes examinations, test security is an important issue. Students accessing unauthorized test materials can create an unfair advantage and lead to examination scores that do not reflect students' true ability level. The purpose of this study was to assess the impact of various simulated security breaches on OSCE scores. APPROACH:Seventy-six 3rd-year medical students participated in an 8-station OSCE and were randomized to either a control group or to 1 of 2 experimental conditions simulating test security breaches: station topic (i.e., providing a list of station topics prior to the examination) or egregious security breach (i.e., providing detailed content information prior to the examination). Overall total scores were compared for the 3 groups using both a one-way between-subjects analysis of variance and a repeated measure analysis of variance to compare the checklist, rating scales, and oral question subscores across the three conditions. RESULTS:Overall total scores were highest for the egregious security breach condition (81.8%), followed by the station topic condition (73.6%), and they were lowest for the control group (67.4%). This trend was also found with checklist subscores only (79.1%, 64.9%, and 60.3%, respectively for the security breach, station topic, and control conditions). Rating scale subscores were higher for both the station topic and egregious security breach conditions compared to the control group (82.6%, 83.1%, and 77.6%, respectively). Oral question subscores were significantly higher for the egregious security breach condition (88.8%) followed by the station topic condition (64.3%), and they were the lowest for the control group (48.6%). CONCLUSIONS:This simulation of different OSCE security breaches demonstrated that student performance is greatly advantaged by having prior access to test materials. This has important implications for medical educators as they develop policies and procedures regarding the safeguarding and reuse of test content.
journal_name
Teach Learn Medjournal_title
Teaching and learning in medicineauthors
Gotzmann A,De Champlain A,Homayra F,Fotheringham A,de Vries I,Forgie M,Pugh Ddoi
10.1080/10401334.2016.1202832subject
Has Abstractpub_date
2017-01-01 00:00:00pages
52-58issue
1eissn
1040-1334issn
1532-8015journal_volume
29pub_type
杂志文章,随机对照试验abstract:PROBLEM:Clinical procedural skills are formally taught to medical students in clinical skills centers using mannequins. Exposure to procedural skills involving patients and opportunities to practice under the supervision of doctors are limited. INTERVENTION:A bedside supervision program was piloted at a district gener...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2015.1077130
更新日期:2015-01-01 00:00:00
abstract:BACKGROUND:A well-known phenomenon among U.S. medical students known as pimping, or the pedagogical device of questioning students in the clinical setting, receives virtually no attention in medical literature. PURPOSE:Identifying 4th-year medical students' relevant knowledge and attitudes about pimping may help educa...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1207/s15328015tlm1702_14
更新日期:2005-04-01 00:00:00
abstract:UNLABELLED:CONSTRUCT: Authentic standard setting methods will demonstrate high convergent validity evidence of their outcomes, that is, cutoff scores and pass/fail decisions, with most other methods when compared with each other. BACKGROUND:The objective structured clinical examination (OSCE) was established for valid...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2015.1044749
更新日期:2015-01-01 00:00:00
abstract::Construct: The McMaster Modular Assessment Program (McMAP) is a programmatic workplace-based assessment (WBA) system that provides emergency medicine trainees with competency judgments through frequent task-specific and global daily assessments. Background: The longevity of McMAP relative to other programmatic WBA sys...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2019.1574581
更新日期:2019-08-01 00:00:00
abstract:PROBLEM:Longitudinal patient contacts are being implemented worldwide as a way to enhance a patient-centered orientation among medical students. In large medical schools, longitudinal integrated clerkships may not be feasible, so other ways must be sought to expose students to prolonged contact with patients. INTERVEN...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2018.1524330
更新日期:2019-04-01 00:00:00
abstract:BACKGROUND:Concept maps can assist learning by integrating new information with existing cognitive structure to facilitate meaningful understanding. The benefits of testable concept maps to illustrate cause-and-effect sequences in the pathogenesis of disease have not yet been determined. PURPOSE:A controlled trial was...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2011.561700
更新日期:2011-04-01 00:00:00
abstract:BACKGROUND:Developing effective transformational leaders is essential for a diverse and complex academic medical system. The purpose of this study is to elicit faculty perspectives on their leadership skills before and after participation in a Leadership in Academic Medicine (LAM) Program. SUMMARY:The two-part study c...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2011.611773
更新日期:2011-10-01 00:00:00
abstract:BACKGROUND:Although medical school typically lasts 4 years, little attention has been devoted to the structure of the educational experience that takes place during the final year of medical school. SUMMARY:In this perspectives paper, we outline goals for the 4th year of medical school to facilitate a transition from ...
journal_title:Teaching and learning in medicine
pub_type: 社论
doi:10.1080/10401334.2014.945027
更新日期:2014-01-01 00:00:00
abstract:BACKGROUND:Provision of adequate opportunities for faculty to receive training in teaching skills requires persons with faculty development expertise to provide this training. PURPOSE:In this study, we examined outcomes of a teaching scholars program (TSP) aimed at promoting leaders in faculty development in teaching ...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1207/s15328015tlm1703_8
更新日期:2005-07-01 00:00:00
abstract:PROBLEM:Point-of-care ultrasound has been a novel addition to undergraduate medical education at a few medical schools. The impact is not fully understood, and few rigorous assessments of educational outcomes exist. This study assessed the impact of a point-of-care ultrasound curriculum on image acquisition, interpreta...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2016.1172012
更新日期:2017-01-01 00:00:00
abstract::Phenomenon: With scholarly collaborations come questions about the order of authorship. Authorship order is an important consideration because it often used as an indicator of seniority, expertise, leadership, and scholarly productivity. As a result, authorship order factors into decisions about hiring, salary, resour...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2018.1533836
更新日期:2019-06-01 00:00:00
abstract:BACKGROUND:Studies have shown that medical student attitudes decline as students progress through school. Controversy persists about the meaning and generalizability of these findings because studies have not been longitudinal and many were conducted prior to an influx of female students. Much of medical education occu...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1207/s15328015tlm0904_2
更新日期:1997-01-01 00:00:00
abstract::Phenomenon: An increasing number of refugees in recent years has led to changes in healthcare delivery. Historically, health care providers did not receive systematic and longitudinal training in refugee health. There is increasing interest among educators in developing educational opportunities for medical students t...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2020.1779071
更新日期:2020-10-01 00:00:00
abstract::Construct: The purpose of this study was to provide initial evidence of the validity of written case summaries as assessments of clinical problem representation in a classroom setting. BACKGROUND:To solve clinical problems, clinicians must gain a clear representation of the issues. In the clinical setting, oral case ...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2016.1190730
更新日期:2016-10-01 00:00:00
abstract:BACKGROUND:We administered selected scales from the Cognitive Behavior Survey, Attitudes Toward Social Issues in Medicine survey, and Learning Environment Questionnaire. We gathered data from other medical schools to put our results into context. PURPOSE:To present results on these scales from our own and other medica...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1207/s15328015tlm1604_6
更新日期:2004-10-01 00:00:00
abstract:BACKGROUND:A systematized approach to descriptive evaluation of clinical performance using a vocabulary of global descriptors in the setting of formal evaluation and feedback sessions has been shown to be reliable and valid. The feasibility of this method beyond the institution at which it was developed has not been st...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1207/S15328015TLM1401_3
更新日期:2002-01-01 00:00:00
abstract:BACKGROUND:The Accreditation Council on Graduate Medical Education (ACGME) Outcomes Project has endorsed the in-training examination (ITE) as an example of a multiple-choice question examination that is a valid measure of a resident's attainment of medical knowledge. An outcome measure for performance on the ITE would ...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401330801991642
更新日期:2008-04-01 00:00:00
abstract:BACKGROUND:Accreditation and Institute of Medicine mandates require retooling of graduate medical education curriculum and assessment processes. This Objective Structured Clinical Exam (OSCE) focused on patient safety-specific skills important to stakeholders from multiple institutions. PURPOSES:A 10-station OSCE was ...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401330802573837
更新日期:2009-01-01 00:00:00
abstract::Phenomenon: This scoping literature review summarizes current Canadian health science education and training aimed to lessen health gaps between Aboriginal and non-Aboriginal peoples. APPROACH:Keyword searches of peer-reviewed and gray literature databases, websites, and resources recommended by local Aboriginal comm...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章,评审
doi:10.1080/10401334.2016.1234960
更新日期:2017-04-01 00:00:00
abstract:BACKGROUND:Studies indicate that practicing clinicians do not employ quantitative techniques in diagnosis. If evidence-based approaches to clinical care are to succeed, there is a need to develop pedagogical tools to introduce the relevant techniques in clinical medicine. DESCRIPTION:This article describes 2 heuristic...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1207/S15328015TLM1203_4
更新日期:2000-07-01 00:00:00
abstract:BACKGROUND:The Personal Qualities Assessment (PQA), developed by the University of Newcastle, Australia to assess the aptitude of future medical professionals, has been used in Western countries. PURPOSES:The objective was to investigate whether the PQA is appropriate for Japanese medical school applicants. METHODS:T...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2014.945029
更新日期:2014-01-01 00:00:00
abstract:BACKGROUND:Computer-based learning has gained widespread acceptance in medical curricula, but can it replace faculty-led teaching. PURPOSE:To investigate the effectiveness of independent computer-based learning of pulmonary auscultation alone and in combination with faculty-led teaching. METHODS:The first method invo...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1207/s15328015tlm1601_6
更新日期:2004-01-01 00:00:00
abstract:BACKGROUND:Aiming to inform curriculum changes in medical school, we developed, administered, and validated a 31-question survey to measure the learning environment as perceived by medical students. DESCRIPTION:We administered the survey annually in 4 medical school classes in a Southeastern medical school from May 19...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1207/S15328015TLM1204_7
更新日期:2000-10-01 00:00:00
abstract::Theory: Self-compassion has been identified as a promising interventional target enabling medical learners to respond effectively to stressors and challenges of medical training. Determining factors in the learning environment that support self-compassion is critical for developing such interventions. What is already ...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2019.1667241
更新日期:2020-04-01 00:00:00
abstract::Issue: While an increasingly diverse workforce of clinicians, researchers, and educators will be needed to address the nation's future healthcare challenges, underrepresented in medicine (UIM) perspectives remain relatively absent from academic medicine. Evidence: Prior studies have identified differential experiences...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2019.1670665
更新日期:2020-01-01 00:00:00
abstract:BACKGROUND:In 2001, the Keck School of Medicine of the University of Southern California initiated a major curriculum reform with fully integrated teaching of the basic sciences. DESCRIPTION:The new curriculum integrated a set of selected clinical cases called the student practice profile (SPP). The SPP cases were des...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2010.512834
更新日期:2010-10-01 00:00:00
abstract:BACKGROUND:Although the literary arts initiated the movement to include the humanities in medical education, little is known about the incorporation of other art forms. PURPOSE:A study was designed to determine the variety of arts-related activities in U.S. medical schools. METHODS:Questionnaires were mailed twice to...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1207/S15328015TLM1404_11
更新日期:2002-10-01 00:00:00
abstract:BACKGROUND:Residency programs must prepare physicians to practice in the current health care environment. This mandate is reflected in 3 of the 6 competency domains now required by the Accreditation Council for Graduate Medical Education: systems-based practice, interpersonal skills and communication, and practice-base...
journal_title:Teaching and learning in medicine
pub_type: 共识发展会议,杂志文章,评审
doi:10.1207/s15328015tlm1601_16
更新日期:2004-01-01 00:00:00
abstract:BACKGROUND:The ability to accurately interpret electrocardiogram (ECG) abnormalities is a core competency for graduating medical students (GMS). Incorrect interpretation of ECG findings can result in adverse patient outcomes. To our knowledge, there has been no published study evaluating the level of competency in ECG ...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401334.2014.918882
更新日期:2014-01-01 00:00:00
abstract:BACKGROUND:The Systems-Based Practice competency expanded the scope of graduate medical education. Innovative approaches are needed to teach this material. PURPOSE:We have designed and implemented a rotation in Systems-Based Practice focused on the interrelationships of patient care, clinical revenue, and the physicia...
journal_title:Teaching and learning in medicine
pub_type: 杂志文章
doi:10.1080/10401330701332201
更新日期:2007-04-01 00:00:00