Development of a modified Cohen method of standard setting.

Abstract:

BACKGROUND:A new 'Cohen' approach to standard setting was recently described where the pass mark is calculated as 60% of the score of the student at the 95th percentile, after correcting for guessing. AIM:This article considers how two potential criticisms of the Cohen method can be addressed and proposes a modified version, with the assumptions tested using local data. METHODS:The modified version removes the correction for guessing and uses the score of the 90th, rather than the 95th percentile student as the reference point, based on the cumulative density functions for 32 modules from one medical school; and incorporates an indirect criterion-referenced passing standard by changing the 60% multiplier to the ratio of the cut score to the score of the student at the 90th percentile on exams that have been standard set using modified Angoff. RESULTS:The assumption that the performance of the 90th percentile student is consistent over time holds for multiple choice questions. Applying the modified Cohen method to the 32 modules generally reduced the variation in failure rate across modules, compared to a fixed pass mark of 50%. CONCLUSION:The results suggest that the modified Cohen method holds much promise as an economical approach to standard setting.

journal_name

Med Teach

journal_title

Medical teacher

authors

Taylor CA

doi

10.3109/0142159X.2011.611192

subject

Has Abstract

pub_date

2011-01-01 00:00:00

pages

e678-82

issue

12

eissn

0142-159X

issn

1466-187X

journal_volume

33

pub_type

杂志文章
  • Relations between background, process and outcome in the first semester of a new, problem-based medical curriculum.

    abstract::The authors investigated the relations between students' background (gender, age, study experience), learning process (learning approach, independent study time) and outcome (examination results, satisfaction) in the first semester of a new, integrated undergraduate medical curriculum, combining PBL and conventional l...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159021000012930

    authors: Wyller VB,Wyller TB

    更新日期:2002-09-01 00:00:00

  • Medical students' attitudes towards disability and support for disability in medicine.

    abstract:BACKGROUND:The number of medical students disclosing a disability is lower than the number of disabled doctors. AIMS:This study aimed to examine rates and types of disability in medical students, whether students disclosed this disability and their support needs, and, if not, possible reasons for non-disclosure. METH...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590802516814

    authors: Miller S,Ross S,Cleland J

    更新日期:2009-06-01 00:00:00

  • Educating clinical educators: using a model of the experience of being a clinical educator.

    abstract:BACKGROUND:Clinical educators are expected to prepare students to be competent beginning practitioners, ready to enter the workforce and meet the demands of competent practice. As part of ensuring the quality of clinical education, universities that provide these programs need to be involved in the education and suppor...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590601046088

    authors: Higgs J,McAllister L

    更新日期:2007-03-01 00:00:00

  • General surgical interns contributing to the clerkship learning environment of medical students.

    abstract:BACKGROUND:Junior doctors are increasingly promoted as clinical teachers but there is limited understanding of how they contribute to medical student clerkship learning. AIM:To describe contributions made by general surgical interns to the student clerkship learning environment. METHODS:The mixed-methods study involv...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.801550

    authors: Yu TC,Lemanu DP,Henning M,Maccormick AD,Hawken SJ,Hill AG

    更新日期:2013-08-01 00:00:00

  • An innovative outcomes-based medical education program built on adult learning principles.

    abstract::An innovative medical curriculum at the University of New South Wales (UNSW) has been developed through a highly collaborative process aimed at building faculty ownership and ongoing sustainability. The result is a novel capability-based program that features early clinical experience and small-group teaching, which o...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590600834229

    authors: McNeil HP,Hughes CS,Toohey SM,Dowton SB

    更新日期:2006-09-01 00:00:00

  • An investigation into the use of multi-source feedback (MSF) as a work-based assessment tool.

    abstract:INTRODUCTION:This study compared Specialist Trainees' (STs) hand-selected multi-source feedback (MSF) scores with those made by their clinical supervisors and explored perceptions of both those being assessed and those assessing. METHODS:Participating STs were asked to hand a mini-PAT questionnaire to a clinical colle...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.909920

    authors: Brown JM,Lowe K,Fillingham J,Murphy PN,Bamforth M,Shaw NJ

    更新日期:2014-11-01 00:00:00

  • How to develop a competency-based examination blueprint for longitudinal standardized patient clinical skills assessments.

    abstract:BACKGROUND:Objective Structured Clinical Exams (OSCEs) with standardized patients (SPs) are commonly used in medical education to assess learners' clinical skills. However, assessments are often discrete rather than intentionally developmentally sequenced. AIMS:We developed an examination blueprint to optimize assessm...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.809408

    authors: Mookherjee S,Chang A,Boscardin CK,Hauer KE

    更新日期:2013-11-01 00:00:00

  • Putting theory into practice - a case study in one UK medical school of the nature and extent of unprofessional behaviour over a 6-year period.

    abstract:BACKGROUND:Producing a medical profession which is fit for the demands and expectations of society involves ensuring that practitioners learn what it means to behave in a 'professional' way. Codes of professional conduct have been developed for medical students in the UK, but the literature on how medical schools actua...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421591003698018

    authors: Howe A,Miles S,Wright S,Leinster S

    更新日期:2010-01-01 00:00:00

  • Embracing the new paradigm of assessment in residency training: an assessment programme for first-year residency training in anaesthesiology.

    abstract::Assessment of clinical competence is facing a paradigm shift in more than one sense. The shift relates to test content, which increasingly covers a broader spectrum of competences than mere medical expertise, and to test methods, with an increasing focus on testing performance in realistic settings. Also there is a sh...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159021000061431

    authors: Ringsted C,Østergaard D,Scherpbier A

    更新日期:2003-01-01 00:00:00

  • Fitting it all in: integration of 12 cross-cutting themes into a School of Medicine curriculum.

    abstract::Changing demographic, social, economic and technological trends have impacted the expectations of the Academic Health Center in preparing physicians to serve the needs of the American society, resulting in revisions to current curricula. In addition to the traditional basic sciences and clinical disciplines, accredite...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701288564

    authors: Kitzes JA,Savich RD,Kalishman S,Sander JC,Prasad A,Morris CR,Timm C

    更新日期:2007-06-01 00:00:00

  • Student perceptions about the occurrence of critical incidents in tutorial groups.

    abstract::The study reported here examines student perceptions about the occurrence of critical incidents in tutorial groups across years of medical training. The study investigates the following research questions. (1) Which factors underlie the occurrence of critical incidents in the tutorial group? (2) How do students rate t...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159002005596

    authors: de Grave WS,Dolmans DH,van Der Vleuten CP

    更新日期:2001-01-01 00:00:00

  • Basic psychological needs, more than mindfulness and resilience, relate to medical student stress: A case for shifting the focus of wellness curricula.

    abstract:PURPOSE:Medical student distress is an increasing concern in medical education. Addressing this issue requires a comprehensive understanding of what factors influence learners' stress in medical school. Grounded in Self-Determination Theory (SDT), this study explores the relative association between medical students' m...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2020.1813876

    authors: Neufeld A,Mossière A,Malin G

    更新日期:2020-12-01 00:00:00

  • Technology and the delivery of the curriculum of the future: opportunities and challenges.

    abstract::There is increasing availability of a wide range of technology that has the potential to support and enhance the curriculum of the future. Learners expect to use technology for their learning, but this requires the development of information and digital literacy skills to maximise the potential learning opportunities....

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2012.671560

    authors: Sandars J

    更新日期:2012-01-01 00:00:00

  • The clinical skills experience of rural immersion medical students and traditional hospital placement students: a student perspective.

    abstract:BACKGROUND:Recent decades have seen an international trend for the development of undergraduate medical programmes in rural locations. These have been considered educationally equivalent alternatives to traditional hospital-based programmes. A pilot Rural Medical Immersion Programme (RMIP) was launched at the Universit...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2011.586745

    authors: Rudland J,Tordoff R,Reid J,Farry P

    更新日期:2011-01-01 00:00:00

  • Problem-based curriculum: outcome evaluation.

    abstract::The College of Medicine and Medical Sciences of the Arabian Gulf University (CMMS-AGU) in Bahrain is, in its innovativeness, unique in the region in that a problem-based strategy is used in the planning and implementation of the curriculum. The first batch of graduates have completed their internship programme in the ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421599109089905

    authors: al-Haddad MK,Jayawickramarajah PT

    更新日期:1991-01-01 00:00:00

  • Aligning physical learning spaces with the curriculum: AMEE Guide No. 107.

    abstract::This Guide explores emerging issues on the alignment of learning spaces with the changing curriculum in medical education. As technology and new teaching methods have altered the nature of learning in medical education, it is necessary to re-think how physical learning spaces are aligned with the curriculum. The bette...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2016.1147541

    authors: Nordquist J,Sundberg K,Laing A

    更新日期:2016-08-01 00:00:00

  • Use of unannounced spaced telephone testing to improve retention of knowledge after life-support courses.

    abstract:BACKGROUND:Life-support courses improve knowledge and skills but attrition of factual knowledge is considerable. There is evidence that retention can be improved by spaced testing. AIM:To investigate the effect of spaced testing on retention of knowledge after a life-support course. METHOD:In a prospective-controlled...

    journal_title:Medical teacher

    pub_type: 杂志文章,随机对照试验

    doi:10.3109/0142159X.2010.542521

    authors: Turner NM,Scheffer R,Custers E,Cate OT

    更新日期:2011-01-01 00:00:00

  • Reform of a traditional clinical curriculum in Japan: experiences at Tokyo Medical and Dental University.

    abstract:BACKGROUND:Until recently, Japanese legislative guidelines dictated that undergraduate clinical training consisted of students' observations of clinicians' work. In 2006, Tokyo Medical and Dental University initiated a reform of their traditional undergraduate clinical curriculum. The reform integrated students into pa...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421590902799302

    authors: Farrell SE,Takada K,Armstrong EG,Tanaka Y,Aretz HT

    更新日期:2009-10-01 00:00:00

  • Can students adequately evaluate the activities of their peers in PBL?

    abstract:BACKGROUND:In problem-based learning (PBL), high-quality discussions are crucial for student learning. The quality of the discussion is affected by the quality of the contributions students make during PBL tutorials. AIM:This study investigated whether students are able to evaluate the activities of their peers in PBL...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2010.509766

    authors: Kamp RJ,Dolmans DH,Van Berkel HJ,Schmidt HG

    更新日期:2011-01-01 00:00:00

  • Creation of an interprofessional clinical experience for healthcare professions trainees in a nursing home setting.

    abstract::Successful interprofessional teams are essential when caring for older adults with multiple complex medical conditions that require ongoing management from a variety of disciplines across healthcare settings. To successfully integrate interprofessional education into the healthcare professions curriculum, the most eff...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2013.787138

    authors: Ford CR,Foley KT,Ritchie CS,Sheppard K,Sawyer P,Swanson M,Harada CN,Brown CJ

    更新日期:2013-07-01 00:00:00

  • An evaluation of the cost of designing, delivering and assessing an undergraduate communication skills module.

    abstract::Communication skills courses are considered expensive to run in terms of time, human resource and finance. This paper reports on the financial cost of designing, delivering and assessing a communication skills module delivered to fifth-year medical students. Costs are classified into three categories: personnel, stand...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590400005475

    authors: Kelly M,Murphy A

    更新日期:2004-11-01 00:00:00

  • A mixed-methods evaluation of a multidisciplinary point of care ultrasound program.

    abstract:BACKGROUND:Point of Care Ultrasound (PoCUS) is well established within emergency medicine, however, the availability of formal training for other clinical disciplines is limited. Memorial University has established a cost-efficient, multidisciplinary PoCUS training program focusing on training residents' discipline-spe...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/0142159X.2018.1461202

    authors: Smith A,Parsons M,Renouf T,Boyd S,Rogers P

    更新日期:2019-02-01 00:00:00

  • Nursing-using the nursing process.

    abstract::It has often been pointed out that the real problem of nurse numbers is not the failure to recruit or to recruit appropriately, but to retain nurses once they have started. The indications are that where the nursing process approach is used in practice as well as taught, nurses (both learners and trained staff) derive...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/01421598109064461

    authors: Ashworth PM,Castledine G

    更新日期:1981-01-01 00:00:00

  • Twelve tips for addressing medical student and resident physician lapses in professionalism.

    abstract::Medical educators have gained significant ground in the practical and scholarly approach to professionalism. When a lapse occurs, thoughtful remediation to address the underlying issue can have a positive impact on medical students and resident physicians, while failure to address lapses, or to do so ineffectively, ca...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2014.1001730

    authors: Rougas S,Gentilesco B,Green E,Flores L

    更新日期:2015-01-01 00:00:00

  • Educational Commission for Foreign Medical Graduates: clinical skills assessment prototype.

    abstract::The Clinical Skills Assessment is an OSCE-based performance examination that is now the final test requirement for Educational Commission for Foreign Medical Graduates certification of graduates of foreign medical schools. Its design, test development and scoring methodologies are presented, as are the processes used ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421599979789

    authors: Whelan GP

    更新日期:1999-01-01 00:00:00

  • PBL curriculum improves medical students' participation in small-group tutorials.

    abstract:BACKGROUND:Group learning is the core of problem-based learning (PBL) but has not been extensively studied, especially in Asian students. METHODS:This study compared students of PBL and non-PBL curricula in students' talking time and participation in small-group tutorials in a medical school in Asia. The proportions o...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701294349

    authors: Wun YT,Tse EY,Lam TP,Lam CL

    更新日期:2007-09-01 00:00:00

  • Communication skills, cultural challenges and individual support: challenges of international medical graduates in a Canadian healthcare environment.

    abstract::Physicians require good communication skills to develop effective patient-physician relationships. Externally funded international medical graduates (IMGs) move directly from their home countries to complete residency training at the University of Ottawa, Canada. They must learn quickly how to work with patients, fami...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590310001653982

    authors: Hall P,Keely E,Dojeiji S,Byszewski A,Marks M

    更新日期:2004-03-01 00:00:00

  • Attributes of effective community preceptors for pre-clerkship medical students.

    abstract:BACKGROUND:Attributes of effective precepting of pre-clerkship medical students in community settings are not adequately described. As part of preceptor needs assessment, we conducted site visits over three consecutive years. We also measured the preceptorships' educational quality, using students' post-rotation data, ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590802139765

    authors: Lie D,Boker J,Dow E,Murata P,Encinas J,Gutierrez D,Morrison EH

    更新日期:2009-03-01 00:00:00

  • The CanMEDS initiative: implementing an outcomes-based framework of physician competencies.

    abstract:BACKGROUND:Outcomes-based education in the health professions has emerged as a priority for curriculum planners striving to align with societal needs. However, many struggle with effective methods of implementing such an approach. In this narrative, we describe the lessons learned from the implementation of a national,...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.1080/01421590701746983

    authors: Frank JR,Danoff D

    更新日期:2007-09-01 00:00:00

  • Assessing self-regulatory processes during clinical skill performance: a pilot study.

    abstract:BACKGROUND:Self-regulated learning (SRL) is a cyclical process involving the proactive use of strategies and feedback to optimise performance. Previous research has used SRL microanalysis to assess and inform the training of athletic skills but there has been no previous research in clinical contexts. AIMS:The aim of ...

    journal_title:Medical teacher

    pub_type: 杂志文章

    doi:10.3109/0142159X.2011.577464

    authors: Cleary TJ,Sandars J

    更新日期:2011-01-01 00:00:00