Setting standards on educational tests.

Abstract:

OBJECTIVE:This instalment in the series on professional assessment provides an introduction to methods of setting standards. METHOD:A standard is a special score that serves as a boundary between those who perform well enough and those who do not. The practical steps in selecting it include: deciding on the type of standard; deciding the method for setting it; selecting the judges; holding the meeting; calculating the cutpoint, and deciding what to do afterwards. Four of the more popular methods are illustrated for both written and clinical examinations. RESULTS:The most important criteria for selecting a method for setting standards are whether it is consistent with the purpose of the test, based on expert judgement, informed by data, supported by research, transparent, and requires due diligence. The credibility of the standard will rely largely on the nature of the standard setters and the selection of a broadly representative and knowledgeable group is essential. After the standard has been set, it is important to ensure that stakeholders view the results as credible and that the pass rates have sensible relationships with other markers of competence. CONCLUSIONS:A standard is an expression of professional values in the context of a test's purpose and content, the ability of the examinees, and the wider social or educational setting. Because standards are an expression of values, methods for setting them are systematic ways of gathering value judgements, reaching consensus and expressing that consensus as a single score on a test.

journal_name

Med Educ

journal_title

Medical education

authors

Norcini JJ

doi

10.1046/j.1365-2923.2003.01495.x

keywords:

subject

Has Abstract

pub_date

2003-05-01 00:00:00

pages

464-9

issue

5

eissn

0308-0110

issn

1365-2923

pii

1495

journal_volume

37

pub_type

杂志文章
  • A systematic review of assessment and intervention strategies for effective clinical communication in culturally and linguistically diverse students.

    abstract:OBJECTIVE:Culturally and linguistically diverse (CALD) students often experience difficulties with the clinical communication skills that are essential for successful interactions in the workplace. However, there is little evidence on the effectiveness of assessment and intervention strategies for this population. The ...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/medu.13117

    authors: Chan A,Purcell A,Power E

    更新日期:2016-09-01 00:00:00

  • Predicting performance: relative importance of students' background and past performance.

    abstract:CONTEXT:Despite evidence for the predictive value of both pre-admission characteristics and past performance at medical school, their relative contribution to predicting medical school performance has not been thoroughly investigated. OBJECTIVES:This study was designed to determine the relative importance of pre-admis...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12779

    authors: Stegers-Jager KM,Themmen AP,Cohen-Schotanus J,Steyerberg EW

    更新日期:2015-09-01 00:00:00

  • Second-year medical students' motivational beliefs, emotions, and achievement.

    abstract:CONTEXT:A challenge for medical educators is to better understand the personal factors that lead to individual success in medical school and beyond. Recently, educational researchers in fields outside medicine have acknowledged the importance of motivation and emotion in students' learning and performance. These affect...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2010.03712.x

    authors: Artino AR,La Rochelle JS,Durning SJ

    更新日期:2010-12-01 00:00:00

  • Medical specialization in Europe: the way forward. Promotion of educational quality.

    abstract::The medical specialties are being intensively reconsidered in the countries of Europe. The important need is for promoting improvement of educational training programmes. Evaluation and improvement of specialist training programmes is the priority and not the setting up of qualifying examinations. The first necessity ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00274.x

    authors: Karle H,Nystrup J,Walton H

    更新日期:1993-07-01 00:00:00

  • Comparison of medical and non-medical student attitudes to social issues in medicine.

    abstract::A 63-item questionnaire on attitudes to psychosocial issues in medicine was administered to final-year students in the Faculties of Medicine (n = 104), Pharmacy (n = 57) and Arts and Social Sciences (n = 75) of the University of Benin. The responses given were analysed by the summation and Cornell scalogram techniques...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1995.tb02848.x

    authors: Nnodim JO,Osuji CU

    更新日期:1995-07-01 00:00:00

  • The mixed impact of medical school on medical students' implicit and explicit weight bias.

    abstract:CONTEXT:Health care trainees demonstrate implicit (automatic, unconscious) and explicit (conscious) bias against people from stigmatised and marginalised social groups, which can negatively influence communication and decision making. Medical schools are well positioned to intervene and reduce bias in new physicians. ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12770

    authors: Phelan SM,Puhl RM,Burke SE,Hardeman R,Dovidio JF,Nelson DB,Przedworski J,Burgess DJ,Perry S,Yeazel MW,van Ryn M

    更新日期:2015-10-01 00:00:00

  • Preparedness is not enough: understanding transitions as critically intensive learning periods.

    abstract:OBJECTIVES:Doctors make many transitions whilst they are training and throughout their ensuing careers. Despite studies showing that transitions in other high-risk professions such as aviation have been linked to increased risk in the form of adverse outcomes, the effects of changes on doctors' performance and conseque...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2011.04048.x

    authors: Kilminster S,Zukas M,Quinton N,Roberts T

    更新日期:2011-10-01 00:00:00

  • Medical education for minorities at a US medical school.

    abstract::The University of Washington School of Medicine (UWSM) has initiated new efforts to build a regional minority applicant pool and to expand its educational programmes to accommodate students from disadvantaged backgrounds. Specific interventions include: establishment of medical career planner position to coordinate re...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1988.tb00760.x

    authors: Yergan J,Phillips TJ,Schaad DC,May A,Drickey R,Yerby MS

    更新日期:1988-07-01 00:00:00

  • The impact of an individual tutorial session on MEDLINE use among obstetrics and gynaecology residents in an academic training programme: a randomized trial.

    abstract::Over the past decade, on-line databases have become increasingly popular among health care professionals. As a group, these 'end-users' report utilizing databases to keep abreast of medical progress, to conduct research and to address specific patient care issues. Throughout the literature, medical professionals ('con...

    journal_title:Medical education

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1046/j.1365-2923.1998.00229.x

    authors: Erickson S,Warner ER

    更新日期:1998-05-01 00:00:00

  • Responding to the implications of the genetics revolution for the education and training of doctors: a medical humanities approach.

    abstract:BACKGROUND:Rapid advances in the field of genetics continue to present medical educators with significant challenges. Whilst there is undoubtedly a pressing need to educate doctors about genetic disorders, research and therapies, there is a parallel need to provide a context for all of these. CONTENT:An interdisciplin...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2003.01433.x

    authors: Kirklin D

    更新日期:2003-02-01 00:00:00

  • Problems of comprehension of medical education vocabulary.

    abstract::Medical teachers' understanding of the vocabulary of medical education has been studied by asking a group of medical teachers whether they understood twenty-two commonly used and important medical educational terms, and whether they could distinguish between the terms. All the words presented some problem of comprehen...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1981.tb02640.x

    authors: Barker VF,Harden RM

    更新日期:1981-07-01 00:00:00

  • Critical performance analysis of rotating resident doctors in Iraq.

    abstract::The present study was undertaken to evaluate the competence of rotating residents in handling clinical problems, falling under the purview of the major clinical disciplines, which they come across during their routine work. Three hundred and one rotating residents (55% of the total) who graduated in June 1981 from the...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1983.tb01124.x

    authors: Al-Chalabi TS,Al-Na'ama MR,Al-Thamery DM,Alkafajei AM,Mustafa GY,Joseph G,Sugathan TN

    更新日期:1983-11-01 00:00:00

  • Medical students as standardized patients to assess interviewing skills for pain evaluation.

    abstract:PURPOSE:The use of medical students as standardized patients in a performance assessment of pain evaluation was studied. METHODS:Fifty-two pairs of second-year medical students participated. One student portrayed a patient presenting with cancer pain and was interviewed by the other medical student. The student-patien...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2002.01070.x

    authors: Mavis BE,Ogle KS,Lovell KL,Madden LM

    更新日期:2002-02-01 00:00:00

  • Dimensions, discourses and differences: trainees conceptualising health care leadership and followership.

    abstract:CONTEXT:As doctors in all specialties are expected to undertake leadership within health care organisations, leadership development has become an inherent part of medical education. Whereas the leadership literature within medical education remains mostly focused on individual, hierarchical leadership, contemporary the...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12832

    authors: Gordon LJ,Rees CE,Ker JS,Cleland J

    更新日期:2015-12-01 00:00:00

  • Advanced training in general practice in the UK for overseas postgraduates.

    abstract::The strengths of general practice in the UK as a training environment for overseas doctors intending to implement the World Health Organization strategy 'Health for All by the Year 2000' in primary care are identified. A course of advanced training for teachers and administrators of primary care is described and evalu...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1991.tb00027.x

    authors: al-Bashir M,Bundred PE,Stanley IM

    更新日期:1991-01-01 00:00:00

  • An exploration of the attitudes, personality and performance of dental students.

    abstract::This study investigates (1) the behavioural patterns, performance and attitudes to dentistry and (2) the personality traits, in male and female dental students (n = 219) studying at Cardiff Dental School. The first part deals with the results of a questionnaire investigating aspects of the students' training course, i...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1985.tb01313.x

    authors: Reeve PE,Watson CJ

    更新日期:1985-05-01 00:00:00

  • Length of in-patient stay in teaching hospitals in Japan.

    abstract::The average length of in-patient stay (LOS) in Japan is longer than that of the other Organization for Economic Cooperation and Development (OECD) countries. The tendency towards long LOS is also apparent in teaching hospitals in Japan. This paper examines factors responsible for the long LOS in teaching hospitals, fo...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00269.x

    authors: Yamaoka K,Kobayashi Y,Yano E

    更新日期:1993-05-01 00:00:00

  • Integrating human factors into the medical curriculum.

    abstract:BACKGROUND:The study of human factors is a scientific discipline that deals with the interactions between human beings and the elements of a system. This is important because shortcomings in these areas, if unchecked, can result in adverse outcomes. Research into human factors in industries where safety is paramount ha...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.37.s1.5.x

    authors: Glavin RJ,Maran NJ

    更新日期:2003-11-01 00:00:00

  • Resident doctors' understanding of their roles as clinical teachers.

    abstract:INTRODUCTION:Limited data illuminate how resident doctors view their important roles as teachers, supervisors and role models. Analysing qualitative data about resident teachers' self-perceptions can offer helpful insights. METHODS:One year after a randomised trial of a residents-as-teachers curriculum at a university...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2004.02063.x

    authors: Morrison EH,Shapiro JF,Harthill M

    更新日期:2005-02-01 00:00:00

  • Misunderstandings: a qualitative study of primary care consultations in multilingual settings, and educational implications.

    abstract:BACKGROUND:Patients in inner-city areas come from increasingly diverse language and cultural backgrounds. Neither communications training modelled on local English speakers nor the provision of interpreters offer adequate solutions. AIM:To identify how patients with limited English and culturally different communicati...

    journal_title:Medical education

    pub_type: 杂志文章,多中心研究

    doi:10.1111/j.1365-2929.2005.02121.x

    authors: Roberts C,Moss B,Wass V,Sarangi S,Jones R

    更新日期:2005-05-01 00:00:00

  • A communication skills course for preclinical students: evaluation of general practice based teaching using group methods.

    abstract::Teaching preclinical medical students about doctor-patient communication gives them an opportunity to develop their interviewing skills prior to their having to elicit lists of symptoms in their clinical years. General practitioners should be among the more efficient interviewers in clinical medicine and therefore abl...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1993.tb00259.x

    authors: Kendrick T,Freeling P

    更新日期:1993-05-01 00:00:00

  • Continuity of supervision: Does it mean what we think it means?

    abstract:CONTEXT:Continuity of supervision (CoS) is generally accepted as an important element of competency-based medical education (CBME). However, collecting and interpreting evidence for its effectiveness are a challenge because we lack a shared understanding of CoS. Translating the available evidence about CoS into practic...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14378

    authors: Lee AS,Ross S

    更新日期:2020-09-14 00:00:00

  • Online testable concept maps: benefits for learning about the pathogenesis of disease.

    abstract:CONTEXT:Concept maps have been used to promote meaningful learning and critical thinking. Although these are crucially important in all disciplines, evidence for the benefits of concept mapping for learning in medicine is limited. METHODS:We performed a randomised crossover study to assess the benefits of online testa...

    journal_title:Medical education

    pub_type: 杂志文章,随机对照试验

    doi:10.1111/medu.12422

    authors: Ho V,Kumar RK,Velan G

    更新日期:2014-07-01 00:00:00

  • Community-based medical education: feasibility and cost.

    abstract::The General Medical Council has issued a call for an increase in community-based medical education, and many medical schools are enhancing the community component of their curricula. This paper uses the experience of a community-based junior medical firm to explore the potential costs, and highlight some of the unreso...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1995.tb02804.x

    authors: Murray E,Jinks V,Modell M

    更新日期:1995-01-01 00:00:00

  • Exploring frontline faculty perspectives after a curriculum change.

    abstract:CONTEXT:Curriculum renewal is an essential and continual process for undergraduate medical education programmes. Although there is substantial literature on the critical role of leadership in successful curricular change, the voices of frontline faculty teachers implementing such change have not been explored. We aimed...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12529

    authors: Venance SL,LaDonna KA,Watling CJ

    更新日期:2014-10-01 00:00:00

  • Assessing suitability for a problem-based learning curriculum: evaluating a new student selection instrument.

    abstract:CONTEXT:A new student selection instrument has been designed to assess candidate suitability for a problem-based learning, small group curriculum. OBJECTIVE:To evaluate the performance of the new teamwork selection instrument in terms of its discriminatory power, fairness, validity, reliability and acceptability among...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02086.x

    authors: Chamberlain SE,Searle J

    更新日期:2005-03-01 00:00:00

  • Louder than words: power and conflict in interprofessional education articles, 1954-2013.

    abstract:CONTEXT:Interprofessional education (IPE) aspires to enable collaborative practice. Current IPE offerings, although rapidly proliferating, lack evidence of efficacy and theoretical grounding. OBJECTIVES:Our research aimed to explore the historical emergence of the field of IPE and to analyse the positioning of this ac...

    journal_title:Medical education

    pub_type: 历史文章,杂志文章

    doi:10.1111/medu.12668

    authors: Paradis E,Whitehead CR

    更新日期:2015-04-01 00:00:00

  • Kabisa: an interactive computer-assisted training program for tropical diseases.

    abstract::In Europe, tropical pathology is usually taught in special short courses, intended for those planning to practise in developing countries. The theoretical knowledge to be assimilated during this short period is considerable, and turning such newly acquired knowledge into competence is difficult. Kabisa is a computer-b...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1997.tb02568.x

    authors: Van den Ende J,Blot K,Kestens L,Van Gompel A,Van den Enden E

    更新日期:1997-05-01 00:00:00

  • Cognitive appraisals and team performance under stress: A simulation study.

    abstract:OBJECTIVES:The present study explored how challenge and threat responses to stress relate to performance, anxiety, confidence, team identity and team characteristics (time spent in training and postgraduate experience) in a medical simulation-based team competition. METHODS:The study was conducted during a national si...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14050

    authors: Carenzo L,Braithwaite EC,Carfagna F,Franc J,Ingrassia PL,Turner MJ,Slater MJ,Jones MV

    更新日期:2020-03-01 00:00:00

  • 'Do as I say and not as I do'? An audit of clinical management in teaching compared with service work.

    abstract::The work of five principals in a teaching general practice was audited to examine differences in prescribing, investigation and follow-up between teaching and service work over a 3-week period. The patients seen in clinical teaching were found to be representative of those consulting in normal service sessions for bot...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1981.tb02407.x

    authors: Freeman GK

    更新日期:1981-03-01 00:00:00