Conditional reliability of admissions interview ratings: extreme ratings are the most informative.

Abstract:

CONTEXT:Admissions interviews are unreliable and have poor predictive validity, yet are the sole measures of non-cognitive skills used by most medical school admissions departments. The low reliability may be due in part to variation in conditional reliability across the rating scale. OBJECTIVES:To describe an empirically derived estimate of conditional reliability and use it to improve the predictive validity of interview ratings. METHODS:A set of medical school interview ratings was compared to a Monte Carlo simulated set to estimate conditional reliability controlling for range restriction, response scale bias and other artefacts. This estimate was used as a weighting function to improve the predictive validity of a second set of interview ratings for predicting non-cognitive measures (USMLE Step II residuals from Step I scores). RESULTS:Compared with the simulated set, both observed sets showed more reliability at low and high rating levels than at moderate levels. Raw interview scores did not predict USMLE Step II scores after controlling for Step I performance (additional r2 = 0.001, not significant). Weighting interview ratings by estimated conditional reliability improved predictive validity (additional r2 = 0.121, P < 0.01). CONCLUSIONS:Conditional reliability is important for understanding the psychometric properties of subjective rating scales. Weighting these measures during the admissions process would improve admissions decisions.

journal_name

Med Educ

journal_title

Medical education

authors

Stansfield RB,Kreiter CD

doi

10.1111/j.1365-2929.2006.02634.x

subject

Has Abstract

pub_date

2007-01-01 00:00:00

pages

32-8

issue

1

eissn

0308-0110

issn

1365-2923

pii

MED2634

journal_volume

41

pub_type

杂志文章
  • Teaching and learning away from the medical centre. The potential contribution of new technology to continuing medical education in the United Kingdom (working document).

    abstract::Continuing education should be convenient, relevant, individualized, systematic and include means of assessment. Educational technology provides the link between teaching and learning; it should accommodate the essential interactions between learner, instructor, environment and material. Media in open learning systems...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1985.tb01328.x

    authors: Cairncross RG

    更新日期:1985-07-01 00:00:00

  • Student population changes and progress in Belgian medical schools.

    abstract::The present study was designed to analyse the evolution of student populations--undergraduates and graduates--in the 11 Belgian medical schools from 1969 to 1982. During this period, an overall 44% drop in the number of entrants was observed, while the number of medical graduates continued to rise until 1977, when it ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1989.tb00810.x

    authors: Albert A,Firket H,Castermans A

    更新日期:1989-01-01 00:00:00

  • Psychological size and distance: emphasising the interpersonal relationship as a pathway to optimal teaching and learning conditions.

    abstract:BACKGROUND:Positive interpersonal relationships between teachers and learners increase the quality of learning. The purpose of this study was to investigate psychological size (perceived status) and psychological distance (perceived emotional connectedness) in medical teaching interactions and their impact on the teach...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2004.01952.x

    authors: Vaughn LM,Baker RC

    更新日期:2004-10-01 00:00:00

  • Entry to medical school: an audit of traditional selection requirements.

    abstract::The major focus in the selection of entrants for medical school has traditionally been on academic achievement in school-leaving examinations in which certain science subjects are a requirement. A longitudinal study of 413 successful applicants was undertaken to determine the relationship of these admission criteria t...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1995.tb02795.x

    authors: Collins JP,White GR,Kennedy JA

    更新日期:1995-01-01 00:00:00

  • "Phase examination" an assessment of consultation skills and integrative knowledge based in general practice.

    abstract::The undergraduate medical curriculum at Linköping was changed and problem-based learning introduced in 1986. As a consequence the need for new examinations arose. To assess the students' consultation skills, ability to use theory in practice and skills in problem-based learning, a new examination called 'phase examina...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1996.tb00842.x

    authors: Foldevi M,Svedin CG

    更新日期:1996-09-01 00:00:00

  • The mixed impact of medical school on medical students' implicit and explicit weight bias.

    abstract:CONTEXT:Health care trainees demonstrate implicit (automatic, unconscious) and explicit (conscious) bias against people from stigmatised and marginalised social groups, which can negatively influence communication and decision making. Medical schools are well positioned to intervene and reduce bias in new physicians. ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12770

    authors: Phelan SM,Puhl RM,Burke SE,Hardeman R,Dovidio JF,Nelson DB,Przedworski J,Burgess DJ,Perry S,Yeazel MW,van Ryn M

    更新日期:2015-10-01 00:00:00

  • Sustainability of change with quality general practitioner education in adolescent health: a 5-year follow-up.

    abstract:OBJECTIVE:To determine whether improvements gained in general practitioners' (GPs') self-perceived competency, attitudes and knowledge after an intervention in adolescent health care designed with evidence-based strategies in continuing medical education, are maintained longterm, 5 years post intervention. The interven...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2005.02172.x

    authors: Sanci L,Coffey C,Patton G,Bowes G

    更新日期:2005-06-01 00:00:00

  • Short-listing of applicants from UCCA forms: the structure of pre-selection judgements.

    abstract::Applicants for admission to St Mary's Hospital Medical School in 1986 were short-listed for interview by one of four assessors, who each made their assessments on a nine-item pro forma. One short-lister had also been studied in detail during 1981. Short-listers used the full range of possible judgements, in approximat...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1989.tb00877.x

    authors: McManus IC,Maitlis SL,Richards P

    更新日期:1989-03-01 00:00:00

  • First step: report on a pilot course for personal and professional development.

    abstract:OBJECTIVE:To describe a pilot course in personal and professional development, entitled 'Becoming a doctor: the first step' and our suggestions for what might be incorporated into future courses. SETTING AND CONTEXT:Leeds Medical School begins a new curriculum in September 1999 with a proportion of the first 3 years b...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2000.00575.x

    authors: Thistlethwaite JE,Green PD,Heywood P,Storr E

    更新日期:2000-02-01 00:00:00

  • Attitudes of house-physicians towards self-poisoning patients.

    abstract::Eighty-two house-physicians filled in a questionnaire concerning the care of self-poisoning patients with special emphasis on training and attitudes. These recently qualified doctors dealt with large numbers of such patients and expressed dissatisfaction with their training in this respect. Hostile attitudes towards t...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1981.tb02500.x

    authors: Creed FH,Pfeffer JM

    更新日期:1981-09-01 00:00:00

  • Training primary health care workers in Upper Volta.

    abstract::In collaboration with aid agencies and government health workers, Save the Children Fund medical staff have been involved in the training of primary health care workers in the Sahel region of upper Volta. This report deals specifically with the problems involved in training illiterate health workers. ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1982.tb01233.x

    authors: Cross I

    更新日期:1982-03-01 00:00:00

  • Development and integration of CAL: a case study in medicine.

    abstract:CONTEXT:The Faculty of Medicine and Medical Sciences at the University of Aberdeen viewed the use of Computer Assisted Leaning (CAL) and other IT based learning resources as a possible way of coping with an increase in student numbers whilst maintaining or increasing the quality of medical teaching. OBJECTIVES:Our pri...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00270.x

    authors: Hamilton NM,Furnace J,Duguid KP,Helms PJ,Simpson JG

    更新日期:1999-04-01 00:00:00

  • Integrating human factors into the medical curriculum.

    abstract:BACKGROUND:The study of human factors is a scientific discipline that deals with the interactions between human beings and the elements of a system. This is important because shortcomings in these areas, if unchecked, can result in adverse outcomes. Research into human factors in industries where safety is paramount ha...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.37.s1.5.x

    authors: Glavin RJ,Maran NJ

    更新日期:2003-11-01 00:00:00

  • Exploring frontline faculty perspectives after a curriculum change.

    abstract:CONTEXT:Curriculum renewal is an essential and continual process for undergraduate medical education programmes. Although there is substantial literature on the critical role of leadership in successful curricular change, the voices of frontline faculty teachers implementing such change have not been explored. We aimed...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12529

    authors: Venance SL,LaDonna KA,Watling CJ

    更新日期:2014-10-01 00:00:00

  • Medical education accreditation in Mexico and the Philippines: impact on student outcomes.

    abstract:CONTEXT:Accreditation of medical education programmes is becoming increasingly prevalent worldwide, but beyond the face validity of these quality assurance methods, data linking accreditation to improved student outcomes are limited. Mexico and the Philippines both have voluntary systems of medical education accreditat...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.2011.04212.x

    authors: van Zanten M,McKinley D,Durante Montiel I,Pijano CV

    更新日期:2012-06-01 00:00:00

  • Translating outcome frameworks to assessment programmes: Implications for validity.

    abstract:OBJECTIVES:Competency-based medical education (CBME) requires that educators structure assessment of clinical competence using outcome frameworks. Although these frameworks may serve some outcomes well (e.g. represent eventual practice), translating these into workplace-based assessment plans may undermine validity and...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14287

    authors: Tavares W,Rowland P,Dagnone D,McEwen LA,Billett S,Sibbald M

    更新日期:2020-10-01 00:00:00

  • Critically reflective practice and its sources: A qualitative exploration.

    abstract:CONTEXT:Critical reflection may improve health professionals' performance of the social roles of care (eg collaboration) in indeterminate zones of practice that are ambiguous, unique, unstable or value-conflicted. Research must explore critical reflection in practice and how it is developed. In this study, we explored ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.14032

    authors: Ng SL,Mylopoulos M,Kangasjarvi E,Boyd VA,Teles S,Orsino A,Lingard L,Phelan S

    更新日期:2020-04-01 00:00:00

  • Effect of reflection on medical students' situational interest: an experimental study.

    abstract:CONTEXT:Reflection has been considered crucial to learning. Engaging in reflection while solving problems is expected to foster identification of knowledge gaps and interest in learning more about them, the latter being a major motivational force in learning. Although theoretically sound, this assumption still lacks em...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.13491

    authors: Ribeiro LMC,Mamede S,Moura AS,de Brito EM,de Faria RMD,Schmidt HG

    更新日期:2018-05-01 00:00:00

  • Traditional vs. flexible programmes: training in family and community medicine.

    abstract::The aims of this study were to gain an understanding of the concerns of those in control in Canadian Family Medicine, and to gain an understanding of the experiences of trainees in the traditional postgraduate year 2 (PGY-2) and in a flexible PGY-2 at the University of Toronto (U of T) Department of Family and Communi...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1996.tb00852.x

    authors: Shafir MS,Wilkins K

    更新日期:1996-09-01 00:00:00

  • Assessment in general practice: the predictive value of written-knowledge tests and a multiple-station examination for actual medical performance in daily practice.

    abstract::This study compares the predictive values of written-knowledge tests and a standardized multiple-station examination for the actual medical performance of general practitioners (GPs) in order to select effective assessment methods to be used in quality-improvement activities. A comprehensive assessment was performed i...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.1999.00280.x

    authors: Ram P,van der Vleuten C,Rethans JJ,Schouten B,Hobma S,Grol R

    更新日期:1999-03-01 00:00:00

  • Publication pattern of medical theses, France, 1993-98.

    abstract:CONTEXT AND OBJECTIVE:In many countries, medical training must be completed by presentation of a thesis. We report publication patterns of French medical theses. MATERIALS:We drew a random sample of theses presented in the 36 French medical universities between 1 January 1993 and 31 December 1997. The sample was strat...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2001.00768.x

    authors: Salmi LR,Gana S,Mouillet E

    更新日期:2001-01-01 00:00:00

  • Students' moral reasoning, Machiavellianism and socially desirable responding: implications for teaching ethics and research integrity.

    abstract:OBJECTIVE:To investigate the relationship between psychological constructs related to professional and research integrity and moral reasoning among medical students. METHODS:Medical students, 2nd-year (n = 208, 85.6% of 243 enrolled students), answered the moral reasoning test-defining issues test 2 (DIT2) and the Mac...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2929.2006.02391.x

    authors: Hren D,Vujaklija A,Ivanisević R,Knezević J,Marusić M,Marusić A

    更新日期:2006-03-01 00:00:00

  • Ethnic and social disparities in performance on medical school selection criteria.

    abstract:CONTEXT:Medical schools in Western societies seek measures to increase the diversity of their student bodies with respect to ethnicity and social background. Currently, little is known about the effects of different selection procedures on student diversity. OBJECTIVES:This prospective cohort study aimed to determine ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.12536

    authors: Stegers-Jager KM,Steyerberg EW,Lucieer SM,Themmen AP

    更新日期:2015-01-01 00:00:00

  • Education and training in medicine.

    abstract::Education and training are terms which are often used loosely, interchangeably, and require definition. Training is often seen as a series of activities which are related to the acquisition of specific skills and may be narrowly based. Education, on the other hand, has an important value base and is broader in concept...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1988.tb00790.x

    authors: Calman KC,Downie RS

    更新日期:1988-11-01 00:00:00

  • The anxieties of new clinical students.

    abstract::The specific anxieties of 74 medical students beginning their clinical training were assessed by means of a questionnaire at the start of the clinical introductory course at St Mary's Hospital Medical School, London. Situations differed in the amount of anxiety that they engendered, and students also differed in the n...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1992.tb00116.x

    authors: Moss F,McManus IC

    更新日期:1992-01-01 00:00:00

  • Improving communication: a practical programme for teaching trainees about communication issues in the general practice consultation.

    abstract::This paper describes a teaching programme, for use in general practice vocational training, which provides a theoretical and practical framework for exploring key aspects of the consultation with trainees. A particular emphasis is on the educational or 'cognitive' outcomes of the consultation and skills for improving ...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1984.tb01022.x

    authors: Boulton M,Griffiths J,Hall D,McIntyre M,Oliver B,Woodward J

    更新日期:1984-07-01 00:00:00

  • Scripts and clinical reasoning.

    abstract:CONTEXT:Each clinical encounter represents an amazing series of psychological events: perceiving the features of the situation; quickly accessing relevant hypotheses; checking for signs and symptoms that confirm or rule out competing hypotheses, and using related knowledge to guide appropriate investigations and treatm...

    journal_title:Medical education

    pub_type: 杂志文章,评审

    doi:10.1111/j.1365-2923.2007.02924.x

    authors: Charlin B,Boshuizen HP,Custers EJ,Feltovich PJ

    更新日期:2007-12-01 00:00:00

  • 'Science', 'critical thinking' and 'competence' for tomorrow's doctors. A review of terms and concepts.

    abstract:CONTEXT:The recommendations of the General Medical Council in Tomorrow's Doctors renewed efforts to define core knowledge in undergraduate medical education. They also encouraged better use of the medical knowledge base in nurturing clinical judgement, critical thinking, and reflective practice. What then does the medi...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1046/j.1365-2923.2000.00428.x

    authors: Maudsley G,Strivens J

    更新日期:2000-01-01 00:00:00

  • Motivations for studying dentistry among first-year dental students.

    abstract::Reasons for choosing dentistry as a profession were analysed among first-year dental students at the University of Toronto. The motivations of various sub-groups were also examined. It was found that an extrinsic motivation, financial rewards, was the most widespread, although the other widely chosen motivations refer...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/j.1365-2923.1977.tb00578.x

    authors: Cohen R,Coburn D

    更新日期:1977-03-01 00:00:00

  • Longitudinal assessment of the impact of the use of the UK clinical aptitude test for medical student selection.

    abstract:CONTEXT:Medical schools are increasingly using novel tools to select applicants. The UK Clinical Aptitude Test (UKCAT) is one such tool and measures mental abilities, attitudes and professional behaviour conducive to being a doctor using constructs likely to be less affected by socio-demographic factors than traditiona...

    journal_title:Medical education

    pub_type: 杂志文章

    doi:10.1111/medu.13082

    authors: Mathers J,Sitch A,Parry J

    更新日期:2016-10-01 00:00:00