Abstract:
BACKGROUND:Given the complexity of competency frameworks, associated skills and abilities, and contexts in which they are to be assessed in competency-based education (CBE), there is an increased reliance on rater judgements when considering trainee performance. This increased dependence on rater-based assessment has led to the emergence of rater cognition as a field of research in health professions education. The topic, however, is often conceptualised and ultimately investigated using many different perspectives and theoretical frameworks. Critically analysing how researchers think about, study and discuss rater cognition or the judgement processes in assessment frameworks may provide meaningful and efficient directions in how the field continues to explore the topic. METHODS:We conducted a critical and integrative review of the literature to explore common conceptualisations and unified terminology associated with rater cognition research. We identified 1045 articles on rater-based assessment in health professions education using Scorpus, Medline and ERIC and 78 articles were included in our review. RESULTS:We propose a three-phase framework of observation, processing and integration. We situate nine specific mechanisms and sub-mechanisms described across the literature within these phases: (i) generating automatic impressions about the person; (ii) formulating high-level inferences; (iii) focusing on different dimensions of competencies; (iv) categorising through well-developed schemata based on (a) personal concept of competence, (b) comparison with various exemplars and (c) task and context specificity; (v) weighting and synthesising information differently, (vi) producing narrative judgements; and (vii) translating narrative judgements into scales. CONCLUSION:Our review has allowed us to identify common underlying conceptualisations of observed rater mechanisms and subsequently propose a comprehensive, although complex, framework for the dynamic and contextual nature of the rating process. This framework could help bridge the gap between researchers adopting different perspectives when studying rater cognition and enable the interpretation of contradictory findings of raters' performance by determining which mechanism is enabled or disabled in any given context.
journal_name
Med Educjournal_title
Medical educationauthors
Gauthier G,St-Onge C,Tavares Wdoi
10.1111/medu.12973subject
Has Abstractpub_date
2016-05-01 00:00:00pages
511-22issue
5eissn
0308-0110issn
1365-2923journal_volume
50pub_type
杂志文章,评审abstract:AIM:To examine how students' evaluations of the environment, process and outcome of clinical learning interrelated and correlated with assessment results. METHOD:A post hoc study in the 3rd of 5 years in a student-centred, horizontally integrated, objective-based medical curriculum. In the last week of each module, st...
journal_title:Medical education
pub_type: 杂志文章,多中心研究
doi:10.1111/j.1365-2929.2006.02507.x
更新日期:2006-07-01 00:00:00
abstract:INTRODUCTION:Despite the wealth of literature surrounding communication curricula within medical education, there is a lack of in-depth research into medical students' perceptions of communication skills assessment. This study aims to address this gap in the research literature. METHODS:Five focus group discussions we...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1046/j.1365-2923.2002.01300.x
更新日期:2002-09-01 00:00:00
abstract::The academic performance of 104 fourth-year medical students was assessed in relation to their sleep habits reported in a questionary and their scores on the Minnesota Multiphasic Personality Inventory. Poorer academic performance was related significantly to later times of waking up in the morning, particularly at we...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1976.tb00432.x
更新日期:1976-05-01 00:00:00
abstract::Older clinicians typically engage in reflections on their own early careers and indeed whichever generation of clinician you talk to, their medical school and early career experiences were more challenging than the last. We draw on inspiration from Monty Python and specifically the Four Yorkshiremen to illustrate this...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/medu.13098
更新日期:2016-12-01 00:00:00
abstract:OBJECTIVE:To determine whether improvements gained in general practitioners' (GPs') self-perceived competency, attitudes and knowledge after an intervention in adolescent health care designed with evidence-based strategies in continuing medical education, are maintained longterm, 5 years post intervention. The interven...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2929.2005.02172.x
更新日期:2005-06-01 00:00:00
abstract::In September 1974 candidates who had taken a computerized patient managment problem examination (CPMP), as part of the certification process in paediatrics required by the Royal College of Physicians and Surgeons of Canada, completed a questionnaire designed to elicit their reactions to CPMPs. The results indicated th...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1976.tb01494.x
更新日期:1976-09-01 00:00:00
abstract::In October 1994 a project was initiated by the General Practice Continuing Medical Education Tutors in the Department of General Practice at Sheffield University. The project sought to evaluate the efficiency (effort expended) and effectiveness (distance travelled) of a model of continuing professional development for...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1997.tb00038.x
更新日期:1997-01-01 00:00:00
abstract:CONTEXT:A challenge for medical educators is to better understand the personal factors that lead to individual success in medical school and beyond. Recently, educational researchers in fields outside medicine have acknowledged the importance of motivation and emotion in students' learning and performance. These affect...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.2010.03712.x
更新日期:2010-12-01 00:00:00
abstract:OBJECTIVES:The objective of this study was to determine whether Medical Informatics education among house staff is included in the current residency curriculum, and to present ways in which this type of education may be improved. DESIGN:During autumn 1996 a mailed survey was distributed to chief residents of American ...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1046/j.1365-2923.1999.00424.x
更新日期:1999-10-01 00:00:00
abstract:OBJECTIVE:To investigate the relationship between psychological constructs related to professional and research integrity and moral reasoning among medical students. METHODS:Medical students, 2nd-year (n = 208, 85.6% of 243 enrolled students), answered the moral reasoning test-defining issues test 2 (DIT2) and the Mac...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2929.2006.02391.x
更新日期:2006-03-01 00:00:00
abstract::Applicants for admission to St Mary's Hospital Medical School in 1986 were short-listed for interview by one of four assessors, who each made their assessments on a nine-item pro forma. One short-lister had also been studied in detail during 1981. Short-listers used the full range of possible judgements, in approximat...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1989.tb00877.x
更新日期:1989-03-01 00:00:00
abstract:CONTEXT:Considerable research has been conducted recently into the notion of patient-centred consulting. The primary goal of this approach is to establish a clear understanding of the patient's perspective on his or her problem, and to allow this understanding to inform both the explanation and planning stages of the c...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.2007.02789.x
更新日期:2007-07-01 00:00:00
abstract:CONTEXT:At the Katholieke Universiteit Leuven, Belgium, final year medical students participate in 70 problem-solving clinical seminars over a period of 2 months, concentrating on clinical reasoning for formulating differential diagnoses. The clinical seminars end in an examination consisting of 200 extended-matching q...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2929.2006.02627.x
更新日期:2006-12-01 00:00:00
abstract:BACKGROUND:We developed a 1-hour teaching seminar for medical students on anti-smoking health promotion for adolescents. We report the development of the programme and a performance-based evaluation. AIM:To develop a seminar for medical students with the objective of improving medical student inquiry into smoking and ...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1046/j.1365-2923.2003.01560.x
更新日期:2003-08-01 00:00:00
abstract:CONTEXT:Electives are part of most Western medical school curricula. It is estimated that each year 3000-4000 undergraduate medical students from the UK alone undertake an elective in a developing country. The impact of these electives has given some cause for concern, but the views of elective hosts are largely missin...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/medu.12727
更新日期:2015-06-01 00:00:00
abstract::At the mid-term test in Part I Physiology at the University of Zagreb the students (n = 280) were graded by our standard pass level (SPL) arbitrarily set at 54% correct answers (SPL = 0.54). The test consisted of 50 items of the one best answer type. Items were selected from the pool by one examiner to conform, by his...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1994.tb02552.x
更新日期:1994-09-01 00:00:00
abstract:CONTEXT:Scholarly experiences have been increasingly employed to support the development of scholarly skills for medical students. How the characteristics of the various scholarly experiences contributes to scholarly outcomes or the complexities of how the experiences build skills warrants further exploration. OBJECTI...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/medu.14362
更新日期:2021-02-01 00:00:00
abstract::With a diverse language background profile in an Australian medical student population, teaching interventions are necessary for students whose English language proficiency is not adequate for the study of medicine. This paper describes the screening of written and aural English language proficiency in 143 first year ...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1046/j.1365-2923.1997.00674.x
更新日期:1997-09-01 00:00:00
abstract::This study set out to determine the long-term benefits of teaching psychiatric interview skills. Nine established general practitioners, eight of whom were also trainers, took part some 18 months after attending a problem-based interviewing course. Interview skills were assessed by rating behaviour during 10-minute vi...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1992.tb00125.x
更新日期:1992-01-01 00:00:00
abstract:CONTEXT:Despite a growing and influential literature, 'professionalism' remains conceptually unclear. A recent review identified three discourses of professionalism in the literature: the individual; the interpersonal, and the societal-institutional. Although all have credibility and empirical support, there are tensio...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/medu.12368
更新日期:2014-04-01 00:00:00
abstract:CONTEXT:Small declines in patient-centred attitudes during medical education have caused great concern. Although some of the self-report scales applied have solid psychometric foundations, validity evidence for the interpretation of attitude erosion during clerkships remains weak. OBJECTIVES:We sought to address this ...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/medu.12102
更新日期:2013-05-01 00:00:00
abstract::This paper reviews some of the problems confronting medical education in Spain and some of the steps which have been taken to improve the current situation which is of serious concern to the Government, the Medical Colleges, the University, and the community generally. ...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1980.tb02250.x
更新日期:1980-05-01 00:00:00
abstract::The use of the epidemiological method in primary health care (PHC) has become an accepted part of the service. The team will utilize community-oriented data in order to assess the health needs of the population, perform continued surveillance of changes in the health of the people served and for service evaluation. Th...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1983.tb01091.x
更新日期:1983-01-01 00:00:00
abstract:CONTEXT:There exists a disparity between the views of physicians and the views of their patients on end-of-life decisions. However, the timing of when the end-of-life preferences of physicians and non-medically-trained individuals diverge is currently unknown. The objective of this paper is to characterise how preferen...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/medu.12938
更新日期:2016-02-01 00:00:00
abstract::An account is given of the introduction of MCQ in an Indian Medical institution in 1974/75. Preliminary results suggest that the reliability coefficient of MCQs rises with their difficulty, and that Pearson-type coefficient indicates a higher degree of correlation with essay marks than do Spearman coefficients. A 'stu...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1978.tb00352.x
更新日期:1978-07-01 00:00:00
abstract:BACKGROUND:Progress testing is a form of longitudinal examination which, in principle, samples at regular intervals from the complete domain of knowledge considered a requirement for medical students on completion of the undergraduate programme. Over the course of the programme students improve their scores on the test...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2929.2004.02060.x
更新日期:2005-02-01 00:00:00
abstract:OBJECTIVES:We placed anaesthesia teams into a stressful environment in order to explore interactions between members of different professional groups and to investigate their perspectives on the impact of these interactions on team performance. METHODS:Ten anaesthetists, 5 nurses and 5 trained anaesthetic assistants e...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.2007.02971.x
更新日期:2008-04-01 00:00:00
abstract::The aims of this study were to gain an understanding of the concerns of those in control in Canadian Family Medicine, and to gain an understanding of the experiences of trainees in the traditional postgraduate year 2 (PGY-2) and in a flexible PGY-2 at the University of Toronto (U of T) Department of Family and Communi...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1996.tb00852.x
更新日期:1996-09-01 00:00:00
abstract::Established in 1858, the General Medical Council was responsible, inter alia, for improving the standard of medical education in Britain. It was agreed on all hands that there were serious deficiencies: there was far too much book-learning and not enough practical knowledge; students graduated who were wholly ignorant...
journal_title:Medical education
pub_type: 历史文章,杂志文章
doi:10.1111/j.1365-2923.1989.tb01573.x
更新日期:1989-11-01 00:00:00
abstract::This paper outlines one component, the project, which in 4 years became an integral part of the Human Ecology course at the Department of Community Medicine at the University of Glasgow. Although it is to be retained in some form, it would seem that the full potential of the device for medical undergraduates has not b...
journal_title:Medical education
pub_type: 杂志文章
doi:10.1111/j.1365-2923.1984.tb01012.x
更新日期:1984-07-01 00:00:00