How good is good? Students and assessors' perceptions of qualitative markers of performance.

Abstract:

BACKGROUND:Qualitative markers of performance are routinely used for medical student assessment, though the extent to which such markers can be readily translated to actionable pieces of information remains uncertain. PURPOSE:To explore (a) the perceived value to be indicated by descriptor phrases commonly used for describing student performance, (b) the perceived weight of the different performance domains (e.g. communication skills, work ethic, knowledge base, etc), and (c) whether or not the perceived value of the descriptors changes as a function of the performance domains. METHODS:Five domains of performance were identified from the thematic coding of past medical student transcripts (N = 156). From the transcripts, 91 distinct descriptors indicating the language commonly used by assessors were also identified. From the list of 91 descriptors, Thurstone's method of equal-appearing intervals was used to extract 10 descriptors that were representative of the continuum of student performance. A modified paired comparisons method was then used to enable the relative ranking of each of 10 descriptors combined with each of 5 different domains of performance. A web-based survey was used to collect responses from participants (N = 209), which consisted of medical students and faculty members who were previously involved in student assessment. RESULTS:Results demonstrated that respondents did not simply sum positive and negative descriptors in a uniform manner. Rather, comments on some domains (e.g., "ability to apply patient centred medicine") were seen as particularly positive when associated with positive descriptors but not particularly negative when associated with negative descriptors. For others (e.g., "receptivity and responsiveness to feedback") the reverse was true. Comments on "knowledge-base" elicited a relatively muted perception at both ends of the scale. Finally, the results also revealed moderate misalignment in the perceptions of assessors and students. CONCLUSIONS:The findings from this study suggest that the use of any given descriptor conveys slightly different meaning dependent on the context in which it is used. This helps to address some key issues surrounding the application of qualitative markers to performance assessment in medical education.

journal_name

Teach Learn Med

authors

Ma HK,Min C,Neville A,Eva K

doi

10.1080/10401334.2012.741545

subject

Has Abstract

pub_date

2013-01-01 00:00:00

pages

15-23

issue

1

eissn

1040-1334

issn

1532-8015

journal_volume

25

pub_type

杂志文章
  • Systems survivor: a program for house staff in systems-based practice.

    abstract:BACKGROUND:The Systems-Based Practice competency expanded the scope of graduate medical education. Innovative approaches are needed to teach this material. PURPOSE:We have designed and implemented a rotation in Systems-Based Practice focused on the interrelationships of patient care, clinical revenue, and the physicia...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330701332201

    authors: Turley CB,Roach R,Marx M

    更新日期:2007-04-01 00:00:00

  • Authorship Order in Medical Education Publications: In Search of Practical Guidance for the Community.

    abstract::Phenomenon: With scholarly collaborations come questions about the order of authorship. Authorship order is an important consideration because it often used as an indicator of seniority, expertise, leadership, and scholarly productivity. As a result, authorship order factors into decisions about hiring, salary, resour...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2018.1533836

    authors: Mavis B,Durning SJ,Uijtdehaage S

    更新日期:2019-06-01 00:00:00

  • Resident perceptions of the educational value of night float rotations.

    abstract:BACKGROUND:Night float rotations are being increasingly used in the era of resident physician work-hour regulations, but their impact on resident education is not clear. PURPOSE:Our objective was to clarify resident perceptions of the educational aspects of night float rotations. METHODS:An anonymous survey of intern...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2010.488203

    authors: Luks AM,Smith CS,Robins L,Wipf JE

    更新日期:2010-07-01 00:00:00

  • The feasibility and acceptability of implementing formal evaluation sessions and using descriptive vocabulary to assess student performance on a clinical clerkship.

    abstract:BACKGROUND:A systematized approach to descriptive evaluation of clinical performance using a vocabulary of global descriptors in the setting of formal evaluation and feedback sessions has been shown to be reliable and valid. The feasibility of this method beyond the institution at which it was developed has not been st...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1401_3

    authors: Battistone MJ,Milne C,Sande MA,Pangaro LN,Hemmer PA,Shomaker TS

    更新日期:2002-01-01 00:00:00

  • Proceedings of the 2008 Annual Predoctoral Education Conference of the Society of Teachers of Family Medicine (STFM).

    abstract::The Society of Teachers of Family Medicine (STFM; http://www.stfm.org) is a community of professionals devoted to teaching family medicine through undergraduate, graduate, and continuing medical education. This multidisciplinary group of physicians, educators, behavioral scientists, and researchers works to further ST...

    journal_title:Teaching and learning in medicine

    pub_type:

    doi:10.1080/10401330802384946

    authors: Little DN,Hatch RL

    更新日期:2008-10-01 00:00:00

  • Relationship between dean's letter rankings and later evaluations by residency program directors.

    abstract:BACKGROUND:It is not known how well dean's letter rankings predict later performance in residency. PURPOSE:To assess the accuracy of dean's letter rankings to predict clinical performance in internship. METHOD:Participants were medical students who graduated from the University of Rochester School of Medicine and Den...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330701366523

    authors: Lurie SJ,Lambert DR,Grady-Weliky TA

    更新日期:2007-07-01 00:00:00

  • Teaching medical students ultrasound to measure liver size: comparison with experienced clinicians using physical examination alone.

    abstract:BACKGROUND:Ultrasound is increasingly recognized as a valuable addition to medical school curriculum. PURPOSE:In this study, we tested the ability of rising second year students to learn and conduct an ultrasound examination of vertical liver span at the point of care. METHODS:Six patients from a GI clinic volunteere...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1080/10401334.2012.741535

    authors: Mouratev G,Howe D,Hoppmann R,Poston MB,Reid R,Varnadoe J,Smith S,McCallum B,Rao V,DeMarco P

    更新日期:2013-01-01 00:00:00

  • A longitudinal investigation of medical student attitudes toward the medically indigent.

    abstract:BACKGROUND:Studies have shown that medical student attitudes decline as students progress through school. Controversy persists about the meaning and generalizability of these findings because studies have not been longitudinal and many were conducted prior to an influx of female students. Much of medical education occu...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm0904_2

    authors: Crandall SJ,Volk RJ,Cacy D

    更新日期:1997-01-01 00:00:00

  • Exploring the Role of Peer Advice in Self-Regulated Learning: Metacognitive, Social, and Environmental Factors.

    abstract::This Conversation Starters article presents a selected research abstract from the 2016 Association of American Medical Colleges Northeast Region Group on Educational Affairs annual spring meeting. The abstract is paired with the integrative commentary of three experts who shared their thoughts stimulated by the pilot ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1217225

    authors: Rashid H,Lebeau R,Saks N,Cianciolo AT,Artino AR,Shea JA,Ten Cate O

    更新日期:2016-10-01 00:00:00

  • Consensus of the Millennium Conference on Teaching High Value Care.

    abstract:ISSUE:Healthcare costs have spiraled out of control, yet students and residents may lack the knowledge and skills to provide high value care, which emphasizes the best possible care while reducing unnecessary costs. EVIDENCE:Mainly national campaigns are aimed at physicians to reconsider their test ordering behaviors,...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2015.1077132

    authors: Huang GC,Tibbles CD,Newman LR,Schwartzstein RM

    更新日期:2016-01-01 00:00:00

  • Medical student participation in a disaster seminar and drill: brief description of activity and report of student experiences.

    abstract:BACKGROUND:Although it is a Joint Commission requirement for hospitals to maintain an up-to-date disaster plan and to implement drills, disaster training is not routinely incorporated into undergraduate medical education. PURPOSES:The objectives are to provide medical students with an introduction to disaster medicine...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330903446040

    authors: Kaji AH,Coates WC,Fung CC

    更新日期:2010-01-01 00:00:00

  • The Action Research Program: Experiential Learning in Systems-Based Practice for First-Year Medical Students.

    abstract:PROBLEM:Systems-based practice focuses on the organization, financing, and delivery of medical services. The American Association of Medical Colleges has recommended that systems-based practice be incorporated into medical schools' curricula. However, experiential learning in systems-based practice, including practical...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1146606

    authors: Ackerman SL,Boscardin C,Karliner L,Handley MA,Cheng S,Gaither TW,Hagey J,Hennein L,Malik F,Shaw B,Trinidad N,Zahner G,Gonzales R

    更新日期:2016-01-01 00:00:00

  • Assessing residents' competency in care management: report of a consensus conference.

    abstract:BACKGROUND:Residency programs must prepare physicians to practice in the current health care environment. This mandate is reflected in 3 of the 6 competency domains now required by the Accreditation Council for Graduate Medical Education: systems-based practice, interpersonal skills and communication, and practice-base...

    journal_title:Teaching and learning in medicine

    pub_type: 共识发展会议,杂志文章,评审

    doi:10.1207/s15328015tlm1601_16

    authors: Frohna JG,Kalet A,Kachur E,Zabar S,Cox M,Halpern R,Hewson MG,Yedidia MJ,Williams BC

    更新日期:2004-01-01 00:00:00

  • An innovative process for faculty development in residency training.

    abstract:BACKGROUND:For programs to accomplish the goals of the Accreditation Council of Graduate Medical Education (ACGME) Outcome Project, faculty must be trained to deliver and assess education that is level-specific, competency-based, standardized, integrated, and easily accessible. DESCRIPTION:An innovative faculty develo...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.692280

    authors: Narayan AP,Whicker SA,McGann KA

    更新日期:2012-01-01 00:00:00

  • Development of a communication curriculum for emergency medicine residents.

    abstract:BACKGROUND:The Accreditation Council for Graduate Medical Education requires residency training programs to develop methods to teach and assess communication skills in residents to ensure competence as a practitioner. In response, we piloted a communication curriculum for emergency medicine residents. We describe the c...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330903228604

    authors: Sullivan C,Ellison SR,Quaintance J,Arnold L,Godrey P

    更新日期:2009-10-01 00:00:00

  • Outcomes of a teaching scholars program to promote leadership in faculty development.

    abstract:BACKGROUND:Provision of adequate opportunities for faculty to receive training in teaching skills requires persons with faculty development expertise to provide this training. PURPOSE:In this study, we examined outcomes of a teaching scholars program (TSP) aimed at promoting leaders in faculty development in teaching ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1703_8

    authors: Rosenbaum ME,Lenoch S,Ferguson KJ

    更新日期:2005-07-01 00:00:00

  • First aid and basic life support skills training early in the medical curriculum: curriculum issues, outcomes, and confidence of students.

    abstract:BACKGROUND:The importance of training physicians and other health care professionals in first aid and basic life support (BLS) is now widely recognized. The Faculty of Medicine and Health Sciences of the United Arab Emirates University have been offering formal training in these skills to 1st-year medical students sinc...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1304_05

    authors: Das M,Elzubeir M

    更新日期:2001-10-01 00:00:00

  • An evidence-based domestic violence education program for internal medicine residents.

    abstract:BACKGROUND:Domestic violence (DV) is prevalent but often unrecognized, and it is a challenge to teach. This article presents an evidence-based DV education program for medical residents and incorporates it into a women's medicine curriculum. DESCRIPTION:An initial 3-hr seminar included video and case discussion, liter...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1504_09

    authors: Korenstein D,Thomas DC,Foldes C,Ross J,Halm E,McGinn T

    更新日期:2003-10-01 00:00:00

  • Medical subinternship: student experience on a resident uncovered hospitalist service.

    abstract:BACKGROUND:Studies demonstrating the value of hospitalists to medical student education have been performed in traditional resident covered ward service settings (RCWS). PURPOSE:To compare medical subinterns' experiences on an RCWS to that on a resident uncovered hospitalist service (RUHS). METHODS:We assessed studen...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330701797974

    authors: O'Leary KJ,Chadha V,Fleming VM,Martin GJ,Baker DW

    更新日期:2008-01-01 00:00:00

  • Ambulatory morning report: an underutilized educational modality.

    abstract:BACKGROUND:Many medicine residency training programs include a lecture-based preclinic conference series as part of the ambulatory educational curriculum when more effective teaching formats might be available. Our institution has replaced this lecture-based teaching format with an ambulatory morning report modeled aft...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1301_9

    authors: Demopoulos B,Pelzman F,Wenderoth S

    更新日期:2001-01-01 00:00:00

  • Grading Practices and Distributions Across Internal Medicine Clerkships.

    abstract:THEORY:Clerkship evaluation and grading practices vary widely between U.S. medical schools. Grade inflation continues to exist, and grade distribution is likely to be different among U.S. medical schools. HYPOTHESES:Increasing the number of available grades curtails "grade inflation." METHOD:A national survey of all ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1164605

    authors: Fazio SB,Torre DM,DeFer TM

    更新日期:2016-07-01 00:00:00

  • Students assigned to community practices for their pediatric clerkship perform as well or better on written examinations as students assigned to academic medical centers.

    abstract:BACKGROUND:Medical schools are increasingly using community practice sites (CPS) for clerkship training. PURPOSES:We compared the test performance of all students assigned to CPS with all students trained at an academic medical center (AMC) for their pediatric clerkship for the past 5 years. METHODS:Baseline comparab...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1603_5

    authors: White CB,Thomas AM

    更新日期:2004-07-01 00:00:00

  • Benefits of testable concept maps for learning about pathogenesis of disease.

    abstract:BACKGROUND:Concept maps can assist learning by integrating new information with existing cognitive structure to facilitate meaningful understanding. The benefits of testable concept maps to illustrate cause-and-effect sequences in the pathogenesis of disease have not yet been determined. PURPOSE:A controlled trial was...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2011.561700

    authors: Kumar S,Dee F,Kumar R,Velan G

    更新日期:2011-04-01 00:00:00

  • A comparison of students who chose a traditional or a problem-based learning curriculum after failing year 2 in the traditional curriculum: a unique case study at the Nelson R. Mandela School of Medicine.

    abstract:PURPOSE:To canvas perceptions and experiences of students who had failed Year 2 of a traditional medical program and who chose to remain in the conventional program (n = 6) or had swapped to Curriculum 2001 (C2001), a problem-based learning (PBL) curriculum (n = 14). METHODS:A year after their decision regarding curri...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1603_15

    authors: McLean M

    更新日期:2004-07-01 00:00:00

  • Relationship between specialty choice and medical student temperament and character assessed with Cloninger Inventory.

    abstract:BACKGROUND:Multiple variables affect medical specialty choice, including temperament, sociodemographic factors, and personal experiences. Many studies address specific variables for specific specialties, but few assess the relative impact of each factor. PURPOSE:To identify the relative influence of temperament in cho...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1602_6

    authors: Vaidya NA,Sierles FS,Raida MD,Fakhoury FJ,Przybeck TR,Cloninger CR

    更新日期:2004-04-01 00:00:00

  • Evaluation of the University of Virginia Leadership in Academic Medicine Program.

    abstract:BACKGROUND:Developing effective transformational leaders is essential for a diverse and complex academic medical system. The purpose of this study is to elicit faculty perspectives on their leadership skills before and after participation in a Leadership in Academic Medicine (LAM) Program. SUMMARY:The two-part study c...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2011.611773

    authors: Sanfey H,Harris I,Pollart S,Schwartz A

    更新日期:2011-10-01 00:00:00

  • Code status discussions: agreement between internal medicine residents and hospitalized patients.

    abstract:BACKGROUND:Medical residents frequently participate in code status discussions, yet their competency in this role has not been evaluated. PURPOSE:The objective is to determine the quality of code status discussions from the perspective of both resident and patient. METHODS:We conducted a cross-sectional survey of con...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2010.512537

    authors: Loertscher LL,Beckman TJ,Cha SS,Reed DA

    更新日期:2010-10-01 00:00:00

  • Attitudes of affiliate faculty members toward medical student summative evaluation for clinical clerkships: a qualitative analysis.

    abstract:BACKGROUND:Summative evaluation of medical students is a critical component of the educational process. Despite extensive literature on evaluation, few studies have centered on affiliate faculty members' attitudes toward summative evaluation of students, though it has been suggested that these attitudes influence their...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.641478

    authors: Wang KE,Fitzpatrick C,George D,Lane L

    更新日期:2012-01-01 00:00:00

  • Examining the medical student body: peer physical exams and genital, rectal, or breast exams.

    abstract:BACKGROUND:Some medical schools have replaced all student practice peer physical examinations in the curriculum with examinations of standardized patients (SPs). PURPOSE:To assess attitudes of medical students toward practicing physical examinations with classmates, including genital, rectal, or female breast componen...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1704_5

    authors: Power DV,Center BA

    更新日期:2005-10-01 00:00:00

  • The patient safety OSCE for PGY-1 residents: a centralized response to the challenge of culture change.

    abstract:BACKGROUND:Accreditation and Institute of Medicine mandates require retooling of graduate medical education curriculum and assessment processes. This Objective Structured Clinical Exam (OSCE) focused on patient safety-specific skills important to stakeholders from multiple institutions. PURPOSES:A 10-station OSCE was ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330802573837

    authors: Wagner DP,Hoppe RB,Lee CP

    更新日期:2009-01-01 00:00:00