An Extended Validity Argument for Assessing Feedback Culture.

Abstract:

UNLABELLED:NEGEA 2015 CONFERENCE ABSTRACT (EDITED): Measuring an Organization's Culture of Feedback: Can It Be Done? Steven Rougas and Brian Clyne. CONSTRUCT: This study sought to develop a construct for measuring formative feedback culture in an academic emergency medicine department. Four archetypes (Market, Adhocracy, Clan, Hierarchy) reflecting an organization's values with respect to focus (internal vs. external) and process (flexibility vs. stability and control) were used to characterize one department's receptiveness to formative feedback. The prevalence of residents' identification with certain archetypes served as an indicator of the department's organizational feedback culture. BACKGROUND:New regulations have forced academic institutions to implement wide-ranging changes to accommodate competency-based milestones and their assessment. These changes challenge residencies that use formative feedback from faculty as a major source of data for determining training advancement. Though various approaches have been taken to improve formative feedback to residents, there currently exists no tool to objectively measure the organizational culture that surrounds this process. Assessing organizational culture, commonly used in the business sector to represent organizational health, may help residency directors gauge their program's success in fostering formative feedback. The Organizational Culture Assessment Instrument (OCAI) is widely used, extensively validated, applicable to survey research, and theoretically based and may be modifiable to assess formative feedback culture in the emergency department. APPROACH:Using a modified Delphi technique and several iterations of focus groups amongst educators at one institution, four of the original six OCAI domains (which each contain 4 possible responses) were modified to create a 16-item Formative Feedback Culture Tool (FFCT) that was administered to 26 residents (response rate = 55%) at a single academic emergency medicine department. The mean score of each item on the FFCT (range = 0-100) was analyzed. Convergent and divergent properties of the four archetypes were assessed using a multitrait-multimethod matrix of Pearson's coefficients. Expecting that items in one archetype would diverge from the others, whereas items within an archetype should have strong convergent properties, convergent validity was assessed by comparing items across domains that all related to the same archetype. Similarly, divergent validity was assessed by comparing the correlation of items within an archetype to the correlations of those items within a hetero-domain block (i.e., to other items within the same domain). RESULTS:Three of the four domains of the FFCT (Overall Departmental Characteristics 35.4 ± 15.4, Departmental Foundation of Feedback 46.1 ± 16.7, and Departmental Emphasis of Feedback 30.3 ± 17.7) had the highest mean in the Market archetype (results/achievement oriented), whereas the final domain (Departmental Definition of Successful Feedback 34.8 ± 22.1) had the highest mean in the Clan archetype (personal growth/team achievement). Item responses in the Clan and Hierarchy archetypes had the strongest convergent and divergent validity, respectively. Item responses in the Adhocracy archetype had the weakest convergent and divergent validity. CONCLUSIONS:Although the sample size was small, this initial study demonstrates that a modified organizational culture assessment tool can feasibly be utilized to identify the primary formative feedback archetype of a cohort of residents. This may have future implications for measuring changes in culture after the implementation of strategic programs to address formative feedback. Future studies should examine the generalizability of the FFCT to other institutions, as well as address the weak validity evidence of the Adhocracy archetype in the FFCT.

journal_name

Teach Learn Med

authors

Rougas S,Clyne B,Cianciolo AT,Chan TM,Sherbino J,Yarris LM

doi

10.1080/10401334.2015.1077133

subject

Has Abstract

pub_date

2015-01-01 00:00:00

pages

355-8

issue

4

eissn

1040-1334

issn

1532-8015

journal_volume

27

pub_type

杂志文章
  • Benefits of testable concept maps for learning about pathogenesis of disease.

    abstract:BACKGROUND:Concept maps can assist learning by integrating new information with existing cognitive structure to facilitate meaningful understanding. The benefits of testable concept maps to illustrate cause-and-effect sequences in the pathogenesis of disease have not yet been determined. PURPOSE:A controlled trial was...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2011.561700

    authors: Kumar S,Dee F,Kumar R,Velan G

    更新日期:2011-04-01 00:00:00

  • Teaching geriatric assessment in home visits: the family physician/geriatrician attachment.

    abstract:BACKGROUND:Geriatric clinical clerkships in Israel teach mostly about the hospitalized elder patient with almost no ambulatory experience. Meanwhile, primary care physicians provide most of the health care to the elderly in the community. This article describes an innovation in the curriculum of the 5th-year family med...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1502_09

    authors: Tandeter H,Peleg R,Menahem S,Biderman A,Fried VA

    更新日期:2003-04-01 00:00:00

  • Realizing the promise and importance of performance-based assessment.

    abstract::Work-based assessment (WBA) is the assessment of trainees and physicians across the educational continuum of day-to-day competencies and practices in authentic, clinical environments. What distinguishes WBA from other assessment modalities is that it enables the evaluation of performance in context. In this perspectiv...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,评审

    doi:10.1080/10401334.2013.842912

    authors: Kogan JR,Holmboe E

    更新日期:2013-01-01 00:00:00

  • First aid and basic life support skills training early in the medical curriculum: curriculum issues, outcomes, and confidence of students.

    abstract:BACKGROUND:The importance of training physicians and other health care professionals in first aid and basic life support (BLS) is now widely recognized. The Faculty of Medicine and Health Sciences of the United Arab Emirates University have been offering formal training in these skills to 1st-year medical students sinc...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1304_05

    authors: Das M,Elzubeir M

    更新日期:2001-10-01 00:00:00

  • A review of U.S. Medical schools' promotion standards for educational excellence.

    abstract::Phenomenon: Given the growing number of medical science educators, an examination of institutions' promotion criteria related to educational excellence and scholarship is timely. This study investigates the extent to which medical schools' promotion criteria align with published standards for documenting and evaluatin...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1686983

    authors: Hoffman LA,Lufler RS,Brown KM,DeVeau K,DeVaul N,Fatica LM,Mussell J,Byram JN,Dunham SM,Wilson AB

    更新日期:2020-04-01 00:00:00

  • A review of primary care training programs in correctional health for physicians.

    abstract:BACKGROUND:Despite the health consequences of incarceration, there are no national standards for teaching physicians about correctional health. The purpose of this study was to survey existing correctional health training programs for primary care physicians. SUMMARY:Programs were identified through literature and Web...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.641492

    authors: Min I,Schonberg D,Anderson M

    更新日期:2012-01-01 00:00:00

  • A teaching oath: a commitment to medical students' learning and development.

    abstract:BACKGROUND:There are several oaths and affirmations that are integrated into the academic customs of the health sciences, such as the Hippocratic Oath and the Ethical Affirmation for Scientists. What current oaths do not communicate is that teaching and learning are the foundation of the professions. SUMMARY:We articu...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.664987

    authors: Cottrell S,Gill A,Crow S,Saizow R,Nelson EA,Shumway JM

    更新日期:2012-01-01 00:00:00

  • Early career mentoring for translational researchers: mentee perspectives on challenges and issues.

    abstract:BACKGROUND:The education and training of early career biomedical translational researchers often involves formal mentoring by more experienced colleagues. PURPOSES:This study investigated the nature of these mentoring relationships from the perspective of mentees. The objective was to understand the challenges and iss...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2014.883983

    authors: Keller TE,Collier PJ,Blakeslee JE,Logan K,McCracken K,Morris C

    更新日期:2014-01-01 00:00:00

  • The Action Research Program: Experiential Learning in Systems-Based Practice for First-Year Medical Students.

    abstract:PROBLEM:Systems-based practice focuses on the organization, financing, and delivery of medical services. The American Association of Medical Colleges has recommended that systems-based practice be incorporated into medical schools' curricula. However, experiential learning in systems-based practice, including practical...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1146606

    authors: Ackerman SL,Boscardin C,Karliner L,Handley MA,Cheng S,Gaither TW,Hagey J,Hennein L,Malik F,Shaw B,Trinidad N,Zahner G,Gonzales R

    更新日期:2016-01-01 00:00:00

  • Designing a National Longitudinal Faculty Development Curriculum Focused on Educational Scholarship: Process, Outcomes, and Lessons Learned.

    abstract:PROBLEM:Clinical educators at U.S. academic health centers are frequently disadvantaged in the academic promotion system, lacking needed faculty development, mentoring, and networking support. INTERVENTION:In 2006, we implemented the national Educational Scholars Program to offer faculty development in educational sch...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2017.1282370

    authors: Chandran L,Gusic ME,Lane JL,Baldwin CD

    更新日期:2017-07-01 00:00:00

  • The Development and Impact of a Social Media and Professionalism Course for Medical Students.

    abstract:PROBLEM:Inappropriate social media behavior can have detrimental effects on students' future opportunities, but medical students are given little opportunity to reflect upon ways of integrating their social media identities with their newly forming professional identities. INTERVENTION:In 2012, a required educational ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1275971

    authors: Gomes AW,Butera G,Chretien KC,Kind T

    更新日期:2017-07-01 00:00:00

  • Validation and use of an instrument to measure the learning environment as perceived by medical students.

    abstract:BACKGROUND:Aiming to inform curriculum changes in medical school, we developed, administered, and validated a 31-question survey to measure the learning environment as perceived by medical students. DESCRIPTION:We administered the survey annually in 4 medical school classes in a Southeastern medical school from May 19...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1204_7

    authors: Pololi L,Price J

    更新日期:2000-10-01 00:00:00

  • An evidence-based domestic violence education program for internal medicine residents.

    abstract:BACKGROUND:Domestic violence (DV) is prevalent but often unrecognized, and it is a challenge to teach. This article presents an evidence-based DV education program for medical residents and incorporates it into a women's medicine curriculum. DESCRIPTION:An initial 3-hr seminar included video and case discussion, liter...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1504_09

    authors: Korenstein D,Thomas DC,Foldes C,Ross J,Halm E,McGinn T

    更新日期:2003-10-01 00:00:00

  • Underrepresented Minorities in Medical School Admissions: A Qualitative Study.

    abstract::Phenomenon: This study explored Black/African American and Hispanic/Latino medical students' perceptions of the medical school admissions process. Previous research has explored other elements of the medical education continuum. However, little is known regarding minorities' perceptions of navigating the medical schoo...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2016.1220861

    authors: Hadinger MA

    更新日期:2017-01-01 00:00:00

  • Competency in electrocardiogram interpretation among graduating medical students.

    abstract:BACKGROUND:The ability to accurately interpret electrocardiogram (ECG) abnormalities is a core competency for graduating medical students (GMS). Incorrect interpretation of ECG findings can result in adverse patient outcomes. To our knowledge, there has been no published study evaluating the level of competency in ECG ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2014.918882

    authors: Jablonover RS,Lundberg E,Zhang Y,Stagnaro-Green A

    更新日期:2014-01-01 00:00:00

  • Learning in a High-Stress Clinical Environment: Stressors Associated with Medical Students' Clerkship Training on Labor and Delivery.

    abstract::Phenomenon: Obstetrics and gynecology can be a high-stress clinical environment for medical students due to the specialty's fast-paced and unpredictable nature. Little is known about learning stressors for medical students on the obstetrics and gynecology clerkship to inform stress-reducing interventions and improve l...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1575742

    authors: Johnson NR,Pelletier A,Chen X,Manning-Geist BL

    更新日期:2019-08-01 00:00:00

  • Medical student perceptions of factors affecting productivity of problem-based learning tutorial groups: does culture influence the outcome?

    abstract:BACKGROUND:The popularization of problem-based learning (PBL) has drawn attention to the motivational and cognitive skills necessary for medical students in group learning. This study identifies the effect of motivational and cognitive factors on group productivity of PBL tutorial groups. DESCRIPTION:A self-administer...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1501_11

    authors: Das Carlo M,Swadi H,Mpofu D

    更新日期:2003-01-01 00:00:00

  • Validity Evidence for a Residency Admissions Standardized Assessment Letter for Pediatrics.

    abstract::Construct: This study aims to provide validity evidence for the standardized Assessment Letter for Pediatrics as a measure of competencies expected of a 1st-year pediatrics resident as part of a pediatric residency admissions process. BACKGROUND:The Narrative Letter of Recommendation is a frequently used tool in the ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2017.1367297

    authors: Bajwa NM,Yudkowsky R,Belli D,Vu NV,Park YS

    更新日期:2018-04-01 00:00:00

  • Further dissemination of medical education projects after presentation at a pediatric national meeting (1998-2008).

    abstract:BACKGROUND:Further dissemination of medical education work presented at national meetings is limited. PURPOSES:The purpose of this study was to explore dissemination outcomes of scholarly work in pediatric medical education. METHODS:Council on Medical Student Education in Pediatrics (COMSEP) members who presented at ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2013.857332

    authors: Smith S,Kind T,Beck G,Schiller J,McLauchlan H,Harris M,Gigante J

    更新日期:2014-01-01 00:00:00

  • Is medicine altruistic? A query from the medical school admissions office.

    abstract:BACKGROUND:Applicants to medical school often state that they are motivated by a desire to help others. Admissions officers must evaluate these claims, but assessment of altruism is difficult and imprecise. SUMMARY:A purely utilitarian moral philosophy denies the possibility of altruism. However, the Enlightenment phi...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1801_10

    authors: Bardes CL

    更新日期:2006-01-01 00:00:00

  • Cheating in OSCEs: The Impact of Simulated Security Breaches on OSCE Performance.

    abstract::Construct: Valid score interpretation is important for constructs in performance assessments such as objective structured clinical examinations (OSCEs). An OSCE is a type of performance assessment in which a series of standardized patients interact with the student or candidate who is scored by either the standardized...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1080/10401334.2016.1202832

    authors: Gotzmann A,De Champlain A,Homayra F,Fotheringham A,de Vries I,Forgie M,Pugh D

    更新日期:2017-01-01 00:00:00

  • Griev_Ing: death notification skills and applications for fourth-year medical students.

    abstract:BACKGROUND AND PURPOSE:Our study examined whether GRIEV_ING improved death notification skills of medical students, whether pretesting with simulated survivors primed learners and improved results of the intervention, and whether feedback on the simulated encounter improved student performance. METHODS:GRIEV_ING train...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401330903018450

    authors: Hobgood CD,Tamayo-Sarver JH,Hollar DW Jr,Sawning S

    更新日期:2009-07-01 00:00:00

  • Students assigned to community practices for their pediatric clerkship perform as well or better on written examinations as students assigned to academic medical centers.

    abstract:BACKGROUND:Medical schools are increasingly using community practice sites (CPS) for clerkship training. PURPOSES:We compared the test performance of all students assigned to CPS with all students trained at an academic medical center (AMC) for their pediatric clerkship for the past 5 years. METHODS:Baseline comparab...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1603_5

    authors: White CB,Thomas AM

    更新日期:2004-07-01 00:00:00

  • Trainees' perceptions of practitioner competence during patient transfer.

    abstract:BACKGROUND:Technical and communicative skills are both important features for one's perception of practitioner competence. PURPOSE:This research examines how trainees' perceptions of practitioner competence change as they view health care practitioners who vary in their technical and communicative skill proficiencies....

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2012.664528

    authors: Grierson L,Dubrowski A,So S,Kistner N,Carnahan H

    更新日期:2012-01-01 00:00:00

  • Ambulatory morning report: an underutilized educational modality.

    abstract:BACKGROUND:Many medicine residency training programs include a lecture-based preclinic conference series as part of the ambulatory educational curriculum when more effective teaching formats might be available. Our institution has replaced this lecture-based teaching format with an ambulatory morning report modeled aft...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/S15328015TLM1301_9

    authors: Demopoulos B,Pelzman F,Wenderoth S

    更新日期:2001-01-01 00:00:00

  • e-Professionalism: a new frontier in medical education.

    abstract:BACKGROUND:This article, prepared by the Association of Professors of Gynecology and Obstetrics Undergraduate Medical Education Committee, discusses the evolving challenges facing medical educators posed by social media and a new form of professionalism that has been termed e-professionalism. SUMMARY:E-professionalism...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2013.770741

    authors: Kaczmarczyk JM,Chuang A,Dugoff L,Abbott JF,Cullimore AJ,Dalrymple J,Davis KR,Hueppchen NA,Katz NT,Nuthalapaty FS,Pradhan A,Wolf A,Casey PM

    更新日期:2013-01-01 00:00:00

  • The Influence of Students' Perceptions of Learning Environment on Coping with Academic Challenges: A Structural Equation Modeling Study.

    abstract::Theory: Self-compassion has been identified as a promising interventional target enabling medical learners to respond effectively to stressors and challenges of medical training. Determining factors in the learning environment that support self-compassion is critical for developing such interventions. What is already ...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1667241

    authors: Rashid M,Guo Q,Babenko O

    更新日期:2020-04-01 00:00:00

  • Increasing Medical Students' Confidence in Procedural Skills Using a Junior Doctor-Delivered Bedside Supervision Program.

    abstract:PROBLEM:Clinical procedural skills are formally taught to medical students in clinical skills centers using mannequins. Exposure to procedural skills involving patients and opportunities to practice under the supervision of doctors are limited. INTERVENTION:A bedside supervision program was piloted at a district gener...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2015.1077130

    authors: Mughal Z,Noory S

    更新日期:2015-01-01 00:00:00

  • Attending Emergency Physicians' Perceptions of a Programmatic Workplace-Based Assessment System: The McMaster Modular Assessment Program (McMAP).

    abstract::Construct: The McMaster Modular Assessment Program (McMAP) is a programmatic workplace-based assessment (WBA) system that provides emergency medicine trainees with competency judgments through frequent task-specific and global daily assessments. Background: The longevity of McMAP relative to other programmatic WBA sys...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1080/10401334.2019.1574581

    authors: Acai A,Li SA,Sherbino J,Chan TM

    更新日期:2019-08-01 00:00:00

  • A comparison of in-class learner engagement across lecture, problem-based learning, and team learning using the STROBE classroom observation tool.

    abstract:BACKGROUND:Having recently introduced team learning into the preclinical medical curriculum, evidence of the relative impact of this instructional method on in-class learner engagement was sought. PURPOSE:To compare patterns of engagement behaviors among learners in class sessions across 3 distinct instructional metho...

    journal_title:Teaching and learning in medicine

    pub_type: 杂志文章

    doi:10.1207/s15328015tlm1702_4

    authors: Kelly PA,Haidet P,Schneider V,Searle N,Seidel CL,Richards BF

    更新日期:2005-04-01 00:00:00