Physicians' diagnostic accuracy, confidence, and resource requests: a vignette study.

Abstract:

IMPORTANCE:Little is known about the relationship between physicians' diagnostic accuracy and their confidence in that accuracy. OBJECTIVE:To evaluate how physicians' diagnostic calibration, defined as the relationship between diagnostic accuracy and confidence in that accuracy, changes with evolution of the diagnostic process and with increasing diagnostic difficulty of clinical case vignettes. DESIGN, SETTING, AND PARTICIPANTS:We recruited general internists from an online physician community and asked them to diagnose 4 previously validated case vignettes of variable difficulty (2 easier; 2 more difficult). Cases were presented in a web-based format and divided into 4 sequential phases simulating diagnosis evolution: history, physical examination, general diagnostic testing data, and definitive diagnostic testing. After each phase, physicians recorded 1 to 3 differential diagnoses and corresponding judgments of confidence. Before being presented with definitive diagnostic data, physicians were asked to identify additional resources they would require to diagnose each case (ie, additional tests, second opinions, curbside consultations, referrals, and reference materials). MAIN OUTCOMES AND MEASURES:Diagnostic accuracy (scored as 0 or 1), confidence in diagnostic accuracy (on a scale of 0-10), diagnostic calibration, and whether additional resources were requested (no or yes). RESULTS:A total of 118 physicians with broad geographical representation within the United States correctly diagnosed 55.3% of easier and 5.8% of more difficult cases (P < .001). Despite a large difference in diagnostic accuracy between easier and more difficult cases, the difference in confidence was relatively small (7.2 vs 6.4 out of 10, for easier and more difficult cases, respectively) (P < .001) and likely clinically insignificant. Overall, diagnostic calibration was worse for more difficult cases (P < .001) and characterized by overconfidence in accuracy. Higher confidence was related to decreased requests for additional diagnostic tests (P = .01); higher case difficulty was related to more requests for additional reference materials (P = .01). CONCLUSIONS AND RELEVANCE:Our study suggests that physicians' level of confidence may be relatively insensitive to both diagnostic accuracy and case difficulty. This mismatch might prevent physicians from reexamining difficult cases where their diagnosis may be incorrect.

journal_name

JAMA Intern Med

journal_title

JAMA internal medicine

authors

Meyer AN,Payne VL,Meeks DW,Rao R,Singh H

doi

10.1001/jamainternmed.2013.10081

subject

Has Abstract

pub_date

2013-11-25 00:00:00

pages

1952-8

issue

21

eissn

2168-6106

issn

2168-6114

pii

1731967

journal_volume

173

pub_type

杂志文章
  • Modeling Contagion Through Social Networks to Explain and Predict Gunshot Violence in Chicago, 2006 to 2014.

    abstract:Importance:Every day in the United States, more than 200 people are murdered or assaulted with a firearm. Little research has considered the role of interpersonal ties in the pathways through which gun violence spreads. Objective:To evaluate the extent to which the people who will become subjects of gun violence can b...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2016.8245

    authors: Green B,Horel T,Papachristos AV

    更新日期:2017-03-01 00:00:00

  • Atrial fibrillation and the risk of myocardial infarction.

    abstract:IMPORTANCE:Myocardial infarction (MI) is an established risk factor for atrial fibrillation (AF). However, the extent to which AF is a risk factor for MI has not been investigated. OBJECTIVE:To examine the risk of incident MI associated with AF. DESIGN, SETTING, AND PARTICIPANTS:A prospective cohort of 23,928 partici...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2013.11912

    authors: Soliman EZ,Safford MM,Muntner P,Khodneva Y,Dawood FZ,Zakai NA,Thacker EL,Judd S,Howard VJ,Howard G,Herrington DM,Cushman M

    更新日期:2014-01-01 00:00:00

  • Clinical Evaluation of Human Papillomavirus Screening With p16/Ki-67 Dual Stain Triage in a Large Organized Cervical Cancer Screening Program.

    abstract:Importance:As cervical cancer screening transitions from Papanicolaou cytologic screening to primary human papillomavirus (HPV) testing worldwide, effective triage tests are needed to decide who among the HPV-positive women should receive further diagnostic evaluation to avoid unnecessary colposcopies and biopsies. Ob...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.0306

    authors: Wentzensen N,Clarke MA,Bremer R,Poitras N,Tokugawa D,Goldhoff PE,Castle PE,Schiffman M,Kingery JD,Grewal KK,Locke A,Kinney W,Lorey TS

    更新日期:2019-07-01 00:00:00

  • Urinary Incontinence Before and After Bariatric Surgery.

    abstract:IMPORTANCE:Among women and men with severe obesity, evidence for improvement in urinary incontinence beyond the first year after bariatric surgery-induced weight loss is lacking. OBJECTIVES:To examine change in urinary incontinence before and after bariatric surgery and to identify factors associated with improvement ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2015.2609

    authors: Subak LL,King WC,Belle SH,Chen JY,Courcoulas AP,Ebel FE,Flum DR,Khandelwal S,Pender JR,Pierson SK,Pories WJ,Steffen KJ,Strain GW,Wolfe BM,Huang AJ

    更新日期:2015-08-01 00:00:00

  • Association of History of Gestational Diabetes With Long-term Cardiovascular Disease Risk in a Large Prospective Cohort of US Women.

    abstract:Importance:Previous studies identify gestational diabetes (GD) as a risk factor for intermediate markers of cardiovascular disease (CVD) risk; however, few are prospective, evaluate hard CVD end points, or account for shared risk factors including body weight and lifestyle. Objective:To prospectively evaluate history ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2017.2790

    authors: Tobias DK,Stuart JJ,Li S,Chavarro J,Rimm EB,Rich-Edwards J,Hu FB,Manson JE,Zhang C

    更新日期:2017-12-01 00:00:00

  • Effect of a Patient and Clinician Communication-Priming Intervention on Patient-Reported Goals-of-Care Discussions Between Patients With Serious Illness and Clinicians: A Randomized Clinical Trial.

    abstract:Importance:Clinician communication about goals of care is associated with improved patient outcomes and reduced intensity of end-of-life care, but it is unclear whether interventions can improve this communication. Objective:To evaluate the efficacy of a patient-specific preconversation communication-priming intervent...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1001/jamainternmed.2018.2317

    authors: Curtis JR,Downey L,Back AL,Nielsen EL,Paul S,Lahdya AZ,Treece PD,Armstrong P,Peck R,Engelberg RA

    更新日期:2018-07-01 00:00:00

  • Assessment of the Safety of Discharging Select Patients Directly Home From the Intensive Care Unit: A Multicenter Population-Based Cohort Study.

    abstract:Importance:The safety of discharging adult patients recovering from critical illness directly home from the intensive care unit (ICU) is unknown. Objective:To compare the health care utilization and clinical outcomes for ICU patients discharged directly home from the ICU with those of patients discharged home via the ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1001/jamainternmed.2018.3675

    authors: Stelfox HT,Soo A,Niven DJ,Fiest KM,Wunsch H,Rowan KM,Bagshaw SM

    更新日期:2018-10-01 00:00:00

  • National Registry Data and Record Linkage to Inform Postmarket Surveillance of Prosthetic Aortic Valve Models Over 15 Years.

    abstract:Importance:Postmarket evidence generation for medical devices is important yet limited for prosthetic aortic valve devices in the United Kingdom. Objective:To identify prosthetic aortic valve models that display unexpected patterns of mortality or reintervention using routinely collected national registry data and rec...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2016.6936

    authors: Hickey GL,Bridgewater B,Grant SW,Deanfield J,Parkinson J,Bryan AJ,Dalrymple-Hay M,Moat N,Buchan I,Dunning J

    更新日期:2017-01-01 00:00:00

  • Impact of providing fee data on laboratory test ordering: a controlled clinical trial.

    abstract:IMPORTANCE:Inpatient care providers often order laboratory tests without any appreciation for the costs of the tests. OBJECTIVE:To determine whether we could decrease the number of laboratory tests ordered by presenting providers with test fees at the time of order entry in a tertiary care hospital, without adding ext...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2013.232

    authors: Feldman LS,Shihab HM,Thiemann D,Yeh HC,Ardolino M,Mandell S,Brotman DJ

    更新日期:2013-05-27 00:00:00

  • Evaluating the Association of Clinical Characteristics With Neutralizing Antibody Levels in Patients Who Have Recovered From Mild COVID-19 in Shanghai, China.

    abstract:Importance:The coronavirus disease 2019 (COVID-19) pandemic caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) threatens global public health. The association between clinical characteristics of the virus and neutralizing antibodies (NAbs) against this virus have not been well studied. Objective:To...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2020.4616

    authors: Wu F,Liu M,Wang A,Lu L,Wang Q,Gu C,Chen J,Wu Y,Xia S,Ling Y,Zhang Y,Xun J,Zhang R,Xie Y,Jiang S,Zhu T,Lu H,Wen Y,Huang J

    更新日期:2020-10-01 00:00:00

  • Association of Industry Sponsorship With Outcomes of Nutrition Studies: A Systematic Review and Meta-analysis.

    abstract:Importance:Food industry sponsorship of nutrition research may bias research reports, systematic reviews, and dietary guidelines. Objective:To determine whether food industry sponsorship is associated with effect sizes, statistical significance of results, and conclusions of nutrition studies with findings that are fa...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,meta分析,评审

    doi:10.1001/jamainternmed.2016.6721

    authors: Chartres N,Fabbri A,Bero LA

    更新日期:2016-12-01 00:00:00

  • Assessment of Self-reported Prognostic Expectations of People Undergoing Dialysis: United States Renal Data System Study of Treatment Preferences (USTATE).

    abstract:Importance:Prognostic understanding can shape patients' treatment goals and preferences. Patients undergoing dialysis in the United States have limited life expectancy and may receive end-of-life care directed at life extension. Little is known about their prognostic expectations. Objective:To understand the prognosti...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.2879

    authors: O'Hare AM,Kurella Tamura M,Lavallee DC,Vig EK,Taylor JS,Hall YN,Katz R,Curtis JR,Engelberg RA

    更新日期:2019-07-08 00:00:00

  • Long-term Outcomes Associated With Implantable Cardioverter Defibrillator in Adults With Chronic Kidney Disease.

    abstract:Importance:Chronic kidney disease (CKD) is common in adults with heart failure and is associated with an increased risk of sudden cardiac death. Randomized trials of participants without CKD have demonstrated that implantable cardioverter defibrillators (ICDs) decrease the risk of arrhythmic death in selected patients ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2017.8462

    authors: Bansal N,Szpiro A,Reynolds K,Smith DH,Magid DJ,Gurwitz JH,Masoudi F,Greenlee RT,Tabada GH,Sung SH,Dighe A,Go AS

    更新日期:2018-03-01 00:00:00

  • Association between a hospital's rate of cardiac arrest incidence and cardiac arrest survival.

    abstract:IMPORTANCE:National efforts to measure hospital performance in treating cardiac arrest have focused on case survival, with the hope of improving survival after cardiac arrest. However, it is plausible that hospitals with high case-survival rates do a poor job of preventing cardiac arrests in the first place. OBJECTIVE...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1001/jamainternmed.2013.1026

    authors: Chen LM,Nallamothu BK,Spertus JA,Li Y,Chan PS,American Heart Association’s Get With the Guidelines-Resuscitation (formerly the National Registry of Cardiopulmonary Resuscitation) Investigators.

    更新日期:2013-07-08 00:00:00

  • Estimation of Excess Deaths Associated With the COVID-19 Pandemic in the United States, March to May 2020.

    abstract:Importance:Efforts to track the severity and public health impact of coronavirus disease 2019 (COVID-19) in the United States have been hampered by state-level differences in diagnostic test availability, differing strategies for prioritization of individuals for testing, and delays between testing and reporting. Evalu...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2020.3391

    authors: Weinberger DM,Chen J,Cohen T,Crawford FW,Mostashari F,Olson D,Pitzer VE,Reich NG,Russi M,Simonsen L,Watkins A,Viboud C

    更新日期:2020-10-01 00:00:00

  • Treatment of Vitamin D Insufficiency in Postmenopausal Women: A Randomized Clinical Trial.

    abstract:IMPORTANCE:Experts debate optimal 25-hydroxyvitamin D (25[OH]D) levels for musculoskeletal health. OBJECTIVE:To compare the effects of placebo, low-dose cholecalciferol, and high-dose cholecalciferol on 1-year changes in total fractional calcium absorption, bone mineral density, Timed Up and Go and five sit-to-stand t...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1001/jamainternmed.2015.3874

    authors: Hansen KE,Johnson RE,Chambers KR,Johnson MG,Lemon CC,Vo TN,Marvdashti S

    更新日期:2015-10-01 00:00:00

  • Effect of angiotensin-converting enzyme inhibitors and angiotensin II receptor blockers on all-cause mortality, cardiovascular deaths, and cardiovascular events in patients with diabetes mellitus: a meta-analysis.

    abstract:IMPORTANCE:Angiotensin-converting enzyme inhibitors (ACEIs) and angiotensin II receptor blockers (ARBs) may have different effects on cardiovascular (CV) events in patients with diabetes mellitus (DM). OBJECTIVE:To conduct a meta-analysis to separately evaluate the effects of ACEIs and ARBs on all-cause mortality, CV ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,meta分析

    doi:10.1001/jamainternmed.2014.348

    authors: Cheng J,Zhang W,Zhang X,Han F,Li X,He X,Li Q,Chen J

    更新日期:2014-05-01 00:00:00

  • Lung Cancer Mortality Associated With Smoking and Smoking Cessation Among People Living With HIV in the United States.

    abstract:Importance:Lung cancer has become a leading cause of death among people living with human immunodeficiency virus (HIV) (PLWH). Over 40% of PLWH in the United States smoke cigarettes; HIV independently increases the risk of lung cancer. Objective:To project cumulative lung cancer mortality by smoking exposure among PLW...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2017.4349

    authors: Reddy KP,Kong CY,Hyle EP,Baggett TP,Huang M,Parker RA,Paltiel AD,Losina E,Weinstein MC,Freedberg KA,Walensky RP

    更新日期:2017-11-01 00:00:00

  • Cardiovascular safety of inhaled long-acting bronchodilators in individuals with chronic obstructive pulmonary disease.

    abstract:IMPORTANCE:Chronic obstructive pulmonary disease (COPD) is a common and deadly disease. Long-acting inhaled β-agonists and anticholinergics, first-line medications for COPD, have been associated with increased risk of cardiovascular outcomes. When choosing between the medications, patients and physicians would benefit ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2013.1016

    authors: Gershon A,Croxford R,Calzavara A,To T,Stanbrook MB,Upshur R,Stukel TA

    更新日期:2013-07-08 00:00:00

  • Use of cardiac biomarker testing in the emergency department.

    abstract:IMPORTANCE:Cardiac biomarker testing is not routinely indicated in the emergency department (ED) because of low utility and potential downstream harms from false-positive results. However, current rates of testing are unknown. OBJECTIVE:To determine the use of cardiac biomarker testing overall, as well as stratified b...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2014.5830

    authors: Makam AN,Nguyen OK

    更新日期:2015-01-01 00:00:00

  • National burden of invasive methicillin-resistant Staphylococcus aureus infections, United States, 2011.

    abstract:IMPORTANCE:Estimating the US burden of methicillin-resistant Staphylococcus aureus (MRSA) infections is important for planning and tracking success of prevention strategies. OBJECTIVE:To describe updated national estimates and characteristics of health care- and community-associated invasive methicillin-resistant Stap...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2013.10423

    authors: Dantes R,Mu Y,Belflower R,Aragon D,Dumyati G,Harrison LH,Lessa FC,Lynfield R,Nadle J,Petit S,Ray SM,Schaffner W,Townes J,Fridkin S,Emerging Infections Program–Active Bacterial Core Surveillance MRSA Surveillance Investigators

    更新日期:2013-11-25 00:00:00

  • Yield of routine provocative cardiac testing among patients in an emergency department-based chest pain unit.

    abstract:IMPORTANCE:The American Heart Association recommends routine provocative cardiac testing in accelerated diagnostic protocols for coronary ischemia. The diagnostic and therapeutic yield of this approach are unknown. OBJECTIVE:To assess the yield of routine provocative cardiac testing in an emergency department-based ch...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2013.850

    authors: Hermann LK,Newman DH,Pleasant WA,Rojanasarntikul D,Lakoff D,Goldberg SA,Duvall WL,Henzlova MJ

    更新日期:2013-06-24 00:00:00

  • Association Between Receipt of a Medically Tailored Meal Program and Health Care Use.

    abstract:Importance:Whether interventions to improve food access can reduce health care use is unknown. Objective:To determine whether participation in a medically tailored meal intervention is associated with fewer subsequent hospitalizations. Design, Setting, and Participants:A retrospective cohort study was conducted using...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.0198

    authors: Berkowitz SA,Terranova J,Randall L,Cranston K,Waters DB,Hsu J

    更新日期:2019-06-01 00:00:00

  • Device-guided breathing as treatment for hypertension in type 2 diabetes mellitus: a randomized, double-blind, sham-controlled trial.

    abstract:IMPORTANCE:Biofeedback with device-guided lowering of breathing frequency could be an alternate nonpharmacologic treatment option for hypertension. Evidence from trials with high methodologic quality is lacking. OBJECTIVE:To evaluate the effects of device-guided lowering of breathing frequency on blood pressure in pat...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1001/jamainternmed.2013.6883

    authors: Landman GW,Drion I,van Hateren KJ,van Dijk PR,Logtenberg SJ,Lambert J,Groenier KH,Bilo HJ,Kleefstra N

    更新日期:2013-07-22 00:00:00

  • Association of a Workplace Sales Ban on Sugar-Sweetened Beverages With Employee Consumption of Sugar-Sweetened Beverages and Health.

    abstract:Importance:Reductions in sugar-sweetened beverage (SSB) intake can improve health, but are difficult for individuals to achieve on their own. Objectives:To evaluate whether a workplace SSB sales ban was associated with SSB intake and cardiometabolic health among employees and whether a brief motivational intervention ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.4434

    authors: Epel ES,Hartman A,Jacobs LM,Leung C,Cohn MA,Jensen L,Ishkanian L,Wojcicki J,Mason AE,Lustig RH,Stanhope KL,Schmidt LA

    更新日期:2019-10-28 00:00:00

  • Observational modeling of strict vs conventional blood pressure control in patients with chronic kidney disease.

    abstract:IMPORTANCE:The effect of strict blood pressure control on clinical outcomes in patients with chronic kidney disease (CKD) is unclear. OBJECTIVE:To compare the outcomes associated with a treated systolic blood pressure (SBP) of less than 120 mm Hg vs those associated with the currently recommended SBP of less than 140 ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2014.3279

    authors: Kovesdy CP,Lu JL,Molnar MZ,Ma JZ,Canada RB,Streja E,Kalantar-Zadeh K,Bleyer AJ

    更新日期:2014-09-01 00:00:00

  • Improving Communication About Serious Illness in Primary Care: A Review.

    abstract:IMPORTANCE:The Institute of Medicine recently called for systematic improvements in clinician-led conversations about goals, values, and care preferences for patients with serious and life-threatening illnesses. Studies suggest that these conversations are associated with improved outcomes for patients and their famili...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,评审

    doi:10.1001/jamainternmed.2016.3212

    authors: Lakin JR,Block SD,Billings JA,Koritsanszky LA,Cunningham R,Wichmann L,Harvey D,Lamey J,Bernacki RE

    更新日期:2016-09-01 00:00:00

  • Risk for Clinically Relevant Adverse Cardiac Events in Patients With Chest Pain at Hospital Admission.

    abstract:IMPORTANCE:Patients with potentially ischemic chest pain are commonly admitted to the hospital or observed after a negative evaluation in the emergency department (ED) owing to concern about adverse events. Previous studies have looked at 30-day mortality, but no current large studies have examined the most important i...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1001/jamainternmed.2015.1674

    authors: Weinstock MB,Weingart S,Orth F,VanFossen D,Kaide C,Anderson J,Newman DH

    更新日期:2015-07-01 00:00:00

  • Evidence-Based Guidelines to Eliminate Repetitive Laboratory Testing.

    abstract::Routine daily laboratory testing of hospitalized patients reflects a wasteful clinical practice that threatens the value of health care. Choosing Wisely initiatives from numerous professional societies have identified repetitive laboratory testing in the face of clinical stability as low value care. Although laborator...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,评审

    doi:10.1001/jamainternmed.2017.5152

    authors: Eaton KP,Levy K,Soong C,Pahwa AK,Petrilli C,Ziemba JB,Cho HJ,Alban R,Blanck JF,Parsons AS

    更新日期:2017-12-01 00:00:00

  • Association of blood transfusion with increased mortality in myocardial infarction: a meta-analysis and diversity-adjusted study sequential analysis.

    abstract:BACKGROUND:The benefit of blood transfusion in patients with myocardial infarction is controversial, and a possibility of harm exists. METHODS:A systematic search of studies published between January 1, 1966, and March 31, 2012, was conducted using MEDLINE, EMBASE, CINAHL, Scopus, Web of Science, and Cochrane Central ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,meta分析

    doi:10.1001/2013.jamainternmed.1001

    authors: Chatterjee S,Wetterslev J,Sharma A,Lichstein E,Mukherjee D

    更新日期:2013-01-28 00:00:00