Reporting and Implementing Interventions Involving Machine Learning and Artificial Intelligence.

Abstract:

:Increasingly, interventions aimed at improving care are likely to use such technologies as machine learning and artificial intelligence. However, health care has been relatively late to adopt them. This article provides clinical examples in which machine learning and artificial intelligence are already in use in health care and appear to deliver benefit. Three key bottlenecks toward increasing the pace of diffusion and adoption are methodological issues in evaluation of artificial intelligence-based interventions, reporting standards to enable assessment of model performance, and issues that need to be addressed for an institution to adopt these interventions. Methodological best practices will include external validation, ideally at a different site; use of proactive learning algorithms to correct for site-specific biases and increase robustness as algorithms are deployed across multiple sites; addressing subgroup performance; and communicating to providers the uncertainty of predictions. Regarding reporting, especially important issues are the extent to which implementing standardized approaches for introducing clinical decision support has been followed, describing the data sources, reporting on data assumptions, and addressing biases. Although most health care organizations in the United States have adopted electronic health records, they may be ill prepared to adopt machine learning and artificial intelligence. Several steps can enable this: preparing data, developing tools to get suggestions to clinicians in useful ways, and getting clinicians engaged in the process. Open challenges and the role of regulation in this area are briefly discussed. Although these techniques have enormous potential to improve care and personalize recommendations for individuals, the hype regarding them is tremendous. Organizations will need to approach this domain carefully with knowledgeable partners to obtain the hoped-for benefits and avoid failures.

journal_name

Ann Intern Med

authors

Bates DW,Auerbach A,Schulam P,Wright A,Saria S

doi

10.7326/M19-0872

subject

Has Abstract

pub_date

2020-06-02 00:00:00

pages

S137-S144

issue

11 Suppl

eissn

0003-4819

issn

1539-3704

journal_volume

172

pub_type

杂志文章,评审
  • ClinicalTrials.gov and Drugs@FDA: A Comparison of Results Reporting for New Drug Approval Trials.

    abstract:BACKGROUND:Pharmaceutical companies and other trial sponsors must submit certain trial results to ClinicalTrials.gov. The validity of these results is unclear. PURPOSE:To validate results posted on ClinicalTrials.gov against publicly available U.S. Food and Drug Administration (FDA) reviews on Drugs@FDA. DATA SOURCES...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/M15-2658

    authors: Schwartz LM,Woloshin S,Zheng E,Tse T,Zarin DA

    更新日期:2016-09-20 00:00:00

  • Ventricular arrhythmias in ischemic heart disease.

    abstract::Ventricular arrhythmias remain the leading cause of death from coronary artery disease. This review summarizes current thinking in several areas relating to the pathophysiology, prognosis, and therapy of ventricular arrhythmias associated with acute and chronic coronary artery disease syndromes. The experimental basis...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-114-9-784

    authors: Weiss JN,Nademanee K,Stevenson WG,Singh B

    更新日期:1991-05-01 00:00:00

  • Pathologic findings in guinea pigs inoculated intraperitoneally with the Legionnaires' disease bacterium.

    abstract::Tissues from guinea pigs inoculated intraperitoneally with the Legionnaires' disease (LD) bacterium were studied with light, immunofluorescent, and electron microscopy. The principal gross lesion was diffuse peritonitis of varying severity. Microscopically, the peritonitis of covered by a mixed inflammatory infiltrate...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-90-4-671

    authors: Chandler FW,McDade JE,Hicklin MD,Blackmon JA,Thomason BM,Ewing EP Jr

    更新日期:1979-04-01 00:00:00

  • Characterization of the glomerular antibody in acute poststreptococcal glomerulonephritis.

    abstract::Glomerular-fixed antibody was eluted from the kidney of a 17-year-old patient who died 2 weeks after the onset of acute poststreptococcal glomerulonephritis. Elevated titers of antibodies to streptococcal enzymes were found in the serum but not in the glomerular eluate. Streptococcal M protein and anti-M protein react...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-92-4-478

    authors: Rodríguez-Iturbe B,Rabideau D,García R,Rubio L,McIntosh RM

    更新日期:1980-04-01 00:00:00

  • Identification of K-ras mutations in pancreatic juice in the early diagnosis of pancreatic cancer.

    abstract:OBJECTIVE:To develop an early diagnostic test for pancreatic cancer based on the identification of K-ras mutations in pure pancreatic juice collected during endoscopic retrograde pancreatography. DESIGN:Prospective study with masked comparison. The standard criteria for the diagnosis of pancreatic cancer were pancreat...

    journal_title:Annals of internal medicine

    pub_type: 临床试验,杂志文章

    doi:10.7326/0003-4819-123-3-199508010-00005

    authors: Berthélemy P,Bouisson M,Escourrou J,Vaysse N,Rumeau JL,Pradayrol L

    更新日期:1995-08-01 00:00:00

  • Press releases by academic medical centers: not so academic?

    abstract:BACKGROUND:The news media are often criticized for exaggerated coverage of weak science. Press releases, a source of information for many journalists, might be a source of those exaggerations. OBJECTIVE:To characterize research press releases from academic medical centers. DESIGN:Content analysis. SETTING:Press rele...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-150-9-200905050-00007

    authors: Woloshin S,Schwartz LM,Casella SL,Kennedy AT,Larson RJ

    更新日期:2009-05-05 00:00:00

  • High-dose immunoglobulin therapy for severe IgA nephropathy and Henoch-Schönlein purpura.

    abstract:OBJECTIVE:To determine if polyvalent IgG is promising therapy for severe IgG nephropathy. DESIGN:Open prospective cohort study. SETTING:Referral nephrology unit. PATIENTS:11 adult patients with severe IgA nephropathy (9 who had idiopathic disease and 2 who had Henoch-Schönlein purpura) and indicators of poor prognos...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-120-6-199403150-00005

    authors: Rostoker G,Desvaux-Belghiti D,Pilatte Y,Petit-Phar M,Philippon C,Deforges L,Terzidis H,Intrator L,André C,Adnot S,Bonin P,Bierling P,Remy P,Lagrue G,Lang P,Weil B

    更新日期:1994-03-15 00:00:00

  • Use of cytotoxic agents and cyclosporine in the treatment of autoimmune disease. Part 2: Inflammatory bowel disease, systemic vasculitis, and therapeutic toxicity.

    abstract::When cytotoxic agents were introduced, their ability to disrupt nucleic acid and protein synthesis led to their effective use for the treatment of neoplastic disease. During the course of this use, however, it became apparent that these agents also suppress the immune system. This usually unwelcome effect was subseque...

    journal_title:Annals of internal medicine

    pub_type: 共识发展会议,杂志文章,评审

    doi:10.7326/0003-4819-129-1-199807010-00012

    authors: Langford CA,Klippel JH,Balow JE,James SP,Sneller MC

    更新日期:1998-07-01 00:00:00

  • Optimizing care for persons with HIV infection. Society of General Internal Medicine AIDS Task Force.

    abstract::Treatment advances and outcomes data have raised new concerns about how to optimize care for patients with HIV infection. This paper reviews evidence on 1) the relation between experience and type of training and patient outcomes, 2) the relation between the components of primary care and patient outcomes, and 3) prim...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-131-2-199907200-00011

    authors: Hecht FM,Wilson IB,Wu AW,Cook RL,Turner BJ

    更新日期:1999-07-20 00:00:00

  • Discontinuation of chemoprophylaxis against Pneumocystis carinii pneumonia in patients with HIV infection. HIV Outpatient Study (HOPS) Investigators.

    abstract:BACKGROUND:HIV-infected patients with sustained immunologic improvement from antiretroviral therapy may be able to discontinue chemoprophylaxis against Pneumocystis carinii pneumonia (PCP). OBJECTIVE:To compare PCP incidence in HIV-infected patients who had sustained CD4+ lymphocyte counts greater than 200 cells/mm3 a...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-132-3-200002010-00005

    authors: Yangco BG,Von Bargen JC,Moorman AC,Holmberg SD

    更新日期:2000-02-01 00:00:00

  • Rapid Rule-out of Acute Myocardial Infarction With a Single High-Sensitivity Cardiac Troponin T Measurement Below the Limit of Detection: A Collaborative Meta-analysis.

    abstract:Background:High-sensitivity assays for cardiac troponin T (hs-cTnT) are sometimes used to rapidly rule out acute myocardial infarction (AMI). Purpose:To estimate the ability of a single hs-cTnT concentration below the limit of detection (<0.005 µg/L) and a nonischemic electrocardiogram (ECG) to rule out AMI in adults ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,meta分析

    doi:10.7326/M16-2562

    authors: Pickering JW,Than MP,Cullen L,Aldous S,Ter Avest E,Body R,Carlton EW,Collinson P,Dupuy AM,Ekelund U,Eggers KM,Florkowski CM,Freund Y,George P,Goodacre S,Greenslade JH,Jaffe AS,Lord SJ,Mokhtari A,Mueller C,Munro A

    更新日期:2017-05-16 00:00:00

  • Association of fibrinogen with glycemic control and albumin excretion rate in patients with non-insulin-dependent diabetes mellitus.

    abstract:BACKGROUND:The high prevalence of classic cardiac risk factors in patients with non-insulin-dependent diabetes mellitus does not explain the increased cardiovascular-related morbidity and mortality in these patients. Fibrinogen may have a role in this excess risk. OBJECTIVE:To evaluate the following in patients with n...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-125-8-199610150-00005

    authors: Bruno G,Cavallo-Perin P,Bargero G,Borra M,D'Errico N,Pagano G

    更新日期:1996-10-15 00:00:00

  • Quantitative Results of a National Intervention to Prevent Central Line-Associated Bloodstream Infection: A Pre-Post Observational Study.

    abstract:Background:Central line-associated bloodstream infection (CLABSI) remains prevalent in hospitals in the United States. Objective:To evaluate the impact of a multimodal intervention in hospitals with elevated rates of health care-associated infection. Design:Pre-post observational evaluation of a prospective, national...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,多中心研究

    doi:10.7326/M18-3533

    authors: Patel PK,Greene MT,Jones K,Rolle AJ,Ratz D,Snyder A,Saint S,Chopra V

    更新日期:2019-10-01 00:00:00

  • Combination therapy with telaprevir for chronic hepatitis C virus genotype 1 infection in patients with HIV: a randomized trial.

    abstract:BACKGROUND:Telaprevir (TVR) plus peginterferon-α2a (PEG-IFN-α2a) and ribavirin substantially increases treatment efficacy for genotype 1 chronic hepatitis C virus (HCV) infection versus PEG-IFN-α2a-ribavirin alone. Its safety and efficacy in patients with HCV and HIV-1 are unknown. OBJECTIVE:To assess the safety and e...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.7326/0003-4819-159-2-201307160-00654

    authors: Sulkowski MS,Sherman KE,Dieterich DT,Bsharat M,Mahnke L,Rockstroh JK,Gharakhanian S,McCallister S,Henshaw J,Girard PM,Adiwijaya B,Garg V,Rubin RA,Adda N,Soriano V

    更新日期:2013-07-16 00:00:00

  • The prevalence of tuberculosis and positive tuberculin skin tests in a steroid-treated asthmatic population.

    abstract::The prevalence of active tuberculosis and positive tuberculin skin tests was assessed in 132 corticosteroid-treated asthmatics for an evaluation period that represented 620 corticosteroid-years of therapy. There was no evidence of active tuberculosis in any of these patients. Positive intermediate-strength tuberculin ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-84-3-261

    authors: Schatz M,Patterson R,Kloner R,Falk J

    更新日期:1976-03-01 00:00:00

  • Residual venous thrombosis as a predictive factor of recurrent venous thromboembolism.

    abstract:BACKGROUND:The optimum duration of anticoagulant therapy after an episode of deep venous thrombosis (DVT) is controversial. Contributing to the controversy is uncertainty about whether residual venous thrombosis, as assessed by repeated ultrasonography over time, increases the risk for recurrent thromboembolism. OBJEC...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-137-12-200212170-00008

    authors: Prandoni P,Lensing AW,Prins MH,Bernardi E,Marchiori A,Bagatella P,Frulla M,Mosena L,Tormene D,Piccioli A,Simioni P,Girolami A

    更新日期:2002-12-17 00:00:00

  • Tetracycline-resistant Ureaplasma urealyticum: a cause of persistent nongonococcal urethritis.

    abstract::We treated 289 men with nongonococcal urethritis in a randomized, double-blind study with minocycline, 100 mg once or twice daily for 7 or 21 days. Ureaplasma urealyticum was isolated before treatment from 167 (58%). The pretherapy isolates from 82 men re-examined 6 to 8 days after initiation of treatment were viable....

    journal_title:Annals of internal medicine

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.7326/0003-4819-94-2-192

    authors: Stimson JB,Hale J,Bowie WR,Holmes KK

    更新日期:1981-02-01 00:00:00

  • Neurologic manifestations of infection with human immunodeficiency virus. Clinical features and pathogenesis.

    abstract::Subacute encephalitis caused by infection of the central nervous system by the human immunodeficiency virus (HIV) is the most frequent cause of neurologic dysfunction in patients with the acquired immunodeficiency syndrome (AIDS). This disorder results in progressive cognitive, motor, and behavioral abnormalities in a...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-107-2-383

    authors: Gabuzda DH,Hirsch MS

    更新日期:1987-09-01 00:00:00

  • Biliary excretion of aluminum in aluminum osteodystrophy with liver disease.

    abstract::Two patients with chronic liver disease developed elevated serum aluminum concentrations and biopsy-proven osteodystrophy. Neither patient had chronic renal failure but both had received aluminum-containing antacids for long periods. We measured biliary and urinary aluminum excretion during antacid loading in patients...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-104-6-782

    authors: Williams JW,Vera SR,Peters TG,Luther RW,Bhattacharya S,Spears H,Graham A,Pitcock JA,Crawford AJ,Palmieri GM

    更新日期:1986-06-01 00:00:00

  • Problem doctors: is there a system-level solution?

    abstract::Physician performance failures are not rare and pose substantial threats to patient welfare and safety. Few hospitals respond to such failures promptly or effectively. Failure to ensure the quality and safety of the performance of colleagues is a breach of medicine's fiduciary responsibility to the public. A major rea...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-144-2-200601170-00008

    authors: Leape LL,Fromson JA

    更新日期:2006-01-17 00:00:00

  • Acute leukemia in multiple myeloma.

    abstract::Of 476 patients with multiple myeloma treated during a 9-year period, 11 developed acute myelogenous leukemia or sideroblastic anemia. In all, the myeloma was in remission from chemotherapy with melphalan-prednisone combinations that had been continued for a median duration of 3 years. The incidence of acute leukemia ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-86-4-440

    authors: Gonzalez F,Trujillo JM,Alexanian R

    更新日期:1977-04-01 00:00:00

  • Reversible renal insufficiency due to angiotensin converting enzyme inhibitors in hypertensive nephrosclerosis.

    abstract:OBJECTIVE:To review the incidence of reversible renal insufficiency in patients with hypertensive nephrosclerosis undergoing antihypertensive therapy. DESIGN:Retrospective analysis of 73 patients in a long-term blood pressure control study that compared the effects of an angiotensin converting enzyme (ACE) inhibitor p...

    journal_title:Annals of internal medicine

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.7326/0003-4819-115-7-513

    authors: Toto RD,Mitchell HC,Lee HC,Milam C,Pettinger WA

    更新日期:1991-10-01 00:00:00

  • In the clinic. Clostridium difficile Infection.

    abstract::This issue provides a clinical overview of Clostridium difficile infection focusing on prevention, diagnosis, treatment, practice improvement, and patient information. Readers can complete the accompanying CME quiz for 1.5 credits. Only ACP members and individual subscribers can access the electronic features of In th...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-153-7-201010050-01004

    authors: Hessen MT

    更新日期:2010-10-05 00:00:00

  • Neuropathology of diabetic neurogenic bladder.

    abstract::Disturbances of urinary bladder function are well-recognized problems in diabetic patients and are generally attributed to peripheral neuropathy. Because of the difficulties inherent in the histologic examination of the peripheral autonomic nerves, little is known about the pathology of these nerves. Recently, alterat...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-92-2-316

    authors: Mastri AR

    更新日期:1980-02-01 00:00:00

  • Short-term hormone therapy suspension and mammography recall: a randomized trial.

    abstract:BACKGROUND:Without population-based evidence, some clinicians recommend short-term suspension of hormone therapy to improve the performance of mammography. Hormone therapy increases breast density, and abnormal screening mammograms are more common among women with denser breasts and among women using hormone therapy. ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.7326/0003-4819-150-11-200906020-00003

    authors: Buist DS,Anderson ML,Reed SD,Aiello Bowles EJ,Fitzgibbons ED,Gandara JC,Seger D,Newton KM

    更新日期:2009-06-02 00:00:00

  • Thyroxine suppressive therapy in patients with nodular thyroid disease.

    abstract:PURPOSE:To review evidence about thyroxine suppressive therapy in patients with thyroid nodules, including the clinical importance and natural history of nodules and the effects and potential side effects of thyroxine therapy. DATA SOURCES:English-language articles published from 1986 to December 1996 were identified ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,评审

    doi:10.7326/0003-4819-128-5-199803010-00008

    authors: Gharib H,Mazzaferri EL

    更新日期:1998-03-01 00:00:00

  • Effect of low-dose aspirin on the occurrence of venous thromboembolism: a randomized trial.

    abstract:BACKGROUND:Short-term aspirin therapy can lower the risk for venous thromboembolism (VTE) in high-risk patients, but whether the long-term use of low-dose aspirin reduces risk in healthy adults is uncertain. OBJECTIVE:To test the efficacy of long-term aspirin therapy for preventing VTE. DESIGN:Secondary analysis of a...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.7326/0003-4819-147-8-200710160-00004

    authors: Glynn RJ,Ridker PM,Goldhaber SZ,Buring JE

    更新日期:2007-10-16 00:00:00

  • Quantitative assessment of procedural competence. A prospective study of training in endoscopic retrograde cholangiopancreatography.

    abstract:BACKGROUND:Endoscopic retrograde cholangiopancreatography (ERCP) is a technically demanding procedure that can cause substantial complications. Competence in performing ERCP and the learning curve for achieving competence are poorly understood. OBJECTIVE:To evaluate the number of supervised ERCPs that physicians must ...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-125-12-199612150-00009

    authors: Jowell PS,Baillie J,Branch MS,Affronti J,Browning CL,Bute BP

    更新日期:1996-12-15 00:00:00

  • Supraventricular arrhythmia in patients having noncardiac surgery: clinical correlates and effect on length of stay.

    abstract:BACKGROUND:Few recent data are available on risk factors for perioperative supraventricular arrhythmia (SVA) after noncardiac surgery or on the effect of SVA on clinical outcomes. OBJECTIVE:To determine the incidence, clinical correlates, and effect on length of stay of perioperative SVA in patients having major nonca...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-129-4-199808150-00003

    authors: Polanczyk CA,Goldman L,Marcantonio ER,Orav EJ,Lee TH

    更新日期:1998-08-15 00:00:00

  • Acute postoperative confusion and hallucinations in Parkinson disease.

    abstract:STUDY OBJECTIVE:To determine whether patients with Parkinson disease are at an increased risk for postoperative confusion. DESIGN:Retrospective chart review of patients with Parkinson disease who remained in the hospital at least 48 hours after their surgery. Current data were compared with published historical contro...

    journal_title:Annals of internal medicine

    pub_type: 杂志文章

    doi:10.7326/0003-4819-111-3-218

    authors: Golden WE,Lavender RC,Metzer WS

    更新日期:1989-08-01 00:00:00