Machine Learning to Develop and Internally Validate a Predictive Model for Post-operative Delirium in a Prospective, Observational Clinical Cohort Study of Older Surgical Patients.

Abstract:

BACKGROUND:Our objective was to assess the performance of machine learning methods to predict post-operative delirium using a prospective clinical cohort. METHODS:We analyzed data from an observational cohort study of 560 older adults (≥ 70 years) without dementia undergoing major elective non-cardiac surgery. Post-operative delirium was determined by the Confusion Assessment Method supplemented by a medical chart review (N = 134, 24%). Five machine learning algorithms and a standard stepwise logistic regression model were developed in a training sample (80% of participants) and evaluated in the remaining hold-out testing sample. We evaluated three overlapping feature sets, restricted to variables that are readily available or minimally burdensome to collect in clinical settings, including interview and medical record data. A large feature set included 71 potential predictors. A smaller set of 18 features was selected by an expert panel using a consensus process, and this smaller feature set was considered with and without a measure of pre-operative mental status. RESULTS:The area under the receiver operating characteristic curve (AUC) was higher in the large feature set conditions (range of AUC, 0.62-0.71 across algorithms) versus the selected feature set conditions (AUC range, 0.53-0.57). The restricted feature set with mental status had intermediate AUC values (range, 0.53-0.68). In the full feature set condition, algorithms such as gradient boosting, cross-validated logistic regression, and neural network (AUC = 0.71, 95% CI 0.58-0.83) were comparable with a model developed using traditional stepwise logistic regression (AUC = 0.69, 95% CI 0.57-0.82). Calibration for all models and feature sets was poor. CONCLUSIONS:We developed machine learning prediction models for post-operative delirium that performed better than chance and are comparable with traditional stepwise logistic regression. Delirium proved to be a phenotype that was difficult to predict with appreciable accuracy.

journal_name

J Gen Intern Med

authors

Racine AM,Tommet D,D'Aquila ML,Fong TG,Gou Y,Tabloski PA,Metzger ED,Hshieh TT,Schmitt EM,Vasunilashorn SM,Kunze L,Vlassakov K,Abdeen A,Lange J,Earp B,Dickerson BC,Marcantonio ER,Steingrimsson J,Travison TG,Inouye SK

doi

10.1007/s11606-020-06238-7

subject

Has Abstract

pub_date

2020-10-19 00:00:00

eissn

0884-8734

issn

1525-1497

pii

10.1007/s11606-020-06238-7

pub_type

杂志文章
  • Recent advances in the acute management of migraine and cluster headaches.

    abstract::I have discussed the pharmacokinetics, efficacies, and side effects of the various nonnarcotic drugs available for the treatment of patients who have headache. Sumatriptan, the newest one, is expensive but may be cost-effective for those who have failed traditional migraine treatment, who visit the ER frequently, who ...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,评审

    doi:10.1007/BF02599185

    authors: Kumar KL

    更新日期:1994-06-01 00:00:00

  • Association of the Implementation of the Patient-Centered Medical Home with Quality of Life in Patients with Multimorbidity.

    abstract:BACKGROUND:The patient-centered medical home (PCMH) has clinical benefits for chronic disease care, but the association with patient-reported outcomes such as health-related quality of life (HRQoL) is unexplored in patients with multimorbidity (two or more chronic diseases). OBJECTIVE:To examine if greater clinic-leve...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-019-05429-1

    authors: Schuttner L,Reddy A,Rosland AM,Nelson K,Wong ES

    更新日期:2020-01-01 00:00:00

  • A Model of Organizational Context and Shared Decision Making: Application to LGBT Racial and Ethnic Minority Patients.

    abstract::Shared decision making (SDM) occurs when patients and clinicians work together to reach care decisions that are both medically sound and responsive to patients' preferences and values. SDM is an important tenet of patient-centered care that can improve patient outcomes. Patients with multiple minority identities, such...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-016-3608-3

    authors: DeMeester RH,Lopez FY,Moore JE,Cook SC,Chin MH

    更新日期:2016-06-01 00:00:00

  • Comparison of current guidelines for primary prevention of coronary heart disease: risk assessment and lipid-lowering therapy.

    abstract:OBJECTIVE:In primary prevention of atherosclerotic disease, it is difficult to decide when medical treatment should be initiated. The main goal of the study was to compare different guidelines for coronary heart disease (CHD) risk assessment and initiation of lipid-lowering therapy. DESIGN:Cross-sectional evaluation. ...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1046/j.1525-1497.2003.20207.x

    authors: Broedl UC,Geiss HC,Parhofer KG

    更新日期:2003-03-01 00:00:00

  • Frequency of mastalgia among women veterans. Association with psychiatric conditions and unexplained pain syndromes.

    abstract:OBJECTIVE:To determine the prevalence and frequency of mastalgia and its association with psychiatric conditions and unexplained pain syndromes. DESIGN, SETTING, AND PARTICIPANTS:Cross-sectional mailed survey completed by 1,219 female veterans enrolled at the VA Puget Sound Health Care System in 1998. MEASUREMENTS:Br...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1111/j.1525-1497.2006.00378.x

    authors: Johnson KM,Bradley KA,Bush K,Gardella C,Dobie DJ,Laya MB

    更新日期:2006-03-01 00:00:00

  • "It's not about you".

    abstract::In this short story, through a challenging case where his sound diagnostic work has seemingly gone unrecognized, an internist is reminded of what is most important in clinical care. ...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-010-1363-4

    authors: Baker CJ

    更新日期:2010-09-01 00:00:00

  • Improving the nutritional resource environment for healthy living through community-based participatory research.

    abstract:OBJECTIVES:To build health promotion capacity among community residents through a community-based participatory model, and to apply this model to study the nutritional environment of an urban area to better understand the role of such resources in residents' efforts to live a healthy life. DESIGN:A multiphase collabor...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1046/j.1525-1497.2003.21022.x

    authors: Sloane DC,Diamant AL,Lewis LB,Yancey AK,Flynn G,Nascimento LM,McCarthy WJ,Guinyard JJ,Cousineau MR,REACH Coalition of the African American Building a Legacy of Health Project.

    更新日期:2003-07-01 00:00:00

  • The Interconnections Project: development and evaluation of a community-based depression program for African American violence survivors.

    abstract:BACKGROUND:Multi-faceted depression care programs based within the healthcare system have been found to be effective, but may not fully address the needs of African American Intimate Partner Violence (IPV) survivors, many of whom are not seeking depression care in healthcare settings. OBJECTIVES:To develop and evaluat...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-012-2270-7

    authors: Nicolaidis C,Wahab S,Trimble J,Mejia A,Mitchell SR,Raymaker D,Thomas MJ,Timmons V,Waters AS

    更新日期:2013-04-01 00:00:00

  • Breast Density Notification Legislation and Breast Cancer Stage at Diagnosis: Early Evidence from the SEER Registry.

    abstract:BACKGROUND:Twenty-eight states have passed breast density notification laws, which require physicians to inform women of a finding of dense breasts on mammography. OBJECTIVE:To evaluate changes in breast cancer stage at diagnosis after enactment of breast density notification legislation. DESIGN:Using a difference-in...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-016-3904-y

    authors: Richman I,Asch SM,Bendavid E,Bhattacharya J,Owens DK

    更新日期:2017-06-01 00:00:00

  • BRIEF REPORT: nutrition and weight loss information in a popular diet book: is it fact, fiction, or something in between?

    abstract:BACKGROUND/OBJECTIVE:Diet books dominate the New York Times Advice Best Seller list and consumers cite such books as an important source of nutrition information. However, the scientific support for nutrition claims presented as fact (nutrition facts) in diet books is not known. DESIGN/MEASUREMENTS:We assessed the qua...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1111/j.1525-1497.2006.00501.x

    authors: Goff SL,Foody JM,Inzucchi S,Katz D,Mayne ST,Krumholz HM

    更新日期:2006-07-01 00:00:00

  • Peer Support for Self-Management of Chronic Pain: the Evaluation of a Peer Coach-Led Intervention to Improve Pain Symptoms (ECLIPSE) Trial.

    abstract:BACKGROUND:Pain self-management is an effective, evidence-based treatment for chronic pain. Peer support, in which patients serve as coaches for other patients, has been effective in other chronic conditions and is a potentially promising approach to implementing pain self-management programs using fewer clinical resou...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-020-06007-6

    authors: Matthias MS,Bair MJ,Ofner S,Heisler M,Kukla M,McGuire AB,Adams J,Kempf C,Pierce E,Menen T,McCalley S,Johnson NL,Daggy J

    更新日期:2020-12-01 00:00:00

  • Pharmaceutical industry gifts to physicians: patient beliefs and trust in physicians and the health care system.

    abstract:BACKGROUND:Pharmaceutical industry gifts to physicians are common and influence physician behavior. Little is known about patient beliefs about the prevalence of these gifts and how these beliefs may influence trust in physicians and the health care system. OBJECTIVE:To measure patient perceptions about the prevalence...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-011-1760-3

    authors: Grande D,Shea JA,Armstrong K

    更新日期:2012-03-01 00:00:00

  • Changing the fourth-year medicine clerkship structure: a successful model for a teaching service without housestaff.

    abstract::The fourth-year medicine clerkship was restructured at one of four sites. Teams consisting of one attending physician and three students cared for eight new patients per week. The overall experience of the restructured clerkship was rated significantly more positively than the experiences at all other sites and the te...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/BF02600292

    authors: Parenti CM

    更新日期:1993-01-01 00:00:00

  • Changes in Mental Health Following the 2016 Presidential Election.

    abstract:BACKGROUND:The 2016 presidential election and the controversial policy agenda of its victor have raised concerns about how the election may have impacted mental health. OBJECTIVE:Assess how mental health changed from before to after the November 2016 election and how trends differed in states that voted for Donald Tru...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-020-06328-6

    authors: Yan BW,Hsia RY,Yeung V,Sloan FA

    更新日期:2020-10-31 00:00:00

  • Excellent Patient Care Processes in Poor Hospitals? Why Hospital-Level and Patient-Level Care Quality-Outcome Relationships Can Differ.

    abstract::Studies finding weak or nonexistent relationships between hospital performance on providing recommended care and hospital-level clinical outcomes raise questions about the value and validity of process of care performance measures. Such findings may cause clinicians to question the effectiveness of the care process pr...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,评审

    doi:10.1007/s11606-015-3564-3

    authors: Finney JW,Humphreys K,Kivlahan DR,Harris AH

    更新日期:2016-04-01 00:00:00

  • Medical Student Debt Reform: a Proposed Value-Based Loan Repayment Policy.

    abstract::The call for value-based medicine has augmented the role of primary care physicians, potentially exacerbating the already-acknowledged shortage of primary care physicians in the current delivery landscape. Lifetime earnings for primary care physicians are millions lower than those for other specialties, and the burden...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-020-05759-5

    authors: Driessen J,Zaloom C,Shrank WH

    更新日期:2020-05-01 00:00:00

  • Factors associated with hepatitis B testing among Vietnamese Americans.

    abstract:BACKGROUND:Chronic hepatitis B and hepatitis B-associated liver cancer is a major health disparity among Vietnamese Americans, who have a chronic hepatitis B prevalence rate of 7-14% and an incidence rate for liver cancer six times that of non-Latino whites. OBJECTIVE:Describe factors associated with hepatitis B testi...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-010-1285-1

    authors: Nguyen TT,McPhee SJ,Stewart S,Gildengorin G,Zhang L,Wong C,Maxwell AE,Bastani R,Taylor VM,Chen MS Jr

    更新日期:2010-07-01 00:00:00

  • Training generalist physicians: structural elements of the curriculum.

    abstract::To train more generalist physicians, structural changes must be made along the continuum of medical education. Future generalists require in-depth exposure to primary care practice, with substantive experience in the longitudinal management of patient panels and the opportunity to work with successful generalist role ...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,评审

    doi:10.1007/BF02598115

    authors: Burke W,Baron RB,Lemon M,Losh D,Novack A

    更新日期:1994-04-01 00:00:00

  • Development of a structured year-end sign-out program in an outpatient continuity practice.

    abstract:BACKGROUND:In an effort to prevent medical errors, it has been recommended that all healthcare organizations implement a standardized approach to communicating patient information during transitions of care between providers. Most research on these transitions has been conducted in the inpatient setting, with relativel...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1007/s11606-012-2206-2

    authors: Garment AR,Lee WW,Harris C,Phillips-Caesar E

    更新日期:2013-01-01 00:00:00

  • Association of Intrinsic Motivating Factors and Markers of Physician Well-Being: A National Physician Survey.

    abstract:BACKGROUND:Although intrinsic motivating factors play important roles in physician well-being and productivity, most studies have focused on extrinsic motivating factors such as salary and work environment. OBJECTIVE:To examine the association of intrinsic motivators with physicians' career satisfaction, life satisfac...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-017-3997-y

    authors: Tak HJ,Curlin FA,Yoon JD

    更新日期:2017-07-01 00:00:00

  • Assessing dual-role staff-interpreter linguistic competency in an integrated healthcare system.

    abstract:BACKGROUND:Interpreter services for medical care increase physician-patient communication and safety, yet a "formal certification" process to demonstrate interpreter competence does not exist. Testing and training is left to individual health care facilities nationwide. Bilingual staff are often used to interpret, with...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-007-0344-8

    authors: Moreno MR,Otero-Sabogal R,Newman J

    更新日期:2007-11-01 00:00:00

  • Does Type 2 Diabetes Genetic Testing and Counseling Reduce Modifiable Risk Factors? A Randomized Controlled Trial of Veterans.

    abstract:OBJECTIVE:We examined the clinical utility of supplementing type 2 diabetes mellitus (DM) risk counseling with DM genetic test results and counseling. RESEARCH DESIGN AND METHODS:In this randomized controlled trial, non-diabetic overweight/obese veteran outpatients aged 21 to 65 years received DM risk estimates for li...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1007/s11606-015-3315-5

    authors: Voils CI,Coffman CJ,Grubber JM,Edelman D,Sadeghpour A,Maciejewski ML,Bolton J,Cho A,Ginsburg GS,Yancy WS Jr

    更新日期:2015-11-01 00:00:00

  • Cultural sensitivity in screening adults for a history of childhood abuse: evidence from a community sample.

    abstract:BACKGROUND:A number of practice guidelines and recommendations call for the assessment of childhood abuse history among adult medical patients. The cultural sensitivity of screening questions, however, has not been examined. OBJECTIVE:To assess whether questions that inquire about childhood abuse history function diff...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-006-0026-y

    authors: Thombs BD,Bennett W,Ziegelstein RC,Bernstein DP,Scher CD,Forde DR

    更新日期:2007-03-01 00:00:00

  • Impact of Project ECHO Models of Medical Tele-Education: a Systematic Review.

    abstract:BACKGROUND:Extension for Community Healthcare Outcomes (ECHO) and related models of medical tele-education are rapidly expanding; however, their effectiveness remains unclear. This systematic review examines the effectiveness of ECHO and ECHO-like medical tele-education models of healthcare delivery in terms of improve...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-019-05291-1

    authors: McBain RK,Sousa JL,Rose AJ,Baxi SM,Faherty LJ,Taplin C,Chappel A,Fischer SH

    更新日期:2019-12-01 00:00:00

  • "Ms. B changes doctors": using a comic and patient transition packet to engineer patient-oriented clinic handoffs (EPOCH).

    abstract:BACKGROUND:Few patient-centered interventions exist to improve year-end residency clinic handoffs. AIM:Our purpose was to assess the impact of a patient-centered transition packet and comic on clinic handoff outcomes. SETTING:The study was conducted at an academic medicine residency clinic. PARTICIPANTS:Participants...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-014-3009-4

    authors: Pincavage AT,Lee WW,Venable LR,Prochaska M,Staisiunas DD,Beiting KJ,Czerweic MK,Oyler J,Vinci LM,Arora VM

    更新日期:2015-02-01 00:00:00

  • Longitudinal Continuity Learning Experiences and Primary Care Career Interest: Outcomes from an Innovative Medical School Curriculum.

    abstract:BACKGROUND:Medical students in the USA have negative perceptions of primary care careers, which are exacerbated by the hidden curriculum and medical school culture. Longitudinal integrated clerkships (LICs) have shown promise in ameliorating this situation by promoting student/preceptor continuity relationships and hel...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-018-4600-x

    authors: Ford CD,Patel PG,Sierpina VS,Wolffarth MW,Rowen JL

    更新日期:2018-10-01 00:00:00

  • Health care utilization as a marker for suicidal behavior on an American Indian Reservation.

    abstract:OBJECTIVE:Overall suicide mortality rates are higher among American Indians than in the general population and are particularly high among Indians residing in the upper Midwest. The identification, during encounters with health care providers, of individuals at high risk of suicide is a potential intervention strategy....

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/BF02599598

    authors: Mock CN,Grossman DC,Mulder D,Stewart C,Koepsell TS

    更新日期:1996-09-01 00:00:00

  • Impact of an Opt-In eConsult Program on Primary Care Demand for Specialty Visits: Stepped-Wedge Cluster Randomized Implementation Study.

    abstract:BACKGROUND:eConsult programs have been instituted to increase access to specialty expertise. Opt-in choice eConsult programs maintain primary care physician (PCP) autonomy to decide whether to utilize eConsults versus traditional specialty referrals, but little is known about how this intervention may impact PCP eConsu...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-020-06101-9

    authors: Rikin S,Zhang C,Lipsey D,Deluca J,Epstein EJ,Berger M,Tomer Y,Arnsten JH

    更新日期:2020-11-01 00:00:00

  • Understanding Long-Term Cancer Survivors' Preferences for Ongoing Medical Care.

    abstract:BACKGROUND:Due to risk for treatment-related late effects and concerns about cancer recurrence, long-term cancer survivors have unique medical needs. Survivors' preferences for care may influence adherence and care utilization. OBJECTIVE:To describe survivors' preferences for care and factors associated with preferred...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1007/s11606-019-05189-y

    authors: Smith TG,Strollo S,Hu X,Earle CC,Leach CR,Nekhlyudov L

    更新日期:2019-10-01 00:00:00

  • Asian Americans' reports of their health care experiences. Results of a national survey.

    abstract:OBJECTIVE:To examine how Asian race/ethnicity affects patients' health care experiences and satisfaction with care. DESIGN:Telephone interview using random-digit dialing, stratified to over-sample adults living in areas with disproportionately large numbers of minorities. PARTICIPANTS AND SETTING:White (N = 3,205) an...

    journal_title:Journal of general internal medicine

    pub_type: 杂志文章

    doi:10.1111/j.1525-1497.2004.30143.x

    authors: Ngo-Metzger Q,Legedza AT,Phillips RS

    更新日期:2004-02-01 00:00:00