Abstract:
BACKGROUND:The assessment of user preferences for performance characteristics of patient-oriented clinical prediction models is lacking. It is unknown if complex statistical aspects of prediction models are readily understandable by a general audience. OBJECTIVE:A pilot study was conducted among nonclinical audiences to determine the feasibility of interpreting statistical concepts that describe the performance of prediction models. METHODS:We conducted a cross-sectional electronic survey using the Amazon Mechanical Turk platform. The survey instrument included educational modules about predictive models, sensitivity, specificity, and confidence intervals (CIs). Follow-up questions tested participants' abilities to interpret these characteristics with both verbatim and gist knowledge. Objective and subjective numeracy were assessed using previously validated instruments. We also tested understanding of these concepts when embedded in a sample discrete choice experiment task to establish feasibility for future elicitation of preferences using a discrete choice experiment design. Multivariable linear regression was used to identify factors associated with correct interpretation of statistical concepts. RESULTS:Among 534 respondents who answered all nine questions, the mean correct responses was 95.9% (95% CI, 93.8-97.4) for sensitivity, 93.1% (95% CI, 90.5-95.0) for specificity, and 86.6% (95% CI, 83.3-89.3) for CIs. Verbatim interpretation was high for all concepts, but significantly higher than gist only for CIs (p < 0.001). Scores on each discrete choice experiment tasks were slightly lower in each category. Both objective and subjective numeracy were positively associated with an increased proportion of correct responses (p < 0.001). CONCLUSION:These results suggest that a nonclinical audience can interpret quantitative performance measures of predictive models with very high accuracy. Future development of patient-facing clinical prediction models can feasibly incorporate patient preferences for model features into their development.
journal_name
Appl Clin Informjournal_title
Applied clinical informaticsauthors
Weissman GE,Yadav KN,Madden V,Courtright KR,Hart JL,Asch DA,Schapira MM,Halpern SDdoi
10.1055/s-0038-1669457subject
Has Abstractpub_date
2018-07-01 00:00:00pages
683-692issue
3issn
1869-0327journal_volume
9pub_type
杂志文章abstract:BACKGROUND: Relaxation of laws and regulations around privacy and billing during the COVID-19 pandemic provide expanded opportunities to use telehealth to provide patient care at a distance. Many health systems have transitioned to providing outpatient care via telehealth; however, there is an opportunity to utilize te...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0040-1713635
更新日期:2020-05-01 00:00:00
abstract:BACKGROUND:UW Medicine was one of the first health systems to encounter and treat COVID-19 patients in the United States, starting in late February 2020. OBJECTIVE:Here we describe the rapid rollout of capabilities by UW Medicine Information Technology Services (ITS) to support our clinical response to the COVID-19 pa...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0040-1709715
更新日期:2020-03-01 00:00:00
abstract:BACKGROUND:Medical students may observe and subsequently perpetuate redundancy in clinical documentation, but the degree of redundancy in student notes and whether there is an association with scholastic performance are unknown. OBJECTIVES:This study sought to quantify redundancy, defined generally as the proportion o...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0039-1692402
更新日期:2019-05-01 00:00:00
abstract:BACKGROUND:Although patients who work and have related health issues are usually first seen in primary care, providers in these settings do not routinely ask questions about work. Guidelines to help manage such patients are rarely used in primary care. Electronic health record (EHR) systems with worker health clinical ...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0040-1715895
更新日期:2020-08-01 00:00:00
abstract:BACKGROUND:Prescribers' inappropriate use of the free-text Notes field in new electronic prescriptions can create confusion and workflow disruptions at receiving pharmacies that often necessitates contact with prescribers for clarification. The inclusion of inappropriate patient direction (Sig) information in the Notes...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2014-03-CR-0022
更新日期:2014-08-06 00:00:00
abstract:BACKGROUND: Prediabetes and type 2 diabetes mellitus (T2DM) are one of the major long-term health conditions affecting global healthcare delivery. One of the few effective approaches is to actively manage diabetes via a healthy and active lifestyle. OBJECTIVES: This research is focused on early detection of prediabete...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0040-1719043
更新日期:2021-01-01 00:00:00
abstract:BACKGROUND:Asthma exacerbations are one of the most common medical reasons for children to be brought to the hospital emergency department (ED). Various prediction models have been proposed to support diagnosis of exacerbations and evaluation of their severity. OBJECTIVES:First, to evaluate prediction models construct...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2013-04-RA-0029
更新日期:2013-08-07 00:00:00
abstract:BACKGROUND: Electronic health records (EHRs) are used in long-term care to document the patients' condition, medication, and care, thereby supporting communication among caregivers and counteracting adverse drug events. However, the use of EHRs in long-term care has lagged behind EHR use in hospitals. In addition, most...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0040-1721013
更新日期:2021-01-01 00:00:00
abstract:UNLABELLED:Nationwide Children's Hospital established an i2b2 (Informatics for Integrating Biology & the Bedside) application for sleep disorder cohort identification. Discrete data were gleaned from semistructured sleep study reports. The system showed to work more efficiently than the traditional manual chart review ...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2014-11-RA-0106
更新日期:2015-05-27 00:00:00
abstract:BACKGROUND: Poor self-management of heart failure (HF) has contributed to poor health outcomes. Sensor-controlled digital games (SCDGs) integrates data from behavior-tracking sensors to trigger progress, rewards, content, and positive feedback in a digital game to motivate real-time behaviors. OBJECTIVES: To assess th...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0040-1721399
更新日期:2020-10-01 00:00:00
abstract:BACKGROUND:In 2015, the German Federal Ministry of Education and Research initiated a large data integration and data sharing research initiative to improve the reuse of data from patient care and translational research. The Observational Medical Outcomes Partnership (OMOP) common data model and the Observational Healt...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0037-1617452
更新日期:2018-01-01 00:00:00
abstract:OBJECTIVES:The authors investigated the impact of computerized provider order entry (CPOE) on the delivery times of analgesia and subsequent patient outcomes. We hypothesized that patients would report less pain and use less pain medications compared with the previous paper-based system. METHODS:Two groups of patients...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2014-12-RA-0114
更新日期:2015-09-23 00:00:00
abstract:BACKGROUND:Care-management tools are typically utilized for chronic disease management. Sonoma County government agencies employed advanced health information technologies, artificial intelligence (AI), and interagency process improvements to help transform health and health care for socially disadvantaged groups and o...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0040-1715894
更新日期:2020-08-01 00:00:00
abstract:OBJECTIVE:Venous thromboembolism (VTE) prophylaxis is an important consideration for hospitalized older adults, and the Padua Prediction Score (PPS) is a risk prediction tool used to prioritize patient selection. We developed an automated PPS (APPS) algorithm using electronic health record (EHR) data. This study examin...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0038-1670678
更新日期:2018-07-01 00:00:00
abstract:BACKGROUND:Electronic health record (EHR)-based registries allow for robust data to be derived directly from the patient clinical record and can provide important information about processes of care delivery and patient health outcomes. METHODS:A data dictionary, and subsequent data model, were developed describing EH...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0038-1651496
更新日期:2018-04-01 00:00:00
abstract:OBJECTIVE:This article aimed to evaluate the effectiveness of newly established innovative smart home healthcare and health informatics laboratories, and a novel laboratory course that focuses on experiential health informatics training, and determine students' self-confidence to operate wireless home health monitoring...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2017-08-RA-0136
更新日期:2017-10-01 00:00:00
abstract:BACKGROUND:Although obesity is a growing problem, primary care physicians often inadequately address it. The objective of this study is to examine the prevalence of obesity documentation in the patient's problem list for patients with eligible body mass indexes (BMI) as contained in the patients' electronic medical rec...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2016-07-RA-0115
更新日期:2017-01-25 00:00:00
abstract:: ...
journal_title:Applied clinical informatics
pub_type: 社论
doi:10.1055/s-0038-1676332
更新日期:2018-10-01 00:00:00
abstract:OBJECTIVE:To understand how clinicians utilize image uploading tools in a home grown electronic health records (EHR) system. METHODS:A content analysis of patient notes containing non-radiological images from the EHR was conducted. Images from 4,000 random notes from July 1, 2009 - June 30, 2010 were reviewed and manu...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2016-10-RA-0180
更新日期:2017-07-12 00:00:00
abstract:BACKGROUND:Although diagnostic error (DE) is a significant problem, it remains challenging for clinicians to identify it reliably and to recognize its contribution to the clinical trajectory of their patients. The purpose of this work was to evaluate the reliability of real-time electronic health record (EHR) reviews u...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0040-1713750
更新日期:2020-05-01 00:00:00
abstract::Patient-generated health data are coming into broader use across the health care spectrum and hold great promise as a means to improve care and health outcomes. At the same time, rapid evolution in the social media and mobile health (mHealth) market has promoted an environment in which creation and transmission of per...
journal_title:Applied clinical informatics
pub_type: 杂志文章,评审
doi:10.4338/ACI-2014-09-R-0082
更新日期:2015-01-14 00:00:00
abstract:OBJECTIVES:Transitions in patient care pose an increased risk to patient safety. One way to reduce this risk is to ensure accurate medication reconciliation during the transition. Here we present an evaluation of an electronic medication reconciliation module we developed to reduce the transition risk in patients refer...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2015-11-RA-0154
更新日期:2016-05-25 00:00:00
abstract:OBJECTIVE:The use of text messaging in clinical care has become ubiquitous. Due to security and privacy concerns, many hospital systems are evaluating secure text messaging applications. This paper highlights our evaluation process, and offers an overview of secure messaging functionalities, as well as a framework for ...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0039-1678607
更新日期:2019-01-01 00:00:00
abstract:BACKGROUND:Care plan concordance among patients and clinicians during hospitalization is suboptimal. OBJECTIVE:This article determines whether an electronic health record (EHR)-integrated patient portal was associated with increased understanding of the care plan, including the key recovery goal, among patients and cl...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0039-1688831
更新日期:2019-05-01 00:00:00
abstract:BACKGROUND:Effective communication is essential to safe and efficient patient care. Additionally, many health information technology (HIT) developments, innovations, and standards aim to implement processes to improve data quality and integrity of electronic health records (EHR) for the purpose of clinical information ...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2011-02-RA-0011
更新日期:2011-06-08 00:00:00
abstract:OBJECTIVE:With the increasing prevalence of type 2 diabetes (T2D) in youth, primary care providers must identify patients at high risk and implement evidence-based screening promptly. Clinical decision support systems (CDSSs) provide clinicians with personalized reminders according to best evidence. One example is the ...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.1055/s-0040-1710024
更新日期:2020-03-01 00:00:00
abstract:BACKGROUND:Code status (CS) of a patient (part of their end-of-life wishes) can be critical information in healthcare delivery, which can change over time, especially at transitions of care. Although electronic health record (EHR) tools exist for medication reconciliation across transitions of care, much less attention...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2016-08-RA-0133
更新日期:2017-03-08 00:00:00
abstract:OBJECTIVES:Telemonitoring of vital signs is an established option in treatment of patients with chronic heart failure (CHF). In order to allow for early detection of atrial fibrillation (AF) which is highly prevalent in the CHF population telemonitoring programs should include electrocardiogram (ECG) signals. It was th...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2010-12-RA-0078
更新日期:2011-11-23 00:00:00
abstract:BACKGROUND:Kidney disease is under-documented in physician notes. The use of template-guided notes may improve physician recognition of kidney disease early in training. OBJECTIVE:The objective of this study was to determine whether a computerized inpatient renal template note with clinical decision support improves r...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2013-07-RA-0048
更新日期:2013-11-13 00:00:00
abstract:OBJECTIVE:1. To conduct a review of the role of informatics in pediatric disaster preparedness using all medical databases. 2. To provide recommendations to improve pediatric disaster preparedness by the application of informatics. METHODS:A literature search was conducted using MEDLINE, CINHL and the Cochrane Library...
journal_title:Applied clinical informatics
pub_type: 杂志文章
doi:10.4338/ACI-2009-12-R-0019
更新日期:2010-08-04 00:00:00