Identification of Long Bone Fractures in Radiology Reports Using Natural Language Processing to support Healthcare Quality Improvement.

Abstract:

BACKGROUND:Important information to support healthcare quality improvement is often recorded in free text documents such as radiology reports. Natural language processing (NLP) methods may help extract this information, but these methods have rarely been applied outside the research laboratories where they were developed. OBJECTIVE:To implement and validate NLP tools to identify long bone fractures for pediatric emergency medicine quality improvement. METHODS:Using freely available statistical software packages, we implemented NLP methods to identify long bone fractures from radiology reports. A sample of 1,000 radiology reports was used to construct three candidate classification models. A test set of 500 reports was used to validate the model performance. Blinded manual review of radiology reports by two independent physicians provided the reference standard. Each radiology report was segmented and word stem and bigram features were constructed. Common English "stop words" and rare features were excluded. We used 10-fold cross-validation to select optimal configuration parameters for each model. Accuracy, recall, precision and the F1 score were calculated. The final model was compared to the use of diagnosis codes for the identification of patients with long bone fractures. RESULTS:There were 329 unique word stems and 344 bigrams in the training documents. A support vector machine classifier with Gaussian kernel performed best on the test set with accuracy=0.958, recall=0.969, precision=0.940, and F1 score=0.954. Optimal parameters for this model were cost=4 and gamma=0.005. The three classification models that we tested all performed better than diagnosis codes in terms of accuracy, precision, and F1 score (diagnosis code accuracy=0.932, recall=0.960, precision=0.896, and F1 score=0.927). CONCLUSIONS:NLP methods using a corpus of 1,000 training documents accurately identified acute long bone fractures from radiology reports. Strategic use of straightforward NLP methods, implemented with freely available software, offers quality improvement teams new opportunities to extract information from narrative documents.

journal_name

Appl Clin Inform

authors

Grundmeier RW,Masino AJ,Casper TC,Dean JM,Bell J,Enriquez R,Deakyne S,Chamberlain JM,Alpern ER,Pediatric Emergency Care Applied Research Network.

doi

10.4338/ACI-2016-08-RA-0129

subject

Has Abstract

pub_date

2016-11-09 00:00:00

pages

1051-1068

issue

4

issn

1869-0327

pii

2016-08-RA-0129

journal_volume

7

pub_type

杂志文章
  • Workarounds and Test Results Follow-up in Electronic Health Record-Based Primary Care.

    abstract:BACKGROUND:Electronic health records (EHRs) have potential to facilitate reliable communication and follow-up of test results. However, limitations in EHR functionality remain, leading practitioners to use workarounds while managing test results. Workarounds can lead to patient safety concerns and signify indications a...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2015-10-RA-0135

    authors: Menon S,Murphy DR,Singh H,Meyer AN,Sittig DF

    更新日期:2016-06-22 00:00:00

  • Usability Testing of a Sensor-Controlled Digital Game to Engage Older Adults with Heart Failure in Physical Activity and Weight Monitoring.

    abstract:BACKGROUND: Poor self-management of heart failure (HF) has contributed to poor health outcomes. Sensor-controlled digital games (SCDGs) integrates data from behavior-tracking sensors to trigger progress, rewards, content, and positive feedback in a digital game to motivate real-time behaviors. OBJECTIVES: To assess th...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0040-1721399

    authors: Radhakrishnan K,Julien C,O'Hair M,Baranowski T,Lee G,Allen C,Sagna A,Thomaz E,Kim M

    更新日期:2020-10-01 00:00:00

  • Measuring Practicing Clinicians' Information Literacy. An Exploratory Analysis in the Context of Panel Management.

    abstract:BACKGROUND:As healthcare moves towards technology-driven population health management, clinicians must adopt complex digital platforms to access health information and document care. OBJECTIVES:This study explored information literacy, a set of skills required to effectively navigate population health information syst...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2016-06-RA-0083

    authors: Dixon BE,Barboza K,Jensen AE,Bennett KJ,Sherman SE,Schwartz MD

    更新日期:2017-02-15 00:00:00

  • Clinician Perceptions of a Computerized Decision Support System for Pediatric Type 2 Diabetes Screening.

    abstract:OBJECTIVE:With the increasing prevalence of type 2 diabetes (T2D) in youth, primary care providers must identify patients at high risk and implement evidence-based screening promptly. Clinical decision support systems (CDSSs) provide clinicians with personalized reminders according to best evidence. One example is the ...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0040-1710024

    authors: El Mikati HK,Yazel-Smith L,Grout RW,Downs SM,Carroll AE,Hannon TS

    更新日期:2020-03-01 00:00:00

  • Reduction in Clinical Variance Using Targeted Design Changes in Computerized Provider Order Entry (CPOE) Order Sets: Impact on Hospitalized Children with Acute Asthma Exacerbation.

    abstract:OBJECTIVES:Unwarranted variance in healthcare has been associated with prolonged length of stay, diminished health and increased cost. Practice variance in the management of asthma can be significant and few investigators have evaluated strategies to reduce this variance. We hypothesized that selective redesign of orde...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2011-01-RA-0002

    authors: Jacobs BR,Hart KW,Rucker DW

    更新日期:2012-02-08 00:00:00

  • Early Detection of Prediabetes and T2DM Using Wearable Sensors and Internet-of-Things-Based Monitoring Applications.

    abstract:BACKGROUND: Prediabetes and type 2 diabetes mellitus (T2DM) are one of the major long-term health conditions affecting global healthcare delivery. One of the few effective approaches is to actively manage diabetes via a healthy and active lifestyle. OBJECTIVES: This research is focused on early detection of prediabete...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0040-1719043

    authors: Baig MM,GholamHosseini H,Gutierrez J,Ullah E,Lindén M

    更新日期:2021-01-01 00:00:00

  • Impact of Electronic Physician Order-Set on Antibiotic Ordering Time in Septic Patients in the Emergency Department.

    abstract:BACKGROUND:Sepsis is a serious medical condition that can lead to organ dysfunction and death. Research shows that each hour delay in antibiotic administration increases mortality. The Surviving Sepsis Campaign Bundles created standards to assist in the timely treatment of patients with suspected sepsis to improve outc...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章,多中心研究

    doi:10.1055/s-0038-1676040

    authors: Fargo EL,D'Amico F,Pickering A,Fowler K,Campbell R,Baumgartner M

    更新日期:2018-10-01 00:00:00

  • Evaluating the Impact of a New Smartphone Texting Tool on Patient Care in Obstetrics, an Emergent Healthcare Setting.

    abstract:BACKGROUND:Hospitals across the country are investing millions of dollars to adopt new Health Insurance Portability and Accountability Act (HIPAA)-compliant secure text messaging systems. However, in nearly all cases, these implementations are occurring without evaluation of their impact on patient care. OBJECTIVE:To ...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0039-1700868

    authors: Feinberg J,Shaw S,Kashyap N,Illuzzi J,Campbell K,Hsiao AL,Pettker CM

    更新日期:2019-10-01 00:00:00

  • Legal and regulatory considerations associated with use of patient-generated health data from social media and mobile health (mHealth) devices.

    abstract::Patient-generated health data are coming into broader use across the health care spectrum and hold great promise as a means to improve care and health outcomes. At the same time, rapid evolution in the social media and mobile health (mHealth) market has promoted an environment in which creation and transmission of per...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章,评审

    doi:10.4338/ACI-2014-09-R-0082

    authors: Petersen C,DeMuro P

    更新日期:2015-01-14 00:00:00

  • Feasibility and Reliability Testing of Manual Electronic Health Record Reviews as a Tool for Timely Identification of Diagnostic Error in Patients at Risk.

    abstract:BACKGROUND:Although diagnostic error (DE) is a significant problem, it remains challenging for clinicians to identify it reliably and to recognize its contribution to the clinical trajectory of their patients. The purpose of this work was to evaluate the reliability of real-time electronic health record (EHR) reviews u...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0040-1713750

    authors: Soleimani J,Pinevich Y,Barwise AK,Huang C,Dong Y,Herasevich V,Gajic O,Pickering BW

    更新日期:2020-05-01 00:00:00

  • Automated versus Manual Data Extraction of the Padua Prediction Score for Venous Thromboembolism Risk in Hospitalized Older Adults.

    abstract:OBJECTIVE:Venous thromboembolism (VTE) prophylaxis is an important consideration for hospitalized older adults, and the Padua Prediction Score (PPS) is a risk prediction tool used to prioritize patient selection. We developed an automated PPS (APPS) algorithm using electronic health record (EHR) data. This study examin...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0038-1670678

    authors: Pavon JM,Sloane RJ,Pieper CF,Colón-Emeric CS,Cohen HJ,Gallagher D,Morey MC,McCarty M,Ortel TL,Hastings SN

    更新日期:2018-07-01 00:00:00

  • Near Field Communication-based telemonitoring with integrated ECG recordings.

    abstract:OBJECTIVES:Telemonitoring of vital signs is an established option in treatment of patients with chronic heart failure (CHF). In order to allow for early detection of atrial fibrillation (AF) which is highly prevalent in the CHF population telemonitoring programs should include electrocardiogram (ECG) signals. It was th...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2010-12-RA-0078

    authors: Morak J,Kumpusch H,Hayn D,Leitner M,Scherr D,Fruhwald FM,Schreier G

    更新日期:2011-11-23 00:00:00

  • Evaluation of an Electronic Module for Reconciling Medications in Home Health Plans of Care.

    abstract:OBJECTIVES:Transitions in patient care pose an increased risk to patient safety. One way to reduce this risk is to ensure accurate medication reconciliation during the transition. Here we present an evaluation of an electronic medication reconciliation module we developed to reduce the transition risk in patients refer...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2015-11-RA-0154

    authors: Kramer HS,Gibson B,Livnat Y,Thraen I,Brody AA,Rupper R

    更新日期:2016-05-25 00:00:00

  • Identification and Characterization of Inter-Organizational Information Flows in the Portuguese National Health Service.

    abstract:OBJECTIVES:To understand and build a collective vision of all existing institutions in the Portuguese National Health Service as well as to perceive how and how far the interaction between those multiple institutions is supported by Information Systems (IS). METHODS:Upon identification of the institutions involved in ...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2016-08-RA-0135

    authors: Pinto E,Brito AC,Cruz-Correia RJ

    更新日期:2016-12-21 00:00:00

  • Clinical Practice Informs Secure Messaging Benefits and Best Practices.

    abstract::Background Clinical care team members in Department of Veterans' Affairs (VA) facilities nationwide are working to integrate the use of Secure Messaging (SM) into care delivery and identify innovative uses. Identifying best practices for proactive use of SM is a key factor in its successful implementation and sustaine...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2017-05-RA-0088

    authors: Haun JN,Hathaway W,Chavez M,Antinori N,Vetter B,Miller BK,Martin TL,Kendziora L,Nazi KM,Melillo C

    更新日期:2017-10-01 00:00:00

  • Electronic Health Records in Danish Home Care and Nursing Homes: Inadequate Documentation of Care, Medication, and Consent.

    abstract:BACKGROUND: Electronic health records (EHRs) are used in long-term care to document the patients' condition, medication, and care, thereby supporting communication among caregivers and counteracting adverse drug events. However, the use of EHRs in long-term care has lagged behind EHR use in hospitals. In addition, most...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0040-1721013

    authors: Hertzum M

    更新日期:2021-01-01 00:00:00

  • Comparing predictions made by a prediction model, clinical score, and physicians: pediatric asthma exacerbations in the emergency department.

    abstract:BACKGROUND:Asthma exacerbations are one of the most common medical reasons for children to be brought to the hospital emergency department (ED). Various prediction models have been proposed to support diagnosis of exacerbations and evaluation of their severity. OBJECTIVES:First, to evaluate prediction models construct...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2013-04-RA-0029

    authors: Farion KJ,Wilk S,Michalowski W,O'Sullivan D,Sayyad-Shirabad J

    更新日期:2013-08-07 00:00:00

  • Towards Implementation of OMOP in a German University Hospital Consortium.

    abstract:BACKGROUND:In 2015, the German Federal Ministry of Education and Research initiated a large data integration and data sharing research initiative to improve the reuse of data from patient care and translational research. The Observational Medical Outcomes Partnership (OMOP) common data model and the Observational Healt...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0037-1617452

    authors: Maier C,Lang L,Storf H,Vormstein P,Bieber R,Bernarding J,Herrmann T,Haverkamp C,Horki P,Laufer J,Berger F,Höning G,Fritsch HW,Schüttler J,Ganslandt T,Prokosch HU,Sedlmayr M

    更新日期:2018-01-01 00:00:00

  • Clinician preferences for verbal communication compared to EHR documentation in the ICU.

    abstract:BACKGROUND:Effective communication is essential to safe and efficient patient care. Additionally, many health information technology (HIT) developments, innovations, and standards aim to implement processes to improve data quality and integrity of electronic health records (EHR) for the purpose of clinical information ...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2011-02-RA-0011

    authors: Collins SA,Bakken S,Vawdrey DK,Coiera E,Currie L

    更新日期:2011-06-08 00:00:00

  • Evaluation of a user guidance reminder to improve the quality of electronic prescription messages.

    abstract:BACKGROUND:Prescribers' inappropriate use of the free-text Notes field in new electronic prescriptions can create confusion and workflow disruptions at receiving pharmacies that often necessitates contact with prescribers for clarification. The inclusion of inappropriate patient direction (Sig) information in the Notes...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2014-03-CR-0022

    authors: Dhavle AA,Corley ST,Rupp MT,Ruiz J,Smith J,Gill R,Sow M

    更新日期:2014-08-06 00:00:00

  • Evaluation of a Korean version of a tool for assessing the incorporation of human factors into a medication-related decision support system: the I-MeDeSA.

    abstract:OBJECTIVE:The Instrument for Evaluating Human-Factor Principles in Medication-Related Decision Support Alerts (I-MeDeSA) was developed recently in the US with a view towards improving considerations of human-factor principles when designing alerts for clinical decision support (CDS) systems. This study evaluated the ge...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2014-01-RA-0005

    authors: Cho I,Lee J,Han H,Phansalkar S,Bates DW

    更新日期:2014-06-18 00:00:00

  • Empowering Caseworkers to Better Serve the Most Vulnerable with a Cloud-Based Care Management Solution.

    abstract:BACKGROUND:Care-management tools are typically utilized for chronic disease management. Sonoma County government agencies employed advanced health information technologies, artificial intelligence (AI), and interagency process improvements to help transform health and health care for socially disadvantaged groups and o...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0040-1715894

    authors: Snowdon JL,Robinson B,Staats C,Wolsey K,Sands-Lincoln M,Strasheim T,Brotman D,Keating K,Schnitter E,Jackson G,Kassler W

    更新日期:2020-08-01 00:00:00

  • The Effectiveness of Hands-on Health Informatics Skills Exercises in the Multidisciplinary Smart Home Healthcare and Health Informatics Training Laboratories.

    abstract:OBJECTIVE:This article aimed to evaluate the effectiveness of newly established innovative smart home healthcare and health informatics laboratories, and a novel laboratory course that focuses on experiential health informatics training, and determine students' self-confidence to operate wireless home health monitoring...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2017-08-RA-0136

    authors: Sapci AH,Sapci HA

    更新日期:2017-10-01 00:00:00

  • Nutrigenomic Information in the openEHR Data Set.

    abstract:BACKGROUND:The traditional concept of personalized nutrition is based on adapting diets according to individual needs and preferences. Discussions about personalized nutrition have been on since the Human Genome Project, which has sequenced the human genome. Thenceforth, topics such as nutrigenomics have been assessed ...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0038-1635115

    authors: Maranhão PA,Bacelar-Silva GM,Ferreira DNG,Calhau C,Vieira-Marques P,Cruz-Correia RJ

    更新日期:2018-01-01 00:00:00

  • Quality Initiative Using Theory of Change and Visual Analytics to Improve Controlled Substance Documentation Discrepancies in the Operating Room.

    abstract:BACKGROUND:Discrepancies in controlled substance documentation are common and can lead to legal and regulatory repercussions. We introduced a visual analytics dashboard to assist in a quality improvement project to reduce the discrepancies in controlled substance documentation in the operating room (OR) of our free-sta...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0039-1693688

    authors: Dolan JE,Lonsdale H,Ahumada LM,Patel A,Samuel J,Jalali A,Peck J,DeRosa JC,Rehman M,Varughese AM,Fernandez AM

    更新日期:2019-05-01 00:00:00

  • Social Media in Health Care: Time for Transparent Privacy Policies and Consent for Data Use and Disclosure.

    abstract:: ...

    journal_title:Applied clinical informatics

    pub_type: 社论

    doi:10.1055/s-0038-1676332

    authors: Petersen C,Lehmann CU

    更新日期:2018-10-01 00:00:00

  • Common Laboratory Results Frequently Misunderstood by a Sample of Mechanical Turk Users.

    abstract:OBJECTIVES:More patients are receiving their test results via patient portals. Given test results are written using medical jargon, there has been concern that patients may misinterpret these results. Using sample colonoscopy and Pap smear results, our objective was to assess how frequently people can identify the corr...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.1055/s-0039-1679960

    authors: Qureshi N,Mehrotra A,Rudin RS,Fischer SH

    更新日期:2019-03-01 00:00:00

  • Registers for Networked Medical Research in Germany: Situation and prospects.

    abstract:BACKGROUND:Several disease specific registers are operated by members of the 'TMF - Technology, Methods, and Infrastructure for Networked Medical Research', an umbrella organization of research networks in Germany. OBJECTIVE:To describe the coverage and the current state as well as financial and organizational issues ...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2010-04-RA-0024

    authors: Stausberg J,Altmann U,Antony G,Drepper J,Sax U,Schütt A

    更新日期:2010-11-24 00:00:00

  • Using Visual Analytics to Determine the Utilization of Preoperative Anesthesia Assessments.

    abstract:BACKGROUND:Preoperative assessments are a required and essential element of anesthetic care, yet little is known about the utilization of these documents by clinicians who are not part of the anesthesia care team. As part of perioperative workflow restructuring, we implemented a data visualization technique of electron...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2015-02-CR-0022

    authors: Wanderer JP,Gruss CL,Ehrenfeld JM

    更新日期:2015-10-21 00:00:00

  • A Picture is Worth 1,000 Words. The Use of Clinical Images in Electronic Medical Records.

    abstract:OBJECTIVE:To understand how clinicians utilize image uploading tools in a home grown electronic health records (EHR) system. METHODS:A content analysis of patient notes containing non-radiological images from the EHR was conducted. Images from 4,000 random notes from July 1, 2009 - June 30, 2010 were reviewed and manu...

    journal_title:Applied clinical informatics

    pub_type: 杂志文章

    doi:10.4338/ACI-2016-10-RA-0180

    authors: Ai AC,Maloney FL,Hickman TT,Wilcox AR,Ramelson H,Wright A

    更新日期:2017-07-12 00:00:00