Active learning reduces annotation time for clinical concept extraction.

Abstract:

OBJECTIVE:To investigate: (1) the annotation time savings by various active learning query strategies compared to supervised learning and a random sampling baseline, and (2) the benefits of active learning-assisted pre-annotations in accelerating the manual annotation process compared to de novo annotation. MATERIALS AND METHODS:There are 73 and 120 discharge summary reports provided by Beth Israel institute in the train and test sets of the concept extraction task in the i2b2/VA 2010 challenge, respectively. The 73 reports were used in user study experiments for manual annotation. First, all sequences within the 73 reports were manually annotated from scratch. Next, active learning models were built to generate pre-annotations for the sequences selected by a query strategy. The annotation/reviewing time per sequence was recorded. The 120 test reports were used to measure the effectiveness of the active learning models. RESULTS:When annotating from scratch, active learning reduced the annotation time up to 35% and 28% compared to a fully supervised approach and a random sampling baseline, respectively. Reviewing active learning-assisted pre-annotations resulted in 20% further reduction of the annotation time when compared to de novo annotation. DISCUSSION:The number of concepts that require manual annotation is a good indicator of the annotation time for various active learning approaches as demonstrated by high correlation between time rate and concept annotation rate. CONCLUSION:Active learning has a key role in reducing the time required to manually annotate domain concepts from clinical free text, either when annotating from scratch or reviewing active learning-assisted pre-annotations.

journal_name

Int J Med Inform

authors

Kholghi M,Sitbon L,Zuccon G,Nguyen A

doi

10.1016/j.ijmedinf.2017.08.001

subject

Has Abstract

pub_date

2017-10-01 00:00:00

pages

25-31

eissn

1386-5056

issn

1872-8243

pii

S1386-5056(17)30200-9

journal_volume

106

pub_type

杂志文章
  • Accuracy of medication documentation in hospital discharge summaries: A retrospective analysis of medication transcription errors in manual and electronic discharge summaries.

    abstract:BACKGROUND:Medication errors in hospital discharge summaries have the potential to cause serious harm to patients. These errors are generally associated with manual transcription of medications between medication charts and discharge summaries. Studies also show junior doctors are more likely to contribute to discharge...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2009.09.002

    authors: Callen J,McIntosh J,Li J

    更新日期:2010-01-01 00:00:00

  • Design and implementation considerations for a personalized patient education system in burn care.

    abstract::Patient education is a significant factor in the provision of health care services, contributing to improved disease management and health care outcomes. Personalization has been suggested as a means for increasing patient education effectiveness and computer-based approaches have been explored as a possible means of ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2004.04.021

    authors: Doupi P,van der Lei J

    更新日期:2005-03-01 00:00:00

  • Field testing of a digital health information system for primary health care: A quasi-experimental study from India.

    abstract:INTRODUCTION:Information and Communication Technologies (ICTs) are acknowledged as vital tools to strengthen Primary Health Care (PHC) in low- and middle-income countries (LMICs). However, these technologies have been used only for selected services. Moreover, there is limited evidence on how effective these interventi...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2020.104235

    authors: Faujdar DS,Sahay S,Singh T,Kaur M,Kumar R

    更新日期:2020-09-01 00:00:00

  • Real-time attended home-polysomnography with telematic data transmission.

    abstract:PURPOSE:Home-polysomnography (HPSG) has been proposed as a cost-effective alternative for obstructive sleep apnea (OSA) diagnosis. We assessed, in a feasibility study, whether telematic transmission using the Dream® and Sleepbox® technologies was associated with low HPSG failure rate. METHODS:Patients referred by ches...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2013.02.008

    authors: Bruyneel M,Van den Broecke S,Libert W,Ninane V

    更新日期:2013-08-01 00:00:00

  • Click yes to consent: Acceptability of incorporating informed consent into an internet-based testing program for sexually transmitted and blood-borne infections.

    abstract:BACKGROUND:Autonomous use of online health care services without interaction with a health care provider challenges existing models for achieving informed consent (IC); current examinations of this issue have focused on commercial direct-to-consumer genetic testing. As IC is integral to publicly funded clinical testing...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2017.05.020

    authors: Gilbert M,Bonnell A,Farrell J,Haag D,Bondyra M,Unger D,Elliot E

    更新日期:2017-09-01 00:00:00

  • Evaluation of real-time location systems in their hospital contexts.

    abstract:OBJECTIVE:The purpose of the research was to assess real-time location systems (RTLS) that have been implemented in U.S. hospitals. We examined the type of uses to which RTLS have been put, the degree of functionality of the various technologies and software, and the organizational effects of implementing RTLS. METHOD...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2012.07.001

    authors: Fisher JA,Monahan T

    更新日期:2012-10-01 00:00:00

  • Predictive factors of telemedicine service acceptance and behavioral intention of physicians.

    abstract:PURPOSE:Despite the proliferation of telemedicine technology, telemedicine service acceptance has been slow in actual healthcare settings. The purpose of this research is to develop a theoretical model for explaining the predictive factors influencing physicians' willingness to use telemedicine technology to provide he...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2014.05.005

    authors: Rho MJ,Choi IY,Lee J

    更新日期:2014-08-01 00:00:00

  • Which barriers affect morbidity registration performance of GP trainees and trainers?

    abstract:BACKGROUND:Diagnosis coding percentages in the specialty training of general practitioners (GPs) are generally high, but not perfect, indicating barriers against coding still exist, possibly influencing the validity of data based on electronic patient records (EPRs). OBJECTIVE:To study the relationship between barrier...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2013.02.002

    authors: de Jong J,Visser MR,Wieringa-de Waard M

    更新日期:2013-08-01 00:00:00

  • Delivery of a urology online course using Moodle versus didactic lectures methods.

    abstract:PURPOSE:To subjectively and objectively compare an accessible interactive electronic library using Moodle with lectures for urology teaching of medical students. METHODS:Forty consecutive fourth-year medical students and one urology teacher were exposed to two teaching methods (4 weeks each) in the form of problem-bas...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2014.11.001

    authors: Reis LO,Ikari O,Taha-Neto KA,Gugliotta A,Denardi F

    更新日期:2015-02-01 00:00:00

  • Health information system for community-based multiple screening in Keelung, Taiwan (Keelung Community-based Integrated Screening No. 3).

    abstract:BACKGROUND:Community-based multiple screening for common cancers and chronic diseases has increasingly gained attention. However, as infrastructure and evaluation system are more diversified and complicated compared with single screening, the development of a novel health information system is paramount. METHODS:The m...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2005.07.033

    authors: Chiu YH,Chen LS,Chan CC,Liou DM,Wu SC,Kuo HS,Chang HJ,Chen TH

    更新日期:2006-05-01 00:00:00

  • Increasing the use of e-consultation in primary care: results of an online survey among non-users of e-consultation.

    abstract:OBJECTIVE:To identify factors that can enhance the use of e-consultation in primary care. We investigated the barriers, demands and motivations regarding e-consultation among patients with no e-consultation experience (non-users). METHODS:We used an online survey to gather data. Via online banners on 26 different webs...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2009.06.002

    authors: Nijland N,van Gemert-Pijnen JE,Boer H,Steehouder MF,Seydel ER

    更新日期:2009-10-01 00:00:00

  • The quality of paper-based versus electronic nursing care plan in Australian aged care homes: A documentation audit study.

    abstract:INTRODUCTION:The nursing care plan plays an essential role in supporting care provision in Australian aged care. The implementation of electronic systems in aged care homes was anticipated to improve documentation quality. Standardized nursing terminologies, developed to improve communication and advance the nursing pr...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2015.04.004

    authors: Wang N,Yu P,Hailey D

    更新日期:2015-08-01 00:00:00

  • Parametric estimation of the continuous non-stationary spectrum and its dynamics in surface EMG studies.

    abstract::Frequency spectrum of surface electromyographic signals (SEMGs) exhibit a non-stationary nature even in the case of constant level isometric muscle contractions due to changes related to muscle fatigue processes. These changes can be evaluated by methods for estimation of time-varying (TV) spectrum. The most widely ad...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(00)00076-9

    authors: Korosec D

    更新日期:2000-09-01 00:00:00

  • Global healthcare and the flux of technology.

    abstract::For Medinfo '98, as an exercise in technological forecasting and analysis, we volunteered to project the direction of healthcare informatics into the next century. This paper is an extended discussion of that presentation. We open with the observation that healthcare informatics is merely one of the many endeavors tha...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(98)00161-0

    authors: Lincoln TL,Builder C

    更新日期:1999-02-01 00:00:00

  • The introduction of a diagnostic decision support system (DXplain™) into the workflow of a teaching hospital service can decrease the cost of service for diagnostically challenging Diagnostic Related Groups (DRGs).

    abstract:BACKGROUND:In an era of short inpatient stays, residents may overlook relevant elements of the differential diagnosis as they try to evaluate and treat patients. However, if a resident's first principal diagnosis is wrong, the patient's appropriate evaluation and treatment may take longer, cost more, and lead to worse ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章,评审

    doi:10.1016/j.ijmedinf.2010.09.004

    authors: Elkin PL,Liebow M,Bauer BA,Chaliki S,Wahner-Roedler D,Bundrick J,Lee M,Brown SH,Froehling D,Bailey K,Famiglietti K,Kim R,Hoffer E,Feldman M,Barnett GO

    更新日期:2010-11-01 00:00:00

  • Angiocardiographic digital still images compressed via irreversible methods: concepts and experiments.

    abstract::We defined, implemented and tested two new methods for irreversible compression of angiocardiographic still images: brightness error limitation (BEL) and pseudo-gradient adaptive brightness and contrast error limitation (PABCEL). The scan path used to compress the digital images is based on the Peano-Hilbert plane-fil...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(97)00063-4

    authors: Portoni L,Combi C,Pozzi G,Pinciroli F,Fritsch JP,Brennecke R

    更新日期:1997-10-01 00:00:00

  • A Morse-code recognition system with LMS and matching algorithms for persons with disabilities.

    abstract::Single-switch communication is an effective auxiliary method for persons with disabilities. However, it is not easy to recognize the Morse codes typed by them. In our earlier proposed Morse code auto-recognition method, using the Least-Mean-Square (LMS) adaptive algorithm, it was demonstrated that the system could suc...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(97)00020-8

    authors: Shih CH,Luo CH

    更新日期:1997-05-01 00:00:00

  • Technology, governance and patient safety: systems issues in technology and patient safety.

    abstract::Technology and equipment are often identified as contributors to adverse medical events, however technology is seldom the focal point of investigation as a source of medical error or adverse event. It is often seen as both a means of reducing error (e.g., automated drug dispensing machines) or as a major contributing ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章,评审

    doi:10.1016/j.ijmedinf.2006.05.046

    authors: Balka E,Doyle-Waters M,Lecznarowicz D,FitzGerald JM

    更新日期:2007-06-01 00:00:00

  • Detection and characterization of usability problems in structured data entry interfaces in dentistry.

    abstract:BACKGROUND:Poor usability is one of the major barriers for optimally using electronic health records (EHRs). Dentists are increasingly adopting EHRs, and are using structured data entry interfaces to enter data such that the data can be easily retrieved and exchanged. Until recently, dentists have lacked a standardized...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2012.05.018

    authors: Walji MF,Kalenderian E,Tran D,Kookal KK,Nguyen V,Tokede O,White JM,Vaderhobli R,Ramoni R,Stark PC,Kimmes NS,Schoonheim-Klein ME,Patel VL

    更新日期:2013-02-01 00:00:00

  • Pharmacy customers' experiences with the national online service for viewing electronic prescriptions in Finland.

    abstract:OBJECTIVES:To investigate (1) Finnish pharmacy customers' familiarity with My Kanta, the national online service for viewing electronic prescriptions (ePrescriptions), (2) how commonly My Kanta is used, (3) who the typical users are, and (4) users' experiences of the usability of My Kanta. METHOD:A survey was conducte...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2016.10.014

    authors: Lämsä E,Timonen J,Mäntyselkä P,Ahonen R

    更新日期:2017-01-01 00:00:00

  • Leadership structures in emergency care settings: a study of two trauma centers.

    abstract:BACKGROUND:Trauma resuscitation involves multidisciplinary teams under surgical leadership in most US trauma centers. Because many trauma centers have also incorporated emergency department (ED) physicians, shared and cross-disciplinary leadership structures often occur. Our study identifies leadership structures and e...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.ijmedinf.2011.01.004

    authors: Sarcevic A,Marsic I,Waterhouse LJ,Stockwell DC,Burd RS

    更新日期:2011-04-01 00:00:00

  • Barriers and facilitators to the use of computer-based intensive insulin therapy.

    abstract:PURPOSE:Computerized clinical decision support systems (CDSSs) for intensive insulin therapy (IIT) are increasingly common. However, recent studies question IIT's safety and mortality benefit. Researchers have identified factors influencing IIT performance, but little is known about how workflow affects computer-based ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2011.10.003

    authors: Campion TR Jr,Waitman LR,Lorenzi NM,May AK,Gadd CS

    更新日期:2011-12-01 00:00:00

  • Morphosemantic parsing of medical compound words: transferring a French analyzer to English.

    abstract:PURPOSE:Medical language, as many technical languages, is rich with morphologically complex words, many of which take their roots in Greek and Latin--in which case they are called neoclassical compounds. Morphosemantic analysis can help generate definitions of such words. The similarity of structure of those compounds ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2008.07.016

    authors: Deléger L,Namer F,Zweigenbaum P

    更新日期:2009-04-01 00:00:00

  • SHARE road map for HealthGrids: methodology.

    abstract::The SHARE(1) project (http://www.eu-share.org) was asked to identify the key developments needed to achieve wide adoption and deployment of HealthGrids throughout Europe. The project was asked to organise these as milestones on a road map, so that all technical advances, social actions, economic investments and ethica...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2008.10.003

    authors: Olive M,Rahmouni H,Solomonides T,Breton V,Legré Y,Blanquer I,Hernandez V

    更新日期:2009-04-01 00:00:00

  • Uncovering healthcare practitioners' information processing using the think-aloud method: From paper-based guideline to clinical decision support system.

    abstract:OBJECTIVE:To investigate whether the use of the think-aloud method with propositional analysis could be helpful in the design of a Clinical Decision Support System (CDSS) providing guideline recommendations about long-term follow-up of childhood cancer survivors. MATERIALS AND METHODS:The think-aloud method was used t...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2015.11.011

    authors: Kilsdonk E,Peute LW,Riezebos RJ,Kremer LC,Jaspers MW

    更新日期:2016-02-01 00:00:00

  • Performance of primary healthcare dentists in a distance learning course in pediatric dentistry.

    abstract:OBJECTIVE:Children are an important portion of the population of the territories covered by Primary Health Care (PHC), with needs and characteristics that can be managed at this level of care. Therefore, it is essential that professionals working in PHC be capable of providing child care. The aim of this study was to e...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2019.06.014

    authors: Bavaresco CS,Bragança S,Vencato V,Feltes B,Sória GS,Brew MC,de Moura FR,D'Ávila OP,Umpierre RN,Harzheim E,Rodrigues JA

    更新日期:2019-09-01 00:00:00

  • Automation bias: empirical results assessing influencing factors.

    abstract:OBJECTIVE:To investigate the rate of automation bias - the propensity of people to over rely on automated advice and the factors associated with it. Tested factors were attitudinal - trust and confidence, non-attitudinal - decision support experience and clinical experience, and environmental - task difficulty. The par...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2014.01.001

    authors: Goddard K,Roudsari A,Wyatt JC

    更新日期:2014-05-01 00:00:00

  • Policy for cryptography in healthcare--a view from the NHS.

    abstract::Effective security arrangements, which both protect and assure those information assets of healthcare providers, doctors and patients, are fundamental requirements in a modern electronic healthcare culture. At the heart of healthcare information systems in future will be those infrastructure components and services, w...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(00)00109-x

    authors: Donaldson A

    更新日期:2000-11-01 00:00:00

  • Decision support in medicine: lessons from the HELP system.

    abstract:PURPOSE:This report describes an ongoing transition from the HELP Hospital Information System to HELP II, a replacement Health Information System built to manage clinical information captured in a variety of medical settings. The focus of the article is on the medical decision support provided by this system and studie...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(02)00110-7

    authors: Haug PJ,Rocha BH,Evans RS

    更新日期:2003-03-01 00:00:00

  • Feasibility and acceptability of virtual academic detailing on opioid prescribing.

    abstract:INTRODUCTION:Social distancing requirements during COVID-19 pose a challenge to conducting traditional academic detailing, which typically involves in-person peer education visits to improve patient outcomes. The main alternative is to conduct virtual academic detailing delivered through web-based technology, but this ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2020.104365

    authors: Smart MH,Mandava MR,Lee TA,Pickard AS

    更新日期:2021-03-01 00:00:00