Task-oriented evaluation of electronic medical records systems: development and validation of a questionnaire for physicians.

Abstract:

BACKGROUND:Evaluation is a challenging but necessary part of the development cycle of clinical information systems like the electronic medical records (EMR) system. It is believed that such evaluations should include multiple perspectives, be comparative and employ both qualitative and quantitative methods. Self-administered questionnaires are frequently used as a quantitative evaluation method in medical informatics, but very few validated questionnaires address clinical use of EMR systems. METHODS:We have developed a task-oriented questionnaire for evaluating EMR systems from the clinician's perspective. The key feature of the questionnaire is a list of 24 general clinical tasks. It is applicable to physicians of most specialties and covers essential parts of their information-oriented work. The task list appears in two separate sections, about EMR use and task performance using the EMR, respectively. By combining these sections, the evaluator may estimate the potential impact of the EMR system on health care delivery. The results may also be compared across time, site or vendor. This paper describes the development, performance and validation of the questionnaire. Its performance is shown in two demonstration studies (n = 219 and 80). Its content is validated in an interview study (n = 10), and its reliability is investigated in a test-retest study (n = 37) and a scaling study (n = 31). RESULTS:In the interviews, the physicians found the general clinical tasks in the questionnaire relevant and comprehensible. The tasks were interpreted concordant to their definitions. However, the physicians found questions about tasks not explicitly or only partially supported by the EMR systems difficult to answer. The two demonstration studies provided unambiguous results and low percentages of missing responses. In addition, criterion validity was demonstrated for a majority of task-oriented questions. Their test-retest reliability was generally high, and the non-standard scale was found symmetric and ordinal. CONCLUSION:This questionnaire is relevant for clinical work and EMR systems, provides reliable and interpretable results, and may be used as part of any evaluation effort involving the clinician's perspective of an EMR system.

authors

Laerum H,Faxvaag A

doi

10.1186/1472-6947-4-1

keywords:

subject

Has Abstract

pub_date

2004-02-09 00:00:00

pages

1

issn

1472-6947

pii

1472-6947-4-1

journal_volume

4

pub_type

杂志文章
  • Some methods for blindfolded record linkage.

    abstract:BACKGROUND:The linkage of records which refer to the same entity in separate data collections is a common requirement in public health and biomedical research. Traditionally, record linkage techniques have required that all the identifying data in which links are sought be revealed to at least one party, often a third ...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-4-9

    authors: Churches T,Christen P

    更新日期:2004-06-28 00:00:00

  • Precursor-induced conditional random fields: connecting separate entities by induction for improved clinical named entity recognition.

    abstract:BACKGROUND:This paper presents a conditional random fields (CRF) method that enables the capture of specific high-order label transition factors to improve clinical named entity recognition performance. Consecutive clinical entities in a sentence are usually separated from each other, and the textual descriptions in cl...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-019-0865-1

    authors: Lee W,Choi J

    更新日期:2019-07-15 00:00:00

  • The caCORE Software Development Kit: streamlining construction of interoperable biomedical information services.

    abstract:BACKGROUND:Robust, programmatically accessible biomedical information services that syntactically and semantically interoperate with other resources are challenging to construct. Such systems require the adoption of common information models, data representations and terminology standards as well as documented applicat...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-6-2

    authors: Phillips J,Chilukuri R,Fragoso G,Warzel D,Covitz PA

    更新日期:2006-01-06 00:00:00

  • Clinical records anonymisation and text extraction (CRATE): an open-source software system.

    abstract:BACKGROUND:Electronic medical records contain information of value for research, but contain identifiable and often highly sensitive confidential information. Patient-identifiable information cannot in general be shared outside clinical care teams without explicit consent, but anonymisation/de-identification allows res...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,评审

    doi:10.1186/s12911-017-0437-1

    authors: Cardinal RN

    更新日期:2017-04-26 00:00:00

  • A method for managing re-identification risk from small geographic areas in Canada.

    abstract:BACKGROUND:A common disclosure control practice for health datasets is to identify small geographic areas and either suppress records from these small areas or aggregate them into larger ones. A recent study provided a method for deciding when an area is too small based on the uniqueness criterion. The uniqueness crite...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-10-18

    authors: El Emam K,Brown A,AbdelMalik P,Neisa A,Walker M,Bottomley J,Roffey T

    更新日期:2010-04-02 00:00:00

  • Optimum binary cut-off threshold of a diagnostic test: comparison of different methods using Monte Carlo technique.

    abstract:BACKGROUND:Using Monte Carlo simulations, we compare different methods (maximizing Youden index, maximizing mutual information, and logistic regression) for their ability to determine optimum binary cut-off thresholds for a ratio-scaled diagnostic test variable. Special attention is given to the stability and precision...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-014-0099-1

    authors: Reibnegger G,Schrabmair W

    更新日期:2014-11-25 00:00:00

  • A clustering approach for detecting implausible observation values in electronic health records data.

    abstract:BACKGROUND:Identifying implausible clinical observations (e.g., laboratory test and vital sign values) in Electronic Health Record (EHR) data using rule-based procedures is challenging. Anomaly/outlier detection methods can be applied as an alternative algorithmic approach to flagging such implausible values in EHRs. ...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-019-0852-6

    authors: Estiri H,Klann JG,Murphy SN

    更新日期:2019-07-23 00:00:00

  • Selected articles from the Third International Workshop on Semantics-Powered Data Analytics (SEPDA 2018).

    abstract::In this editorial, we first summarize the Third International Workshop on Semantics-Powered Data Analytics (SEPDA 2018) held on December 3, 2018 in conjunction with the 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2018) in Madrid, Spain, and then briefly introduce five research articles i...

    journal_title:BMC medical informatics and decision making

    pub_type: 社论

    doi:10.1186/s12911-019-0855-3

    authors: He Z,Bian J,Tao C,Zhang R

    更新日期:2019-08-08 00:00:00

  • A usability design checklist for Mobile electronic data capturing forms: the validation process.

    abstract:BACKGROUND:New Specific Application Domain (SAD) heuristics or design principles are being developed to guide the design and evaluation of mobile applications in a bid to improve on the usability of these applications. This is because the existing heuristics are rather generic and are often unable to reveal a large num...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-018-0718-3

    authors: Mugisha A,Nankabirwa V,Tylleskär T,Babic A

    更新日期:2019-01-09 00:00:00

  • EURISWEB--Web-based epidemiological surveillance of antibiotic-resistant pneumococci in day care centers.

    abstract:BACKGROUND:EURIS (European Resistance Intervention Study) was launched as a multinational study in September of 2000 to identify the multitude of complex risk factors that contribute to the high carriage rate of drug resistant Streptococcus pneumoniae strains in children attending Day Care Centers in several European c...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-3-9

    authors: Silva S,Gouveia-Oliveira R,Maretzek A,Carriço J,Gudnason T,Kristinsson KG,Ekdahl K,Brito-Avô A,Tomasz A,Sanches IS,de Lencastre H,Almeida J

    更新日期:2003-07-08 00:00:00

  • A simulation study comparing aberration detection algorithms for syndromic surveillance.

    abstract:BACKGROUND:The usefulness of syndromic surveillance for early outbreak detection depends in part on effective statistical aberration detection. However, few published studies have compared different detection algorithms on identical data. In the largest simulation study conducted to date, we compared the performance of...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-7-6

    authors: Jackson ML,Baer A,Painter I,Duchin J

    更新日期:2007-03-01 00:00:00

  • Are cancer-related decision aids appropriate for socially disadvantaged patients? A systematic review of US randomized controlled trials.

    abstract:BACKGROUND:Shared decision-making (SDM) is considered a key component of high quality cancer care and may be supported by patient decision aids (PtDAs). Many patients, however, face multiple social disadvantages that may influence their ability to fully participate in SDM or to use PtDAs; additionally, these social dis...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-016-0303-6

    authors: Enard KR,Dolan Mullen P,Kamath GR,Dixon NM,Volk RJ

    更新日期:2016-06-06 00:00:00

  • What information is used in treatment decision aids? A systematic review of the types of evidence populating health decision aids.

    abstract:BACKGROUND:Patient decision aids (DAs) are support tools designed to provide patients with relevant information to help them make informed decisions about their healthcare. While DAs can be effective in improving patient knowledge and decision quality, it is unknown what types of information and evidence are used to po...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,评审

    doi:10.1186/s12911-017-0415-7

    authors: Clifford AM,Ryan J,Walsh C,McCurtin A

    更新日期:2017-02-23 00:00:00

  • Healthcare professional acceptance of telemonitoring for chronic care patients in primary care.

    abstract:BACKGROUND:A pilot experimentation of a telemonitoring system for chronic care patients is conducted in the Bilbao Primary Care Health Region (Basque Country, Spain). It seems important to understand the factors related to healthcare professionals' acceptance of this new technology in order to inform its extension to t...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-12-139

    authors: Asua J,Orruño E,Reviriego E,Gagnon MP

    更新日期:2012-11-30 00:00:00

  • A qualitative analysis to optimize a telemonitoring intervention for heart failure patients from disparity communities.

    abstract:BACKGROUND:The use of telemonitoring is a promising approach to optimizing outcomes in the treatment of heart failure (HF) for patients living in the community. HF telemonitoring interventions, however, have not been tested for use with individuals residing in disparity communities. METHODS:The current study describes...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-016-0300-9

    authors: Pekmezaris R,Schwartz RM,Taylor TN,DiMarzio P,Nouryan CN,Murray L,McKenzie G,Ahern D,Castillo S,Pecinka K,Bauer L,Orona T,Makaryus AN

    更新日期:2016-06-24 00:00:00

  • Attitudes of pediatric intensive care unit physicians towards the use of cognitive aids: a qualitative study.

    abstract:BACKGROUND:Cognitive aids are increasingly recommended in clinical practice, yet little is known about the attitudes of physicians towards these tools. METHODS:We employed a qualitative, descriptive design to explore physician attitudes towards cognitive aids in pediatric intensive care units (PICUs). Semi-structured ...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-016-0291-6

    authors: Weiss MJ,Kramer C,Tremblay S,Côté L

    更新日期:2016-05-21 00:00:00

  • Quantile-based fecal hemoglobin concentration for assessing colorectal neoplasms with 1,263,717 Taiwanese screenees.

    abstract:BACKGROUND:Although fecal hemoglobin concentration (f-Hb) was highly associated with the risk of colorectal neoplasms, current studies on this subject are hampered by skewedness of the data and the ordinal property of f-Hb has not been well studied yet. Our aim was to develop a quantile-based method to estimate adjuste...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-019-0812-1

    authors: Peng SM,Chiu HM,Jen HH,Hsu CY,Chen SL,Chiu SY,Yen AM,Fann JC,Lee YC,Chen HH

    更新日期:2019-05-02 00:00:00

  • Addressing health literacy in patient decision aids.

    abstract:BACKGROUND:Effective use of a patient decision aid (PtDA) can be affected by the user's health literacy and the PtDA's characteristics. Systematic reviews of the relevant literature can guide PtDA developers to attend to the health literacy needs of patients. The reviews reported here aimed to assess: METHODS:We revie...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,评审

    doi:10.1186/1472-6947-13-S2-S10

    authors: McCaffery KJ,Holmes-Rovner M,Smith SK,Rovner D,Nutbeam D,Clayman ML,Kelly-Blake K,Wolf MS,Sheridan SL

    更新日期:2013-01-01 00:00:00

  • Decision support at home (DS@HOME)--system architectures and requirements.

    abstract:BACKGROUND:Demographic change with its consequences of an aging society and an increase in the demand for care in the home environment has triggered intensive research activities in sensor devices and smart home technologies. While many advanced technologies are already available, there is still a lack of decision supp...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,评审

    doi:10.1186/1472-6947-12-43

    authors: Marschollek M

    更新日期:2012-05-28 00:00:00

  • Duke Surgery Research Central: an open-source Web application for the improvement of compliance with research regulation.

    abstract:BACKGROUND:Although regulatory compliance in academic research is enforced by law to ensure high quality and safety to participants, its implementation is frequently hindered by cost and logistical barriers. In order to decrease these barriers, we have developed a Web-based application, Duke Surgery Research Central (D...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-6-32

    authors: Pietrobon R,Shah A,Kuo P,Harker M,McCready M,Butler C,Martins H,Moorman CT,Jacobs DO

    更新日期:2006-07-27 00:00:00

  • The anxious wait: assessing the impact of patient accessible EHRs for breast cancer patients.

    abstract:BACKGROUND:Personal health records (PHRs) provide patients with access to personal health information (PHI) and targeted education. The use of PHRs has the potential to improve a wide range of outcomes, including empowering patients to be more active participants in their care. There are a number of widespread barriers...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-10-46

    authors: Wiljer D,Leonard KJ,Urowitz S,Apatu E,Massey C,Quartey NK,Catton P

    更新日期:2010-09-01 00:00:00

  • The predictability of claim-data-based comorbidity-adjusted models could be improved by using medication data.

    abstract:BACKGROUND:Recently, claim-data-based comorbidity-adjusted methods such as the Charlson index and the Elixhauser comorbidity measures have been widely used among researchers. At the same time, there have been an increasing number of attempts to improve the predictability of comorbidity-adjusted models. We tried to impr...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-13-128

    authors: Bang JH,Hwang SH,Lee EJ,Kim Y

    更新日期:2013-11-20 00:00:00

  • Process evaluation of discharge planning implementation in healthcare using normalization process theory.

    abstract:BACKGROUND:Discharge planning is a care process that aims to secure the transfer of care for the patient at transition from home to the hospital and back home. Information exchange and collaboration between care providers are essential, but deficits are common. A wide range of initiatives to improve the discharge plann...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-016-0285-4

    authors: Nordmark S,Zingmark K,Lindberg I

    更新日期:2016-04-27 00:00:00

  • Fine-grained information extraction from German transthoracic echocardiography reports.

    abstract:BACKGROUND:Information extraction techniques that get structured representations out of unstructured data make a large amount of clinically relevant information about patients accessible for semantic applications. These methods typically rely on standardized terminologies that guide this process. Many languages and cli...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-015-0215-x

    authors: Toepfer M,Corovic H,Fette G,Klügl P,Störk S,Puppe F

    更新日期:2015-11-12 00:00:00

  • Improving bone mineral density reporting to patients with an illustration of personal fracture risk.

    abstract:BACKGROUND:To determine patients' preferences for, and understanding of, FRAX® fracture risk conveyed through illustrations. METHODS:Drawing on examples from published studies, four illustrations of fracture risk were designed and tested for patient preference, ease of understanding, and perceived risk. We enrolled a ...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,多中心研究

    doi:10.1186/s12911-014-0101-y

    authors: Edmonds SW,Cram P,Lu X,Roblin DW,Wright NC,Saag KG,Solimeo SL,PAADRN Investigators.

    更新日期:2014-11-25 00:00:00

  • The information imperative: to study the impact of informational discontinuity on clinical decision making among doctors.

    abstract:BACKGROUND:Informational discontinuity can have far reaching consequences like medical errors, increased re-hospitalization rates and adverse events among others. Thus the holy grail of seamless informational continuity in healthcare has been an enigma with some nations going the digital way. Digitization in healthcare...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-020-01190-2

    authors: Gowda NR,Kumar A,Arya SK,H V

    更新日期:2020-07-28 00:00:00

  • Utility-preserving anonymization for health data publishing.

    abstract:BACKGROUND:Publishing raw electronic health records (EHRs) may be considered as a breach of the privacy of individuals because they usually contain sensitive information. A common practice for the privacy-preserving data publishing is to anonymize the data before publishing, and thus satisfy privacy models such as k-an...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-017-0499-0

    authors: Lee H,Kim S,Kim JW,Chung YD

    更新日期:2017-07-11 00:00:00

  • Automatic schizophrenic discrimination on fNIRS by using complex brain network analysis and SVM.

    abstract:BACKGROUND:Schizophrenia is a kind of serious mental illness. Due to the lack of an objective physiological data supporting and a unified data analysis method, doctors can only rely on the subjective experience of the data to distinguish normal people and patients, which easily lead to misdiagnosis. In recent years, fu...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-017-0559-5

    authors: Song H,Chen L,Gao R,Bogdan IIM,Yang J,Wang S,Dong W,Quan W,Dang W,Yu X

    更新日期:2017-12-20 00:00:00

  • The effect of model selection on cost-effectiveness research: a comparison of kidney function-based microsimulation and disease grade-based microsimulation in chronic kidney disease modeling.

    abstract:BACKGROUND:Cost effectiveness research is emerging in the chronic kidney disease (CKD) research field. Especially, an individual-level state transition model (microsimulation) is widely used for these researches. Some researchers set CKD grades as discrete health states, and the transition probabilities between these s...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-018-0678-7

    authors: Hiragi S,Tamura H,Goto R,Kuroda T

    更新日期:2018-11-09 00:00:00

  • Initial development of Supportive care Assessment, Prioritization and Recommendations for Kids (SPARK), a symptom screening and management application.

    abstract:BACKGROUND:We developed Supportive care Prioritization, Assessment and Recommendations for Kids (SPARK), a web-based application designed to facilitate symptom screening by children receiving cancer treatments and access to supportive care clinical practice guidelines primarily by healthcare providers. The objective wa...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-018-0715-6

    authors: Cook S,Vettese E,Soman D,Hyslop S,Kuczynski S,Spiegler B,Davis H,Duong N,Ou Wai S,Golabek R,Golabek P,Antoszek-Rallo A,Schechter T,Lee Dupuis L,Sung L

    更新日期:2019-01-10 00:00:00