Evaluating the agreement of users with usability problems identified by heuristic evaluation.

Abstract:

OBJECTIVE:Heuristic evaluation (HE) is an inspection method that can be used for identifying usability problems of health information systems. There is insufficient evidence to what extent these problems are experienced by users in their working environment. The objective of this study was to investigate the agreement of real end users of a health information system with the problems identified by HE. METHODS:First, the emergency information system of educational hospitals in Kerman, Iran was evaluated by a heuristic evaluation. Then, a valid and reliable (Cronbach's alpha = 0.95) electronic questionnaire was designed based on the results of the first phase. RESULTS:Among 127 identified problems, the highest number of problems was related to the "consistency and standards" heuristic (18.9%). The user agreement coefficient with heuristic results was 0.5. The highest agreement of the participants was on the problems related to the "help user recognize, diagnose and recover from errors" heuristic (78%). There was a significant relationship between participants age and work experience with a computer (p < 0.05). CONCLUSION:The agreement rate of real end users with the results of HE was at a medium level. Therefore, in some areas, the perception of evaluators in using this method is not consistent with the users experience with a system. This can result in identifying minor issues and ignoring important system-critical usability issues. The HE is appropriate for identifying specific problems, such as problems related to identifying and correcting errors, but in some areas, such as consistency and standards in the design of a system, it identifies minor or ineffective problems.

journal_name

Int J Med Inform

authors

Khajouei R,Ameri A,Jahani Y

doi

10.1016/j.ijmedinf.2018.05.012

subject

Has Abstract

pub_date

2018-09-01 00:00:00

pages

13-18

eissn

1386-5056

issn

1872-8243

pii

S1386-5056(18)30125-4

journal_volume

117

pub_type

杂志文章
  • Validating a decision support system for anti-epileptic drug treatment. Part II: adjusting anti-epileptic drug treatment.

    abstract::A model of expertise for monitoring antiepileptic drug treatment was implemented in a decision support system. We validated the advice of the system regarding treatment decisions at first follow-up with 265 paper cases based on patient records. The reference for comparison is based on the opinions of neurologists. We ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(99)00052-0

    authors: Smeets R,Talmon J,Meinardi H,Hasman A

    更新日期:1999-11-01 00:00:00

  • Communications and EHR: authenticating who's who is vital.

    abstract::It is becoming increasingly essential for individuals to be able uniquely to identify themselves and each other, even where they may never meet. Access to and use of privileges of membership, whether of a professional association, computer network or health insurance policy depends upon the 'members' being able to pro...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(00)00119-2

    authors: Neame R

    更新日期:2000-11-01 00:00:00

  • Identifying and eliminating inefficiencies in information system usage: A lean perspective.

    abstract:OBJECTIVES:Mismatches frequently occur between information system (IS) dictated workflows and actual workflows of IS users. The resulting impeded workflows negatively influence the efficiency with which goods or services are produced and delivered to customers. Within a healthcare context, impeded workflows can additio...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2017.08.005

    authors: Blijleven V,Koelemeijer K,Jaspers M

    更新日期:2017-11-01 00:00:00

  • SHARE road map for HealthGrids: methodology.

    abstract::The SHARE(1) project (http://www.eu-share.org) was asked to identify the key developments needed to achieve wide adoption and deployment of HealthGrids throughout Europe. The project was asked to organise these as milestones on a road map, so that all technical advances, social actions, economic investments and ethica...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2008.10.003

    authors: Olive M,Rahmouni H,Solomonides T,Breton V,Legré Y,Blanquer I,Hernandez V

    更新日期:2009-04-01 00:00:00

  • CORBA security services for health information systems.

    abstract::The structure of healthcare systems in developed countries is changing to 'shared care', enforced by economic constraints and caused by a change in the basic conditions of care. That development results in co-operative health information systems across the boundaries of organisational, technological, and policy domain...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(98)00122-1

    authors: Blobel B,Holena M

    更新日期:1998-10-01 00:00:00

  • Overcoming the barriers: national to European to G7.

    abstract::An information revolution is underway which will have an impact on all sectors of society. It will fundamentally change national and international health systems. The global Internet is a key influence and will change the balance of power within and between healthcare professions, and between them and the general publ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(97)00106-8

    authors: Rogers R

    更新日期:1998-02-01 00:00:00

  • Fractal analysis of surface EMG signals from the biceps.

    abstract::Nonlinear analysis techniques are necessary to understand the complexity of the EMG. The purpose of the present study was to determine the fractal dimension of surface EMG obtained from the biceps brachii of normal subjects during isokinetic flexion-extension of the arm. The measurements were obtained with different l...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(97)00029-4

    authors: Gupta V,Suryanarayanan S,Reddy NP

    更新日期:1997-07-01 00:00:00

  • Predictive factors of telemedicine service acceptance and behavioral intention of physicians.

    abstract:PURPOSE:Despite the proliferation of telemedicine technology, telemedicine service acceptance has been slow in actual healthcare settings. The purpose of this research is to develop a theoretical model for explaining the predictive factors influencing physicians' willingness to use telemedicine technology to provide he...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2014.05.005

    authors: Rho MJ,Choi IY,Lee J

    更新日期:2014-08-01 00:00:00

  • Delivering the electronic healthcare record for the 21st century.

    abstract::In spite of over four decades of research into Electronic Healthcare Record Systems, the penetration of records which incorporate more than simply basic information, into the working life of healthcare organisations is relatively small. This paper discusses some of the key impediments to progress including in particul...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(01)00205-2

    authors: Grimson J

    更新日期:2001-12-01 00:00:00

  • Achieving the integrated and smart health and wellbeing paradigm: a call for policy research and action on governance and business models.

    abstract::To assure sustainability of our health systems and improve quality, implementing integrated wellness, health and social care service models have been proposed. They will need the enabling power of Health ICT facilitated systems and applications. Such solutions support the efficient coordination of service provision ac...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2012.05.008

    authors: Stroetmann KA

    更新日期:2013-04-01 00:00:00

  • Using the critical incident technique to define a minimal data set for requirements elicitation in public health.

    abstract::The introduction of computer-based information systems (ISs) in public health provides enhanced possibilities for service improvements and hence also for improvement of the population's health. Not least, new communication systems can help in the socialization and integration process needed between the different profe...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(02)00074-6

    authors: Olvingson C,Hallberg N,Timpka T,Greenes RA

    更新日期:2002-12-18 00:00:00

  • Vertical Compliance: A novel method of reporting patient specific ERAS compliance for real-time risk assessment.

    abstract:BACKGROUND:ERAS protocol compliance is traditionally measured and reported as 'items compliance' which is retrospective longitudinal adherence of all patients to an index element. Reporting in this manner is restrictive and cannot impact care in real-time. In order to modify behavior effectively and instantaneously, we...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2020.104194

    authors: Baimas-George M,Cochran A,Watson M,Murphy KJ,Iannitti D,Martinie JB,Baker E,Ocuin L,Vrochides D

    更新日期:2020-09-01 00:00:00

  • Design and implementation of I2Vote--an interactive image-based voting system using windows mobile devices.

    abstract:PURPOSE:To develop, implement and test a novel audience response system (ARS) that allows image based interaction for radiology education. METHODS:The ARS developed in this project is based on standard Personal Digital Assistants (PDAs) (HP iPAQ 114 classic handheld) running Microsoft® Windows Mobile® 6 Classic with a...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2011.05.002

    authors: van Ooijen PM,Broekema A,Oudkerk M

    更新日期:2011-08-01 00:00:00

  • A novel concept for integrating and delivering health information using a comprehensive digital dashboard: An analysis of healthcare professionals' intention to adopt a new system and the trend of its real usage.

    abstract:OBJECTIVE:To introduce a new concept of medical dashboard system called BESTBoard. Such a system was implemented in all wards in a tertiary academic hospital to explore the development process, core designs, functions, usability and feasibility. METHODS:The task-force team made user interface designs for 6 months base...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2016.10.001

    authors: Lee K,Jung SY,Hwang H,Yoo S,Baek HY,Baek RM,Kim S

    更新日期:2017-01-01 00:00:00

  • EmerLoc: location-based services for emergency medical incidents.

    abstract:BACKGROUND:Recent developments in positioning systems and telecommunications have provided the technology needed for the development of location aware medical applications. We developed a system, named EmerLoc, which is based upon this technology and uses a set of sensors that are attached to the patient's body, a micr...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2006.07.010

    authors: Maglogiannis I,Hadjiefthymiades S

    更新日期:2007-10-01 00:00:00

  • Exploiting the terminological approach from CEN/TC251 and GALEN to support semantic interoperability of healthcare record systems.

    abstract::We apply the principles included in two CEN standards (ENV 12265, ENV 12264) to the analysis of the semantic structure of health record systems, to support their semantic interoperability. This result was made possible by dramatic methodological progress in the field of terminological systems--due to a worldwide evolu...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(97)00116-0

    authors: Rossi Mori A,Consorti F

    更新日期:1998-02-01 00:00:00

  • User-centred design for developing e-Health system for renal patients at home (AppNephro).

    abstract:BACKGROUND:Despite the promising benefits of the e-Health approaches (including provide technology-based healthcare services to anyone, anytime, and anywhere), few solutions are adopted in daily practice. User acceptance is one of the major obstacles that hinder the success of technology approaches. End-users often str...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.ijmedinf.2019.02.007

    authors: Calvillo-Arbizu J,Roa-Romero LM,Estudillo-Valderrama MA,Salgueira-Lazo M,Aresté-Fosalba N,Del-Castillo-Rodríguez NL,González-Cabrera F,Marrero-Robayna S,López-de-la-Manzana V,Román-Martínez I

    更新日期:2019-05-01 00:00:00

  • Applying the archetype approach to the database of a biobank information management system.

    abstract:PURPOSE:The purpose of this study is to investigate the feasibility of applying the openEHR archetype approach to modelling the data in the database of an existing proprietary biobank information management system. A biobank information management system stores the clinical/phenotypic data of the sample donor and sampl...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2010.11.002

    authors: Späth MB,Grimson J

    更新日期:2011-03-01 00:00:00

  • Increasing the use of e-consultation in primary care: results of an online survey among non-users of e-consultation.

    abstract:OBJECTIVE:To identify factors that can enhance the use of e-consultation in primary care. We investigated the barriers, demands and motivations regarding e-consultation among patients with no e-consultation experience (non-users). METHODS:We used an online survey to gather data. Via online banners on 26 different webs...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2009.06.002

    authors: Nijland N,van Gemert-Pijnen JE,Boer H,Steehouder MF,Seydel ER

    更新日期:2009-10-01 00:00:00

  • Patients' perceptions of a home telecare system.

    abstract:GOAL:To identify any major factors that could affect patients' perceptions of a Home Telecare Management System (HTMS) and use the findings to contribute to development of a theoretical framework for patient acceptance of HTMS. MATERIALS AND METHODS:Ten Focus Group Interviews (FGIs) were conducted with patients suffer...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2007.10.006

    authors: Rahimpour M,Lovell NH,Celler BG,McCormick J

    更新日期:2008-07-01 00:00:00

  • Information content in Medline record fields.

    abstract:BACKGROUND:The authors have been conducting text mining analyses (extraction of useful information from text) of Medline records, using Abstracts as the main data source. For literature-based discovery, and other text mining applications as well, all records in a discipline need to be evaluated for determining prior ar...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2004.02.008

    authors: Kostoff RN,Block JA,Stump JA,Pfeil KM

    更新日期:2004-06-30 00:00:00

  • Development of diagnostic reference frames for seizures. Part 1: inter-participant agreement in the selection of symptoms.

    abstract:OBJECTIVE:Our aim is to develop reliable descriptions of various seizure types, which will be used as a basis for decision support. We use expert opinions in this process. In this contribution we evaluate the inter-participant agreement in the selection of frequently occurring symptoms for the description of seizure ty...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(03)00047-9

    authors: van Ast JF,Talmon JL,Renier WO,Ahles PP,Hasman A

    更新日期:2003-07-01 00:00:00

  • Health IT and inappropriate utilization of outpatient imaging: A cross-sectional study of U.S. hospitals.

    abstract:OBJECTIVE:To determine whether the use of information technology (IT), measured by Meaningful Use capability, is associated with lower rates of inappropriate utilization of imaging services in hospital outpatient settings. RESEARCH DESIGN:A retrospective cross-sectional analysis of 3332 nonfederal U.S. hospitals using...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2017.10.020

    authors: Appari A,Johnson ME,Anthony DL

    更新日期:2018-01-01 00:00:00

  • Development of an integrated e-health tool for people with, or at high risk of, cardiovascular disease: The Consumer Navigation of Electronic Cardiovascular Tools (CONNECT) web application.

    abstract:BACKGROUND:Cardiovascular disease is the leading killer globally and secondary prevention substantially reduces risk. Uptake of, and adherence to, face-to-face preventive programs is often low. Alternative models of care are exploiting the prominence of technology in daily life to facilitate lifestyle behavior change. ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2016.01.009

    authors: Neubeck L,Coorey G,Peiris D,Mulley J,Heeley E,Hersch F,Redfern J

    更新日期:2016-12-01 00:00:00

  • Same system, different outcomes: comparing the transitions from two paper-based systems to the same computerized physician order entry system.

    abstract:OBJECTIVE:To compare how nurses in two different paper-based systems perceive the impact of a computerized physician order entry (CPOE) system on their medication-related activities. SETTING:13 non-surgical, adult inpatient wards in a Dutch academic hospital. METHODS:Questionnaire survey of 295 nurses before and 304 ...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2008.06.012

    authors: Niazkhani Z,van der Sijs H,Pirnejad H,Redekop WK,Aarts J

    更新日期:2009-03-01 00:00:00

  • Factors determining the adherence to antimicrobial guidelines and the adoption of computerised decision support systems by physicians: A qualitative study in three European hospitals.

    abstract:BACKGROUND AND OBJECTIVES:Antimicrobial stewardship (AMS) programs aim to optimize antibiotic use and reduce inappropriate prescriptions through a panel of interventions. The implementation of clinical guidelines is a core strategy of AMS programs. Nevertheless, their dissemination and application remain low. Computeri...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2020.104233

    authors: Catho G,Centemero NS,Catho H,Ranzani A,Balmelli C,Landelle C,Zanichelli V,Huttner BD,on the behalf of the Q-COMPASS study group.

    更新日期:2020-09-01 00:00:00

  • Healthcare professional's demand for knowledge in informatics.

    abstract:OBJECTIVE:To develop an economic model of health care professional demand for knowledge capital in health informatics. DESIGN:Case study with application of the contingent valuation method to develop a small-scale model. SETTING:Specialized clinic at a university Hospital in Sweden. RESULTS:The model displays the ec...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/s1386-5056(98)00151-8

    authors: Vimarlund V,Timpka T,Hallberg N

    更新日期:1999-02-01 00:00:00

  • Healthcare technology management competency and its impacts on IT-healthcare partnerships development.

    abstract:OBJECTIVE:This study presents a conceptual model to investigate the healthcare technology management (HTM) competency required by healthcare IS professionals and the impact of such competency in gaining strategic advantages through information technology (IT) by development of partnerships with people from different di...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2008.05.007

    authors: Wu JH,Chen YC,Greenes RA

    更新日期:2009-02-01 00:00:00

  • Technology-mediated awareness: facilitating the handling of (un)wanted interruptions in a hospital setting.

    abstract:INTRODUCTION:Nurses' work in hospital departments is highly collaborative and includes communication with a variety of actors. To further support nurses' communications, wireless phones, on which nurses receive both nurse calls and ordinary phone calls, have been introduced. However, while they ensure high availability...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2014.06.007

    authors: Klemets J,Evjemo TE

    更新日期:2014-09-01 00:00:00

  • Design and implementation of an ICU incident registry.

    abstract::Due to its complexity intensive care is vulnerable to errors. On the ICU adults of the AMC (Amsterdam, The Netherlands) the available registries used for error reporting did not give insight in the occurrence of unwanted events, and did not lead to preventive measures. Therefore, a new registry has been developed on t...

    journal_title:International journal of medical informatics

    pub_type: 杂志文章

    doi:10.1016/j.ijmedinf.2006.08.003

    authors: van der Veer S,Cornet R,de Jonge E

    更新日期:2007-02-01 00:00:00