Web evaluation at the US National Institutes of Health: use of the American Customer Satisfaction Index online customer survey.

Abstract:

BACKGROUND:The National Institutes of Health (NIH), US Department of Health and Human Services (HHS), realized the need to better understand its Web users in order to help assure that websites are user friendly and well designed for effective information dissemination. A trans-NIH group proposed a trans-NIH project to implement an online customer survey, known as the American Customer Satisfaction Index (ACSI) survey, on a large number of NIH websites-the first "enterprise-wide" ACSI application, and probably the largest enterprise Web evaluation of any kind, in the US government. The proposal was funded by the NIH Evaluation Set-Aside Program for two years at a cost of US $1.5 million (US $1.275 million for survey licenses for 60 websites at US $18000 per website; US $225,000 for a project evaluation contractor). OBJECTIVE:The overall project objectives were to assess the value added to the participating NIH websites of using the ACSI online survey, identify any NIH-wide benefits (and limitations) of the ACSI, ascertain any new understanding about the NIH Web presence based on ACSI survey results, and evaluate the effectiveness of a trans-NIH approach to Web evaluation. This was not an experimental study and was not intended to evaluate the ACSI survey methodology, per se, or the impacts of its use on customer satisfaction with NIH websites. METHODS:The evaluation methodology included baseline pre-project websites profiles; before and after email surveys of participating website teams; interviews with a representative cross-section of website staff; observations of debriefing meetings with website teams; observations at quarterly trans-NIH Web staff meetings and biweekly trans-NIH leadership team meetings; and review and analysis of secondary data. RESULTS:Of the original 60 NIH websites signed up, 55 implemented the ACSI survey, 42 generated sufficient data for formal reporting of survey results for their sites, and 51 completed the final project survey. A broad cross-section of websites participated, and a majority reported significant benefits and new knowledge gained from the ACSI survey results. NIH websites as a group scored consistently higher on overall customer satisfaction relative to US government-wide and private sector benchmarks. CONCLUSIONS:Overall, the enterprise-wide experiment was successful. On the level of individual websites, the project confirmed the value of online customer surveys as a Web evaluation method. The evaluation results indicated that successful use of the ACSI, whether site-by-site or enterprise-wide, depends in large part on strong staff and management support and adequate funding and time for the use of such evaluative methods. In the age of Web-based e-government, a broad commitment to Web evaluation may well be needed. This commitment would help assure that the potential of the Web and other information technologies to improve customer and citizen satisfaction is fully realized.

journal_name

J Med Internet Res

authors

Wood FB,Siegel ER,Feldman S,Love CB,Rodrigues D,Malamud M,Lagana M,Crafts J

doi

10.2196/jmir.944

subject

Has Abstract

pub_date

2008-02-15 00:00:00

pages

e4

issue

1

eissn

1439-4456

issn

1438-8871

pii

v10i1e4

journal_volume

10

pub_type

杂志文章
  • Comparative Effectiveness of a Web-Based Patient Decision Aid for Therapeutic Options for Sickle Cell Disease: Randomized Controlled Trial.

    abstract:BACKGROUND:Hydroxyurea, chronic blood transfusions, and bone marrow transplantation are efficacious, disease-modifying therapies for sickle cell disease but involve complex risk-benefit trade-offs and decisional dilemma compounded by the lack of comparative studies. A patient decision aid can inform patients about thei...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/14462

    authors: Krishnamurti L,Ross D,Sinha C,Leong T,Bakshi N,Mittal N,Veludhandi D,Pham AP,Taneja A,Gupta K,Nwanze J,Matthews AM,Joshi S,Vazquez Olivieri V,Arjunan S,Okonkwo I,Lukombo I,Lane P,Bakshi N,Loewenstein G

    更新日期:2019-12-04 00:00:00

  • Parent opinions about use of text messaging for immunization reminders.

    abstract:BACKGROUND:Adherence to childhood immunization schedules is a function of various factors. Given the increased use of technology as a strategy to increase immunization coverage, it is important to investigate how parents perceive different forms of communication, including traditional means and text-message reminders. ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.1976

    authors: Ahlers-Schmidt CR,Chesser AK,Paschal AM,Hart TA,Williams KS,Yaghmai B,Shah-Haque S

    更新日期:2012-06-06 00:00:00

  • Alcohol Consumption Reduction Among a Web-Based Supportive Community Using the Hello Sunday Morning Blog Platform: Observational Study.

    abstract:BACKGROUND:Alcohol misuse is a major social and public health issue in Australia, with an estimated cost to the community of Aus $30 billion per annum. Until recently, a major barrier in addressing this significant public health issue is the fact that the majority of individuals with alcohol use disorders and alcohol m...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.9605

    authors: Kirkman JJL,Leo B,Moore JC

    更新日期:2018-05-17 00:00:00

  • Reinforcement Learning for Clinical Decision Support in Critical Care: Comprehensive Review.

    abstract:BACKGROUND:Decision support systems based on reinforcement learning (RL) have been implemented to facilitate the delivery of personalized care. This paper aimed to provide a comprehensive review of RL applications in the critical care setting. OBJECTIVE:This review aimed to survey the literature on RL applications for...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/18477

    authors: Liu S,See KC,Ngiam KY,Celi LA,Sun X,Feng M

    更新日期:2020-07-20 00:00:00

  • Internet-Based Assessment of Oncology Health Care Professional Learning Style and Optimization of Materials for Web-Based Learning: Controlled Trial With Concealed Allocation.

    abstract:BACKGROUND:Precision medicine has resulted in increasing complexity in the treatment of cancer. Web-based educational materials can help address the needs of oncology health care professionals seeking to understand up-to-date treatment strategies. OBJECTIVE:This study aimed to assess learning styles of oncology health...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.7506

    authors: Micheel CM,Anderson IA,Lee P,Chen SC,Justiss K,Giuse NB,Ye F,Kusnoor SV,Levy MA

    更新日期:2017-07-25 00:00:00

  • Ethical dilemmas in online research and treatment of sexually abused adolescents.

    abstract:BACKGROUND:In a recent uncontrolled trial of a new therapist-assisted Web-based treatment of adolescent victims of sexual abuse, the treatment effects were found to be promising. However, the study suffered a large pretreatment withdrawal rate that appeared to emanate from reluctance among the participants to disclose ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.1455

    authors: Lange A,Ruwaard J

    更新日期:2010-12-19 00:00:00

  • Effectiveness of an Internet- and App-Based Intervention for College Students With Elevated Stress: Randomized Controlled Trial.

    abstract:BACKGROUND:Mental health problems are highly prevalent among college students. Most students with poor mental health, however, do not receive professional help. Internet-based self-help formats may increase the utilization of treatment. OBJECTIVE:The aim of this randomized controlled trial was to evaluate the efficacy...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.9293

    authors: Harrer M,Adam SH,Fleischmann RJ,Baumeister H,Auerbach R,Bruffaerts R,Cuijpers P,Kessler RC,Berking M,Lehr D,Ebert DD

    更新日期:2018-04-23 00:00:00

  • Storing and using health data in a virtual private cloud.

    abstract::Electronic health records are being adopted at a rapid rate due to increased funding from the US federal government. Health data provide the opportunity to identify possible improvements in health care delivery by applying data mining and statistical methods to the data and will also enable a wide variety of new appli...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.2076

    authors: Regola N,Chawla NV

    更新日期:2013-03-13 00:00:00

  • Relationship Between Patient-Reported Outcome Measures and the Severity of Chronic Obstructive Pulmonary Disease in the Context of an Innovative Digitally Supported 24-Hour Service: Longitudinal Study.

    abstract:BACKGROUND:Individuals with chronic obstructive pulmonary disease (COPD) live with the burden of a progressive life-threatening condition that is often accompanied by anxiety and depression. The severity of the condition is usually considered from a clinical perspective and characterized according to the Global Initiat...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/10924

    authors: Lindskrog S,Christensen KB,Osborne RH,Vingtoft S,Phanareth K,Kayser L

    更新日期:2019-06-02 00:00:00

  • The Use of Technology for Communicating With Clinicians or Seeking Health Information in a Multilingual Urban Cohort: Cross-Sectional Survey.

    abstract:BACKGROUND:Technology is being increasingly used to communicate health information, but there is limited knowledge on whether these strategies are effective for vulnerable populations, including non-English speaking or low-income individuals. OBJECTIVE:This study assessed how language preferences (eg, English, Spanish...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/16951

    authors: Khoong EC,Rivadeneira NA,Hiatt RA,Sarkar U

    更新日期:2020-04-06 00:00:00

  • Connected Health User Willingness to Share Personal Health Data: Questionnaire Study.

    abstract:BACKGROUND:Connected health has created opportunities for leveraging health data to deliver preventive and personalized health care services. The increasing number of personal devices and advances in measurement technologies contribute to an exponential growth in digital health data. The practices for sharing data acro...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/14537

    authors: Karampela M,Ouhbi S,Isomursu M

    更新日期:2019-11-27 00:00:00

  • Lifestyle Disease Surveillance Using Population Search Behavior: Feasibility Study.

    abstract:BACKGROUND:As the process of producing official health statistics for lifestyle diseases is slow, researchers have explored using Web search data as a proxy for lifestyle disease surveillance. Existing studies, however, are prone to at least one of the following issues: ad-hoc keyword selection, overfitting, insufficie...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/13347

    authors: Memon SA,Razak S,Weber I

    更新日期:2020-01-27 00:00:00

  • An Integrated Brain-Machine Interface Platform With Thousands of Channels.

    abstract::Brain-machine interfaces hold promise for the restoration of sensory and motor function and the treatment of neurological disorders, but clinical brain-machine interfaces have not yet been widely adopted, in part, because modest channel counts have limited their potential. In this white paper, we describe Neuralink's ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/16194

    authors: Musk E,Neuralink.

    更新日期:2019-10-31 00:00:00

  • The chronic care model and technological research and innovation: a scoping review at the crossroads.

    abstract:BACKGROUND:Information and communication technologies (ICT) are key to optimizing the outcomes of the Chronic Care Model (CCM), currently acknowledged as the best synthesis of available evidence for chronic illness prevention and management. At the same time, CCM can offer a needed framework for increasing the relevanc...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.3547

    authors: Gammon D,Berntsen GK,Koricho AT,Sygna K,Ruland C

    更新日期:2015-02-06 00:00:00

  • Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES).

    abstract::Analogous to checklists of recommendations such as the CONSORT statement (for randomized trials), or the QUORUM statement (for systematic reviews), which are designed to ensure the quality of reports in the medical literature, a checklist of recommendations for authors is being presented by the Journal of Medical Inte...

    journal_title:Journal of medical Internet research

    pub_type: 社论

    doi:10.2196/jmir.6.3.e34

    authors: Eysenbach G

    更新日期:2004-09-29 00:00:00

  • Common cold symptoms in children: results of an Internet-based surveillance program.

    abstract:BACKGROUND:Conducting and analyzing clinical studies of cough and cold medications is challenging due to the rapid onset and short duration of the symptoms. The use of Internet-based surveillance tools is a new approach in clinical studies that is gradually becoming popular and may become a useful method of recruitment...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.2868

    authors: Troullos E,Baird L,Jayawardena S

    更新日期:2014-06-19 00:00:00

  • Professional Use of Social Media by Pharmacists: A Qualitative Study.

    abstract:BACKGROUND:Social media is frequently used by consumers and health care professionals; however, our knowledge about its use in a professional capacity by pharmacists is limited. OBJECTIVE:Our aim was to investigate the professional use of social media by pharmacists. METHODS:In-depth semistructured interviews were co...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.5702

    authors: Benetoli A,Chen TF,Schaefer M,Chaar BB,Aslani P

    更新日期:2016-09-23 00:00:00

  • Evaluating Patient Empowerment in Association With eHealth Technology: Scoping Review.

    abstract:BACKGROUND:The prioritization of sustainable patient-centered care in contemporary health care has resulted in an increased focus on patient empowerment, which in turn is considered to facilitate patient independence, self-management, and self-efficacy. However, a definitional consensus of empowerment remains elusive, ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.7809

    authors: Risling T,Martinez J,Young J,Thorp-Froslie N

    更新日期:2017-09-29 00:00:00

  • Using Social Media to Target Cancer Prevention in Young Adults: Viewpoint.

    abstract::Focusing on primary cancer prevention can reduce its incidence. Changing health behaviors is critical to cancer prevention. Modifiable cancer risk factors include lifestyle behaviors related to vaccination, physical activity, weight control and maintenance, alcohol consumption, and tobacco use. These health habits are...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.8882

    authors: Sarkar U,Le GM,Lyles CR,Ramo D,Linos E,Bibbins-Domingo K

    更新日期:2018-06-05 00:00:00

  • Who's using PDAs? Estimates of PDA use by health care providers: a systematic review of surveys.

    abstract:BACKGROUND:Personal digital assistants (PDAs) find many uses in health care. Knowing rates of collective PDA use among health care providers is an important guiding step to further understanding those health care contexts that are most suited to PDA use and whether PDAs provide improved health outcomes. OBJECTIVES:The...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.8.2.e7

    authors: Garritty C,El Emam K

    更新日期:2006-05-12 00:00:00

  • Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence.

    abstract:BACKGROUND:In electronic health (eHealth) evaluations, there is increasing attention for studying the actual usage of a technology in relation to the outcomes found, often by studying the adherence to the technology. On the basis of the definition of adherence, we suggest that the following three elements are necessary...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.8578

    authors: Sieverink F,Kelders SM,van Gemert-Pijnen JE

    更新日期:2017-12-06 00:00:00

  • Understanding Users' Vaping Experiences from Social Media: Initial Study Using Sentiment Opinion Summarization Techniques.

    abstract:BACKGROUND:E-liquid is one of the main components in electronic nicotine delivery systems (ENDS). ENDS review comments could serve as an early warning on use patterns and even function to serve as an indicator of problems or adverse events pertaining to the use of specific e-liquids-much like types of responses tracked...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.9373

    authors: Li Q,Wang C,Liu R,Wang L,Zeng DD,Leischow SJ

    更新日期:2018-08-15 00:00:00

  • Enhancing Doctors' Competencies in Communication With and Activation of Older Patients: The Promoting Active Aging (PRACTA) Computer-Based Intervention Study.

    abstract:BACKGROUND:Demographic changes over the past decades call for the promotion of health and disease prevention for older patients, as well as strategies to enhance their independence, productivity, and quality of life. OBJECTIVE:Our objective was to examine the effects of a computer-based educational intervention design...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.6948

    authors: Wlodarczyk D,Chylińska J,Lazarewicz M,Rzadkiewicz M,Jaworski M,Adamus M,Haugan G,Lillefjell M,Espnes GA

    更新日期:2017-02-22 00:00:00

  • Demographic and Indication-Specific Characteristics Have Limited Association With Social Network Engagement: Evidence From 24,954 Members of Four Health Care Support Groups.

    abstract:BACKGROUND:Digital health social networks (DHSNs) are widespread, and the consensus is that they contribute to wellness by offering social support and knowledge sharing. The success of a DHSN is based on the number of participants and their consistent creation of externalities through the generation of new content. To ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,多中心研究

    doi:10.2196/jmir.6330

    authors: van Mierlo T,Li X,Hyatt D,Ching AT

    更新日期:2017-02-17 00:00:00

  • Web-Based Immersive Virtual Patient Simulators: Positive Effect on Clinical Reasoning in Medical Education.

    abstract:BACKGROUND:Clinical reasoning is based on the declarative and procedural knowledge of workflows in clinical medicine. Educational approaches such as problem-based learning or mannequin simulators support learning of procedural knowledge. Immersive patient simulators (IPSs) go one step further as they allow an illusiona...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.5035

    authors: Kleinert R,Heiermann N,Plum PS,Wahba R,Chang DH,Maus M,Chon SH,Hoelscher AH,Stippel DL

    更新日期:2015-11-17 00:00:00

  • Public Disclosure on Social Media of Identifiable Patient Information by Health Professionals: Content Analysis of Twitter Data.

    abstract:BACKGROUND:Respecting patient privacy and confidentiality is critical for doctor-patient relationships and public trust in medical professionals. The frequency of potentially identifiable disclosures online during periods of active engagement is unknown. OBJECTIVE:The objective of this study was to quantify potentiall...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/19746

    authors: Ahmed W,Jagsi R,Gutheil TG,Katz MS

    更新日期:2020-09-01 00:00:00

  • Short-term trajectories of use of a caloric-monitoring mobile phone app among patients with type 2 diabetes mellitus in a primary care setting.

    abstract:BACKGROUND:Self-management plays an important role in maintaining good control of diabetes mellitus, and mobile phone interventions have been shown to improve such self-management. The Health Promotion Board of Singapore has created a caloric-monitoring mobile health app, the "interactive Diet and Activity Tracker" (iD...

    journal_title:Journal of medical Internet research

    pub_type: 临床试验,杂志文章

    doi:10.2196/jmir.3938

    authors: Goh G,Tan NC,Malhotra R,Padmanabhan U,Barbier S,Allen JC Jr,Østbye T

    更新日期:2015-02-03 00:00:00

  • Short message service (SMS) applications for disease prevention in developing countries.

    abstract:BACKGROUND:The last decade has witnessed unprecedented growth in the number of mobile phones in the developing world, thus linking millions of previously unconnected people. The ubiquity of mobile phones, which allow for short message service (SMS), provides new and innovative opportunities for disease prevention effor...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.1823

    authors: Déglise C,Suggs LS,Odermatt P

    更新日期:2012-01-12 00:00:00

  • Paper-Based Survivorship Care Plans May be Less Helpful for Cancer Patients Who Search for Disease-Related Information on the Internet: Results of the Registrationsystem Oncological Gynecology (ROGY) Care Randomized Trial.

    abstract:BACKGROUND:The Institute of Medicine recommends Survivorship Care Plans (SCPs) for all cancer survivors. However, it is unclear whether certain patient groups may or may not benefit from SCPs. OBJECTIVE:The aim was to assess whether the effects of an automatically generated paper SCP on patients' satisfaction with inf...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.2196/jmir.4914

    authors: Nicolaije KA,Ezendam NP,Pijnenborg JM,Boll D,Vos MC,Kruitwagen RF,van de Poll-Franse LV

    更新日期:2016-07-08 00:00:00

  • Managing COVID-19 With a Clinical Decision Support Tool in a Community Health Network: Algorithm Development and Validation.

    abstract:BACKGROUND:The coronavirus disease (COVID-19) pandemic has resulted in significant morbidity and mortality; large numbers of patients require intensive care, which is placing strain on health care systems worldwide. There is an urgent need for a COVID-19 disease severity assessment that can assist in patient triage and...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/22033

    authors: McRae MP,Dapkins IP,Sharif I,Anderman J,Fenyo D,Sinokrot O,Kang SK,Christodoulides NJ,Vurmaz D,Simmons GW,Alcorn TM,Daoura MJ,Gisburne S,Zar D,McDevitt JT

    更新日期:2020-08-24 00:00:00