Methods to Evaluate the Effects of Internet-Based Digital Health Interventions for Citizens: Systematic Review of Reviews.

Abstract:

BACKGROUND:Digital health can empower citizens to manage their health and address health care system problems including poor access, uncoordinated care and increasing costs. Digital health interventions are typically complex interventions. Therefore, evaluations present methodological challenges. OBJECTIVE:The objective of this study was to provide a systematic overview of the methods used to evaluate the effects of internet-based digital health interventions for citizens. Three research questions were addressed to explore methods regarding approaches (study design), effects and indicators. METHODS:We conducted a systematic review of reviews of the methods used to measure the effects of internet-based digital health interventions for citizens. The protocol was developed a priori according to Preferred Reporting Items for Systematic review and Meta-Analysis Protocols and the Cochrane Collaboration methodology for overviews of reviews. Qualitative, mixed-method, and quantitative reviews published in English or French from January 2010 to October 2016 were included. We searched for published reviews in PubMed, EMBASE, The Cochrane Database of Systematic Reviews, CINHAL and Epistemonikos. We categorized the findings based on a thematic analysis of the reviews structured around study designs, indicators, types of interventions, effects and perspectives. RESULTS:A total of 20 unique reviews were included. The most common digital health interventions for citizens were patient portals and patients' access to electronic health records, covered by 10/20 (50%) and 6/20 (30%) reviews, respectively. Quantitative approaches to study design included observational study (15/20 reviews, 75%), randomized controlled trial (13/20 reviews, 65%), quasi-experimental design (9/20 reviews, 45%), and pre-post studies (6/20 reviews, 30%). Qualitative studies or mixed methods were reported in 13/20 (65%) reviews. Five main categories of effects were identified: (1) health and clinical outcomes, (2) psychological and behavioral outcomes, (3) health care utilization, (4) system adoption and use, and (5) system attributes. Health and clinical outcomes were measured with both general indicators and disease-specific indicators and reported in 11/20 (55%) reviews. Patient-provider communication and patient satisfaction were the most investigated psychological and behavioral outcomes, reported in 13/20 (65%) and 12/20 (60%) reviews, respectively. Evaluation of health care utilization was included in 8/20 (40%) reviews, most of which focused on the economic effects on the health care system. CONCLUSIONS:Although observational studies and surveys have provided evidence of benefits and satisfaction for patients, there is still little reliable evidence from randomized controlled trials of improved health outcomes. Future evaluations of digital health interventions for citizens should focus on specific populations or chronic conditions which are more likely to achieve clinically meaningful benefits and use high-quality approaches such as randomized controlled trials. Implementation research methods should also be considered. We identified a wide range of effects and indicators, most of which focused on patients as main end users. Implications for providers and the health system should also be included in evaluations or monitoring of digital health interventions.

journal_name

J Med Internet Res

authors

Zanaboni P,Ngangue P,Mbemba GIC,Schopf TR,Bergmo TS,Gagnon MP

doi

10.2196/10202

subject

Has Abstract

pub_date

2018-06-07 00:00:00

pages

e10202

issue

6

eissn

1439-4456

issn

1438-8871

pii

v20i6e10202

journal_volume

20

pub_type

杂志文章
  • Understanding Monitoring Technologies for Adults With Pain: Systematic Literature Review.

    abstract:BACKGROUND:Monitoring of patients may decrease treatment costs and improve quality of care. Pain is the most common health problem that people seek help for in hospitals. Therefore, monitoring patients with pain may have significant impact in improving treatment. Several studies have studied factors affecting pain; how...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.7279

    authors: Rodríguez I,Herskovic V,Gerea C,Fuentes C,Rossel PO,Marques M,Campos M

    更新日期:2017-10-27 00:00:00

  • SARS and population health technology.

    abstract::The recent global outbreak of SARS (severe acute respiratory syndrome) provides an opportunity to study the use and impact of public health informatics and population health technology to detect and fight a global epidemic. Population health technology is the umbrella term for technology applications that have a popul...

    journal_title:Journal of medical Internet research

    pub_type: 社论

    doi:10.2196/jmir.5.2.e14

    authors: Eysenbach G

    更新日期:2003-04-01 00:00:00

  • Electronic Health Program to Empower Patients in Returning to Normal Activities After General Surgical and Gynecological Procedures: Intervention Mapping as a Useful Method for Further Development.

    abstract:BACKGROUND:Support for guiding and monitoring postoperative recovery and resumption of activities is usually not provided to patients after discharge from the hospital. Therefore, a perioperative electronic health (eHealth) intervention ("ikherstel" intervention or "I recover" intervention) was developed to empower gyn...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.9938

    authors: den Bakker CM,Schaafsma FG,van der Meij E,Meijerink WJ,van den Heuvel B,Baan AH,Davids PH,Scholten PC,van der Meij S,van Baal WM,van Dalsen AD,Lips DJ,van der Steeg JW,Leclercq WK,Geomini PM,Consten EC,Schraffordt Koops S

    更新日期:2019-02-06 00:00:00

  • E-mental health care among young adults and help-seeking behaviors: a transversal study in a community sample.

    abstract:BACKGROUND:The Internet is widely used by young people and could serve to improve insufficient access to mental health care. Previous information on this topic comes from selected samples (students or self-selected individuals) and is incomplete. OBJECTIVE:In a community sample of young adults, we aimed to describe fr...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.4254

    authors: Younes N,Chollet A,Menard E,Melchior M

    更新日期:2015-05-15 00:00:00

  • Institutionalizing telemedicine applications: the challenge of legitimizing decision-making.

    abstract::During the last decades a variety of telemedicine applications have been trialed worldwide. However, telemedicine is still an example of major potential benefits that have not been fully attained. Health care regulators are still debating why institutionalizing telemedicine applications on a large scale has been so di...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.1669

    authors: Zanaboni P,Lettieri E

    更新日期:2011-09-28 00:00:00

  • Participant-Centered Online Active Surveillance for Adverse Events Following Vaccination in a Large Clinical Trial: Feasibility and Usability Study.

    abstract:BACKGROUND:Active participant monitoring of adverse events following immunization (AEFI) is a recent development to improve the speed and transparency of vaccine safety postmarketing. Vaxtracker, an online tool used to monitor vaccine safety, has successfully demonstrated its usefulness in postmarketing surveillance of...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.2196/14791

    authors: Munnoch SA,Cashman P,Peel R,Attia J,Hure A,Durrheim DN

    更新日期:2019-10-23 00:00:00

  • No increase in response rate by adding a web response option to a postal population survey: a randomized trial.

    abstract:BACKGROUND:There is substantial interest in use of the Internet for surveys, but there have been few health-oriented, large, randomized trials of general population surveys on the Internet. It is unclear whether providing the option to respond via Internet increases the response rate, and to what degree the results wil...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.9.5.e40

    authors: Brøgger J,Nystad W,Cappelen I,Bakke P

    更新日期:2007-12-31 00:00:00

  • Equipping Learners to Evaluate Online Health Care Resources: Longitudinal Study of Learning Design Strategies in a Health Care Massive Open Online Course.

    abstract:BACKGROUND:The digital revolution has led to a boom in the number of available online health care resources. To navigate these resources successfully, digital literacy education is required. Learners who can evaluate the reliability and validity of online health care information are likely to be more effective at avoid...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/15177

    authors: Blakemore LM,Meek SEM,Marks LK

    更新日期:2020-02-26 00:00:00

  • Web-Based Technology for Remote Viewing of Radiological Images: App Validation.

    abstract:BACKGROUND:Internet technologies can create advanced and rich web-based apps that allow radiologists to easily access teleradiology systems and remotely view medical images. However, each technology has its own drawbacks. It is difficult to balance the advantages and disadvantages of these internet technologies and ide...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/16224

    authors: Min Q,Wang X,Huang B,Xu L

    更新日期:2020-09-25 00:00:00

  • Importance of Internet surveillance in public health emergency control and prevention: evidence from a digital epidemiologic study during avian influenza A H7N9 outbreaks.

    abstract:BACKGROUND:Outbreaks of human infection with a new avian influenza A H7N9 virus occurred in China in the spring of 2013. Control and prevention of a new human infectious disease outbreak can be strongly affected by public reaction and social impact through the Internet and social media. OBJECTIVE:This study aimed to i...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.2911

    authors: Gu H,Chen B,Zhu H,Jiang T,Wang X,Chen L,Jiang Z,Zheng D,Jiang J

    更新日期:2014-01-17 00:00:00

  • Childcare service centers' preferences and intentions to use a web-based program to implement healthy eating and physical activity policies and practices: a cross-sectional study.

    abstract:BACKGROUND:Overweight and obesity is a significant public health problem that impacts a large number of children globally. Supporting childcare centers to deliver healthy eating and physical activity-promoting policies and practices is a recommended strategy for obesity prevention, given that such services provide acce...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.3639

    authors: Yoong SL,Williams CM,Finch M,Wyse R,Jones J,Freund M,Wiggers JH,Nathan N,Dodds P,Wolfenden L

    更新日期:2015-04-30 00:00:00

  • Engagement and Nonusage Attrition With a Free Physical Activity Promotion Program: The Case of 10,000 Steps Australia.

    abstract:BACKGROUND:Data from controlled trials indicate that Web-based interventions generally suffer from low engagement and high attrition. This is important because the level of exposure to intervention content is linked to intervention effectiveness. However, data from real-life Web-based behavior change interventions are ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.4339

    authors: Guertler D,Vandelanotte C,Kirwan M,Duncan MJ

    更新日期:2015-07-15 00:00:00

  • Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES).

    abstract::Analogous to checklists of recommendations such as the CONSORT statement (for randomized trials), or the QUORUM statement (for systematic reviews), which are designed to ensure the quality of reports in the medical literature, a checklist of recommendations for authors is being presented by the Journal of Medical Inte...

    journal_title:Journal of medical Internet research

    pub_type: 社论

    doi:10.2196/jmir.6.3.e34

    authors: Eysenbach G

    更新日期:2004-09-29 00:00:00

  • The Electronic CardioMetabolic Program (eCMP) for Patients With Cardiometabolic Risk: A Randomized Controlled Trial.

    abstract:BACKGROUND:Effective lifestyle interventions targeting high-risk adults that are both practical for use in ambulatory care settings and scalable at a population management level are needed. OBJECTIVE:Our aim was to examine the potential effectiveness, feasibility, and acceptability of delivering an evidence-based Elec...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.5143

    authors: Azar KM,Koliwad S,Poon T,Xiao L,Lv N,Griggs R,Ma J

    更新日期:2016-05-27 00:00:00

  • Digital Marketing to Promote Healthy Weight Gain Among Pregnant Women in Alberta: An Implementation Study.

    abstract:BACKGROUND:As the use of digital media for health promotion has become increasingly common, descriptive studies exploring current and innovative marketing strategies can enhance the understanding of effective strategies and best practices. OBJECTIVE:This study aims to describe the implementation of a provincial digita...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/11534

    authors: Graham JE,Moore JL,Bell RC,Miller T

    更新日期:2019-02-01 00:00:00

  • Web-Based Cognitive Behavioral Therapy for Female Patients With Eating Disorders: Randomized Controlled Trial.

    abstract:BACKGROUND:Many patients with eating disorders do not receive help for their symptoms, even though these disorders have severe morbidity. The Internet may offer alternative low-threshold treatment interventions. OBJECTIVE:This study evaluated the effects of a Web-based cognitive behavioral therapy (CBT) intervention u...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.3946

    authors: ter Huurne ED,de Haan HA,Postel MG,van der Palen J,VanDerNagel JE,DeJong CA

    更新日期:2015-06-18 00:00:00

  • Social cognitive determinants of nutrition and physical activity among web-health users enrolling in an online intervention: the influence of social support, self-efficacy, outcome expectations, and self-regulation.

    abstract:BACKGROUND:The Internet is a trusted source of health information for growing majorities of Web users. The promise of online health interventions will be realized with the development of purely online theory-based programs for Web users that are evaluated for program effectiveness and the application of behavior change...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.1551

    authors: Anderson-Bill ES,Winett RA,Wojcik JR

    更新日期:2011-03-17 00:00:00

  • Professional Use of Social Media by Pharmacists: A Qualitative Study.

    abstract:BACKGROUND:Social media is frequently used by consumers and health care professionals; however, our knowledge about its use in a professional capacity by pharmacists is limited. OBJECTIVE:Our aim was to investigate the professional use of social media by pharmacists. METHODS:In-depth semistructured interviews were co...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.5702

    authors: Benetoli A,Chen TF,Schaefer M,Chaar BB,Aslani P

    更新日期:2016-09-23 00:00:00

  • Managing COVID-19 With a Clinical Decision Support Tool in a Community Health Network: Algorithm Development and Validation.

    abstract:BACKGROUND:The coronavirus disease (COVID-19) pandemic has resulted in significant morbidity and mortality; large numbers of patients require intensive care, which is placing strain on health care systems worldwide. There is an urgent need for a COVID-19 disease severity assessment that can assist in patient triage and...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/22033

    authors: McRae MP,Dapkins IP,Sharif I,Anderman J,Fenyo D,Sinokrot O,Kang SK,Christodoulides NJ,Vurmaz D,Simmons GW,Alcorn TM,Daoura MJ,Gisburne S,Zar D,McDevitt JT

    更新日期:2020-08-24 00:00:00

  • Beyond traditional advertisements: leveraging Facebook's social structures for research recruitment.

    abstract:BACKGROUND:Obtaining access to a demographically and geographically diverse sample for health-related research can be costly and time consuming. Previous studies have reported mixed results regarding the potential of using social media-based advertisements to overcome these challenges. OBJECTIVE:Our aim was to develop...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.3786

    authors: Valdez RS,Guterbock TM,Thompson MJ,Reilly JD,Menefee HK,Bennici MS,Williams IC,Rexrode DL

    更新日期:2014-10-27 00:00:00

  • Feasibility of a wiki as a participatory tool for patients in clinical guideline development.

    abstract:BACKGROUND:Patient participation is essential in developing high-quality guidelines but faces practical challenges. Evidence on timing, methods, evaluations, and outcomes of methodologies for patient participation in guideline development is lacking. OBJECTIVE:To assess the feasibility of a wiki as a participatory too...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.2080

    authors: den Breejen EM,Nelen WL,Knijnenburg JM,Burgers JS,Hermens RP,Kremer JA

    更新日期:2012-10-26 00:00:00

  • Does Usage of an eHealth Intervention Reduce the Risk of Excessive Gestational Weight Gain? Secondary Analysis From a Randomized Controlled Trial.

    abstract:BACKGROUND:Excessive gestational weight gain (GWG) contributes to the development of obesity in mother and child. Internet-based interventions have the potential for delivering innovative and interactive options for prevention of excessive GWG to large numbers of people. OBJECTIVE:The objective of this study was to cr...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.6644

    authors: Graham ML,Strawderman MS,Demment M,Olson CM

    更新日期:2017-01-09 00:00:00

  • Validity of electronic diet recording nutrient estimates compared to dietitian analysis of diet records: randomized controlled trial.

    abstract:BACKGROUND:Dietary intake assessment with diet records (DR) is a standard research and practice tool in nutrition. Manual entry and analysis of DR is time-consuming and expensive. New electronic tools for diet entry by clients and research participants may reduce the cost and effort of nutrient intake estimation. OBJE...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.3744

    authors: Raatz SK,Scheett AJ,Johnson LK,Jahns L

    更新日期:2015-01-20 00:00:00

  • DietPal: a Web-based dietary menu-generating and management system.

    abstract:BACKGROUND:Attempts in current health care practice to make health care more accessible, effective, and efficient through the use of information technology could include implementation of computer-based dietary menu generation. While several of such systems already exist, their focus is mainly to assist healthy individ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.6.1.e4

    authors: Noah SA,Abdullah SN,Shahar S,Abdul-Hamid H,Khairudin N,Yusoff M,Ghazali R,Mohd-Yusoff N,Shafii NS,Abdul-Manaf Z

    更新日期:2004-01-30 00:00:00

  • Exacerbations in Chronic Obstructive Pulmonary Disease: Identification and Prediction Using a Digital Health System.

    abstract:BACKGROUND:Chronic obstructive pulmonary disease (COPD) is a progressive, chronic respiratory disease with a significant socioeconomic burden. Exacerbations, the sudden and sustained worsening of symptoms, can lead to hospitalization and reduce quality of life. Major limitations of previous telemonitoring interventions...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.7207

    authors: Shah SA,Velardo C,Farmer A,Tarassenko L

    更新日期:2017-03-07 00:00:00

  • Ontology-Based Approach to Social Data Sentiment Analysis: Detection of Adolescent Depression Signals.

    abstract:BACKGROUND:Social networking services (SNSs) contain abundant information about the feelings, thoughts, interests, and patterns of behavior of adolescents that can be obtained by analyzing SNS postings. An ontology that expresses the shared concepts and their relationships in a specific field could be used as a semanti...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.7452

    authors: Jung H,Park HA,Song TM

    更新日期:2017-07-24 00:00:00

  • The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions.

    abstract::A growing number of investigators have commented on the lack of models to inform the design of behavioral intervention technologies (BITs). BITs, which include a subset of mHealth and eHealth interventions, employ a broad range of technologies, such as mobile phones, the Web, and sensors, to support users in changing ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.3077

    authors: Mohr DC,Schueller SM,Montague E,Burns MN,Rashidi P

    更新日期:2014-06-05 00:00:00

  • Motivations for Social Distancing and App Use as Complementary Measures to Combat the COVID-19 Pandemic: Quantitative Survey Study.

    abstract:BACKGROUND:The current COVID-19 pandemic is showing negative effects on human health as well as on social and economic life. It is a critical and challenging task to revive public life while minimizing the risk of infection. Reducing interactions between people by social distancing is an effective and prevalent measure...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/21613

    authors: Kaspar K

    更新日期:2020-08-27 00:00:00

  • Adopting Patient Portals in Hospitals: Qualitative Study.

    abstract:BACKGROUND:Theoretical models help to explain or predict the adoption of electronic health (eHealth) technology and illustrate the complexity of the adoption process. These models provide insights into general factors that influence the use of eHealth technology. However, they do not give hospitals much actionable know...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/16921

    authors: Hulter P,Pluut B,Leenen-Brinkhuis C,de Mul M,Ahaus K,Weggelaar-Jansen AM

    更新日期:2020-05-19 00:00:00

  • Behavior Change Techniques in Physical Activity eHealth Interventions for People With Cardiovascular Disease: Systematic Review.

    abstract:BACKGROUND:Cardiovascular disease (CVD) is the leading cause of premature death and disability in Europe, accounting for 4 million deaths per year and costing the European Union economy almost €196 billion annually. There is strong evidence to suggest that exercise-based secondary rehabilitation programs can decrease t...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.7782

    authors: Duff OM,Walsh DM,Furlong BA,O'Connor NE,Moran KA,Woods CB

    更新日期:2017-08-02 00:00:00