Patient and Consumer Safety Risks When Using Conversational Assistants for Medical Information: An Observational Study of Siri, Alexa, and Google Assistant.

Abstract:

BACKGROUND:Conversational assistants, such as Siri, Alexa, and Google Assistant, are ubiquitous and are beginning to be used as portals for medical services. However, the potential safety issues of using conversational assistants for medical information by patients and consumers are not understood. OBJECTIVE:To determine the prevalence and nature of the harm that could result from patients or consumers using conversational assistants for medical information. METHODS:Participants were given medical problems to pose to Siri, Alexa, or Google Assistant, and asked to determine an action to take based on information from the system. Assignment of tasks and systems were randomized across participants, and participants queried the conversational assistants in their own words, making as many attempts as needed until they either reported an action to take or gave up. Participant-reported actions for each medical task were rated for patient harm using an Agency for Healthcare Research and Quality harm scale. RESULTS:Fifty-four subjects completed the study with a mean age of 42 years (SD 18). Twenty-nine (54%) were female, 31 (57%) Caucasian, and 26 (50%) were college educated. Only 8 (15%) reported using a conversational assistant regularly, while 22 (41%) had never used one, and 24 (44%) had tried one "a few times." Forty-four (82%) used computers regularly. Subjects were only able to complete 168 (43%) of their 394 tasks. Of these, 49 (29%) reported actions that could have resulted in some degree of patient harm, including 27 (16%) that could have resulted in death. CONCLUSIONS:Reliance on conversational assistants for actionable medical information represents a safety risk for patients and consumers. Patients should be cautioned to not use these technologies for answers to medical questions they intend to act on without further consultation from a health care provider.

journal_name

J Med Internet Res

authors

Bickmore TW,Trinh H,Olafsson S,O'Leary TK,Asadi R,Rickles NM,Cruz R

doi

10.2196/11510

subject

Has Abstract

pub_date

2018-09-04 00:00:00

pages

e11510

issue

9

eissn

1439-4456

issn

1438-8871

pii

v20i9e11510

journal_volume

20

pub_type

杂志文章
  • A Rapid Electronic Cognitive Assessment Measure for Multiple Sclerosis: Validation of Cognitive Reaction, an Electronic Version of the Symbol Digit Modalities Test.

    abstract:BACKGROUND:Incorporating cognitive testing into routine clinical practice is a challenge in multiple sclerosis (MS), given the wide spectrum of both cognitive and physical impairments people can have and the time that testing requires. Shortened paper and verbal assessments predominate but still are not used routinely....

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/18234

    authors: Middleton RM,Pearson OR,Ingram G,Craig EM,Rodgers WJ,Downing-Wood H,Hill J,Tuite-Dalton K,Roberts C,Watson L,Ford DV,Nicholas R,UK MS Register Research Group.

    更新日期:2020-09-23 00:00:00

  • Exploring design requirements for repurposing dental virtual patients from the web to second life: a focus group study.

    abstract:BACKGROUND:Since their inception, virtual patients have provided health care educators with a way to engage learners in an experience simulating the clinician's environment without danger to learners and patients. This has led this learning modality to be accepted as an essential component of medical education. With th...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.3343

    authors: Antoniou PE,Athanasopoulou CA,Dafli E,Bamidis PD

    更新日期:2014-06-13 00:00:00

  • Earned media and public engagement with CDC's "Tips from Former Smokers" campaign: an analysis of online news and blog coverage.

    abstract:BACKGROUND:In March 2012, the US Centers for Disease Control and Prevention (CDC) launched the first-ever paid national tobacco education campaign. At a cost of US $54 million, "Tips from Former Smokers" (Tips) ran for 3 months across multiple media, depicting the suffering experienced by smokers and their families in ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.3645

    authors: Kornfield R,Smith KC,Szczypka G,Vera L,Emery S

    更新日期:2015-01-20 00:00:00

  • Electronic Health Physical Activity Behavior Change Intervention to Self-Manage Cardiovascular Disease: Qualitative Exploration of Patient and Health Professional Requirements.

    abstract:BACKGROUND:Cardiovascular diseases are a leading cause of premature death worldwide. International guidelines recommend routine delivery of all phases of cardiac rehabilitation. Uptake of traditional cardiac rehabilitation remains suboptimal, as attendance at formal hospital-based cardiac rehabilitation programs is low...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.9181

    authors: Walsh DM,Moran K,Cornelissen V,Buys R,Cornelis N,Woods C

    更新日期:2018-05-08 00:00:00

  • Scope of policy issues in eHealth: results from a structured literature review.

    abstract:BACKGROUND:eHealth is widely used as a tool for improving health care delivery and information. However, distinct policies and strategies are required for its proper implementation and integration at national and international levels. OBJECTIVE:To determine the scope of policy issues faced by individuals, institutions...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.1633

    authors: Khoja S,Durrani H,Nayani P,Fahim A

    更新日期:2012-02-17 00:00:00

  • The Optimization of an eHealth Solution (Thought Spot) with Transition-Aged Youth in Postsecondary Settings: Participatory Design Research.

    abstract:BACKGROUND:Seventy percent of lifetime cases of mental illness emerge before the age of 24 years, but many youth are unable to access the support and services they require in a timely and appropriate way. With most youth using the internet, electronic health (eHealth) interventions are promising tools for reaching this...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.8102

    authors: VanHeerwaarden N,Ferguson G,Abi-Jaoude A,Johnson A,Hollenberg E,Chaim G,Cleverley K,Eysenbach G,Henderson J,Levinson A,Robb J,Sharpe S,Voineskos A,Wiljer D

    更新日期:2018-03-06 00:00:00

  • Balancing Accuracy and Privacy in Federated Queries of Clinical Data Repositories: Algorithm Development and Validation.

    abstract:BACKGROUND:Over the past decade, the emergence of several large federated clinical data networks has enabled researchers to access data on millions of patients at dozens of health care organizations. Typically, queries are broadcast to each of the sites in the network, which then return aggregate counts of the number o...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/18735

    authors: Yu YW,Weber GM

    更新日期:2020-11-03 00:00:00

  • Internet patient records: new techniques.

    abstract:BACKGROUND:The ease by which the Internet is able to distribute information to geographically-distant users on a wide variety of computers makes it an obvious candidate for a technological solution for electronic patient record systems. Indeed, second-generation Internet technologies such as the ones described in this ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.3.1.e8

    authors: Brelstaff G,Moehrs S,Anedda P,Tuveri M,Zanetti G

    更新日期:2001-01-01 00:00:00

  • Determinants of successful weight loss after using a commercial web-based weight reduction program for six months: cohort study.

    abstract:BACKGROUND:The Internet is widely available and commonly used for health information; therefore, Web-based weight loss programs could provide support to large parts of the population in self-guided weight loss. Previous studies showed that Web-based weight loss interventions can be effective, depending on the quality o...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.2648

    authors: Postrach E,Aspalter R,Elbelt U,Koller M,Longin R,Schulzke JD,Valentini L

    更新日期:2013-10-14 00:00:00

  • Peer Mentorship via Mobile Phones for Newly Diagnosed HIV-Positive Youths in Clinic Care in Khayelitsha, South Africa: Mixed Methods Study.

    abstract:BACKGROUND:Youths in South Africa are poor utilizers of HIV health services. Medecins Sans Frontieres has been piloting youth-adapted services at a youth clinic in Khayelitsha, including a peer virtual mentorship program over mobile phones, piloted from March 2015 to May 2016. OBJECTIVE:The objective of this study was...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/14012

    authors: Hacking D,Mgengwana-Mbakaza Z,Cassidy T,Runeyi P,Duran LT,Mathys RH,Boulle A

    更新日期:2019-12-10 00:00:00

  • The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions.

    abstract::A growing number of investigators have commented on the lack of models to inform the design of behavioral intervention technologies (BITs). BITs, which include a subset of mHealth and eHealth interventions, employ a broad range of technologies, such as mobile phones, the Web, and sensors, to support users in changing ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/jmir.3077

    authors: Mohr DC,Schueller SM,Montague E,Burns MN,Rashidi P

    更新日期:2014-06-05 00:00:00

  • Serious Gaming During Multidisciplinary Rehabilitation for Patients With Chronic Pain or Fatigue Symptoms: Mixed Methods Design of a Realist Process Evaluation.

    abstract:BACKGROUND:Serious gaming could support patients in learning to cope with chronic pain or functional somatic syndromes and reduce symptom burdens. OBJECTIVE:To realize this potential, insight is needed into how, why, for whom, and when it works in actual treatment circumstances. METHODS:Following a realist approach, ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/14766

    authors: Vugts MA,Zedlitz AM,Joosen MC,Vrijhoef HJ

    更新日期:2020-03-09 00:00:00

  • Facebook Groups for the Management of Chronic Diseases.

    abstract::The use of Facebook groups by health care researchers and professionals for chronic disease management, namely type 2 diabetes mellitus and coronary heart disease, is in its early stages and challenges are emerging. While Facebook groups offer great potential to deliver health support, research of Facebook groups for ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.7558

    authors: Partridge SR,Gallagher P,Freeman B,Gallagher R

    更新日期:2018-01-17 00:00:00

  • Effects of a 12-Week Digital Care Program for Chronic Knee Pain on Pain, Mobility, and Surgery Risk: Randomized Controlled Trial.

    abstract:BACKGROUND:Chronic knee pain, most commonly caused by knee osteoarthritis, is a prevalent condition which in most cases can be effectively treated through conservative, non-surgical care involving exercise therapy, education, psychosocial support, and weight loss. However, most people living with chronic knee pain do n...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.9667

    authors: Mecklenburg G,Smittenaar P,Erhart-Hledik JC,Perez DA,Hunter S

    更新日期:2018-04-25 00:00:00

  • Perspectives of English, Chinese, and Spanish-Speaking Safety-Net Patients on Clinician Computer Use: Qualitative Analysis.

    abstract:BACKGROUND:Safety-net systems serve patients with limited health literacy and limited English proficiency (LEP) who face communication barriers. However, little is known about how diverse safety-net patients feel about increasing clinician electronic health record (EHR) use. OBJECTIVE:The aim of this study was to bett...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/13131

    authors: Khoong EC,Cherian R,Matta GY,Lyles CR,Schillinger D,Ratanawongsa N

    更新日期:2019-05-22 00:00:00

  • The good, bad, and ugly of online recruitment of parents for health-related focus groups: lessons learned.

    abstract:BACKGROUND:We describe our experiences with identifying and recruiting Ontario parents through the Internet, primarily, as well as other modes, for participation in focus groups about adding the influenza vaccine to school-based immunization programs. OBJECTIVE:Our objectives were to assess participation rates with an...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.2829

    authors: Quach S,Pereira JA,Russell ML,Wormsbecker AE,Ramsay H,Crowe L,Quan SD,Kwong J

    更新日期:2013-11-14 00:00:00

  • Differences in reach and attrition between Web-based and print-delivered tailored interventions among adults over 50 years of age: clustered randomized trial.

    abstract:BACKGROUND:The Internet has the potential to provide large populations with individual health promotion advice at a relatively low cost. Despite the high rates of Internet access, actual reach by Web-based interventions is often disappointingly low, and differences in use between demographic subgroups are present. Furt...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.2229

    authors: Peels DA,Bolman C,Golsteijn RH,De Vries H,Mudde AN,van Stralen MM,Lechner L

    更新日期:2012-12-17 00:00:00

  • Feasibility and effectiveness of a web-based positive psychology program for youth mental health: randomized controlled trial.

    abstract:BACKGROUND:Youth mental health is a significant public health concern due to the high prevalence of mental health problems in this population and the low rate of those affected seeking help. While it is increasingly recognized that prevention is better than cure, most youth prevention programs have utilized interventio...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.3176

    authors: Manicavasagar V,Horswood D,Burckhardt R,Lum A,Hadzi-Pavlovic D,Parker G

    更新日期:2014-06-04 00:00:00

  • Associations Between Exposure to and Expression of Negative Opinions About Human Papillomavirus Vaccines on Social Media: An Observational Study.

    abstract:BACKGROUND:Groups and individuals that seek to negatively influence public opinion about the safety and value of vaccination are active in online and social media and may influence decision making within some communities. OBJECTIVE:We sought to measure whether exposure to negative opinions about human papillomavirus (...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.4343

    authors: Dunn AG,Leask J,Zhou X,Mandl KD,Coiera E

    更新日期:2015-06-10 00:00:00

  • Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES).

    abstract::Analogous to checklists of recommendations such as the CONSORT statement (for randomized trials), or the QUORUM statement (for systematic reviews), which are designed to ensure the quality of reports in the medical literature, a checklist of recommendations for authors is being presented by the Journal of Medical Inte...

    journal_title:Journal of medical Internet research

    pub_type: 社论

    doi:10.2196/jmir.6.3.e34

    authors: Eysenbach G

    更新日期:2004-09-29 00:00:00

  • Possibilities, Problems, and Perspectives of Data Collection by Mobile Apps in Longitudinal Epidemiological Studies: Scoping Review.

    abstract:BACKGROUND:The broad availability of smartphones and the number of health apps in app stores have risen in recent years. Health apps have benefits for individuals (eg, the ability to monitor one's health) as well as for researchers (eg, the ability to collect data in population-based, clinical, and observational studie...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,评审

    doi:10.2196/17691

    authors: Fischer F,Kleen S

    更新日期:2021-01-22 00:00:00

  • Telemonitoring for Patients With COVID-19: Recommendations for Design and Implementation.

    abstract::Despite significant efforts, the COVID-19 pandemic has put enormous pressure on health care systems around the world, threatening the quality of patient care. Telemonitoring offers the opportunity to carefully monitor patients with a confirmed or suspected case of COVID-19 from home and allows for the timely identific...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/20953

    authors: Silven AV,Petrus AHJ,Villalobos-Quesada M,Dirikgil E,Oerlemans CR,Landstra CP,Boosman H,van Os HJA,Blanker MH,Treskes RW,Bonten TN,Chavannes NH,Atsma DE,Teng YKO

    更新日期:2020-09-02 00:00:00

  • Responses of Conversational Agents to Health and Lifestyle Prompts: Investigation of Appropriateness and Presentation Structures.

    abstract:BACKGROUND:Conversational agents (CAs) are systems that mimic human conversations using text or spoken language. Their widely used examples include voice-activated systems such as Apple Siri, Google Assistant, Amazon Alexa, and Microsoft Cortana. The use of CAs in health care has been on the rise, but concerns about th...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/15823

    authors: Kocaballi AB,Quiroz JC,Rezazadegan D,Berkovsky S,Magrabi F,Coiera E,Laranjo L

    更新日期:2020-02-09 00:00:00

  • How Veterans With Post-Traumatic Stress Disorder and Comorbid Health Conditions Utilize eHealth to Manage Their Health Care Needs: A Mixed-Methods Analysis.

    abstract:BACKGROUND:Mental health conditions are prevalent among US veterans and pose a number of self-management and health care navigation challenges. Post-Traumatic Stress Disorder (PTSD) with comorbid chronic medical conditions (CMCs) is especially common, in both returning Iraq or Afghanistan and earlier war-era veterans. ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.5594

    authors: Whealin JM,Jenchura EC,Wong AC,Zulman DM

    更新日期:2016-10-26 00:00:00

  • Connected Health User Willingness to Share Personal Health Data: Questionnaire Study.

    abstract:BACKGROUND:Connected health has created opportunities for leveraging health data to deliver preventive and personalized health care services. The increasing number of personal devices and advances in measurement technologies contribute to an exponential growth in digital health data. The practices for sharing data acro...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/14537

    authors: Karampela M,Ouhbi S,Isomursu M

    更新日期:2019-11-27 00:00:00

  • Smartphones as multimodal communication devices to facilitate clinical knowledge processes: randomized controlled trial.

    abstract:BACKGROUND:Despite the widespread use and advancements of mobile technology that facilitate rich communication modes, there is little evidence demonstrating the value of smartphones for effective interclinician communication and knowledge processes. OBJECTIVE:The objective of this study was to determine the effects of...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章,随机对照试验

    doi:10.2196/jmir.2758

    authors: Pimmer C,Mateescu M,Zahn C,Genewein U

    更新日期:2013-11-27 00:00:00

  • Evaluation of a Technology-Based Peer-Support Intervention Program for Preventing Postnatal Depression (Part 2): Qualitative Study.

    abstract:BACKGROUND:Social support is known to reduce risks of postnatal depression (PND) and improve maternal emotional well-being. However, the Asian cultural context is often neglected when appraising maternal needs and mothers' preferences for social support. While many preventive efforts have experimented with technology, ...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/12915

    authors: Shorey S,Ng ED

    更新日期:2019-08-29 00:00:00

  • Association Between Acute Medical Exacerbations and Consuming or Producing Web-Based Health Information: Analysis From Pew Survey Data.

    abstract:BACKGROUND:The Internet is an increasingly important resource for individuals who seek information from both health professionals and peers. While the demographic and health characteristics of persons who use health information technology has been well described, less is known about the relationship between these healt...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.3801

    authors: Gidwani R,Zulman D

    更新日期:2015-06-23 00:00:00

  • Using the internet to understand smokers' treatment preferences: informing strategies to increase demand.

    abstract:BACKGROUND:Most smokers attempt to quit on their own even though cessation aids can substantially increase their chances of success. Millions of smokers seek cessation advice on the Internet, so using it to promote cessation products and services is one strategy for increasing demand for treatments. Little is known, ho...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.1666

    authors: Westmaas JL,Abroms L,Bontemps-Jones J,Bauer JE,Bade J

    更新日期:2011-08-26 00:00:00

  • Health-Specific Information and Communication Technology Use and Its Relationship to Obesity in High-Poverty, Urban Communities: Analysis of a Population-Based Biosocial Survey.

    abstract:BACKGROUND:More than 35% of American adults are obese. For African American and Hispanic adults, as well as individuals residing in poorer or more racially segregated urban neighborhoods, the likelihood of obesity is even higher. Information and communication technologies (ICTs) may substitute for or complement communi...

    journal_title:Journal of medical Internet research

    pub_type: 杂志文章

    doi:10.2196/jmir.5741

    authors: Gopalan A,Makelarski JA,Garibay LB,Escamilla V,Merchant RM,Wolfe MB Sr,Holbrook R,Lindau ST

    更新日期:2016-06-28 00:00:00