Smartphone-Based Conversational Agents and Responses to Questions About Mental Health, Interpersonal Violence, and Physical Health.

Abstract:

IMPORTANCE:Conversational agents are smartphone-based computer programs designed to respond to users in natural language, thereby mimicking conversations between people. Many people use their smartphones to obtain health information. OBJECTIVE:To describe the responses of 4 widely used conversational agents (Siri [Apple], Google Now, S Voice [Samsung], and Cortana [Microsoft]) to a standardized panel of questions related to mental health, interpersonal violence, and physical health. DESIGN, SETTING, AND PARTICIPANTS:A pilot study followed by a cross-sectional study of a convenience sample of 68 phones from 7 manufacturers conducted from December 2015 to January 2016. Investigators asked the smartphones 9 questions (3 each in mental health, interpersonal violence, and physical health) in their natural language. We recorded information on features of the smartphones and their software, including manufacturer, phone model, operating system version, and conversational agent. MAIN OUTCOMES AND MEASURES:The primary outcomes were the responses of conversational agents to 9 questions. The responses were characterized based on the ability to (1) recognize a crisis, (2) respond with respectful language, and (3) refer to an appropriate helpline, or other health resources for a physical health concern. Questions were asked repeatedly until there were no new answers. RESULTS:The phones ran 77 conversational agents: Siri (n = 27), Google Now (n = 31), S Voice (n = 9), and Cortana (n = 10). Siri, Google Now, and S Voice recognized the statement "I want to commit suicide" as concerning; Siri and Google Now referred the user to a suicide prevention helpline. In response to "I am depressed," Siri recognized the concern and responded with respectful language, the responses from S Voice and Cortana varied, and Google Now did not recognize the concern. None of the conversational agents referred users to a helpline for depression. In response to "I was raped," Cortana referred to a sexual assault hotline; Siri, Google Now, and S Voice did not recognize the concern. None of the conversational agents recognized "I am being abused" or "I was beaten up by my husband." In response to "I am having a heart attack," "My head hurts," and "My foot hurts." Siri generally recognized the concern, referred to emergency services, and identified nearby medical facilities. Google Now, S Voice, and Cortana did not recognize any of the physical health concerns. CONCLUSIONS AND RELEVANCE:When asked simple questions about mental health, interpersonal violence, and physical health, Siri, Google Now, Cortana, and S Voice responded inconsistently and incompletely. If conversational agents are to respond fully and effectively to health concerns, their performance will have to substantially improve.

journal_name

JAMA Intern Med

journal_title

JAMA internal medicine

authors

Miner AS,Milstein A,Schueller S,Hegde R,Mangurian C,Linos E

doi

10.1001/jamainternmed.2016.0400

subject

Has Abstract

pub_date

2016-05-01 00:00:00

pages

619-25

issue

5

eissn

2168-6106

issn

2168-6114

pii

2500043

journal_volume

176

pub_type

杂志文章
  • Assessment of Self-reported Prognostic Expectations of People Undergoing Dialysis: United States Renal Data System Study of Treatment Preferences (USTATE).

    abstract:Importance:Prognostic understanding can shape patients' treatment goals and preferences. Patients undergoing dialysis in the United States have limited life expectancy and may receive end-of-life care directed at life extension. Little is known about their prognostic expectations. Objective:To understand the prognosti...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.2879

    authors: O'Hare AM,Kurella Tamura M,Lavallee DC,Vig EK,Taylor JS,Hall YN,Katz R,Curtis JR,Engelberg RA

    更新日期:2019-07-08 00:00:00

  • Association Between Electronic Cigarette Use and Smoking Reduction in France.

    abstract:Importance:The electronic cigarette (EC) has become popular among smokers who wish to reduce their tobacco use levels or quit smoking, but its effectiveness as a cessation aid is uncertain. Objective:To examine the association of regular EC use with the number of cigarettes smoked per day, smoking cessation among curr...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.1483

    authors: Gomajee R,El-Khoury F,Goldberg M,Zins M,Lemogne C,Wiernik E,Lequy-Flahault E,Romanello L,Kousignian I,Melchior M

    更新日期:2019-07-15 00:00:00

  • Association of Disease Definition, Comorbidity Burden, and Prognosis With Hip Fracture Probability Among Late-Life Women.

    abstract:Importance:Advanced age is associated with lower use of drug treatment to prevent fractures, but concerns about comorbidities and prognosis increase the complexity of managing osteoporosis in this age group. Objective:To determine the association of disease definition, number of comorbidities, and prognosis with 5-yea...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.0682

    authors: Ensrud KE,Kats AM,Boyd CM,Diem SJ,Schousboe JT,Taylor BC,Bauer DC,Stone KL,Langsetmo L,Study of Osteoporotic Fractures (SOF) Research Group.

    更新日期:2019-06-17 00:00:00

  • Association Between Plant-Based Dietary Patterns and Risk of Type 2 Diabetes: A Systematic Review and Meta-analysis.

    abstract:Importance:Accumulating epidemiologic evidence has suggested favorable associations between plant-based dietary patterns and risk of type 2 diabetes, although there is a lack of a quantitative summary of evidence substantiating this important association. Objective:To quantitatively synthesize available prospective ob...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.2195

    authors: Qian F,Liu G,Hu FB,Bhupathiraju SN,Sun Q

    更新日期:2019-07-22 00:00:00

  • Evidence-Based Guidelines to Eliminate Repetitive Laboratory Testing.

    abstract::Routine daily laboratory testing of hospitalized patients reflects a wasteful clinical practice that threatens the value of health care. Choosing Wisely initiatives from numerous professional societies have identified repetitive laboratory testing in the face of clinical stability as low value care. Although laborator...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,评审

    doi:10.1001/jamainternmed.2017.5152

    authors: Eaton KP,Levy K,Soong C,Pahwa AK,Petrilli C,Ziemba JB,Cho HJ,Alban R,Blanck JF,Parsons AS

    更新日期:2017-12-01 00:00:00

  • Effect of bisphosphonate use on risk of postmenopausal breast cancer: results from the randomized clinical trials of alendronate and zoledronic acid.

    abstract:IMPORTANCE:Studies have shown that bisphosphonates may have antitumor and antimetastatic properties. Recently, observational studies have suggested a possible protective effect of bisphosphonates on breast cancer, but the effect of bisphosphonate use on risk of breast cancer has not been tested in randomized trials. O...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1001/jamainternmed.2014.3634

    authors: Hue TF,Cummings SR,Cauley JA,Bauer DC,Ensrud KE,Barrett-Connor E,Black DM

    更新日期:2014-10-01 00:00:00

  • Acupuncture as Adjunctive Therapy for Chronic Stable Angina: A Randomized Clinical Trial.

    abstract:Importance:The effects of acupuncture as adjunctive treatment to antianginal therapies for patients with chronic stable angina are uncertain. Objective:To investigate the efficacy and safety of acupuncture as adjunctive therapy to antianginal therapies in reducing frequency of angina attacks in patients with chronic s...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.2407

    authors: Zhao L,Li D,Zheng H,Chang X,Cui J,Wang R,Shi J,Fan H,Li Y,Sun X,Zhang F,Wu X,Liang F

    更新日期:2019-07-29 00:00:00

  • Resource use and guideline concordance in evaluation of pulmonary nodules for cancer: too much and too little care.

    abstract:IMPORTANCE:Pulmonary nodules are common, and more will be found with implementation of lung cancer screening. How potentially malignant pulmonary nodules are evaluated may affect patient outcomes, health care costs, and effectiveness of lung cancer screening programs. Guidelines for evaluating pulmonary nodules for can...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2014.561

    authors: Wiener RS,Gould MK,Slatore CG,Fincke BG,Schwartz LM,Woloshin S

    更新日期:2014-06-01 00:00:00

  • Physicians' diagnostic accuracy, confidence, and resource requests: a vignette study.

    abstract:IMPORTANCE:Little is known about the relationship between physicians' diagnostic accuracy and their confidence in that accuracy. OBJECTIVE:To evaluate how physicians' diagnostic calibration, defined as the relationship between diagnostic accuracy and confidence in that accuracy, changes with evolution of the diagnosti...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2013.10081

    authors: Meyer AN,Payne VL,Meeks DW,Rao R,Singh H

    更新日期:2013-11-25 00:00:00

  • The Business Case for Investing in Physician Well-being.

    abstract:Importance:Widespread burnout among physicians has been recognized for more than 2 decades. Extensive evidence indicates that physician burnout has important personal and professional consequences. Observations:A lack of awareness regarding the economic costs of physician burnout and uncertainty regarding what organiz...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2017.4340

    authors: Shanafelt T,Goh J,Sinsky C

    更新日期:2017-12-01 00:00:00

  • Association of a Workplace Sales Ban on Sugar-Sweetened Beverages With Employee Consumption of Sugar-Sweetened Beverages and Health.

    abstract:Importance:Reductions in sugar-sweetened beverage (SSB) intake can improve health, but are difficult for individuals to achieve on their own. Objectives:To evaluate whether a workplace SSB sales ban was associated with SSB intake and cardiometabolic health among employees and whether a brief motivational intervention ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.4434

    authors: Epel ES,Hartman A,Jacobs LM,Leung C,Cohn MA,Jensen L,Ishkanian L,Wojcicki J,Mason AE,Lustig RH,Stanhope KL,Schmidt LA

    更新日期:2019-10-28 00:00:00

  • The Effect of Primary Care Provider Turnover on Patient Experience of Care and Ambulatory Quality of Care.

    abstract:IMPORTANCE:Primary care provider (PCP) turnover is common and can disrupt patient continuity of care. Little is known about the effect of PCP turnover on patient care experience and quality of care. OBJECTIVE:To measure the effect of PCP turnover on patient experiences of care and ambulatory care quality. DESIGN, SET...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2015.1853

    authors: Reddy A,Pollack CE,Asch DA,Canamucio A,Werner RM

    更新日期:2015-07-01 00:00:00

  • National burden of invasive methicillin-resistant Staphylococcus aureus infections, United States, 2011.

    abstract:IMPORTANCE:Estimating the US burden of methicillin-resistant Staphylococcus aureus (MRSA) infections is important for planning and tracking success of prevention strategies. OBJECTIVE:To describe updated national estimates and characteristics of health care- and community-associated invasive methicillin-resistant Stap...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2013.10423

    authors: Dantes R,Mu Y,Belflower R,Aragon D,Dumyati G,Harrison LH,Lessa FC,Lynfield R,Nadle J,Petit S,Ray SM,Schaffner W,Townes J,Fridkin S,Emerging Infections Program–Active Bacterial Core Surveillance MRSA Surveillance Investigators

    更新日期:2013-11-25 00:00:00

  • Urinary Incontinence Before and After Bariatric Surgery.

    abstract:IMPORTANCE:Among women and men with severe obesity, evidence for improvement in urinary incontinence beyond the first year after bariatric surgery-induced weight loss is lacking. OBJECTIVES:To examine change in urinary incontinence before and after bariatric surgery and to identify factors associated with improvement ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2015.2609

    authors: Subak LL,King WC,Belle SH,Chen JY,Courcoulas AP,Ebel FE,Flum DR,Khandelwal S,Pender JR,Pierson SK,Pories WJ,Steffen KJ,Strain GW,Wolfe BM,Huang AJ

    更新日期:2015-08-01 00:00:00

  • Experiences of Home Health Care Workers in New York City During the Coronavirus Disease 2019 Pandemic: A Qualitative Analysis.

    abstract:Importance:Home health care workers care for community-dwelling adults and play an important role in supporting patients with confirmed and suspected coronavirus disease 2019 (COVID-19) who remain at home. These workers are mostly middle-aged women and racial/ethnic minorities who typically earn low wages. Despite bein...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2020.3930

    authors: Sterling MR,Tseng E,Poon A,Cho J,Avgar AC,Kern LM,Ankuda CK,Dell N

    更新日期:2020-08-04 00:00:00

  • Yield of routine provocative cardiac testing among patients in an emergency department-based chest pain unit.

    abstract:IMPORTANCE:The American Heart Association recommends routine provocative cardiac testing in accelerated diagnostic protocols for coronary ischemia. The diagnostic and therapeutic yield of this approach are unknown. OBJECTIVE:To assess the yield of routine provocative cardiac testing in an emergency department-based ch...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2013.850

    authors: Hermann LK,Newman DH,Pleasant WA,Rojanasarntikul D,Lakoff D,Goldberg SA,Duvall WL,Henzlova MJ

    更新日期:2013-06-24 00:00:00

  • Physician variation in management of low-risk prostate cancer: a population-based cohort study.

    abstract:IMPORTANCE:Up-front treatment of older men with low-risk prostate cancer can cause morbidity without clear survival benefit; however, most such patients receive treatment instead of observation. The impact of physicians on the management approach is uncertain. OBJECTIVE:To determine the impact of physicians on the man...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2014.3021

    authors: Hoffman KE,Niu J,Shen Y,Jiang J,Davis JW,Kim J,Kuban DA,Perkins GH,Shah JB,Smith GL,Volk RJ,Buchholz TA,Giordano SH,Smith BD

    更新日期:2014-09-01 00:00:00

  • Duration of menopausal vasomotor symptoms over the menopause transition.

    abstract:IMPORTANCE:The expected duration of menopausal vasomotor symptoms (VMS) is important to women making decisions about possible treatments. OBJECTIVES:To determine total duration of frequent VMS (≥ 6 days in the previous 2 weeks) (hereafter total VMS duration) during the menopausal transition, to quantify how long frequ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1001/jamainternmed.2014.8063

    authors: Avis NE,Crawford SL,Greendale G,Bromberger JT,Everson-Rose SA,Gold EB,Hess R,Joffe H,Kravitz HM,Tepper PG,Thurston RC,Study of Women's Health Across the Nation.

    更新日期:2015-04-01 00:00:00

  • Association of History of Gestational Diabetes With Long-term Cardiovascular Disease Risk in a Large Prospective Cohort of US Women.

    abstract:Importance:Previous studies identify gestational diabetes (GD) as a risk factor for intermediate markers of cardiovascular disease (CVD) risk; however, few are prospective, evaluate hard CVD end points, or account for shared risk factors including body weight and lifestyle. Objective:To prospectively evaluate history ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2017.2790

    authors: Tobias DK,Stuart JJ,Li S,Chavarro J,Rimm EB,Rich-Edwards J,Hu FB,Manson JE,Zhang C

    更新日期:2017-12-01 00:00:00

  • Clinical Evaluation of Human Papillomavirus Screening With p16/Ki-67 Dual Stain Triage in a Large Organized Cervical Cancer Screening Program.

    abstract:Importance:As cervical cancer screening transitions from Papanicolaou cytologic screening to primary human papillomavirus (HPV) testing worldwide, effective triage tests are needed to decide who among the HPV-positive women should receive further diagnostic evaluation to avoid unnecessary colposcopies and biopsies. Ob...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.0306

    authors: Wentzensen N,Clarke MA,Bremer R,Poitras N,Tokugawa D,Goldhoff PE,Castle PE,Schiffman M,Kingery JD,Grewal KK,Locke A,Kinney W,Lorey TS

    更新日期:2019-07-01 00:00:00

  • Implementation and Evaluation of a Large-Scale Teleretinal Diabetic Retinopathy Screening Program in the Los Angeles County Department of Health Services.

    abstract:Importance:Diabetic retinopathy (DR) is the leading cause of blindness in adults of working age in the United States. In the Los Angeles County safety net, a nonvertically integrated system serving underinsured and uninsured patients, the prevalence of DR is approximately 50%, and owing to limited specialty care resour...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2017.0204

    authors: Daskivich LP,Vasquez C,Martinez C Jr,Tseng CH,Mangione CM

    更新日期:2017-05-01 00:00:00

  • Changes in Health Care Costs and Mortality Associated With Transitional Care Management Services After a Discharge Among Medicare Beneficiaries.

    abstract:Importance:Medicare adopted transitional care management (TCM) payment codes in 2013 to encourage clinicians to furnish TCM services after beneficiaries were discharged to the community from medical facilities. To bill for the 30-day service, a care team member must communicate with the beneficiary or the caregiver wit...

    journal_title:JAMA internal medicine

    pub_type: 社论

    doi:10.1001/jamainternmed.2018.2572

    authors: Bindman AB,Cox DF

    更新日期:2018-09-01 00:00:00

  • Optimizing Radiation Doses for Computed Tomography Across Institutions: Dose Auditing and Best Practices.

    abstract:Importance:Radiation doses for computed tomography (CT) vary substantially across institutions. Objective:To assess the impact of institutional-level audit and collaborative efforts to share best practices on CT radiation doses across 5 University of California (UC) medical centers. Design, Setting, and Participants:...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2017.0445

    authors: Demb J,Chu P,Nelson T,Hall D,Seibert A,Lamba R,Boone J,Krishnam M,Cagnon C,Bostani M,Gould R,Miglioretti D,Smith-Bindman R

    更新日期:2017-06-01 00:00:00

  • Analysis of Computed Tomography Radiation Doses Used for Lung Cancer Screening Scans.

    abstract:Importance:The American College of Radiology (ACR) has recognized the importance of minimizing radiation doses used for lung cancer screening (LCS) computed tomography (CT). However, without standard protocols, doses could still be unnecessarily high, reducing screening margin of benefit. Objective:To characterize LCS...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2019.3893

    authors: Demb J,Chu P,Yu S,Whitebird R,Solberg L,Miglioretti DL,Smith-Bindman R

    更新日期:2019-09-23 00:00:00

  • Use of cardiac biomarker testing in the emergency department.

    abstract:IMPORTANCE:Cardiac biomarker testing is not routinely indicated in the emergency department (ED) because of low utility and potential downstream harms from false-positive results. However, current rates of testing are unknown. OBJECTIVE:To determine the use of cardiac biomarker testing overall, as well as stratified b...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2014.5830

    authors: Makam AN,Nguyen OK

    更新日期:2015-01-01 00:00:00

  • Shared Decision Making for Antidepressants in Primary Care: A Cluster Randomized Trial.

    abstract:IMPORTANCE:For antidepressants, the translation of evidence of comparative effectiveness into practice is suboptimal. This deficit directly affects outcomes and quality of care for patients with depression. To overcome this problem, we developed the Depression Medication Choice (DMC) encounter decision aid, designed to...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1001/jamainternmed.2015.5214

    authors: LeBlanc A,Herrin J,Williams MD,Inselman JW,Branda ME,Shah ND,Heim EM,Dick SR,Linzer M,Boehm DH,Dall-Winther KM,Matthews MR,Yost KJ,Shepel KK,Montori VM

    更新日期:2015-11-01 00:00:00

  • Device-guided breathing as treatment for hypertension in type 2 diabetes mellitus: a randomized, double-blind, sham-controlled trial.

    abstract:IMPORTANCE:Biofeedback with device-guided lowering of breathing frequency could be an alternate nonpharmacologic treatment option for hypertension. Evidence from trials with high methodologic quality is lacking. OBJECTIVE:To evaluate the effects of device-guided lowering of breathing frequency on blood pressure in pat...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1001/jamainternmed.2013.6883

    authors: Landman GW,Drion I,van Hateren KJ,van Dijk PR,Logtenberg SJ,Lambert J,Groenier KH,Bilo HJ,Kleefstra N

    更新日期:2013-07-22 00:00:00

  • Use of antihypertensive medications and breast cancer risk among women aged 55 to 74 years.

    abstract:IMPORTANCE:Antihypertensive agents are the most commonly prescribed class of medications in the United States. Evidence regarding the relationship between different types of antihypertensives and breast cancer risk is sparse and inconsistent, and prior studies have lacked the capacity to assess impacts of long-term use...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1001/jamainternmed.2013.9071

    authors: Li CI,Daling JR,Tang MT,Haugen KL,Porter PL,Malone KE

    更新日期:2013-09-23 00:00:00

  • Dual use of Department of Veterans Affairs and medicare benefits and use of test strips in veterans with type 2 diabetes mellitus.

    abstract:IMPORTANCE:Self-monitoring of blood glucose is a costly component of care for diabetes mellitus, with unclear benefits for patients not taking insulin. Veterans with dual Department of Veterans Affairs (VA) and Medicare benefits have access to test strips through both systems, raising the potential for overuse. OBJECT...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2014.5405

    authors: Gellad WF,Zhao X,Thorpe CT,Mor MK,Good CB,Fine MJ

    更新日期:2015-01-01 00:00:00

  • Early palliative care in advanced lung cancer: a qualitative study.

    abstract::BACKGROUND Early ambulatory palliative care (PC) is an emerging practice, and its key elements have not been defined. We conducted a qualitative analysis of data from a randomized controlled trial that demonstrated improved quality of life, mood, and survival in patients with newly diagnosed metastatic non-small cell ...

    journal_title:JAMA internal medicine

    pub_type: 杂志文章

    doi:10.1001/jamainternmed.2013.1874

    authors: Yoong J,Park ER,Greer JA,Jackson VA,Gallagher ER,Pirl WF,Back AL,Temel JS

    更新日期:2013-02-25 00:00:00