Mobile detection of autism through machine learning on home video: A development and prospective validation study.

Abstract:

BACKGROUND:The standard approaches to diagnosing autism spectrum disorder (ASD) evaluate between 20 and 100 behaviors and take several hours to complete. This has in part contributed to long wait times for a diagnosis and subsequent delays in access to therapy. We hypothesize that the use of machine learning analysis on home video can speed the diagnosis without compromising accuracy. We have analyzed item-level records from 2 standard diagnostic instruments to construct machine learning classifiers optimized for sparsity, interpretability, and accuracy. In the present study, we prospectively test whether the features from these optimized models can be extracted by blinded nonexpert raters from 3-minute home videos of children with and without ASD to arrive at a rapid and accurate machine learning autism classification. METHODS AND FINDINGS:We created a mobile web portal for video raters to assess 30 behavioral features (e.g., eye contact, social smile) that are used by 8 independent machine learning models for identifying ASD, each with >94% accuracy in cross-validation testing and subsequent independent validation from previous work. We then collected 116 short home videos of children with autism (mean age = 4 years 10 months, SD = 2 years 3 months) and 46 videos of typically developing children (mean age = 2 years 11 months, SD = 1 year 2 months). Three raters blind to the diagnosis independently measured each of the 30 features from the 8 models, with a median time to completion of 4 minutes. Although several models (consisting of alternating decision trees, support vector machine [SVM], logistic regression (LR), radial kernel, and linear SVM) performed well, a sparse 5-feature LR classifier (LR5) yielded the highest accuracy (area under the curve [AUC]: 92% [95% CI 88%-97%]) across all ages tested. We used a prospectively collected independent validation set of 66 videos (33 ASD and 33 non-ASD) and 3 independent rater measurements to validate the outcome, achieving lower but comparable accuracy (AUC: 89% [95% CI 81%-95%]). Finally, we applied LR to the 162-video-feature matrix to construct an 8-feature model, which achieved 0.93 AUC (95% CI 0.90-0.97) on the held-out test set and 0.86 on the validation set of 66 videos. Validation on children with an existing diagnosis limited the ability to generalize the performance to undiagnosed populations. CONCLUSIONS:These results support the hypothesis that feature tagging of home videos for machine learning classification of autism can yield accurate outcomes in short time frames, using mobile devices. Further work will be needed to confirm that this approach can accelerate autism diagnosis at scale.

journal_name

PLoS Med

journal_title

PLoS medicine

authors

Tariq Q,Daniels J,Schwartz JN,Washington P,Kalantarian H,Wall DP

doi

10.1371/journal.pmed.1002705

subject

Has Abstract

pub_date

2018-11-27 00:00:00

pages

e1002705

issue

11

eissn

1549-1277

issn

1549-1676

pii

PMEDICINE-D-18-01991

journal_volume

15

pub_type

杂志文章
  • A gene expression signature for RSV: clinical implications and limitations.

    abstract::Peter Openshaw discusses the challenges in advancing respiratory syncytial virus (RSV) treatments and the implications of a study by Mejias and colleagues using a newly identified gene signature for diagnosis and prediction of RSV severity. Please see later in the article for the Editors' Summary. ...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1001550

    authors: Openshaw PJ

    更新日期:2013-11-01 00:00:00

  • Estimating the global clinical burden of Plasmodium falciparum malaria in 2007.

    abstract:BACKGROUND:The epidemiology of malaria makes surveillance-based methods of estimating its disease burden problematic. Cartographic approaches have provided alternative malaria burden estimates, but there remains widespread misunderstanding about their derivation and fidelity. The aims of this study are to present a new...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1000290

    authors: Hay SI,Okiro EA,Gething PW,Patil AP,Tatem AJ,Guerra CA,Snow RW

    更新日期:2010-06-15 00:00:00

  • New methodology for estimating the burden of infectious diseases in Europe.

    abstract::Mirjam Kretzschmar and colleagues describe the BCoDE project, which uses a pathogen-based incidence approach to better estimate the infectious disease burden in Europe. ...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1001205

    authors: Kretzschmar M,Mangen MJ,Pinheiro P,Jahn B,Fèvre EM,Longhi S,Lai T,Havelaar AH,Stein C,Cassini A,Kramarz P,BCoDE consortium.

    更新日期:2012-01-01 00:00:00

  • The global spread of hepatitis C virus 1a and 1b: a phylodynamic and phylogeographic analysis.

    abstract:BACKGROUND:Hepatitis C virus (HCV) is estimated to affect 130-180 million people worldwide. Although its origin is unknown, patterns of viral diversity suggest that HCV genotype 1 probably originated from West Africa. Previous attempts to estimate the spatiotemporal parameters of the virus, both globally and regionally...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1000198

    authors: Magiorkinis G,Magiorkinis E,Paraskevis D,Ho SY,Shapiro B,Pybus OG,Allain JP,Hatzakis A

    更新日期:2009-12-01 00:00:00

  • Decreased bone mineral density in adults born with very low birth weight: a cohort study.

    abstract:BACKGROUND:Very-low-birth-weight (VLBW, <1,500 g) infants have compromised bone mass accrual during childhood, but it is unclear whether this results in subnormal peak bone mass and increased risk of impaired skeletal health in adulthood. We hypothesized that VLBW is associated with reduced bone mineral density (BMD) i...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1000135

    authors: Hovi P,Andersson S,Järvenpää AL,Eriksson JG,Strang-Karlsson S,Kajantie E,Mäkitie O

    更新日期:2009-08-01 00:00:00

  • Anatomy of the epidemiological literature on the 2003 SARS outbreaks in Hong Kong and Toronto: a time-stratified review.

    abstract:BACKGROUND:Outbreaks of emerging infectious diseases, especially those of a global nature, require rapid epidemiological analysis and information dissemination. The final products of those activities usually comprise internal memoranda and briefs within public health authorities and original research published in peer-...

    journal_title:PLoS medicine

    pub_type: 杂志文章,评审

    doi:10.1371/journal.pmed.1000272

    authors: Xing W,Hejblum G,Leung GM,Valleron AJ

    更新日期:2010-05-04 00:00:00

  • Serological testing versus other strategies for diagnosis of active tuberculosis in India: a cost-effectiveness analysis.

    abstract:BACKGROUND:Undiagnosed and misdiagnosed tuberculosis (TB) drives the epidemic in India. Serological (antibody detection) TB tests are not recommended by any agency, but widely used in many countries, including the Indian private sector. The cost and impact of using serology compared with other diagnostic techniques is ...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1001074

    authors: Dowdy DW,Steingart KR,Pai M

    更新日期:2011-08-01 00:00:00

  • Time to renal disease and end-stage renal disease in PROFILE: a multiethnic lupus cohort.

    abstract:BACKGROUND:Renal involvement is a serious manifestation of systemic lupus erythematosus (SLE); it may portend a poor prognosis as it may lead to end-stage renal disease (ESRD). The purpose of this study was to determine the factors predicting the development of renal involvement and its progression to ESRD in a multi-e...

    journal_title:PLoS medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1371/journal.pmed.0030396

    authors: Alarcón GS,McGwin G Jr,Petri M,Ramsey-Goldman R,Fessler BJ,Vilá LM,Edberg JC,Reveille JD,Kimberly RP,PROFILE Study Group.

    更新日期:2006-10-01 00:00:00

  • High quality health systems in the SDG era: Country-specific priorities for improving quality of care.

    abstract::Hannah Leslie and co-authors discuss priorities in individual countries for health system reform. ...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1002946

    authors: Thapa G,Jhalani M,García-Saisó S,Malata A,Roder-DeWan S,Leslie HH

    更新日期:2019-10-03 00:00:00

  • The consumption of khat and other drugs in Somali combatants: a cross-sectional study.

    abstract:BACKGROUND:For more than a decade, most parts of Somalia have not been under the control of any type of government. This "failure of state" is complete in the central and southern regions and most apparent in Mogadishu, which had been for a long period in the hands of warlords deploying their private militias in a batt...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.0040341

    authors: Odenwald M,Hinkel H,Schauer E,Neuner F,Schauer M,Elbert TR,Rockstroh B

    更新日期:2007-12-01 00:00:00

  • Can we systematically review studies that evaluate complex interventions?

    abstract:BACKGROUND TO THE DEBATE:The UK Medical Research Council defines complex interventions as those comprising "a number of separate elements which seem essential to the proper functioning of the interventions although the 'active ingredient' of the intervention that is effective is difficult to specify." A typical example...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1000086

    authors: Shepperd S,Lewin S,Straus S,Clarke M,Eccles MP,Fitzpatrick R,Wong G,Sheikh A

    更新日期:2009-08-01 00:00:00

  • Validation of IMPROD biparametric MRI in men with clinically suspected prostate cancer: A prospective multi-institutional trial.

    abstract:BACKGROUND:Magnetic resonance imaging (MRI) combined with targeted biopsy (TB) is increasingly used in men with clinically suspected prostate cancer (PCa), but the long acquisition times, high costs, and inter-center/reader variability of routine multiparametric prostate MRI limit its wider adoption. METHODS AND FINDI...

    journal_title:PLoS medicine

    pub_type: 临床试验,杂志文章,多中心研究

    doi:10.1371/journal.pmed.1002813

    authors: Jambor I,Verho J,Ettala O,Knaapila J,Taimen P,Syvänen KT,Kiviniemi A,Kähkönen E,Perez IM,Seppänen M,Rannikko A,Oksanen O,Riikonen J,Vimpeli SM,Kauko T,Merisaari H,Kallajoki M,Mirtti T,Lamminen T,Saunavaara J,Arone

    更新日期:2019-06-03 00:00:00

  • Pretreatment CD4 cell slope and progression to AIDS or death in HIV-infected patients initiating antiretroviral therapy--the CASCADE collaboration: a collaboration of 23 cohort studies.

    abstract:BACKGROUND:CD4 cell count is a strong predictor of the subsequent risk of AIDS or death in HIV-infected patients initiating combination antiretroviral therapy (cART). It is not known whether the rate of CD4 cell decline prior to therapy is related to prognosis and should, therefore, influence the decision on when to in...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1000239

    authors: Wolbers M,Babiker A,Sabin C,Young J,Dorrucci M,Chêne G,Mussini C,Porter K,Bucher HC,CASCADE Collaboration Members.

    更新日期:2010-02-23 00:00:00

  • Obstructive sleep apnea and risk of cardiovascular events and all-cause mortality: a decade-long historical cohort study.

    abstract:BACKGROUND:Obstructive sleep apnea (OSA) has been reported to be a risk factor for cardiovascular (CV) disease. Although the apnea-hypopnea index (AHI) is the most commonly used measure of OSA, other less well studied OSA-related variables may be more pathophysiologically relevant and offer better prediction. The objec...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1001599

    authors: Kendzerska T,Gershon AS,Hawker G,Leung RS,Tomlinson G

    更新日期:2014-02-04 00:00:00

  • The preclinical natural history of serous ovarian cancer: defining the target for early detection.

    abstract:BACKGROUND:Ovarian cancer kills approximately 15,000 women in the United States every year, and more than 140,000 women worldwide. Most deaths from ovarian cancer are caused by tumors of the serous histological type, which are rarely diagnosed before the cancer has spread. Rational design of a potentially life-saving e...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1000114

    authors: Brown PO,Palmer C

    更新日期:2009-07-01 00:00:00

  • Young children's probability of dying before and after their mother's death: a rural South African population-based surveillance study.

    abstract:BACKGROUND:There is evidence that a young child's risk of dying increases following the mother's death, but little is known about the risk when the mother becomes very ill prior to her death. We hypothesized that children would be more likely to die during the period several months before their mother's death, as well ...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1001409

    authors: Clark SJ,Kahn K,Houle B,Arteche A,Collinson MA,Tollman SM,Stein A

    更新日期:2013-01-01 00:00:00

  • Progress in the HIV epidemic: Identifying goals and measuring success.

    abstract::Substantial progress has been made towards the goal of ending the HIV/AIDS epidemic due to advancements in both prevention and treatment of HIV. However, major challenges still remain. We describe basic principles of epidemic control in the context of HIV and identify a number of attainable goals in terms of control a...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1002729

    authors: Jones J,Sullivan PS,Curran JW

    更新日期:2019-01-18 00:00:00

  • Migration and first-year maternal mortality among HIV-positive postpartum women: A population-based longitudinal study in rural South Africa.

    abstract:BACKGROUND:In South Africa, within-country migration is common. Mobility affects many of the factors in the pathway for entry to or retention in care among people living with HIV. We characterized the patterns of migration (i.e., change in residency) among peripartum women from rural South Africa and their association ...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1003085

    authors: Kim HY,Dobra A,Tanser F

    更新日期:2020-03-31 00:00:00

  • Prediction of myopia development among Chinese school-aged children using refraction data from electronic medical records: A retrospective, multicentre machine learning study.

    abstract:BACKGROUND:Electronic medical records provide large-scale real-world clinical data for use in developing clinical decision systems. However, sophisticated methodology and analytical skills are required to handle the large-scale datasets necessary for the optimisation of prediction accuracy. Myopia is a common cause of ...

    journal_title:PLoS medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1371/journal.pmed.1002674

    authors: Lin H,Long E,Ding X,Diao H,Chen Z,Liu R,Huang J,Cai J,Xu S,Zhang X,Wang D,Chen K,Yu T,Wu D,Zhao X,Liu Z,Wu X,Jiang Y,Yang X,Cui D,Liu W,Zheng Y,Luo L,Wang H,Chan CC,Morgan IG,He M,Liu Y

    更新日期:2018-11-06 00:00:00

  • Asporin Is a Fibroblast-Derived TGF-β1 Inhibitor and a Tumor Suppressor Associated with Good Prognosis in Breast Cancer.

    abstract:BACKGROUND:Breast cancer is a leading malignancy affecting the female population worldwide. Most morbidity is caused by metastases that remain incurable to date. TGF-β1 has been identified as a key driving force behind metastatic breast cancer, with promising therapeutic implications. METHODS AND FINDINGS:Employing im...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1001871

    authors: Maris P,Blomme A,Palacios AP,Costanza B,Bellahcène A,Bianchi E,Gofflot S,Drion P,Trombino GE,Di Valentin E,Cusumano PG,Maweja S,Jerusalem G,Delvenne P,Lifrange E,Castronovo V,Turtoi A

    更新日期:2015-09-01 00:00:00

  • IL-7 Receptor Mutations and Steroid Resistance in Pediatric T cell Acute Lymphoblastic Leukemia: A Genome Sequencing Study.

    abstract:BACKGROUND:Pediatric acute lymphoblastic leukemia (ALL) is the most common childhood cancer and the leading cause of cancer-related mortality in children. T cell ALL (T-ALL) represents about 15% of pediatric ALL cases and is considered a high-risk disease. T-ALL is often associated with resistance to treatment, includi...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1002200

    authors: Li Y,Buijs-Gladdines JG,Canté-Barrett K,Stubbs AP,Vroegindeweij EM,Smits WK,van Marion R,Dinjens WN,Horstmann M,Kuiper RP,Buijsman RC,Zaman GJ,van der Spek PJ,Pieters R,Meijerink JP

    更新日期:2016-12-20 00:00:00

  • The association between heat exposure and hospitalization for undernutrition in Brazil during 2000-2015: A nationwide case-crossover study.

    abstract:BACKGROUND:Global warming is predicted to indirectly result in more undernutrition by threatening crop production. Whether temperature rise could affect undernutrition directly is unknown. We aim to quantify the relationship between short-term heat exposure and risk of hospitalization due to undernutrition in Brazil. ...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1002950

    authors: Xu R,Zhao Q,Coelho MSZS,Saldiva PHN,Abramson MJ,Li S,Guo Y

    更新日期:2019-10-29 00:00:00

  • Epidemiological characteristics of 2009 (H1N1) pandemic influenza based on paired sera from a longitudinal community cohort study.

    abstract:BACKGROUND:While patterns of incidence of clinical influenza have been well described, much uncertainty remains over patterns of incidence of infection. The 2009 pandemic provided both the motivation and opportunity to investigate patterns of mild and asymptomatic infection using serological techniques. However, to dat...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1000442

    authors: Riley S,Kwok KO,Wu KM,Ning DY,Cowling BJ,Wu JT,Ho LM,Tsang T,Lo SV,Chu DK,Ma ES,Peiris JS

    更新日期:2011-06-01 00:00:00

  • Polygenic risk scores in cardiovascular risk prediction: A cohort study and modelling analyses.

    abstract:BACKGROUND:Polygenic risk scores (PRSs) can stratify populations into cardiovascular disease (CVD) risk groups. We aimed to quantify the potential advantage of adding information on PRSs to conventional risk factors in the primary prevention of CVD. METHODS AND FINDINGS:Using data from UK Biobank on 306,654 individual...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1003498

    authors: Sun L,Pennells L,Kaptoge S,Nelson CP,Ritchie SC,Abraham G,Arnold M,Bell S,Bolton T,Burgess S,Dudbridge F,Guo Q,Sofianopoulou E,Stevens D,Thompson JR,Butterworth AS,Wood A,Danesh J,Samani NJ,Inouye M,Di Angelantoni

    更新日期:2021-01-14 00:00:00

  • Integration of postpartum healthcare services for HIV-infected women and their infants in South Africa: A randomised controlled trial.

    abstract:BACKGROUND:As the number of HIV-infected women initiating lifelong antiretroviral therapy (ART) during pregnancy increases globally, concerns have emerged regarding low levels of retention in HIV services and suboptimal adherence to ART during the postpartum period. We examined the impact of integrating postpartum ART ...

    journal_title:PLoS medicine

    pub_type: 杂志文章,随机对照试验

    doi:10.1371/journal.pmed.1002547

    authors: Myer L,Phillips TK,Zerbe A,Brittain K,Lesosky M,Hsiao NY,Remien RH,Mellins CA,McIntyre JA,Abrams EJ

    更新日期:2018-03-30 00:00:00

  • Bioequivalence of twice-daily oral tacrolimus in transplant recipients: More evidence for consensus?

    abstract::In this Perspective on the clinical trial by Rita Alloway and colleagues, Simon Ball explains the benefits to healthcare systems and individual patients of the bioequivalence established between generic and brand-name formulations of an immunosuppressive drug in transplant recipients. ...

    journal_title:PLoS medicine

    pub_type: 评论,杂志文章

    doi:10.1371/journal.pmed.1002429

    authors: Ball S

    更新日期:2017-11-14 00:00:00

  • HIV treatment as prevention: the utility and limitations of ecological observation.

    abstract::Results from several observational studies of HIV-discordant couples and a randomized controlled trial (HIV Prevention Trials Network 052) show that antiretroviral therapy (ART) can greatly reduce heterosexual HIV transmission in stable HIV-discordant couples. However, such data do not prove that ART will reduce HIV i...

    journal_title:PLoS medicine

    pub_type: 杂志文章,评审

    doi:10.1371/journal.pmed.1001260

    authors: Smith MK,Powers KA,Muessig KE,Miller WC,Cohen MS

    更新日期:2012-01-01 00:00:00

  • The effect of tobacco control measures during a period of rising cardiovascular disease risk in India: a mathematical model of myocardial infarction and stroke.

    abstract:BACKGROUND:We simulated tobacco control and pharmacological strategies for preventing cardiovascular deaths in India, the country that is expected to experience more cardiovascular deaths than any other over the next decade. METHODS AND FINDINGS:A microsimulation model was developed to quantify the differential effect...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1001480

    authors: Basu S,Glantz S,Bitton A,Millett C

    更新日期:2013-01-01 00:00:00

  • Maternal prescribed opioid analgesic use during pregnancy and associations with adverse birth outcomes: A population-based study.

    abstract:BACKGROUND:Published research on prescribed opioid analgesic (POA) use during pregnancy and birth outcomes is limited in scope and has not adequately adjusted for potential confounding factors. To help address these gaps, we estimated associations between maternal POAs during pregnancy and two adverse birth outcomes us...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.1002980

    authors: Sujan AC,Quinn PD,Rickert ME,Wiggs KK,Lichtenstein P,Larsson H,Almqvist C,Öberg AS,D'Onofrio BM

    更新日期:2019-12-02 00:00:00

  • Undertaking research in other countries: national ethico-legal barometers and international ethical consensus statements.

    abstract::Is it ethical for scientists to conduct or to benefit from research in another country if that research would be unlawful, or not generally accepted, in their own country? ...

    journal_title:PLoS medicine

    pub_type: 杂志文章

    doi:10.1371/journal.pmed.0040010

    authors: Skene L

    更新日期:2007-02-01 00:00:00