Single-stage intake gesture detection using CTC loss and extended prefix beam search.

Abstract:

:Accurate detection of individual intake gestures is a key step towards automatic dietary monitoring. Both inertial sensor data of wrist movements and video data depicting the upper body have been used for this purpose. The most advanced approaches to date use a two-stage approach, in which (i) framelevel intake probabilities are learned from the sensor data using a deep neural network, and then (ii) sparse intake events are detected by finding the maxima of the frame-level probabilities. In this study, we propose a single-stage approach which directly decodes the probabilities learned from sensor data into sparse intake detections. This is achieved by weakly supervised training using Connectionist Temporal Classification (CTC) loss, and decoding using a novel extended prefix beam search decoding algorithm. Benefits of this approach include (i) end-to-end training for detections, (ii) simplified timing requirements for intake gesture labels, and (iii) improved detection performance compared to existing approaches. Across two separate datasets, we achieve relative F1 score improvements between 1.9% and 6.2% over the two-stage approach for intake detection and eating/drinking detection tasks, for both video and inertial sensors.

authors

Rouast PV,Adam M

doi

10.1109/JBHI.2020.3046613

subject

Has Abstract

pub_date

2020-12-23 00:00:00

eissn

2168-2194

issn

2168-2208

journal_volume

PP

pub_type

杂志文章
  • Vein visualization using a smart phone with multispectral Wiener estimation for point-of-care applications.

    abstract::Effective vein visualization is clinically important for various point-of-care applications, such as needle insertion. It can be achieved by utilizing ultrasound imaging or by applying infrared laser excitation and monitoring its absorption. However, while these approaches can be used for vein visualization, they are ...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2313145

    authors: Song JH,Kim C,Yoo Y

    更新日期:2015-03-01 00:00:00

  • ELEMENT: Multi-Modal Retinal Vessel Segmentation Based on a Coupled Region Growing and Machine Learning Approach.

    abstract::Vascular structures in the retina contain important information for the detection and analysis of ocular diseases, including age-related macular degeneration, diabetic retinopathy and glaucoma. Commonly used modalities in diagnosis of these diseases are fundus photography, scanning laser ophthalmoscope (SLO) and fluor...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.2999257

    authors: Rodrigues EO,Conci A,Liatsis P

    更新日期:2020-12-01 00:00:00

  • Modeling Consistent Dynamics of Cardiogenic Vibrations in Low-Dimensional Subspace.

    abstract::The seismocardiogram (SCG) measures the movement of the chest wall in response to underlying cardiovascular events. Though this signal contains clinically-relevant information, its morphology is both patient-specific and highly transient. In light of recent work suggesting the existence of population-level patterns in...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.2980979

    authors: Zia J,Kimball J,Hersek S,Inan OT

    更新日期:2020-07-01 00:00:00

  • A Multidimensional Time-Series Similarity Measure With Applications to Eldercare Monitoring.

    abstract::In the last decade, data mining techniques have been applied to sensor data in a wide range of application domains, such as healthcare monitoring systems, manufacturing processes, intrusion detection, database management, and others. Many data mining techniques are based on computing the similarity between two sensor ...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2015.2424711

    authors: Hajihashemi Z,Popescu M

    更新日期:2016-05-01 00:00:00

  • A Resampling Based Grid Search Method to Improve Reliability and Robustness of Mixture-Item Response Theory Models of Multimorbid High-Risk Patients.

    abstract::There are many statistics available to the applied statistician for assessing model fit and even more methods for assessing internal and external validity. We detail a useful approach using a grid search technique that balances the internal model consistency with generalizability and can be used with models that natur...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2019.2948734

    authors: Batten AJ,Thorpe J,Piegari RI,Rosland AM

    更新日期:2020-06-01 00:00:00

  • A method of detecting heartbeat locations in the ballistocardiographic signal from the fiber-optic vital signs sensor.

    abstract::We present a flexible, easy-to-expand digital signal processing method for detecting heart rate (HR) for cardiac vibration signals of fiber Bragg grating (FBG) sensor. The FBG-based method of measuring HR is possible to use during the magnetic resonance imaging procedure, which is its unique advantage. Our goal was to...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2015.2392796

    authors: Krej M,Dziuda L,Skibniewski FW

    更新日期:2015-07-01 00:00:00

  • Statistical Metamodeling and Sequential Design of Computer Experiments to Model Glyco-Altered Gating of Sodium Channels in Cardiac Myocytes.

    abstract::Glycan structures account for up to 35% of the mass of cardiac sodium ( Nav ) channels. To question whether and how reduced sialylation affects Nav activity and cardiac electrical signaling, we conducted a series of in vitro experiments on ventricular apex myocytes under two different glycosylation conditions, reduced...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2015.2458791

    authors: Du D,Yang H,Ednie AR,Bennett ES

    更新日期:2016-09-01 00:00:00

  • Detecting Suspected Pump Thrombosis in Left Ventricular Assist Devices via Acoustic Analysis.

    abstract:OBJECTIVE:Left ventricular assist devices (LVADs) fail in up to 10% of patients due to the development of pump thrombosis. Remote monitoring of patients with LVADs can enable early detection and, subsequently, treatment and prevention of pump thrombosis. We assessed whether acoustical signals measured on the chest of p...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.2966178

    authors: Semiz B,Hersek S,Pouyan MB,Partida C,Blazquez-Arroyo L,Selby V,Wieselthaler G,Rehg JM,Klein L,Inan OT

    更新日期:2020-07-01 00:00:00

  • Enhancing Predictive Accuracy of Cardiac Autonomic Neuropathy Using Blood Biochemistry Features and Iterative Multitier Ensembles.

    abstract::Blood biochemistry attributes form an important class of tests, routinely collected several times per year for many patients with diabetes. The objective of this study is to investigate the role of blood biochemistry for improving the predictive accuracy of the diagnosis of cardiac autonomic neuropathy (CAN) progressi...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2363177

    authors: Abawajy J,Kelarev A,Chowdhury MU,Jelinek HF

    更新日期:2016-01-01 00:00:00

  • A Deep Convolutional Neural Network-Based Framework for Automatic Fetal Facial Standard Plane Recognition.

    abstract::Ultrasound imaging has become a prevalent examination method in prenatal diagnosis. Accurate acquisition of fetal facial standard plane (FFSP) is the most important precondition for subsequent diagnosis and measurement. In the past few years, considerable effort has been devoted to FFSP recognition using various hand-...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2017.2705031

    authors: Yu Z,Tan EL,Ni D,Qin J,Chen S,Li S,Lei B,Wang T

    更新日期:2018-05-01 00:00:00

  • Transfer Learning for Multicenter Classification of Chronic Obstructive Pulmonary Disease.

    abstract::Chronic obstructive pulmonary disease (COPD) is a lung disease that can be quantified using chest computed tomography scans. Recent studies have shown that COPD can be automatically diagnosed using weakly supervised learning of intensity and texture distributions. However, up till now such classifiers have only been e...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2017.2769800

    authors: Cheplygina V,Pena IP,Pedersen JH,Lynch DA,Sorensen L,de Bruijne M

    更新日期:2018-09-01 00:00:00

  • Delta Features From Ambient Sensor Data are Good Predictors of Change in Functional Health.

    abstract::Sensor systems can be deployed in the homes of older adults living alone for functional health assessments. Their information is very useful for health care specialists. The problem lies in developing person independent models while facing a large variability in behavior. We address this problem by, first, proposing a...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2016.2593980

    authors: Robben S,Englebienne G,Krose B

    更新日期:2017-07-01 00:00:00

  • Accurate Joint-Alignment of Indocyanine Green and Fluorescein Angiograph Sequences for Treatment of Subretinal Lesions.

    abstract::In ophthalmology, aligning images in indocyanine green and fluorescein angiograph sequences is important for the treatment of subretinal lesions. This paper introduces an algorithm that is tailored to align jointly in a common reference space all the images in an angiogram sequence containing both modalities. To overc...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2016.2538265

    authors: Chia-Ling Tsai,Hung-Chuan Hsu,Xin-Chang Wu,Shih-Jen Chen,Wei-Yang Lin

    更新日期:2017-05-01 00:00:00

  • Objective study of sensor relevance for automatic cough detection.

    abstract::The development of a system for the automatic, objective, and reliable detection of cough events is a need underlined by the medical literature for years. The benefit of such a tool is clear as it would allow the assessment of pathology severity in chronic cough diseases. Even though some approaches have recently repo...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/jbhi.2013.2239303

    authors: Drugman T,Urbain J,Bauwens N,Chessini R,Valderrama C,Lebecque P,Dutoit T

    更新日期:2013-05-01 00:00:00

  • Unified Fine-Grained Access Control for Personal Health Records in Cloud Computing.

    abstract::Attribute-based encryption has been a promising encryption technology to secure personal health records (PHRs) sharing in cloud computing. PHRs consist of the patient data often collected from various sources including hospitals and general practice centres. Different patients' access policies have a common access sub...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2018.2850304

    authors: Li W,Liu BM,Liu D,Liu RP,Wang P,Luo S,Ni W

    更新日期:2019-05-01 00:00:00

  • The Removal of EOG Artifacts From EEG Signals Using Independent Component Analysis and Multivariate Empirical Mode Decomposition.

    abstract::The recorded electroencephalography (EEG) signals are usually contaminated by electrooculography (EOG) artifacts. In this paper, by using independent component analysis (ICA) and multivariate empirical mode decomposition (MEMD), the ICA-based MEMD method was proposed to remove EOG artifacts (EOAs) from multichannel EE...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2015.2450196

    authors: Wang G,Teng C,Li K,Zhang Z,Yan X

    更新日期:2016-09-01 00:00:00

  • Automatic Analysis of Food Intake and Meal Microstructure Based on Continuous Weight Measurements.

    abstract::The structure of the cumulative food intake (CFI) curve has been associated with obesity and eating disorders. Scales that record the weight loss of a plate from which a subject eats food are used for capturing this curve; however, their measurements are contaminated by additive noise and are distorted by certain type...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2018.2812243

    authors: Papapanagiotou V,Diou C,Ioakimidis I,Sodersten P,Delopoulos A

    更新日期:2019-03-01 00:00:00

  • Network-based modeling and intelligent data mining of social media for improving care.

    abstract::Intelligently extracting knowledge from social media has recently attracted great interest from the Biomedical and Health Informatics community to simultaneously improve healthcare outcomes and reduce costs using consumer-generated opinion. We propose a two-step analysis framework that focuses on positive and negative...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2336251

    authors: Akay A,Dragomir A,Erlandsson BE

    更新日期:2015-01-01 00:00:00

  • A survey on ambient-assisted living tools for older adults.

    abstract::In recent years, we have witnessed a rapid surge in assisted living technologies due to a rapidly aging society. The aging population, the increasing cost of formal health care, the caregiver burden, and the importance that the individuals place on living independently, all motivate development of innovative-assisted ...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/jbhi.2012.2234129

    authors: Rashidi P,Mihailidis A

    更新日期:2013-05-01 00:00:00

  • Unsupervised eye blink artifact denoising of EEG data with modified multiscale sample entropy, Kurtosis, and wavelet-ICA.

    abstract::Brain activities commonly recorded using the electroencephalogram (EEG) are contaminated with ocular artifacts. These activities can be suppressed using a robust independent component analysis (ICA) tool, but its efficiency relies on manual intervention to accurately identify the independent artifactual components. In...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2333010

    authors: Mahajan R,Morshed BI

    更新日期:2015-01-01 00:00:00

  • Classification and Quantification of Emphysema Using a Multi-Scale Residual Network.

    abstract::Automated tissue classification is an essential step for quantitative analysis and treatment of emphysema. Although many studies have been conducted in this area, there still remain two major challenges. First, different emphysematous tissue appears in different scales, which we call "inter-class variations." Second, ...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2018.2890045

    authors: Peng L,Lin L,Hu H,Li H,Chen Q,Ling X,Wang D,Han X,Iwamoto Y,Chen YW

    更新日期:2019-11-01 00:00:00

  • Near-realistic mobile exergames with wireless wearable sensors.

    abstract::Exergaming is expanding as an option for sedentary behavior in childhood/adult obesity and for extra exercise for gamers. This paper presents the development process for a mobile active sports exergame with near-realistic motions through the usage of body-wearable sensors. The process begins by collecting a dataset sp...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2013.2293674

    authors: Mortazavi B,Nyamathi S,Lee SI,Wilkerson T,Ghasemzadeh H,Sarrafzadeh M

    更新日期:2014-03-01 00:00:00

  • Automatic annotation of seismocardiogram with high-frequency precordial accelerations.

    abstract::Seismocardiogram (SCG) is the low-frequency vibrations signal recorded from the chest using accelerometers. Peaks on dorsoventral and sternal SCG correspond to specific cardiac events. Prior research work has shown the potential of extracting such peaks for various types of monitoring and diagnosis applications. Howev...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2014.2360156

    authors: Khosrow-khavar F,Tavakolian K,Blaber AP,Zanetti JM,Fazel-Rezai R,Menon C

    更新日期:2015-07-01 00:00:00

  • Cluster-based analysis for personalized stress evaluation using physiological signals.

    abstract::Technology development in wearable sensors and biosignal processing has made it possible to detect human stress from the physiological features. However, the intersubject difference in stress responses presents a major challenge for reliable and accurate stress estimation. This research proposes a novel cluster-based ...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章,随机对照试验

    doi:10.1109/JBHI.2014.2311044

    authors: Xu Q,Nwe TL,Guan C

    更新日期:2015-01-01 00:00:00

  • An Attribute Supervised Probabilistic Dependent Matrix Tri-Factorization Model for the Prediction of Adverse Drug-Drug Interaction.

    abstract::Adverse drug-drug interaction (ADDI) becomes a significant threat to public health. Despite the detection of ADDIs is experimentally implemented in the early development phase of drug design, many potential ADDIs are still clinically explored by accidents, leading to a large number of morbidity and mortality. Several ...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.3048059

    authors: Zhu J,Liu Y,Zhang Y,Li D

    更新日期:2020-12-29 00:00:00

  • RACE-Net: A Recurrent Neural Network for Biomedical Image Segmentation.

    abstract::The level set based deformable models (LDM) are commonly used for medical image segmentation. However, they rely on a handcrafted curve evolution velocity that needs to be adapted for each segmentation task. The Convolutional Neural Networks (CNN) address this issue by learning robust features in a supervised end-to-e...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2018.2852635

    authors: Chakravarty A,Sivaswamy J

    更新日期:2019-05-01 00:00:00

  • Classification of Opioid Usage Through Semi-Supervised Learning for Total Joint Replacement Patients.

    abstract::Opioid misuse and overdose have become a public health hazard and caused drug addiction and death in the United States due to rapid increase in prescribed and non-prescribed opioid usage. The misuse and overdose are highly related to opioid over-prescription for chronic and acute pain treatment, where a one-size-fits-...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2020.2992973

    authors: Lee S,Wei S,White V,Bain PA,Baker C,Li J

    更新日期:2021-01-01 00:00:00

  • Groupwise Multichannel Image Registration.

    abstract::Multichannel image registration is an important challenge in medical image analysis. Multichannel images result from modalities such as dual-energy CT or multispectral microscopy. Besides, multichannel feature images can be derived from acquired images, for instance, by applying multiscale feature banks to the origina...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2018.2844361

    authors: Guyader JM,Huizinga W,Fortunati V,Poot DHJ,Veenland JF,Paulides MM,Niessen WJ,Klein S

    更新日期:2019-05-01 00:00:00

  • Bi-Frequency Symmetry Difference EIT-Feasibility and Limitations of Application to Stroke Diagnosis.

    abstract:OBJECTIVE:Bi-Frequency Symmetry Difference (BFSD)-EIT can detect, localize and identify unilateral perturbations in symmetric scenes. Here, we test the viability and robustness of BFSD-EIT in stroke diagnosis. METHODS:A realistic 4-layer Finite Element Method (FEM) head model with and without bleed and clot lesions is...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/JBHI.2019.2960862

    authors: McDermott B,O'Halloran M,Avery J,Porter E

    更新日期:2020-08-01 00:00:00

  • A low-complexity ECG feature extraction algorithm for mobile healthcare applications.

    abstract::This paper introduces a low-complexity algorithm for the extraction of the fiducial points from the Electrocardiogram (ECG). The application area we consider is that of remote cardiovascular monitoring, where continuous sensing and processing takes place in low-power, computationally constrained devices, thus the powe...

    journal_title:IEEE journal of biomedical and health informatics

    pub_type: 杂志文章

    doi:10.1109/TITB.2012.2231312

    authors: Mazomenos EB,Biswas D,Acharyya A,Chen T,Maharatna K,Rosengarten J,Morgan J,Curzen N

    更新日期:2013-03-01 00:00:00