Handling Data Skew in MapReduce Cluster by Using Partition Tuning

Abstract:

:The healthcare industry has generated large amounts of data, and analyzing these has emerged as an important problem in recent years. The MapReduce programming model has been successfully used for big data analytics. However, data skew invariably occurs in big data analytics and seriously affects efficiency. To overcome the data skew problem in MapReduce, we have in the past proposed a data processing algorithm called Partition Tuning-based Skew Handling (PTSH). In comparison with the one-stage partitioning strategy used in the traditional MapReduce model, PTSH uses a two-stage strategy and the partition tuning method to disperse key-value pairs in virtual partitions and recombines each partition in case of data skew. The robustness and efficiency of the proposed algorithm were tested on a wide variety of simulated datasets and real healthcare datasets. The results showed that PTSH algorithm can handle data skew in MapReduce efficiently and improve the performance of MapReduce jobs in comparison with the native Hadoop, Closer, and locality-aware and fairness-aware key partitioning (LEEN). We also found that the time needed for rule extraction can be reduced significantly by adopting the PTSH algorithm, since it is more suitable for association rule mining (ARM) on healthcare data.

journal_name

J Healthc Eng

authors

Gao Y,Zhou Y,Zhou B,Shi L,Zhang J

doi

10.1155/2017/1425102

subject

Has Abstract

pub_date

2017-01-01 00:00:00

eissn

2040-2295

issn

2040-2309

journal_volume

2017

pub_type

杂志文章
  • An Application for Skin Macules Characterization Based on a 3-Stage Image-Processing Algorithm for Patients with Diabetes.

    abstract::Diabetic skin manifestations, previous to ulcers and wounds, are not highly accounted as part of diagnosis even when they represent the first symptom of vascular damage and are present in up to 70% of patients with diabetes mellitus type II. Here, an application for skin macules characterization based on a three-stage...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/9397105

    authors: Toledo Peral CL,Ramos Becerril FJ,Vega Martínez G,Vera Hernández A,Leija Salas L,Gutiérrez Martínez J

    更新日期:2018-12-16 00:00:00

  • Evaluation of Growth and Development of Late Mixed Dentition Upper Dental Arch with Normal Occlusion Using 3-Dimensional Digital Models.

    abstract:Objective:The purpose of this study was to observe the three-dimensional growth and development of the maxillary arch in 10-year-olds with normal occlusion during the late mixed dentition stage. Methods:Forty-four 10-year-old students (22 males and 22 females) who had normal occlusion during late mixed dentition were ...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2019/4191848

    authors: Yang D,Liang S,Zhang K,Gao W,Bai Y

    更新日期:2019-11-14 00:00:00

  • A Numerical Investigation into the Effects of Overweight and Obesity on Total Knee Arthroplasty.

    abstract::Overweight and obesity increase risks of knee osteoarthritis, which is a major cause of disability. Severe knee osteoarthritis can be treated by knee arthroplasty. Total knee arthroplasty has been used in overweight and obese patients; however, clinical reports showed that the outcome of this group of patients was not...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2017/1496379

    authors: Wang C,Guo Y,Shi J,Chen W

    更新日期:2017-01-01 00:00:00

  • Blood Glucose Level Prediction for Diabetics Based on Nutrition and Insulin Administration Logs Using Personalized Mathematical Models.

    abstract::According to recent surveys, the current ways of diabetics trying to estimate their insulin need based on experience and conjecture are sometimes inefficient in practice. This paper proposes a prediction algorithm and presents the validation of the model in outpatient care. The algorithm consists of two state-of-the-a...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2019/8605206

    authors: Gyuk P,Vassányi I,Kósa I

    更新日期:2019-01-10 00:00:00

  • Potential of Electrospun Poly(3-hydroxybutyrate)/Collagen Blends for Tissue Engineering Applications.

    abstract::In this work, tunable nonwoven mats based on poly(3-hydroxybutyrate) (PHB) and type I collagen (Coll) were successfully produced by electrospinning. The PHB/Coll weight ratio (fixed at 100/0, 70/30, and 50/50, resp.) was found to control the morphological, thermal, mechanical, and degradation properties of the mats. I...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/6573947

    authors: Salvatore L,Carofiglio VE,Stufano P,Bonfrate V,Calò E,Scarlino S,Nitti P,Centrone D,Cascione M,Leporatti S,Sannino A,Demitri C,Madaghiele M

    更新日期:2018-04-19 00:00:00

  • Fully Automatic Segmentation and Three-Dimensional Reconstruction of the Liver in CT Images.

    abstract::Automatic segmentation and three-dimensional reconstruction of the liver is important for liver disease diagnosis and surgical treatment. However, the shape of the imaged 2D liver in each CT image changes dramatically across the slices. In all slices, the imaged 2D liver is connected with other organs, and the connect...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/6797102

    authors: Wang Z,Zhang C,Jiao T,Gao M,Zou G

    更新日期:2018-11-18 00:00:00

  • Experimental feasibility study of estimation of the normalized central blood pressure waveform from radial photoplethysmogram.

    abstract::The feasibility of a novel system to reliably estimate the normalized central blood pressure (CBPN) from the radial photoplethysmogram (PPG) is investigated. Right-wrist radial blood pressure and left-wrist PPG were simultaneously recorded in five different days. An industry-standard applanation tonometer was employed...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1260/2040-2295.6.1.121

    authors: Zahedi E,Sohani V,Ali MA,Chellappan K,Beng GK

    更新日期:2015-01-01 00:00:00

  • An Improved Fuzzy Connectedness Method for Automatic Three-Dimensional Liver Vessel Segmentation in CT Images.

    abstract::In this paper, an improved fuzzy connectedness (FC) method was proposed for automatic three-dimensional (3D) liver vessel segmentation in computed tomography (CT) images. The vessel-enhanced image (i.e., vesselness image) was incorporated into the fuzzy affinity function of FC, rather than the intensity image used by ...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/2376317

    authors: Zhang R,Zhou Z,Wu W,Lin CC,Tsui PH,Wu S

    更新日期:2018-10-29 00:00:00

  • Hollow Abutment Screw Design for Easy Retrieval in Case of Screw Fracture in Dental Implant System.

    abstract::The prosthetic component of dental implant is attached on the abutment which is connected to the fixture with an abutment screw. The abutment screw fracture is not frequent; however, the retrieval of the fractured screw is not easy, and it poses complications. A retrieval kit was developed which utilizes screw removal...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2017/4842072

    authors: Sim BK,Kim B,Kim MJ,Jeong GH,Ju KW,Shin YJ,Kim MY,Lee JH

    更新日期:2017-01-01 00:00:00

  • Sensory Electrical Stimulation Cueing May Reduce Freezing of Gait Episodes in Parkinson's Disease.

    abstract:Introduction:Freezing of gait (FoG) is a movement abnormality that presents with advancing Parkinson's disease (PD) and is one of the most debilitating symptoms of the disease. The mainstay of nonpharmacological management of FoG is typically through external cueing techniques designed to relieve or prevent the freezin...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/4684925

    authors: Rosenthal L,Sweeney D,Cunnington AL,Quinlan LR,ÓLaighin G

    更新日期:2018-08-01 00:00:00

  • The Application Method of Nanobubble Conveyor on the Effect of Preventive Oral Hygiene.

    abstract::There are various methods to generate nanobubbles, and in this study, we experimented using a nanobubble generator with a high-density of stainless steel mesh nozzle to deliver nanobubble water (normal water and two kinds of mouthwash) stream through a tooth tray to clean bacteria coated on the denture. It showed that...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2020/8871849

    authors: Lin PJ

    更新日期:2020-10-30 00:00:00

  • A robust electrode configuration for bioimpedance measurement of respiration.

    abstract::Electrode configuration is an important issue in the continuous measurement of respiration using impedance pneumography (IP). The robust configuration is usually confirmed by comparing the amplitude of the IP signals acquired with different electrode configurations, while the relative change in waveform and the effect...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1260/2040-2295.5.3.313

    authors: Wang HB,Yen CW,Liang JT,Wang Q,Liu GZ,Song R

    更新日期:2014-01-01 00:00:00

  • Dynamic Regulation of Level Set Parameters Using 3D Convolutional Neural Network for Liver Tumor Segmentation.

    abstract::Segmentation of liver tumors plays an important role in the choice of therapeutic strategies for liver disease and treatment monitoring. In this paper, we generalize the process of a level set with a novel algorithm of dynamic regulation to energy functional parameters. The presented method is fully automatic once the...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2019/4321645

    authors: Deng Z,Guo Q,Zhu Z

    更新日期:2019-02-24 00:00:00

  • Current Status and Prospects of Health-Related Sensing Technology in Wearable Devices.

    abstract::The healthcare-related functions of wearable devices are very useful for continuous monitoring of biological information. Wearable devices equipped with communication function can be used for additional healthcare services. Among the wearable devices, the wristband type is most suitable for acquiring biological signal...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章,评审

    doi:10.1155/2019/3924508

    authors: Cho J

    更新日期:2019-06-16 00:00:00

  • A Novel Method to Quantify Longitudinal Orthodontic Bone Changes with In Vivo Micro-CT Data.

    abstract::Orthodontic tooth movement (OTM) is the result of region-specific bone modeling under a load. Quantification of this change in the alveolar bone around a tooth is a basic requirement to understand the mechanism of orthodontics. The purpose of this study was to quantify subregional alveolar bone changes during orthodon...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/1651097

    authors: Wang C,Cao L,Yang C,Fan Y

    更新日期:2018-10-01 00:00:00

  • An Automatic Bleeding Frame and Region Detection Scheme for Wireless Capsule Endoscopy Videos Based on Interplane Intensity Variation Profile in Normalized RGB Color Space.

    abstract::Wireless capsule endoscopy (WCE) is an effective video technology to diagnose gastrointestinal (GI) disease, such as bleeding. In order to avoid conventional tedious and risky manual review process of long duration WCE videos, automatic bleeding detection schemes are getting importance. In this paper, to investigate b...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/9423062

    authors: Kundu AK,Fattah SA,Rizve MN

    更新日期:2018-02-25 00:00:00

  • Dynamic Changes in Heart Rate Variability and Nasal Airflow Resistance during Nasal Allergen Provocation Test.

    abstract::Allergic rhinitis is a major chronic respiratory disease and an immunoneuronal disorder. We aimed at providing further knowledge on the function of the neural system in nasal allergic reaction. Here, a method to assess simultaneously the nasal airflow resistance and the underlying function of autonomic nervous system ...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2016/1245418

    authors: Seppänen TM,Alho OP,Seppänen T

    更新日期:2016-01-01 00:00:00

  • Detection of Heart Rate through a Wall Using UWB Impulse Radar.

    abstract::Measuring the physiological functions of the human body in a noncontact manner through walls is useful for healthcare, security, and surveillance. And radar technology can be used for this purpose. In this paper, a new method for detecting the human heartbeat using ultra wideband (UWB) impulse radar, which has advanta...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/4832605

    authors: Cho HS,Park YJ

    更新日期:2018-04-01 00:00:00

  • Model of Murine Ventricular Cardiac Tissue for In Vitro Kinematic-Dynamic Studies of Electromagnetic and β-Adrenergic Stimulation.

    abstract::In a model of murine ventricular cardiac tissue in vitro, we have studied the inotropic effects of electromagnetic stimulation (frequency, 75 Hz), isoproterenol administration (10 μM), and their combination. In particular, we have performed an image processing analysis to evaluate the kinematics and the dynamics of be...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2017/4204085

    authors: Fassina L,Cornacchione M,Pellegrini M,Mognaschi ME,Gimmelli R,Isidori AM,Lenzi A,Magenes G,Naro F

    更新日期:2017-01-01 00:00:00

  • An Interpretable Classification Framework for Information Extraction from Online Healthcare Forums.

    abstract::Online healthcare forums (OHFs) have become increasingly popular for patients to share their health-related experiences. The healthcare-related texts posted in OHFs could help doctors and patients better understand specific diseases and the situations of other patients. To extract the meaning of a post, a commonly use...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2017/2460174

    authors: Gao J,Liu N,Lawley M,Hu X

    更新日期:2017-01-01 00:00:00

  • The Effect of Augmented Reality and Virtual Reality on Inducing Anxiety for Exposure Therapy: A Comparison Using Heart Rate Variability.

    abstract::Claustrophobia is an anxiety disorder characterized by the fear of enclosed spaces. Although medication treatment can effectively control symptoms, the effects quickly disappear once medication is discontinued. Many studies have shown that combining psychotherapy and medication is more efficacious than solely using me...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/6357351

    authors: Tsai CF,Yeh SC,Huang Y,Wu Z,Cui J,Zheng L

    更新日期:2018-11-25 00:00:00

  • A Comparison of Three-Dimensional Speckle Tracking Echocardiography Parameters in Predicting Left Ventricular Remodeling.

    abstract::Three-dimensional speckle tracking echocardiography (3D STE) is an emerging noninvasive method for predicting left ventricular remodeling (LVR) after acute myocardial infarction (AMI). Previous studies analyzed the predictive value of 3D STE with traditional models. However, no models that contain comprehensive risk f...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2020/8847144

    authors: Zhong J,Liu P,Li S,Huang X,Zhang Q,Huang J,Guo Y,Chen M,Ruan Z,Qin C,Xu L

    更新日期:2020-07-30 00:00:00

  • Performance Analysis of Ten Common QRS Detectors on Different ECG Application Cases.

    abstract::A systematical evaluation work was performed on ten widely used and high-efficient QRS detection algorithms in this study, aiming at verifying their performances and usefulness in different application situations. Four experiments were carried on six internationally recognized databases. Firstly, in the test of high-q...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/9050812

    authors: Liu F,Liu C,Jiang X,Zhang Z,Zhang Y,Li J,Wei S

    更新日期:2018-05-08 00:00:00

  • Multichannel Surface EMG Decomposition Based on Measurement Correlation and LMMSE.

    abstract::A method based on measurement correlation (MC) and linear minimum mean square error (LMMSE) for multichannel surface electromyography (sEMG) signal decomposition was developed in this study. This MC-LMMSE method gradually and iteratively increases the correlation between an optimized vector and a reconstructed matrix ...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/2347589

    authors: Ning Y,Zhao Y,Juraboev A,Tan P,Ding J,He J

    更新日期:2018-06-28 00:00:00

  • Fall Prevention Shoes Using Camera-Based Line-Laser Obstacle Detection System.

    abstract::Fall prevention is an important issue particularly for the elderly. This paper proposes a camera-based line-laser obstacle detection system to prevent falls in the indoor environment. When obstacles are detected, the system will emit alarm messages to catch the attention of the user. Because the elderly spend a lot of...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2017/8264071

    authors: Lin TH,Yang CY,Shih WP

    更新日期:2017-01-01 00:00:00

  • Modelling pH-Optimized Degradation of Microgel-Functionalized Polyesters.

    abstract::We establish a novel mathematical model to describe and analyze pH levels in the vicinity of poly(N-vinylcaprolactam-co-acetoacetoxyethyl methacrylate-co-N-vinylimidazole) (VCL/AAEM/VIm) microgel-functionalized polymers during biodegradation. Biodegradable polymers, especially aliphatic polyesters (polylactide/polygly...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2016/8125416

    authors: Bürgermeister L,Hermann M,Fehér K,Molano Lopez C,Pich A,Hannen J,Vogt F,Schulz W

    更新日期:2016-01-01 00:00:00

  • Evaluation of postprandial glucose excursion using a novel minimally invasive glucose area-under-the-curve monitoring system.

    abstract:OBJECTIVE:To develop a minimally invasive interstitial fluid extraction technology (MIET) to monitor postprandial glucose area under the curve (AUC) without blood sampling, we evaluated the accuracy of glucose AUC measured by MIET and compared with that by blood sampling after food intake. METHODS:Interstitial fluid g...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1260/2040-2295.4.4.529

    authors: Kuranuki S,Sato T,Okada S,Hosoya S,Seko A,Sugihara K,Nakamura T

    更新日期:2013-01-01 00:00:00

  • A New Intelligent Medical Decision Support System Based on Enhanced Hierarchical Clustering and Random Decision Forest for the Classification of Alcoholic Liver Damage, Primary Hepatoma, Liver Cirrhosis, and Cholelithiasis.

    abstract::Diagnosis of liver disease principally depends on physician's subjective knowledge. Automatic prediction of the disease is a critical real-world medical problem. This work presents an EHC-ERF-based intelligence-integrated model purposive to predict different types of liver disease including alcoholic liver damage, pri...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2018/1469043

    authors: Singh A,Pandey B

    更新日期:2018-02-01 00:00:00

  • Integrated Multicriteria Decision-Making Methods to Solve Supplier Selection Problem: A Case Study in a Hospital.

    abstract::In supply chain literature, supplier evaluation and selection problem is one of the most studied subjects because of the significant roles of suppliers in terms of the chain's sustainability and profitability. Therefore, it is important for organizations to adopt a systematic way to evaluate and select the best suppli...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2019/5614892

    authors: Akcan S,Güldeş M

    更新日期:2019-10-10 00:00:00

  • Frame-Based CT Image Reconstruction via the Balanced Approach.

    abstract::Frame-based regularization method as one kind of sparsity representation method has been developed in recent years and has been proved to be an efficient method for CT image reconstruction. However, most of the developed CT image reconstruction methods are analysis-based frame methods. This paper proposes a novel fram...

    journal_title:Journal of healthcare engineering

    pub_type: 杂志文章

    doi:10.1155/2017/1417270

    authors: Zhou W,Xiang H

    更新日期:2017-01-01 00:00:00