Measurement and control of bias in patient reported outcomes using multidimensional item response theory.

Abstract:

BACKGROUND:Patient-reported outcome (PRO) measures play a key role in the advancement of patient-centered care research. The accuracy of inferences, relevance of predictions, and the true nature of the associations made with PRO data depend on the validity of these measures. Errors inherent to self-report measures can seriously bias the estimation of constructs assessed by the scale. A well-documented disadvantage of self-report measures is their sensitivity to response style (RS) effects such as the respondent's tendency to select the extremes of a rating scale. Although the biasing effect of extreme responding on constructs measured by self-reported tools has been widely acknowledged and studied across disciplines, little attention has been given to the development and systematic application of methodologies to assess and control for this effect in PRO measures. METHODS:We review the methodological approaches that have been proposed to study extreme RS effects (ERS). We applied a multidimensional item response theory model to simultaneously estimate and correct for the impact of ERS on trait estimation in a PRO instrument. Model estimates were used to study the biasing effects of ERS on sum scores for individuals with the same amount of the targeted trait but different levels of ERS. We evaluated the effect of joint estimation of multiple scales and ERS on trait estimates and demonstrated the biasing effects of ERS on these trait estimates when used as explanatory variables. RESULTS:A four-dimensional model accounting for ERS bias provided a better fit to the response data. Increasing levels of ERS showed bias in total scores as a function of trait estimates. The effect of ERS was greater when the pattern of extreme responding was the same across multiple scales modeled jointly. The estimated item category intercepts provided evidence of content independent category selection. Uncorrected trait estimates used as explanatory variables in prediction models showed downward bias. CONCLUSIONS:A comprehensive evaluation of the psychometric quality and soundness of PRO assessment measures should incorporate the study of ERS as a potential nuisance dimension affecting the accuracy and validity of scores and the impact of PRO data in clinical research and decision making.

journal_name

BMC Med Res Methodol

authors

Dowling NM,Bolt DM,Deng S,Li C

doi

10.1186/s12874-016-0161-z

subject

Has Abstract

pub_date

2016-05-26 00:00:00

pages

63

issn

1471-2288

pii

10.1186/s12874-016-0161-z

journal_volume

16

pub_type

杂志文章
  • Estimating required information size by quantifying diversity in random-effects model meta-analyses.

    abstract:BACKGROUND:There is increasing awareness that meta-analyses require a sufficiently large information size to detect or reject an anticipated intervention effect. The required information size in a meta-analysis may be calculated from an anticipated a priori intervention effect or from an intervention effect suggested b...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-86

    authors: Wetterslev J,Thorlund K,Brok J,Gluud C

    更新日期:2009-12-30 00:00:00

  • Item response models for the longitudinal analysis of health-related quality of life in cancer clinical trials.

    abstract:BACKGROUND:The use of health-related quality of life (HRQoL) as an endpoint in cancer clinical trials is growing rapidly. Hence, research into the statistical approaches used to analyze HRQoL data is of major importance, and could lead to a better understanding of the impact of treatments on the everyday life and care ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/s12874-017-0410-9

    authors: Barbieri A,Peyhardi J,Conroy T,Gourgou S,Lavergne C,Mollevi C

    更新日期:2017-09-26 00:00:00

  • Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity.

    abstract:BACKGROUND:Controlled clinical trials of health care interventions are either explanatory or pragmatic. Explanatory trials test whether an intervention is efficacious; that is, whether it can have a beneficial effect in an ideal situation. Pragmatic trials measure effectiveness; they measure the degree of beneficial ef...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-3-28

    authors: Godwin M,Ruhland L,Casson I,MacDonald S,Delva D,Birtwhistle R,Lam M,Seguin R

    更新日期:2003-12-22 00:00:00

  • Lost productivity due to premature mortality in developed and emerging countries: an application to smoking cessation.

    abstract:BACKGROUND:Researchers and policy makers have determined that accounting for productivity costs, or "indirect costs," may be as important as including direct medical expenditures when evaluating the societal value of health interventions. These costs are also important when estimating the global burden of disease. The ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-87

    authors: Menzin J,Marton JP,Menzin JA,Willke RJ,Woodward RM,Federico V

    更新日期:2012-06-25 00:00:00

  • Incorporating nonlinearity into mediation analyses.

    abstract:BACKGROUND:Mediation is an important issue considered in the behavioral, medical, and social sciences. It addresses situations where the effect of a predictor variable X on an outcome variable Y is explained to some extent by an intervening, mediator variable M. Methods for addressing mediation have been available for ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0296-6

    authors: Knafl GJ,Knafl KA,Grey M,Dixon J,Deatrick JA,Gallo AM

    更新日期:2017-03-21 00:00:00

  • The use of relative incidence ratios in self-controlled case series studies: an overview.

    abstract:BACKGROUND:The self-controlled case series (SCCS) is a useful design for investigating associations between outcomes and transient exposures. The SCCS design controls for all fixed covariates, but effect modification can still occur. This can be evaluated by including interaction terms in the model which, when exponent...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0225-0

    authors: Hawken S,Potter BK,Little J,Benchimol EI,Mahmud S,Ducharme R,Wilson K

    更新日期:2016-09-23 00:00:00

  • Integrating and extending cohort studies: lessons from the eXtending Treatments, Education and Networks in Depression (xTEND) study.

    abstract:BACKGROUND:Epidemiologic studies often struggle to adequately represent populations and outcomes of interest. Differences in methodology, data analysis and research questions often mean that reviews and synthesis of the existing literature have significant limitations. The current paper details our experiences in combi...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-122

    authors: Allen J,Inder KJ,Lewin TJ,Attia JR,Kay-Lambkin FJ,Baker AL,Hazell T,Kelly BJ

    更新日期:2013-10-05 00:00:00

  • A review of equity issues in quantitative studies on health inequalities: the case of asthma in adults.

    abstract:BACKGROUND:The term 'inequities' refers to avoidable differences rooted in injustice. This review examined whether or not, and how, quantitative studies identifying inequalities in risk factors and health service utilization for asthma explicitly addressed underlying inequities. Asthma was chosen because recent decades...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-11-104

    authors: Greenwood HL,Edwards N,Hoogbruin A,Kahwa EK,Odhiambo ON,Buong JA

    更新日期:2011-07-12 00:00:00

  • Clinical trial simulation to evaluate power to compare the antiviral effectiveness of two hepatitis C protease inhibitors using nonlinear mixed effect models: a viral kinetic approach.

    abstract:BACKGROUND:Models of hepatitis C virus (HCV) kinetics are increasingly used to estimate and to compare in vivo drug's antiviral effectiveness of new potent anti-HCV agents. Viral kinetic parameters can be estimated using non-linear mixed effect models (NLMEM). Here we aimed to evaluate the performance of this approach ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-60

    authors: Laouénan C,Guedj J,Mentré F

    更新日期:2013-04-25 00:00:00

  • Using a social marketing framework to evaluate recruitment of a prospective study of genetic counseling and testing for the deaf community.

    abstract:BACKGROUND:Recruiting deaf and hard-of-hearing participants, particularly sign language-users, for genetics health service research is challenging due to communication barriers, mistrust toward genetics, and researchers' unfamiliarity with deaf people. Feelings of social exclusion and lack of social cohesion between re...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-145

    authors: Kobayashi Y,Boudreault P,Hill K,Sinsheimer JS,Palmer CG

    更新日期:2013-11-25 00:00:00

  • Generating evidence on a risk-based monitoring approach in the academic setting - lessons learned.

    abstract:BACKGROUND:In spite of efforts to employ risk-based strategies to increase monitoring efficiency in the academic setting, empirical evidence on their effectiveness remains sparse. This mixed-methods study aimed to evaluate the risk-based on-site monitoring approach currently followed at our academic institution. METHO...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0308-6

    authors: von Niederhäusern B,Orleth A,Schädelin S,Rawi N,Velkopolszky M,Becherer C,Benkert P,Satalkar P,Briel M,Pauli-Magnus C

    更新日期:2017-02-14 00:00:00

  • Effectiveness of motivational interviewing, health education and brief advice in a population of smokers who are not ready to quit.

    abstract:BACKGROUND:Motivational Interviewing (MI), Brief Advice (BA) and Health Education (HE) are established smoking cessation induction methods for smokers with low desire to quit. Although randomized controlled trials (RCT's) have been frequently used to assess these interventions the temporal efficacy and effectiveness of...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12874-018-0511-0

    authors: Bani-Yaghoub M,Elhomani A,Catley D

    更新日期:2018-06-13 00:00:00

  • Data enhancement for co-morbidity measurement among patients referred for sleep diagnostic testing: an observational study.

    abstract:BACKGROUND:Observational outcome studies of patients with obstructive sleep apnea (OSA) require adjustment for co-morbidity to produce valid results. The aim of this study was to evaluate whether the combination of administrative data and self-reported data provided a more complete estimate of co-morbidity among patien...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-50

    authors: Ronksley PE,Tsai WH,Quan H,Faris P,Hemmelgarn BR

    更新日期:2009-07-15 00:00:00

  • Factors associated with reporting multiple causes of death.

    abstract:BACKGROUND:There is analytical potential for multiple cause of death data collected from death certificates. This study examines relationships of multiple causes of death as a function of factors available on the death certificate (demographics of decedent, place of death, type of certifier, disposal method, whether an...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-5-4

    authors: Wall MM,Huang J,Oswald J,McCullen D

    更新日期:2005-01-17 00:00:00

  • Resuming the discussion of AMSTAR: What can (should) be made better?

    abstract:BACKGROUND:Evidence syntheses, and in particular systematic reviews (SRs), have become one of the cornerstones of evidence-based health care. The Assessment of Multiple Systematic Reviews (AMSTAR) tool has become the most widely used tool for investigating the methodological quality of SRs and is currently undergoing r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0183-6

    authors: Wegewitz U,Weikert B,Fishta A,Jacobs A,Pieper D

    更新日期:2016-08-26 00:00:00

  • Determinants of non- response to a second assessment of lifestyle factors and body weight in the EPIC-PANACEA study.

    abstract:BACKGROUND:This paper discusses whether baseline demographic, socio-economic, health variables, length of follow-up and method of contacting the participants predict non-response to the invitation for a second assessment of lifestyle factors and body weight in the European multi-center EPIC-PANACEA study. METHODS:Over...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-148

    authors: May AM,Adema LE,Romaguera D,Vergnaud AC,Agudo A,Ekelund U,Steffen A,Orfanos P,Slimani N,Rinaldi S,Mouw T,Rohrmann S,Hermann S,Boeing H,Bergmann MM,Jakobsen MU,Overvad K,Wareham NJ,Gonzalez C,Tjonneland A,Halkjaer

    更新日期:2012-09-24 00:00:00

  • Measuring sidewalk distances using Google Earth.

    abstract:BACKGROUND:Physical activity is an important determinant of health. Walking is the most common physical activity performed by adults and the presence of sidewalks along roads is a determinant of walking. Geographic information systems (GIS) can be used to measure sidewalks; however, GIS sidewalk data are difficult to a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-39

    authors: Janssen I,Rosu A

    更新日期:2012-03-29 00:00:00

  • Obstacles to recruitment in paediatric studies focusing on mental health in a physical health context: the experiences of clinical gatekeepers in an observational cohort study.

    abstract:BACKGROUND:Studies in both paediatric and psychiatric settings often experience problems in recruitment. This can compromise the ability of the study to recruit to target, meaning studies are potentially underpowered. It can also result in a biased sample if a non-representative group are selectively recruited. Recruit...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0730-z

    authors: Loades ME,Smith L,Higson-Sweeney N,Beasant L,Stallard P,Kessler D,Crawley E

    更新日期:2019-04-27 00:00:00

  • Primary outcome reporting in adolescent depression clinical trials needs standardization.

    abstract:BACKGROUND:Evidence-based health care is informed by results of randomized clinical trials (RCTs) and their syntheses in meta-analyses. When the trial outcomes measured are not clearly described in trial publications, knowledge synthesis, translation, and decision-making may be impeded. While heterogeneity in outcomes ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01019-6

    authors: Monsour A,Mew EJ,Patel S,Chee-A-Tow A,Saeed L,Santos L,Courtney DB,Watson PN,Monga S,Szatmari P,Offringa M,Butcher NJ

    更新日期:2020-05-25 00:00:00

  • Recruiting former melanoma patients via hospitals in comparison to office-based dermatologists in a register-based cohort study that required indirect contact.

    abstract:BACKGROUND:There are detailed reviews about different recruitment strategies, but not with regard to differences between recruitment of hospital-based versus office-based physicians. Within this study, the two different recruitment schemes are compared. Advantages and disadvantages of different ways of recruitment in r...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0425-2

    authors: Zeissig SR,Weyer-Elberich V,Emrich K,Binder H,Fischbeck S,Imruck BH,Friedrich-Mai P,Beutel ME,Blettner M

    更新日期:2017-11-22 00:00:00

  • A multi-country comparison of stochastic models of breast cancer mortality with P-splines smoothing approach.

    abstract:BACKGROUND:Precise predictions of incidence and mortality rates due to breast cancer (BC) are required for planning of public health programs as well as for clinical services. A number of approaches has been established for prediction of mortality using stochastic models. The performance of these models intensely depen...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01187-5

    authors: Mubarik S,Hu Y,Yu C

    更新日期:2020-12-09 00:00:00

  • Enhanced reporting of deaths among Aboriginal and Torres Strait Islander peoples using linked administrative health datasets.

    abstract:BACKGROUND:Aboriginal and Torres Strait Islander peoples are under-reported in administrative health datasets in NSW, Australia. Correct reporting of Aboriginal and Torres Strait Islander peoples is essential to measure the effectiveness of policies and programmes aimed at reducing the health disadvantage experienced b...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-91

    authors: Taylor LK,Bentley J,Hunt J,Madden R,McKeown S,Brandt P,Baker D

    更新日期:2012-07-02 00:00:00

  • Bayesian methods in clinical trials: a Bayesian analysis of ECOG trials E1684 and E1690.

    abstract:BACKGROUND:E1684 was the pivotal adjuvant melanoma trial for establishment of high-dose interferon (IFN) as effective therapy of high-risk melanoma patients. E1690 was an intriguing effort to corroborate E1684, and the differences between the outcomes of these trials have embroiled the field in controversy over the pas...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-183

    authors: Ibrahim JG,Chen MH,Chu H

    更新日期:2012-11-29 00:00:00

  • Good agreement between questionnaire and administrative databases for health care use and costs in patients with osteoarthritis.

    abstract:BACKGROUND:Estimating costs is essential to the economic analysis of health care programs. Health care costs are often captured from administrative databases or by patient report. Administrative records only provide a partial representation of health care costs and have additional limitations. Patient-completed questio...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-45

    authors: Pinto D,Robertson MC,Hansen P,Abbott JH

    更新日期:2011-04-13 00:00:00

  • Does it matter whether the recipient of patient questionnaires in general practice is the general practitioner or an independent researcher? The REPLY randomised trial.

    abstract:BACKGROUND:Self-administered questionnaires are becoming increasingly common in general practice. Much research has explored methods to increase response rates but comparatively few studies have explored the effect of questionnaire administration on reported answers. METHODS:The aim of this study was to determine the ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-8-42

    authors: Desborough JA,Butters P,Bhattacharya D,Holland RC,Wright DJ

    更新日期:2008-06-27 00:00:00

  • Dichotomisation using a distributional approach when the outcome is skewed.

    abstract:BACKGROUND:Dichotomisation of continuous outcomes has been rightly criticised by statisticians because of the loss of information incurred. However to communicate a comparison of risks, dichotomised outcomes may be necessary. Peacock et al. developed a distributional approach to the dichotomisation of normally distribu...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0028-8

    authors: Sauzet O,Ofuya M,Peacock JL

    更新日期:2015-04-24 00:00:00

  • An information-motivation-behavioural skills analysis of long-lasting insecticidal net use among pregnant women in a hospital in North-Eastern Nigeria.

    abstract:BACKGROUND:Sleeping under a long-lasting insecticidal net (LLIN) is recommended for all pregnant women in sub-Saharan Africa, due to the high prevalence of malaria infection and its associated complications in the region. Despite this, LLIN use has still remained sub-optimal among pregnant women in Maiduguri, Nigeria. ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0803-z

    authors: Balami AD,Said SM,Zulkefli NAM,Bachok N,Balami EL

    更新日期:2019-07-18 00:00:00

  • Recruitment strategies and yields for the Pathobiology of Prediabetes in a Biracial Cohort: a prospective natural history study of incident dysglycemia.

    abstract:BACKGROUND:The Pathobiology of Prediabetes in A Biracial Cohort study is a prospective evaluation of the transition from normal to impaired glucose regulation among African American and Caucasian adults with parental type 2 diabetes. This report describes recruitment strategies and relative yields for the 376 enrolled ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-64

    authors: Ebenibo S,Edeoga C,Ammons A,Egbuonu N,Dagogo-Jack S,Pathobiology of Prediabetes in a Biracial Cohort (POP-ABC) Research Group.

    更新日期:2013-05-10 00:00:00

  • Prediction intervals for future BMI values of individual children: a non-parametric approach by quantile boosting.

    abstract:BACKGROUND:The construction of prediction intervals (PIs) for future body mass index (BMI) values of individual children based on a recent German birth cohort study with n = 2007 children is problematic for standard parametric approaches, as the BMI distribution in childhood is typically skewed depending on age. METHO...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-6

    authors: Mayr A,Hothorn T,Fenske N

    更新日期:2012-01-25 00:00:00

  • Development of an integrative coding framework for evaluating context within implementation science.

    abstract:BACKGROUND:This research aims to explore an identified gap in implementation science methodology, that is, how to assess context in implementation research. Context is among the strongest influences on implementation success but is a construct that is poorly understood and reported within the literature. Consequently, ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01044-5

    authors: Rogers L,De Brún A,McAuliffe E

    更新日期:2020-06-15 00:00:00