Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement.

Abstract:

OBJECTIVE:In the course of performing systematic reviews on the prevalence of low back and neck pain, we required a tool to assess the risk of study bias. Our objectives were to (1) modify an existing checklist and (2) test the final tool for interrater agreement. STUDY DESIGN AND SETTING:The final tool consists of 10 items addressing four domains of bias plus a summary risk of bias assessment. Two researchers tested the interrater agreement of the tool by independently assessing 54 randomly selected studies. Interrater agreement overall and for each individual item was assessed using the proportion of agreement and Kappa statistic. RESULTS:Raters found the tool easy to use, and there was high interrater agreement: overall agreement was 91% and the Kappa statistic was 0.82 (95% confidence interval: 0.76, 0.86). Agreement was almost perfect for the individual items on the tool and moderate for the summary assessment. CONCLUSION:We have addressed a research gap by modifying and testing a tool to assess risk of study bias. Further research may be useful for assessing the applicability of the tool across different conditions.

journal_name

J Clin Epidemiol

authors

Hoy D,Brooks P,Woolf A,Blyth F,March L,Bain C,Baker P,Smith E,Buchbinder R

doi

10.1016/j.jclinepi.2011.11.014

subject

Has Abstract

pub_date

2012-09-01 00:00:00

pages

934-9

issue

9

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(12)00079-0

journal_volume

65

pub_type

杂志文章
  • International classification of diseases codes showed modest sensitivity for detecting community-acquired pneumonia.

    abstract:OBJECTIVE:To estimate the sensitivity of International Classification of Diseases (ICD-9-CM) coding for detecting hospitalized community-acquired pneumonia and to assess possible determinants for misclassification. STUDY DESIGN AND SETTING:Based on microbiological analysis data, 293 patients with a principal diagnosis...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2006.10.018

    authors: van de Garde EM,Oosterheert JJ,Bonten M,Kaplan RC,Leufkens HG

    更新日期:2007-08-01 00:00:00

  • Medical record validation of maternally reported history of preeclampsia.

    abstract:OBJECTIVE:In this study, we assessed the validity of maternally self-reported history of preeclampsia. STUDY DESIGN AND SETTING:This study was embedded in the Generation R Study, a population-based prospective cohort study. Data were obtained from prenatal questionnaires and one questionnaire obtained 2 months postpar...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.10.010

    authors: Coolman M,de Groot CJ,Jaddoe VW,Hofman A,Raat H,Steegers EA

    更新日期:2010-08-01 00:00:00

  • Epidemiology of adulthood injuries: a quickly changing injury profile in Finland.

    abstract::Although developed societies have undergone many profound changes during recent decades, including urbanization, increased traffic and aging of the populations, epidemiologic information on secular trends in profiles of injuries is limited. We investigated such trends in Finland by selecting from the National Hospital...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00346-2

    authors: Kannus P,Niemi S,Parkkari J,Palvanen M

    更新日期:2001-06-01 00:00:00

  • Bias in estimates of confidence intervals for health outcome report cards.

    abstract::Health researchers commonly use logistic regression when profiling health providers. Data from the patients treated by the providers are used to construct models predicting the expected number of outcomes for providers and the ratio of observed to expected outcomes (O/E ratio) used as a risk-adjusted measure of provid...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00048-9

    authors: Faris PD,Ghali WA,Brant R

    更新日期:2003-06-01 00:00:00

  • The effect of exposure variance and exposure measurement error on study sample size: implications for the design of epidemiologic studies.

    abstract::A small variability of exposure in a population, for example small variance in nutrient intake, limits the power of an epidemiologic study. McKeown-Eyssen and Thomas (J Chron Dis 1985; 38:559-568) have shown that by selecting a population with larger exposure variance vs one with smaller variance, the study sample siz...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/0895-4356(94)90190-2

    authors: White E,Kushi LH,Pepe MS

    更新日期:1994-08-01 00:00:00

  • Super learning to hedge against incorrect inference from arbitrary parametric assumptions in marginal structural modeling.

    abstract:OBJECTIVE:Clinical trials are unlikely to ever be launched for many comparative effectiveness research (CER) questions. Inferences from hypothetical randomized trials may however be emulated with marginal structural modeling (MSM) using observational data, but success in adjusting for time-dependent confounding and sel...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.01.016

    authors: Neugebauer R,Fireman B,Roy JA,Raebel MA,Nichols GA,O'Connor PJ

    更新日期:2013-08-01 00:00:00

  • Proxy respondents reliably assessed the quality of life of elective cardiac surgery patients.

    abstract:BACKGROUND AND OBJECTIVE:The level of agreement between index and proxy respondents on assessment of health status of clinical cohorts is variable. There is limited information regarding agreement between cardiac surgery patients and their proxies, and levels of agreement examined across repeated measures. This study e...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.06.010

    authors: Elliott D,Lazarus R,Leeder SR

    更新日期:2006-02-01 00:00:00

  • Single pivotal trials with few corroborating characteristics were used for FDA approval of cancer therapies.

    abstract:BACKGROUND AND OBJECTIVE:Novel cancer therapies are often approved with evidence from a single pivotal trial alone. There are concerns about the credibility of this evidence. Higher validity may be indicated by five methodological and statistical characteristics of pivotal trial evidence that were described by the U.S....

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.05.033

    authors: Ladanie A,Speich B,Briel M,Sclafani F,Bucher HC,Agarwal A,Ioannidis JPA,Pereira TV,Kasenda B,Hemkens LG

    更新日期:2019-10-01 00:00:00

  • Optimal sampling in derivation studies was associated with improved discrimination in external validation for heart failure prognostic models.

    abstract:OBJECTIVES:The objective of the study was to identify determinants of external validity of prognostic models. STUDY DESIGN AND SETTING:We systematically searched for studies reporting prognostic models of heart failure (HF) and examined their performance for predicting 30-day death in a cohort of consecutive 3,452 acu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2020.01.011

    authors: Iwakami N,Nagai T,Furukawa TA,Tajika A,Onishi A,Nishimura K,Ogata S,Nakai M,Takegami M,Nakano H,Kawasaki Y,Alba AC,Guyatt GH,Shiraishi Y,Kohsaka S,Kohno T,Goda A,Mizuno A,Yoshikawa T,Anzai T,investigators for the

    更新日期:2020-05-01 00:00:00

  • What is a clinically meaningful change on the Functional Assessment of Cancer Therapy-Lung (FACT-L) Questionnaire? Results from Eastern Cooperative Oncology Group (ECOG) Study 5592.

    abstract::To assess the impact of disease and treatment on patients with advanced non-small cell lung cancer (NSCLC), we set out to determine a clinically meaningful change (CMC) on the Lung Cancer Subscale (LCS) and the Trial Outcome Index (TOI) of the Functional Assessment of Cancer Therapy-Lung (FACT-L) questionnaire. We use...

    journal_title:Journal of clinical epidemiology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1016/s0895-4356(01)00477-2

    authors: Cella D,Eton DT,Fairclough DL,Bonomi P,Heyes AE,Silberman C,Wolf MK,Johnson DH

    更新日期:2002-03-01 00:00:00

  • The measurement of health: a comparison of indices of disease severity.

    abstract::This study compared the utility of different health indicators in frail older people, as a component of a larger study of medical evaluations of 183 adult day care participants in five Maryland centers. Indices examined included: number of disease categories, number of active categories, number of severe categories, n...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(01)00389-4

    authors: Cohen-Mansfield J,Pawlson G,Lipson S,Volpato S

    更新日期:2001-11-01 00:00:00

  • A reliable and valid index was developed to measure appropriate psychotropic drug use in dementia.

    abstract:OBJECTIVES:The aim of this study was to develop an index derived from the Medication Appropriateness Index (MAI) items that is suited for clinical studies evaluating appropriateness of psychotropic drug use (PDU) for neuropsychiatric symptoms (NPS) in patients with dementia in nursing homes and to test its reliability ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.03.012

    authors: van der Spek K,Gerritsen DL,Smalbrugge M,Nelissen-Vrancken MH,Wetzels RB,Smeets CH,Zuidema SU,Koopmans RT

    更新日期:2015-08-01 00:00:00

  • Simulated computerized adaptive test for patients with shoulder impairments was efficient and produced valid measures of function.

    abstract:BACKGROUND AND OBJECTIVE:To test unidimensionality and local independence of a set of shoulder functional status (SFS) items, develop a computerized adaptive test (CAT) of the items using a rating scale item response theory model (RSM), and compare discriminant validity of measures generated using all items (theta(IRT)...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.08.006

    authors: Hart DL,Cook KF,Mioduski JE,Teal CR,Crane PK

    更新日期:2006-03-01 00:00:00

  • Metacarpal bone loss in middle-aged women: "horse racing" in a 9-year population based follow-up study.

    abstract::Differences in the rate of metacarpal bone loss were evaluated in a 9 year population based follow-up study among 799 women initially aged 45-64 years, using initial and follow-up radiographs of the hands. Metacarpal bone loss started around the age of 50 years and was present in more than 95% of the women. The averag...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90162-i

    authors: van Hemert AM,Vandenbroucke JP,Hofman A,Valkenburg HA

    更新日期:1990-01-01 00:00:00

  • A self-report home environment screening tool identified older women at risk of falls.

    abstract:OBJECTIVE:To evaluate a self-report version of the Home Falls and Accidents Screening Tool (HOME FAST-SR). STUDY DESIGN AND SETTING:The HOME FAST-SR was designed using expert review, pretesting and piloting. Agreement of self-reported home hazard ratings and ratings by health professionals was evaluated using the kapp...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2010.02.013

    authors: Hassani Mehraban A,Mackenzie LA,Byles JE

    更新日期:2011-02-01 00:00:00

  • The number needed to treat (NNT) can be adjusted for bias when the outcome is measured with error.

    abstract:BACKGROUND AND OBJECTIVE:We consider the number needed to treat (NNT) when the event of interest is defined by dichotomizing a continuous response at a threshold level. If the response is measured with error, the resulting NNT is biased. We consider methods to reduce this bias. METHODS:Bias adjustment was studied usin...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.01.021

    authors: Marschner IC,Emberson J,Irwig L,Walter SD

    更新日期:2004-12-01 00:00:00

  • The MVQOLI successfully captured quality of life in African palliative care: a factor analysis.

    abstract:OBJECTIVE:To examine the factor structure of the Missoula Vitas Quality of Life Index (MVQOLI) in palliative care patients in South Africa and Uganda and to assess the tool's appropriateness for measuring quality of life (QOL) in this context. STUDY DESIGN AND SETTING:Cross-sectional survey using the MVQOLI, a 26-item...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2010.12.013

    authors: Selman L,Siegert RJ,Higginson IJ,Agupio G,Dinat N,Downing J,Gwyther L,Mashao T,Mmoledi K,Moll T,Sebuyira LM,Ikin B,Harding R

    更新日期:2011-08-01 00:00:00

  • A simulation study into the performance of "optimal" diagnostic thresholds in the population:"Large" effect sizes are not enough.

    abstract:OBJECTIVES:Many diagnostic studies are aimed at defining "optimal" thresholds. Here, we evaluate the performance of empirically defined optimal thresholds (1) in the sample in which they were defined and (2) in the population from which the sample was drawn. STUDY DESIGN AND SETTING:We simulated test results for 120,0...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.07.018

    authors: Hirschfeld G,do Brasil PE

    更新日期:2014-04-01 00:00:00

  • Sieve analysis: methods for assessing from vaccine trial data how vaccine efficacy varies with genotypic and phenotypic pathogen variation.

    abstract::A key component in the evaluation of efficacy of a vaccine to protect against disease caused by an antigenically diverse infectious pathogen in a preventative vaccine trial is assessing how vaccine-induced protection depends on genotypic and phenotypic variations of the exposing pathogen. This assessment is made by co...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0895-4356(00)00258-4

    authors: Gilbert P,Self S,Rao M,Naficy A,Clemens J

    更新日期:2001-01-01 00:00:00

  • Cross-cultural adaptation of Roland-Morris Disability Questionnaire needs to assess the measurement properties: a systematic review.

    abstract:OBJECTIVE:To assess the cross-cultural adaptations of the Roland-Morris Disability Questionnaire (RMDQ). STUDY DESIGN AND SETTING:English and Chinese databases were searched through December 2017. Cross-cultural adaptation and measurement properties were evaluated using the Guidelines for the Process of Cross-Cultural...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.03.011

    authors: Yao M,Zhu S,Tian ZR,Song YJ,Yang L,Wang YJ,Cui XJ

    更新日期:2018-07-01 00:00:00

  • Measuring health status using the Health Utilities Index: agreement between raters and between modalities of administration.

    abstract::The aim of this study was to evaluate interrater and intermodality agreement in assessing health status using the Health Utilities Index. A random sample from a Dutch cohort of 14-year-old Very Low Birth Weight children and their parents were invited to participate in a face-to-face (n = 150) or telephone (n = 150) in...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00317-6

    authors: Verrips GH,Stuifbergen MC,den Ouden AL,Bonsel GJ,Gemke RJ,Paneth N,Verloove-Vanhorick SP

    更新日期:2001-05-01 00:00:00

  • Quality of life and functional health of primary care patients.

    abstract::Quality of life and functional health were measured cross-sectionally for 314 adult ambulatory primary care patients in a rural clinic and found to be much better for patients with low severity of illness who required no confinement to home because of health problems, than for patients with high severity of illness wh...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90171-i

    authors: Parkerson GR Jr,Broadhead WE,Tse CK

    更新日期:1992-11-01 00:00:00

  • Clinical economics education in the International Clinical Epidemiology Network. INCLEN Economics Faculty.

    abstract::The application of rigorous epidemiologic methods to clinical questions has broadened the scope of research in epidemiology and enhanced the quality of clinical research. The International Clinical Epidemiology Network (INCLEN) has enabled physicians from developing countries to obtain training in epidemiologic method...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90013-9

    authors: Eisenberg JM,Freund D,Glick H,Hall J,Halstead S,Labelle R

    更新日期:1989-01-01 00:00:00

  • Measuring drug exposure: concordance between defined daily dose and days' supply depended on drug class.

    abstract:OBJECTIVES:To determine the concordance between two methods to measure drug exposure duration from pharmacy claim data. STUDY DESIGN AND SETTING:We conducted a cohort study using 2002-2007 US Medicaid data. Initiators of eight drug groups were identified: statins, metformin, atypical antipsychotics, warfarin, proton p...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.05.026

    authors: Sinnott SJ,Polinski JM,Byrne S,Gagne JJ

    更新日期:2016-01-01 00:00:00

  • Quantifying the potential benefit of CA 125 screening for ovarian cancer.

    abstract::We develop a stochastic model of screening for ovarian cancer with serum levels of the CA 125 radioimmunoassay, a tumor-specific marker. The natural history of the disease is constructed using a four stage model characterized by a multivariate distribution for duration in each stage. Preserving its important features,...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90075-k

    authors: Skates SJ,Singer DE

    更新日期:1991-01-01 00:00:00

  • The Italian SF-36 Health Survey: translation, validation and norming.

    abstract::This article reports on the development and validation of the Italian SF-36 Health Survey using data from seven studies in which an Italian version of the SF-36 was administered to more than 7000 subjects between 1991 and 1995. Empirical findings from a wide array of studies and diseases indicate that the performance ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(98)00094-8

    authors: Apolone G,Mosconi P

    更新日期:1998-11-01 00:00:00

  • Interaction between a single exposure and age in cohort-based hazard rate models impacted the statistical distribution of age at onset.

    abstract:OBJECTIVE:Statistical interaction between a single, instantaneous exposure and attained age (age during follow-up; attained age = age at exposure + time since exposure) is used in risk analyses to assess potential effect modification by unmeasured factors correlated with age. However, the impact of such interaction on ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.10.004

    authors: Izumi S,Sakata R,Yamada M,Cologne J

    更新日期:2016-03-01 00:00:00

  • Rasch analysis informed modifications to the Work Instability Scale for Rheumatoid Arthritis for use in work-related upper limb disorders.

    abstract:OBJECTIVE:The Work Instability Scale for Rheumatoid Arthritis (RA-WIS) is a promising prognostic tool for future work disability outcomes. Rasch analysis was conducted to examine the psychometric performance of the RA-WIS in work-related upper limb disorders. STUDY DESIGN AND SETTING:Eligible injured workers (n=396) a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2011.02.002

    authors: Tang K,Beaton DE,Gignac MA,Bombardier C

    更新日期:2011-11-01 00:00:00

  • Misclassification in a questionnaire survey of varicose veins.

    abstract::The objective of this study was to assess the determinants and the effect of misclassification in a questionnaire survey of varicose veins. A random sample of 166 individuals aged 50 years in a larger prevalence study (n = 6874) was examined by a surgeon to validate the self-reporting of varicose veins. Varicose veins...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(95)00012-s

    authors: Laurikka J,Läärä E,Sisto T,Tarkka M,Auvinen O,Hakama M

    更新日期:1995-09-01 00:00:00

  • Mortality, hospital discharges, and case fatality for pulmonary embolism in the Twin Cities: 1980-1995.

    abstract::Pulmonary embolism (PE) causes substantial morbidity and mortality, but little information is available regarding recent secular trends for PE. This study determined trends for PE in adults ages 30 to 84 years in the Minneapolis-St. Paul metropolitan area from 1980 to 1995. The age-adjusted mortality rate for PE decre...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(99)00147-x

    authors: Janke RM,McGovern PG,Folsom AR

    更新日期:2000-01-01 00:00:00