Association Between Risk-of-Bias Assessments and Results of Randomized Trials in Cochrane Reviews: The ROBES Meta-Epidemiologic Study.

Abstract:

:Flaws in the design of randomized trials may bias intervention effect estimates and increase between-trial heterogeneity. Empirical evidence suggests that these problems are greatest for subjectively assessed outcomes. For the Risk of Bias in Evidence Synthesis (ROBES) Study, we extracted risk-of-bias judgements (for sequence generation, allocation concealment, blinding, and incomplete data) from a large collection of meta-analyses published in the Cochrane Library (issue 4; April 2011). We categorized outcome measures as mortality, other objective outcome, or subjective outcome, and we estimated associations of bias judgements with intervention effect estimates using Bayesian hierarchical models. Among 2,443 randomized trials in 228 meta-analyses, intervention effect estimates were, on average, exaggerated in trials with high or unclear (versus low) risk-of-bias judgements for sequence generation (ratio of odds ratios (ROR) = 0.91, 95% credible interval (CrI): 0.86, 0.98), allocation concealment (ROR = 0.92, 95% CrI: 0.86, 0.98), and blinding (ROR = 0.87, 95% CrI: 0.80, 0.93). In contrast to previous work, we did not observe consistently different bias for subjective outcomes compared with mortality. However, we found an increase in between-trial heterogeneity associated with lack of blinding in meta-analyses with subjective outcomes. Inconsistency in criteria for risk-of-bias judgements applied by individual reviewers is a likely limitation of routinely collected bias assessments. Inadequate randomization and lack of blinding may lead to exaggeration of intervention effect estimates in randomized trials.

journal_name

Am J Epidemiol

authors

Savovic J,Turner RM,Mawdsley D,Jones HE,Beynon R,Higgins JPT,Sterne JAC

doi

10.1093/aje/kwx344

subject

Has Abstract

pub_date

2018-05-01 00:00:00

pages

1113-1122

issue

5

eissn

0002-9262

issn

1476-6256

pii

4604571

journal_volume

187

pub_type

杂志文章
  • Hormone Therapy Use and Risk of Chronic Disease in the Nurses' Health Study: A Comparative Analysis With the Women's Health Initiative.

    abstract::Observational studies and randomized controlled trials of menopausal hormone therapy (HT) and chronic disease risk appear to have divergent results for cardiovascular disease. However, differences may be related to a modifying effect of age, time since menopause, and HT formulation. In the Nurses' Health Study (NHS) (...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwx131

    authors: Bhupathiraju SN,Grodstein F,Rosner BA,Stampfer MJ,Hu FB,Willett WC,Manson JE

    更新日期:2017-09-15 00:00:00

  • Alcohol consumption and all-cause and cancer mortality among middle-aged Japanese men: seven-year follow-up of the JPHC study Cohort I. Japan Public Health Center.

    abstract::To examine the association between alcohol consumption and mortality in Japan, where mortality and lifestyle differ substantially from Western countries, a population-based prospective study was conducted in four public health center areas as part of the Japan Public Health Center-based prospective study on cancer and...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a009946

    authors: Tsugane S,Fahey MT,Sasaki S,Baba S

    更新日期:1999-12-01 00:00:00

  • Pesticides and lung cancer risk in the agricultural health study cohort.

    abstract::The authors examined the relation between 50 widely used agricultural pesticides and lung cancer incidence in the Agricultural Health Study, a prospective cohort study of 57,284 pesticide applicators and 32,333 spouses of farmer applicators with no prior history of lung cancer. Self-administered questionnaires were co...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwh290

    authors: Alavanja MC,Dosemeci M,Samanic C,Lubin J,Lynch CF,Knott C,Barker J,Hoppin JA,Sandler DP,Coble J,Thomas K,Blair A

    更新日期:2004-11-01 00:00:00

  • Pesticide exposure and depression among agricultural workers in France.

    abstract::Pesticides are ubiquitous neurotoxicants, and several lines of evidence suggest that exposure may be associated with depression. Epidemiologic evidence has focused largely on organophosphate exposures, while research on other pesticides is limited. We collected detailed pesticide use history from farmers recruited in ...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwt089

    authors: Weisskopf MG,Moisan F,Tzourio C,Rathouz PJ,Elbaz A

    更新日期:2013-10-01 00:00:00

  • Epidemiologic interactions, complexity, and the lonesome death of Max von Pettenkofer.

    abstract::In the mid-19th century, the German hygienist Max von Pettenkofer viewed cholera as resulting from the interaction between a postulated cholera germ and the characteristics of soils. In order to cause cholera, the cholera germ had to become a cholera miasma, but this transformation required prolonged contact of the ge...

    journal_title:American journal of epidemiology

    pub_type: 传,历史文章,杂志文章

    doi:10.1093/aje/kwm279

    authors: Morabia A

    更新日期:2007-12-01 00:00:00

  • Socioeconomic status in relation to selected birth defects in a large multicentered US case-control study.

    abstract::This study examined individual and household socioeconomic status (SES) in relation to phenotypes of neural tube defects, orafacial clefts, and conotruncal heart defects using data from the National Birth Defects Prevention Study with 2,551 nonmalformed liveborn controls and 1,841 cases delivered in 1997-2000. The ind...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1093/aje/kwm283

    authors: Yang J,Carmichael SL,Canfield M,Song J,Shaw GM,National Birth Defects Prevention Study.

    更新日期:2008-01-15 00:00:00

  • Poisson regression modeling of temporal variation in incidence of childhood insulin-dependent diabetes mellitus in Allegheny County, Pennsylvania, and Wielkopolska, Poland, 1970-1985.

    abstract::Contradictory observations have accumulated regarding a secular trend and/or an epidemic pattern in the incidence of insulin-dependent diabetes mellitus. In this study, insulin-dependent diabetes mellitus incidence below age 15 years was examined in Allegheny County, Pennsylvania, and in Wielkopolska, Poland, two area...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a115169

    authors: Rewers M,Stone RA,LaPorte RE,Drash AL,Becker DJ,Walczak M,Kuller LH

    更新日期:1989-03-01 00:00:00

  • Temporal Trends in Hospitalization for Acute Decompensated Heart Failure in the United States, 1998-2011.

    abstract::Estimates of the numbers and rates of acute decompensated heart failure (ADHF) hospitalization are central to understanding health-care utilization and efforts to improve patient care. We comprehensively estimated the frequency, rate, and trends of ADHF hospitalization in the United States. Based on Atherosclerosis Ri...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwv455

    authors: Agarwal SK,Wruck L,Quibrera M,Matsushita K,Loehr LR,Chang PP,Rosamond WD,Wright J,Heiss G,Coresh J

    更新日期:2016-03-01 00:00:00

  • Sample size requirements for association studies of gene-gene interaction.

    abstract::In the study of complex diseases, it may be important to test hypotheses related to gene-gene (G x G) interaction. The success of such studies depends critically on obtaining adequate sample sizes. In this paper, the author investigates sample size requirements for studies of G x G interaction, focusing on four study ...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/155.5.478

    authors: Gauderman WJ

    更新日期:2002-03-01 00:00:00

  • Estimating exposure-specific disease rates from case-control studies using Bayes' theorem.

    abstract::The methods used for selecting subjects yield three types of case-control studies: 1) incident cases are compared to non-cases chosen to be representative of the exposure distribution among the person-years which produced the cases. In this type of study the exposure-odds ratio equals the incidence density ratio; 2) i...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a112614

    authors: Neutra RR,Drolette ME

    更新日期:1978-09-01 00:00:00

  • A case-control study of leukemia at a naval nuclear shipyard.

    abstract::A matched case-control study was conducted of 53 leukemia deaths and of 212 controls within a previously studied cohort of 24,545 on-shore workers employed between January 1, 1952 and August 15, 1977 at the Portsmouth (New Hampshire) Naval Shipyard. The study sought to ascertain a priori whether there was an associati...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a114350

    authors: Stern FB,Waxweiler RA,Beaumont JJ,Lee ST,Rinsky RA,Zumwalde RD,Halperin WE,Bierbaum PJ,Landrigan PJ,Murray WE Jr

    更新日期:1986-06-01 00:00:00

  • Sex differences in the association between alcohol consumption and cognitive performance. EVA Study Group. Epidemiology of Vascular Aging.

    abstract::Heavy alcohol drinking is associated with cognitive impairment, but little is known concerning the cognitive effect of moderate alcohol consumption. The Epidemiology of Vascular Aging (EVA) Study is a longitudinal study of cognitive and vascular aging. Between June 1991 and June 1993, 1,389 subjects aged 59-71 years (...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a009293

    authors: Dufouil C,Ducimetière P,Alpérovitch A

    更新日期:1997-09-01 00:00:00

  • Epidemiologic study of Vibrio cholerae O1 and O139 in Thailand: at the advancing edge of the eighth pandemic.

    abstract::Vibrio cholerae O139 Bengal emerged on the Indian subcontinent in late 1992 and was first recognized in Thailand in 1993. To characterize the epidemiology of this disease, a hospital-based case-control study was conducted in Samutsakorn, a port city 30 km southwest of Bangkok. Between November 15, 1993, and June 3, 19...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a008737

    authors: Hoge CW,Bodhidatta L,Echeverria P,Deesuwan M,Kitporka P

    更新日期:1996-02-01 00:00:00

  • Body mass index at different adult ages, weight change, and colorectal cancer risk in the National Institutes of Health-AARP Cohort.

    abstract::The authors investigated the relations of body mass index at different ages and adult weight change to incident colorectal cancer risk in the prospective National Institutes of Health-AARP Diet and Health Study (1995-1996), using a subcohort with repeated recall weights (273,679 participants; mean baseline age = 62.8 ...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kws192

    authors: Renehan AG,Flood A,Adams KF,Olden M,Hollenbeck AR,Cross AJ,Leitzmann MF

    更新日期:2012-12-15 00:00:00

  • Some epidemiologic features of motorcycle collision injuries. II. Factors associated with severity of injuries.

    abstract::Male drivers sustained relatively more serious motorcycle collision injuries than did male passengers, female drivers, or female passengers. For male drivers, severity of injury was related to age. The relative frequency of serious head injury was highest for drivers not wearing helmets who were involved in collisions...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a112137

    authors: Kraus JF,Riggins RS,Franti CE

    更新日期:1975-07-01 00:00:00

  • Alcohol and breast cancer: results from The Netherlands Cohort Study.

    abstract::Although the results of cohort studies on the association between alcohol and breast cancer are rather consistent, the current evidence is based solely on North American cohorts. Therefore, this association was evaluated in the Netherlands Cohort Study on diet and cancer, conducted since 1986 among 62,573 women aged 5...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a117357

    authors: van den Brandt PA,Goldbohm RA,van 't Veer P

    更新日期:1995-05-15 00:00:00

  • Validity of birth certificate data for the outcome of the previous pregnancy, Georgia, 1980-1995.

    abstract::The author evaluated the validity of four historically based variables collected on Georgia birth certificates: outcome of preceding pregnancy, history of delivery of a low- (<2,500 g) or high- (>4,000 g) birth-weight infant, and death of the baby resulting from the preceding pregnancy. Data were derived from birth an...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/154.10.883

    authors: Adams M

    更新日期:2001-11-15 00:00:00

  • Physical activity during adulthood and adolescence in relation to renal cell cancer.

    abstract::Evidence for a relation between physical activity and renal cell cancer has been inconsistent. The authors examined physical activity in relation to renal cell cancer in a large, prospective US cohort study of 482,386 participants (289,503 men and 192,883 women) aged 50-71 years at baseline (1995-1996). At baseline, p...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwn102

    authors: Moore SC,Chow WH,Schatzkin A,Adams KF,Park Y,Ballard-Barbash R,Hollenbeck A,Leitzmann MF

    更新日期:2008-07-15 00:00:00

  • Soy and fish oil intake and mortality in a Japanese community.

    abstract::The relation between intake of fish and soy products and subsequent all-cause and cause-specific mortality was examined in a cohort of 13,355 male and 15,724 female residents of Takayama, Gifu, Japan. A diet that included soy and fish intake was assessed in 1992 by using a validated semiquantitative food frequency que...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwf118

    authors: Nagata C,Takatsuka N,Shimizu H

    更新日期:2002-11-01 00:00:00

  • Community-acquired Legionnaires' disease associated with a cooling tower: evidence for longer-distance transport of Legionella pneumophila.

    abstract::In the period August 10-29, 1986, 29 confirmed cases of Legionnaires' disease occurred in Sheboygan, Wisconsin; two cases were fatal. No common source of indoor exposure was identified. Water specimens were obtained from all known cooling tower units in Sheboygan; Legionella pneumophila serogroup 1 was isolated at 1 x...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a115370

    authors: Addiss DG,Davis JP,LaVenture M,Wand PJ,Hutchinson MA,McKinney RM

    更新日期:1989-09-01 00:00:00

  • Experiences of Discrimination and Incident Type 2 Diabetes Mellitus: The Multi-Ethnic Study of Atherosclerosis (MESA).

    abstract::Experiences of discrimination are associated with increased risk of adverse health outcomes; however, it is unknown whether discrimination is related to incident type 2 diabetes mellitus (diabetes). We investigated the associations of major experiences of discrimination (unfair treatment in 6 situations) and everyday ...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwx047

    authors: Whitaker KM,Everson-Rose SA,Pankow JS,Rodriguez CJ,Lewis TT,Kershaw KN,Diez Roux AV,Lutsey PL

    更新日期:2017-08-15 00:00:00

  • Airborne particulate matter and mortality: timescale effects in four US cities.

    abstract::While time-series studies have consistently provided evidence for an effect of particulate air pollution on mortality, uncertainty remains as to the extent of the life-shortening implied by those associations. In this paper, the authors estimate the association between air pollution and mortality using different times...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwg087

    authors: Dominici F,McDermott A,Zeger SL,Samet JM

    更新日期:2003-06-15 00:00:00

  • Endemic amebiasis in an Arkansas community.

    abstract::Parasitologic, serologic, and epidemiologic studies were done during 1967 in Calion, Arkansas (population 544). Infection with Entamoeba histolytica was found to be endemic but was segregated along racial lines. Twenty-two (9.9%) black compared with only one (0.6%) white had E. histolytica demonstrated in one stool ex...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a112279

    authors: Spencer HC Jr,Hermos JA,Healy GR,Melvin DM,Shmunes E

    更新日期:1976-07-01 00:00:00

  • The E-cadherin gene polymorphism 160C->A and cancer risk: A HuGE review and meta-analysis of 26 case-control studies.

    abstract::A single nucleotide polymorphism, - 160C-->A, has been identified in the promoter region of the E-cadherin gene and has been shown to alter its transcriptional activity. To assess susceptibility of -160A allele carriers to seven types of cancers, the authors conducted a comprehensive meta-analysis, up to November 2006...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章,meta分析,评审

    doi:10.1093/aje/kwm264

    authors: Wang GY,Lu CQ,Zhang RM,Hu XH,Luo ZW

    更新日期:2008-01-01 00:00:00

  • Risk of Hospitalization for Cancer, Musculoskeletal Disorders, Injuries, or Poisonings Surrounding Widowhood.

    abstract::Psychological distress has been indicated to affect the risk of death from cardiovascular disease, cancer, and external causes. Mortality from these major causes of death is also known to be elevated after widowhood when distress is at a heightened level. Surprisingly little is known about changes in health other than...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwy184

    authors: Einiö E,Martikainen P

    更新日期:2019-01-01 00:00:00

  • Alcohol Consumption and Risk of Chronic Obstructive Pulmonary Disease: A Prospective Cohort Study of Men.

    abstract::Studies indicate an inverse association between moderate alcohol consumption and chronic inflammatory diseases; however, the association between alcohol consumption and chronic obstructive pulmonary disease (COPD) incidence has not been widely studied. We investigated the associations of total alcohol consumption and ...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/kwz020

    authors: Kaluza J,Harris HR,Linden A,Wolk A

    更新日期:2019-05-01 00:00:00

  • Does arsenic exposure increase the risk for circulatory disease?

    abstract::Studies of residents in communities with high endemic concentrations of arsenic in drinking water suggest a deleterious effect on the circulatory system; however, studies among workers with high occupational exposures generally have shown either no or weak associations. This discrepancy could be a result of the health...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a010185

    authors: Hertz-Picciotto I,Arrighi HM,Hu SW

    更新日期:2000-01-15 00:00:00

  • Body size and fat distribution as predictors of coronary heart disease among middle-aged and older US men.

    abstract::Obesity, android fat distribution, and other anthropometric measures have been associated with coronary heart disease in long-term prospective studies. However, fluctuations in weight due to age-related hormonal changes and changes in lifestyle practices may bias relative risk estimates over a long follow-up period. T...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a117385

    authors: Rimm EB,Stampfer MJ,Giovannucci E,Ascherio A,Spiegelman D,Colditz GA,Willett WC

    更新日期:1995-06-15 00:00:00

  • Do common mental disorders increase cigarette smoking? Results from five waves of a population-based panel cohort study.

    abstract::A prospective panel cohort design was used to investigate whether mental disorders common in the general population increase the likelihood of increased cigarette smoking at 12 months follow-up. By 1995, the last year for which data were available, a random sample of 12,057 persons aged 16-75 years residing in private...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/aje/152.7.651

    authors: Ismail K,Sloggett A,De Stavola B

    更新日期:2000-10-01 00:00:00

  • Sex hormones and postmenopausal breast cancer: a prospective study in an adult community.

    abstract::Few studies have examined the role of endogenous sex hormones in breast cancer, and to the authors' knowledge, only two have done so prospectively. The authors report here the results of a prospective study based on an available bank of previously analyzed plasma collected in 1972-1974 from 442 women aged 50-79 years ...

    journal_title:American journal of epidemiology

    pub_type: 杂志文章

    doi:10.1093/oxfordjournals.aje.a116228

    authors: Garland CF,Friedlander NJ,Barrett-Connor E,Khaw KT

    更新日期:1992-06-01 00:00:00