Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses.

Abstract:

OBJECTIVES:To evaluate meta-analyses with trial sequential analysis (TSA). TSA adjusts for random error risk and provides the required number of participants (information size) in a meta-analysis. Meta-analyses not reaching information size are analyzed with trial sequential monitoring boundaries analogous to interim monitoring boundaries in a single trial. STUDY DESIGN AND SETTING:We applied TSA on meta-analyses performed in Cochrane Neonatal reviews. We calculated information sizes and monitoring boundaries with three different anticipated intervention effects of 30% relative risk reduction (TSA(30%)), 15% (TSA(15%)), or a risk reduction suggested by low-bias risk trials of the meta-analysis corrected for heterogeneity (TSA(LBHIS)). RESULTS:A total of 174 meta-analyses were eligible; 79 out of 174 (45%) meta-analyses were statistically significant (P<0.05). In the significant meta-analyses, TSA(30%) showed firm evidence in 61%. TSA(15%) and TSA(LBHIS) found firm evidence in 33% and 73%, respectively. The remaining significant meta-analyses had potentially spurious evidence of effect. In the 95 statistically nonsignificant (P>or=0.05) meta-analyses, TSA(30%) showed absence of evidence in 80% (insufficient information size). TSA(15%) and TSA(LBHIS) found that 95% and 91% had absence of evidence. The remaining nonsignificant meta-analyses had evidence of lack of effect. CONCLUSION:TSA reveals insufficient information size and potentially false positive results in many meta-analyses.

journal_name

J Clin Epidemiol

authors

Brok J,Thorlund K,Gluud C,Wetterslev J

doi

10.1016/j.jclinepi.2007.10.007

subject

Has Abstract

pub_date

2008-08-01 00:00:00

pages

763-9

issue

8

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(07)00369-1

journal_volume

61

pub_type

杂志文章
  • Comparative safety evaluation of non-narcotic analgesics.

    abstract::Both spontaneous reports and single outcome studies may distort the overall safety evaluation of drugs. We identified epidemiologic studies, published from January 1970 to December 1995, that investigated the association of serious adverse effects with aspirin, diclofenac, acetaminophen, and dipyrone to determine and ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(98)00076-6

    authors: Andrade SE,Martinez C,Walker AM

    更新日期:1998-12-01 00:00:00

  • Prescription-event monitoring: methodology and recent progress.

    abstract::Event monitoring was first suggested 25 years ago as a way of detecting adverse reactions to drugs. Prescription-event monitoring (PEM), which has been developed by the Drug Safety Research Unit, is the first large-scale systematic post-marketing surveillance method to use event monitoring in the U.K. PEM identifies p...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(90)90140-k

    authors: Rawson NS,Pearce GL,Inman WH

    更新日期:1990-01-01 00:00:00

  • Regression discontinuity was a valid design for dichotomous outcomes in three randomized trials.

    abstract:OBJECTIVE:Regression discontinuity (RD) is a quasi-experimental design that may provide valid estimates of treatment effects in case of continuous outcomes. We aimed to evaluate validity and precision in the RD design for dichotomous outcomes. STUDY DESIGN AND SETTING:We performed validation studies in three large ran...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.02.015

    authors: van Leeuwen N,Lingsma HF,Mooijaart SP,Nieboer D,Trompet S,Steyerberg EW

    更新日期:2018-06-01 00:00:00

  • Methods for analyzing matched designs with double controls: excess risk is easily estimated and misinterpreted when evaluating traffic deaths.

    abstract:OBJECTIVES:To demonstrate analytic approaches for matched studies where two controls are linked to each case and events are accumulating counts rather than binary outcomes. A secondary intent is to clarify the distinction between total risk and excess risk (unmatched vs. matched perspectives). STUDY DESIGN AND SETTING...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.02.005

    authors: Redelmeier DA,Tibshirani RJ

    更新日期:2018-06-01 00:00:00

  • A self-report home environment screening tool identified older women at risk of falls.

    abstract:OBJECTIVE:To evaluate a self-report version of the Home Falls and Accidents Screening Tool (HOME FAST-SR). STUDY DESIGN AND SETTING:The HOME FAST-SR was designed using expert review, pretesting and piloting. Agreement of self-reported home hazard ratings and ratings by health professionals was evaluated using the kapp...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2010.02.013

    authors: Hassani Mehraban A,Mackenzie LA,Byles JE

    更新日期:2011-02-01 00:00:00

  • Multiple imputation was an efficient method for harmonizing the Mini-Mental State Examination with missing item-level data.

    abstract:OBJECTIVE:The Mini-Mental State Examination (MMSE) is used to estimate current cognitive status and as a screen for possible dementia. Missing item-level data are commonly reported. Attention to missing data is particularly important. However, there are concerns that common procedures for dealing with missing data, for...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2010.10.011

    authors: Burns RA,Butterworth P,Kiely KM,Bielak AA,Luszcz MA,Mitchell P,Christensen H,Von Sanden C,Anstey KJ

    更新日期:2011-07-01 00:00:00

  • A large number of COVID-19 interventional clinical trials were registered soon after the pandemic onset: a descriptive analysis.

    abstract:BACKGROUND AND OBJECTIVE:There is a pressing need for evidence-based interventions to address the devastating clinical and public health effects of the coronavirus disease 2019 (COVID-19) pandemic. The number of registered trials related to COVID-19 is increasing by the day. The objective of this study was to describe ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2020.06.005

    authors: Nasrallah AA,Farran SH,Nasrallah ZA,Chahrour MA,Salhab HA,Fares MY,Khachfe HH,Akl EA

    更新日期:2020-09-01 00:00:00

  • Risk adjustment for older hospitalized persons: a comparison of two methods of data collection for the Charlson index.

    abstract::To compare Charlson indices based on chart data and ICD-9 data for agreement overall and on rating specific comorbid conditions, and to compare mortality risks associated with these indices. Prospective cohort study. Six general medicine wards at Yale-New Haven Hospital. 524 consecutive patients who had no clinical ev...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00367-x

    authors: van Doorn C,Bogardus ST,Williams CS,Concato J,Towle VR,Inouye SK

    更新日期:2001-07-01 00:00:00

  • Decline in mortality from heart disease in Denmark: some methodological problems.

    abstract::Mortality rates in Denmark from ischemic heart diseases (IHD), other heart diseases and unknown causes are presented for the period 1968-92. In all age groups, mortality from IHD is higher at the beginning of the period than at the end. For other heart disease, the plot of the mortality rate is U-shaped for the age gr...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(94)00158-m

    authors: Juel K,Sjøl A

    更新日期:1995-04-01 00:00:00

  • Public and private hypotheses.

    abstract::The uses of hypothesis in scientific medicine and in clinical medicine are broadly similar; but they differ in subtle but important logical details. The key distinction is that scientific medicine deals with broad ("public") hypotheses about entire populations; and the predominant problem of inference is statistics in...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(89)90028-0

    authors: Murphy EA

    更新日期:1989-01-01 00:00:00

  • Inadequate use and regulation of interventions against publication bias decreases their effectiveness: a systematic review.

    abstract:OBJECTIVES:To determine the effectiveness of interventions designed to prevent or reduce publication and related biases. STUDY DESIGN AND SETTING:We searched multiple databases and performed manual searches using terms related to publication bias and known interventions against publication bias. We dually reviewed cit...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2015.01.008

    authors: Thaler K,Kien C,Nussbaumer B,Van Noord MG,Griebler U,Klerings I,Gartlehner G,UNCOVER Project Consortium.

    更新日期:2015-07-01 00:00:00

  • Redundant meta-analyses are common in genetic epidemiology.

    abstract:OBJECTIVES:The massive growth in the publication of meta-analyses may cause redundancy and wasted efforts. We performed a metaepidemiologic study to evaluate the extent of potential redundancy in published meta-analyses in genetic epidemiology. STUDY DESIGN AND SETTING:Using a sample of 38 index meta-analyses of genet...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2020.05.035

    authors: Sigurdson MK,Khoury MJ,Ioannidis JPA

    更新日期:2020-11-01 00:00:00

  • Clustering of cancer in families of patients with primary lung cancer.

    abstract::We have previously shown that patients with a positive family history of lung cancer did not exhibit characteristics expected if the familial association was a surrogate for a genetic mechanism which was absent in those without such a history. In this study, we examine the incidence of cancer (all sites) in two groups...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90202-k

    authors: McDuffie HH

    更新日期:1991-01-01 00:00:00

  • Most overviews of Cochrane reviews neglected potential biases from dual authorship.

    abstract:OBJECTIVE:Some authors of Cochrane overviews have also (co-)authored one or more of the underlying reviews. We examined the extent of dual (co-)authorship in Cochrane overviews, how it is dealt with, and whether the issue is raised in protocols. STUDY DESIGN:The Cochrane Library was searched for overviews and protocol...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2016.04.008

    authors: Büchter RB,Pieper D

    更新日期:2016-09-01 00:00:00

  • Methodologic considerations in measuring glycosylated hemoglobin in epidemiologic studies.

    abstract::Multiple linear regression was used to predict an incubated glycosylated hemoglobin value from the unincubated value and blood glucose. Hemoglobin A1 (HbA1) was measured by a disposable microcolumn technique in a large, geographically defined population of diabetic persons in southern Wisconsin. During the study, incu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90116-3

    authors: Moss SE,Klein R,Klein BE,Spennetta TL,Shrago ES

    更新日期:1988-01-01 00:00:00

  • Decision making about healthcare-related tests and diagnostic test strategies. Paper 4: International guidelines show variability in their approaches.

    abstract:OBJECTIVES:The objective of the study was to describe and compare current practices in developing guidelines about the use of healthcare-related tests and diagnostic strategies (HCTDS). STUDY DESIGN AND SETTING:We sampled 37 public health and clinical practice guidelines about HCTDS from various sources without langua...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2017.09.004

    authors: Mustafa RA,Wiercioch W,Arevalo-Rodriguez I,Cheung A,Prediger B,Ivanova L,Ventresca M,Brozek J,Santesso N,Bossuyt P,Garg AX,Lloyd N,Lelgemann M,Bühler D,Schünemann HJ

    更新日期:2017-12-01 00:00:00

  • OAKHQOL: a new instrument to measure quality of life in knee and hip osteoarthritis.

    abstract:OBJECTIVE:To develop a questionnaire with which to measure quality of life (QoL) in patients with knee and hip osteoarthritis (OA). STUDY DESIGN AND SETTING:Thirty-two caregivers and 96 OA patients were interviewed individually (using cognitive and face-to-face techniques) and in focus groups. A group of experts worki...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2004.04.011

    authors: Rat AC,Coste J,Pouchot J,Baumann M,Spitz E,Retel-Rude N,Le Quintrec JS,Dumont-Fischer D,Guillemin F

    更新日期:2005-01-01 00:00:00

  • Methodologists and context experts disagreed regarding managing conflicts of interest of clinical practice guidelines panels.

    abstract:OBJECTIVE:A new strategy to manage conflicts of interests (COIs) of a clinical guideline's panelists gives primary responsibility to a methodologist, puts equal emphasis on intellectual and financial COIs, and excludes panelists with primary conflicts from drafting or voting on recommendations. We explored the views of...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2011.12.013

    authors: Akl EA,Karl R,Guyatt GH

    更新日期:2012-07-01 00:00:00

  • Analysis of non-response bias in a mailed health survey.

    abstract::The objective of this study was to identify characteristics of non-respondents and late respondents to a mailed health survey. Persons who returned and those who did not return the questionnaire were compared using health insurance data, which indicated their age, sex, and health care expenditures in the previous year...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00166-2

    authors: Etter JF,Perneger TV

    更新日期:1997-10-01 00:00:00

  • Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings.

    abstract:OBJECTIVE:The uptake of research findings into routine health care is a haphazard and unpredictable process. The usefulness of the results of implementation studies is limited, due in part to the lack of an underlying framework of the important dimensions of research studies in this area and the healthcare settings wit...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.09.002

    authors: Eccles M,Grimshaw J,Walker A,Johnston M,Pitts N

    更新日期:2005-02-01 00:00:00

  • Phone respondents reported less mental health problems whereas mail interviewee gave higher physical health ratings.

    abstract:OBJECTIVE:This study examines the effects of telephone and mail interview methods on the measurement of health-related quality of life. STUDY DESIGN AND SETTING:One thousand six hundred ninety individuals aged 25-66 were interviewed randomly either by telephone or by mail. Health-related quality of life was assessed w...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jclinepi.2007.12.003

    authors: Ravens-Sieberer U,Erhart M,Wetzel R,Krügel A,Brambosch A

    更新日期:2008-10-01 00:00:00

  • Synthesis of genetic association studies for pertinent gene-disease associations requires appropriate methodological and statistical approaches.

    abstract:OBJECTIVE:The aim of the study was to consider statistical and methodological issues affecting the results of meta-analysis of genetic association studies for pertinent gene-disease associations. Although the basic statistical issues for performing meta-analysis are well described in the literature, there are remaining...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2007.12.011

    authors: Zintzaras E,Lau J

    更新日期:2008-07-01 00:00:00

  • Cross-cultural adaptation of Roland-Morris Disability Questionnaire needs to assess the measurement properties: a systematic review.

    abstract:OBJECTIVE:To assess the cross-cultural adaptations of the Roland-Morris Disability Questionnaire (RMDQ). STUDY DESIGN AND SETTING:English and Chinese databases were searched through December 2017. Cross-cultural adaptation and measurement properties were evaluated using the Guidelines for the Process of Cross-Cultural...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.03.011

    authors: Yao M,Zhu S,Tian ZR,Song YJ,Yang L,Wang YJ,Cui XJ

    更新日期:2018-07-01 00:00:00

  • Laboratory data predicts survival post hospitalization.

    abstract::From a database of 93,077 in-patient admissions, patients assigned to catastrophic, very severe, moderately severe, and average 30-day mortality risk categories (as defined in Medicare Hospital Mortality Information, 1989 release, from the Health Care Financing Administration (HCFA] were selected for study. These admi...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90100-n

    authors: Sheiner LB,Easterling MJ,Mozes B,Brown A

    更新日期:1991-01-01 00:00:00

  • FOOTSTEP: a randomized controlled trial investigating the clinical and cost effectiveness of a patient self-management program for basic foot care in the elderly.

    abstract:BACKGROUND AND OBJECTIVES:Podiatry (chiropody) services are one of the most frequently requested services in primary care. The elderly are given priority access to podiatry services in the UK blocking access for other priority groups. To evaluate the clinical and cost-effectiveness of a self-management program as a mea...

    journal_title:Journal of clinical epidemiology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1016/s0895-4356(03)00197-5

    authors: Waxman R,Woodburn H,Powell M,Woodburn J,Blackburn S,Helliwell P

    更新日期:2003-11-01 00:00:00

  • Insulin sensitivity markers: predictors of accidents and suicides in Helsinki Heart Study screenees.

    abstract::The purpose of this study was to evaluate whether elements signifying relative insulin sensitivity (IS) were prospectively linked to accidents and suicides in 14,976 Helsinki Heart Study (HHS) screenees. The main outcome measure was hospitalizations and deaths from accidents and suicide attempts determined from Finnis...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00407-9

    authors: Golomb BA,Tenkanen L,Alikoski T,Niskanen T,Manninen V,Huttunen M,Mednick SA

    更新日期:2002-08-01 00:00:00

  • An enhancement of ROC curves made them clinically relevant for diagnostic-test comparison and optimal-threshold determination.

    abstract:OBJECTIVES:The receiver operating characteristic curves (ROC curves) are often used to compare continuous diagnostic tests or determine the optimal threshold of a test; however, they do not consider the costs of misclassifications or the disease prevalence. The ROC graph was extended to allow for these aspects. STUDY ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.01.003

    authors: Subtil F,Rabilloud M

    更新日期:2015-07-01 00:00:00

  • Nonrandomized studies using causal-modeling may give different answers than RCTs: a meta-epidemiological study.

    abstract:OBJECTIVES:To evaluate how estimated treatment effects agree between nonrandomized studies using causal modeling with marginal structural models (MSM-studies) and randomized trials (RCTs). STUDY DESIGN:Meta-epidemiological study. SETTING:MSM-studies providing effect estimates on any healthcare outcome of any treatmen...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2019.10.012

    authors: Ewald H,Ioannidis JPA,Ladanie A,Mc Cord K,Bucher HC,Hemkens LG

    更新日期:2020-02-01 00:00:00

  • Using ordinal logistic regression to estimate the likelihood of colorectal neoplasia.

    abstract::The utility of ordinal logistic regression in the prediction of colorectal neoplasia was demonstrated in a group of 461 consecutive patients undergoing colonoscopy in a community practice. One hundred twenty-nine patients had adenomatous polyps and 34 had colorectal adenocarcinoma. An ordinal logistic regression model...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90159-7

    authors: Brazer SR,Pancotto FS,Long TT 3rd,Harrell FE Jr,Lee KL,Tyor MP,Pryor DB

    更新日期:1991-01-01 00:00:00

  • Rasch analysis informed modifications to the Work Instability Scale for Rheumatoid Arthritis for use in work-related upper limb disorders.

    abstract:OBJECTIVE:The Work Instability Scale for Rheumatoid Arthritis (RA-WIS) is a promising prognostic tool for future work disability outcomes. Rasch analysis was conducted to examine the psychometric performance of the RA-WIS in work-related upper limb disorders. STUDY DESIGN AND SETTING:Eligible injured workers (n=396) a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2011.02.002

    authors: Tang K,Beaton DE,Gignac MA,Bombardier C

    更新日期:2011-11-01 00:00:00