Abstract:
OBJECTIVES:Meta-analyses inform clinical practice by summarizing treatment effect estimates based on results from several trials. However, the statistical significance of a meta-analysis (i.e., whether the pooled treatment effect is statistically significant or not) may rely on the outcome of only a few patients from specific trials in the meta-analysis. We aimed to evaluate the extent to which the statistical significance of meta-analyses can be changed (from statistically significant to nonsignificant, or vice versa) after modifying the event status of patients in specific arms of specific trials. METHODS:We conducted a cross-sectional analysis of meta-analyses of trials with a binary outcome from Cochrane Systematic Reviews. We defined the fragility index of meta-analyses as the minimum number of patients from one or more trials included in the meta-analysis for whom an event-status modification (i.e., changing an event to nonevent or a nonevent to event) would change the statistical significance of the pooled treatment effect. For statistically significant and nonsignificant meta-analyses, we evaluated the fragility index, the ratio between the fragility index and the total number of participants included in the trials, and the ratio between the fragility index and the total number of events. RESULTS:Our sample comprised 906 meta-analyses: 400 and 506 had statistically significant and nonsignificant pooled treatment effects, respectively. For statistically significant meta-analyses, the median fragility index was 12 (Q1-Q3: 4-33); for 29% the fragility index was 5 or less. Overall, 43% and 9% meta-analyses would have become nonsignificant if the event status was modified for less than 1% of the total participants in one or several specific trials, and for less than 1% of the total number of events, respectively. These proportions were similar for statistically nonsignificant meta-analyses. Overall, the statistical significance of 33% of all meta-analyses depended on the event status of five or fewer participants from one or more specific trials. CONCLUSION:The statistical significance of meta-analyses often depends on the outcome of a few patients. The fragility index of meta-analyses may help in interpreting the conclusions of meta-analyses.
journal_name
J Clin Epidemioljournal_title
Journal of clinical epidemiologyauthors
Atal I,Porcher R,Boutron I,Ravaud Pdoi
10.1016/j.jclinepi.2019.03.012subject
Has Abstractpub_date
2019-07-01 00:00:00pages
32-40eissn
0895-4356issn
1878-5921pii
S0895-4356(18)30818-7journal_volume
111pub_type
杂志文章abstract::Health researchers commonly use logistic regression when profiling health providers. Data from the patients treated by the providers are used to construct models predicting the expected number of outcomes for providers and the ratio of observed to expected outcomes (O/E ratio) used as a risk-adjusted measure of provid...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/s0895-4356(03)00048-9
更新日期:2003-06-01 00:00:00
abstract:OBJECTIVES:The aim of this study was to evaluate how often the European Medicines Agency (EMA) has authorized drugs based on nonrandomized studies and whether there is an association between treatment effects and EMA preference for further testing in randomized clinical trials (RCTs). STUDY DESIGN AND SETTING:We revie...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章,评审
doi:10.1016/j.jclinepi.2018.01.011
更新日期:2018-06-01 00:00:00
abstract:BACKGROUND AND OBJECTIVE:A large number of trials remain difficult to locate or unpublished for systematic reviews. The objective of this article was to determine the usefulness of making e-mail contact with authors of clinical trials and literature reviews found in MEDLINE to identify unpublished or difficult to locat...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2005.11.022
更新日期:2006-07-01 00:00:00
abstract:OBJECTIVE:Genetic studies of complex human diseases rely heavily on the epidemiologic association paradigm, particularly the population-based case-control designs. This study aims to compare the matching effectiveness in terms of bias reduction between exposure matching and stratum matching. STUDY DESIGN AND SETTING:F...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2008.02.016
更新日期:2009-01-01 00:00:00
abstract::Accurate prognosis is critical to the design of all prospective research aimed at improving survival. Predictions based on birth weight, gestational age, or any other single variable, fail to take into account the potentially important contribution of other factors. In order to develop a practical and accurate multiva...
journal_title:Journal of clinical epidemiology
pub_type: 临床试验,杂志文章
doi:10.1016/0895-4356(88)90079-0
更新日期:1988-01-01 00:00:00
abstract:OBJECTIVE:Correspondence analysis (CA) is a multivariate graphical technique designed to explore the relationships among categorical variables. Epidemiologists frequently collect data on multiple categorical variables with the goal of examining associations among these variables. Nevertheless, CA appears to be an under...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2009.08.008
更新日期:2010-06-01 00:00:00
abstract:BACKGROUND AND OBJECTIVE:Reference limits are widely used in anthropometry, the behavioral sciences, medicine, and clinical chemistry. They describe the distribution of a quantitative variable in a healthy population, and are often a smooth function of age or another determinant. Thus, instead of estimating reference l...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2006.09.004
更新日期:2007-06-01 00:00:00
abstract:OBJECTIVE:Citations by other researchers are important in the dissemination of research findings. We aimed to investigate whether preferential citation of statistically significant articles exists in the psychiatric literature. STUDY DESIGN AND SETTINGS:We analyzed all original research papers published in 1996 in fou...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2006.11.014
更新日期:2007-09-01 00:00:00
abstract:BACKGROUND AND OBJECTIVE:In many observational studies, the association between drugs and disease is analyzed with information from a baseline interview. We investigated the magnitude and direction of exposure misclassification by comparing interview data at baseline with prospectively gathered pharmacy data. METHODS:...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2003.12.017
更新日期:2004-09-01 00:00:00
abstract::The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method implementation evidence. Choice of appropriate methodologies, methods, and tools is essential when developing a rigorous protocol and conducting the synthesis. Cochrane authors who...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2017.06.020
更新日期:2018-05-01 00:00:00
abstract:OBJECTIVES:To evaluate the responsiveness of generic and mapped preference-based measures based on the anchor of global change in health condition of colorectal cancer (CRC) patients. STUDY DESIGN AND SETTING:A baseline sample of 333 Chinese CRC patients was recruited between September 2009 and July 2010 and was surve...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2013.08.011
更新日期:2014-02-01 00:00:00
abstract::The objective of this study was to construct a prediction model for predicting stroke in an elderly U.S. population, and to assess the accuracy in this population of other previously published prediction models. The subjects were participants in the Cardiovascular Health Study: 2,495 men and 3,393 women age 65 years a...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/s0895-4356(01)00434-6
更新日期:2002-02-01 00:00:00
abstract::Mortality rates in Denmark from ischemic heart diseases (IHD), other heart diseases and unknown causes are presented for the period 1968-92. In all age groups, mortality from IHD is higher at the beginning of the period than at the end. For other heart disease, the plot of the mortality rate is U-shaped for the age gr...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/0895-4356(94)00158-m
更新日期:1995-04-01 00:00:00
abstract::Measuring the effectiveness of cognitive rehabilitation programs poses both conceptual and practical challenges. We compared several standardized outcome measures with goal attainment scaling (GAS) to assess their sensitivity to changes in health status in patients undergoing cognitive rehabilitation. GAS is a measure...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/s0895-4356(97)00014-0
更新日期:1997-05-01 00:00:00
abstract:OBJECTIVES:To compare the abilities of six validated comorbidity indices (Charlson index, cumulative illness rating scale [CIRS], index of coexistent diseases, Kaplan scale, geriatrics index of comorbidity [GIC], and chronic disease score) to predict adverse hospitalization outcomes (death during hospitalization, lengt...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2009.11.013
更新日期:2010-09-01 00:00:00
abstract::The clinical correlates of advanced retinopathy were determined in a sample of 427 type II diabetic outpatients, aged 35 to 74 years, recruited in eight centers from all parts of France. The presence of retinopathy was assessed by fluorescein angiography with centralized interpretation. Advanced retinopathy (prolifera...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章,多中心研究
doi:10.1016/0895-4356(95)00582-x
更新日期:1996-06-01 00:00:00
abstract:OBJECTIVES:Procedures for controlling the false positive rate when performing many hypothesis tests are commonplace in health and medical studies. Such procedures, most notably the Bonferroni adjustment, suffer from the problem that error rate control cannot be localized to individual tests, and that these procedures d...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章,评审
doi:10.1016/j.jclinepi.2014.03.012
更新日期:2014-08-01 00:00:00
abstract::Breast cancer therapy is often followed by a decline in upper-body function. Women (303) diagnosed with stage I or II breast cancer were interviewed 5 and 21 months after surgery and their medical records were reviewed. Women with cardiopulmonary comorbidity had an odds ratio for decline at the 5-month interview of 2....
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/s0895-4356(99)00176-6
更新日期:2000-06-01 00:00:00
abstract:OBJECTIVES:Network meta-analysis (NMA) may produce more precise estimates of treatment effects than pairwise meta-analysis. We examined the relative contribution of network paths of different lengths to estimates of treatment effects. STUDY DESIGN AND SETTING:We analyzed 213 published NMAs. We categorized network shap...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2020.04.009
更新日期:2020-08-01 00:00:00
abstract:BACKGROUND AND OBJECTIVE:We consider the number needed to treat (NNT) when the event of interest is defined by dichotomizing a continuous response at a threshold level. If the response is measured with error, the resulting NNT is biased. We consider methods to reduce this bias. METHODS:Bias adjustment was studied usin...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2004.01.021
更新日期:2004-12-01 00:00:00
abstract::Previous work has suggested that recall bias in case-control studies may be more serious when the overall study quality is lower. This paper summarizes a systematic literature search to examine the question. All relevant studies published between 1966 and 1990 were included if they met the following criteria: (1) they...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/0895-4356(94)00132-a
更新日期:1995-02-01 00:00:00
abstract::We analyzed the 1986-1997 mortality in a cohort of 2065 residents of an Italian municipality which had been exposed to drinking water with a high content of inorganic selenium over a long period of time, and compared it with mortality in the remainder of the municipal population. Mortality from malignant neoplasms inc...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/s0895-4356(00)00233-x
更新日期:2000-10-01 00:00:00
abstract:OBJECTIVE:To assess the effects of abbreviated literature searches on evidence syntheses conclusions. STUDY DESIGN AND SETTING:We randomly selected 60 Cochrane reviews of clinical interventions and repeated literature searches using 14 abbreviated approaches (combinations of MEDLINE, Embase, CENTRAL with and without s...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章,meta分析
doi:10.1016/j.jclinepi.2018.05.022
更新日期:2018-10-01 00:00:00
abstract::The aim of this paper was to evaluate the combined effect of alcohol, smoking habits and frequency of consumption of selected dietary items, which are the major sources of retinoids and beta-carotene in the Italian diet, on the risk of esophageal cancer (EC). The adequacy of the multiplicative structure for describing...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/0895-4356(92)90035-l
更新日期:1992-04-01 00:00:00
abstract::The uses of hypothesis in scientific medicine and in clinical medicine are broadly similar; but they differ in subtle but important logical details. The key distinction is that scientific medicine deals with broad ("public") hypotheses about entire populations; and the predominant problem of inference is statistics in...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/0895-4356(89)90028-0
更新日期:1989-01-01 00:00:00
abstract:OBJECTIVES:This study investigated trial consultations to identify whether and to what extent discussions of retention are present. STUDY DESIGN AND SETTING:This embedded mixed-methods study design included a purposive sample of audio-recorded trial consultations obtained from four sites of a large multicenter UK-base...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2020.03.011
更新日期:2020-07-01 00:00:00
abstract::Time to revision is an important criterion describing the quality of implants in total joint surgery. Estimates of failure probabilities are required to inform a patient about the risk of suffering a reoperation. Also, regression models are used for comparing different prosthesis designs. Typically, patients dying bef...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/s0895-4356(01)00371-7
更新日期:2001-10-01 00:00:00
abstract:OBJECTIVE:The aim of the study was to consider statistical and methodological issues affecting the results of meta-analysis of genetic association studies for pertinent gene-disease associations. Although the basic statistical issues for performing meta-analysis are well described in the literature, there are remaining...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章,评审
doi:10.1016/j.jclinepi.2007.12.011
更新日期:2008-07-01 00:00:00
abstract::Although previous studies document that blood pressure measured in the clinic may differ significantly from blood pressure recorded over 24 hours, the impact of these differences on patient selection for therapeutic drug trials is unknown. A placebo controlled double-blind evaluation of an experimental antihypertensiv...
journal_title:Journal of clinical epidemiology
pub_type: 临床试验,杂志文章
doi:10.1016/0895-4356(89)90046-2
更新日期:1989-01-01 00:00:00
abstract:OBJECTIVE:To develop a conceptual model to describe the burden of osteoarthritis in individuals with this condition and on the broader community. STUDY DESIGN AND SETTING:Six concept mapping workshops were undertaken: three with patients (n = 26) and three with health professionals (n = 27) in Australia and Sweden. Th...
journal_title:Journal of clinical epidemiology
pub_type: 杂志文章
doi:10.1016/j.jclinepi.2013.03.012
更新日期:2013-09-01 00:00:00