Cluster-randomized controlled trials evaluating complex interventions in general practices are mostly ineffective: a systematic review.

Abstract:

OBJECTIVES:The aim of this study was to evaluate how frequently complex interventions are shown to be superior to routine care in general practice-based cluster-randomized controlled studies (c-RCTs) and to explore whether potential differences explain results that come out in favor of a complex intervention. STUDY DESIGN AND SETTING:We performed an unrestricted search in the Central Register of Controlled Trials, MEDLINE, and EMBASE. Included were all c-RCTs that included a patient-relevant primary outcome in a general practice setting with at least 1-year follow-up. We extracted effect sizes, P-values, intracluster correlation coefficients (ICCs), and 22 quality aspects. RESULTS:We identified 29 trials with 99 patient-relevant primary outcomes. After adjustment for multiple testing on a trial level, four outcomes (4%) in four studies (14%) remained statistically significant. Of the 11 studies that reported ICCs, in 8, the ICC was equal to or smaller than the assumed ICC. In 16 of the 17 studies with available sample size calculation, effect sizes were smaller than anticipated. CONCLUSION:More than 85% of the c-RCTs failed to demonstrate a beneficial effect on a predefined primary endpoint. All but one study were overly optimistic with regard to the expected treatment effect. This highlights the importance of weighing up the potential merit of new treatments and planning prospectively, when designing clinical studies in a general practice setting.

journal_name

J Clin Epidemiol

authors

Siebenhofer A,Paulitsch MA,Pregartner G,Berghold A,Jeitler K,Muth C,Engler J

doi

10.1016/j.jclinepi.2017.10.010

subject

Has Abstract

pub_date

2018-02-01 00:00:00

pages

85-96

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(17)30406-7

journal_volume

94

pub_type

杂志文章,评审
  • Using the STROBE statement: survey findings emphasized the role of journals in enforcing reporting guidelines.

    abstract:OBJECTIVES:The objective of the study was to identify factors affecting the use of the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement, specifically authors' attitudes toward and experiences with it. STUDY DESIGN AND SETTING:An online survey was distributed to authors of observa...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.07.019

    authors: Sharp MK,Bertizzolo L,Rius R,Wager E,Gómez G,Hren D

    更新日期:2019-12-01 00:00:00

  • Clinical history and biologic age predicted falls better than objective functional tests.

    abstract:OBJECTIVE:Fall risk assessment is important because the consequences, such as a fracture, may be devastating. The objective of this study was to find the test or tests that best predicted falls in a population-based sample of elderly women. STUDY DESIGN AND SETTING:The fall-predictive ability of a questionnaire, a sub...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.06.013

    authors: Gerdhem P,Ringsberg KA,Akesson K,Obrant KJ

    更新日期:2005-03-01 00:00:00

  • Increased asthma hospitalizations among registered Indian children and adults in Saskatchewan, 1970-1989.

    abstract::We investigated asthma morbidity in children and adults among Registered Indians in Saskatchewan using hospitalization data for 1970-1989. In Registered Indians, significant increases were observed in the asthma hospitalization rates from 1979 to 1989 in boys and girls under 4 years, boys aged 5-14 years, and female a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(95)00019-z

    authors: Senthilselvan A,Habbick BF

    更新日期:1995-10-01 00:00:00

  • The next stage: molecular epidemiology.

    abstract::The traditional approach in epidemiology of relating exposure to an environmental agent such as a drug or infective agent has been to measure an overall risk (i.e., average and then "adjust risk for demographic variables and other confounders"). An attempt is sometimes made to define a "susceptible" subgroup. The anal...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00052-8

    authors: Shpilberg O,Dorman JS,Ferrell RE,Trucco M,Shahar A,Kuller LH

    更新日期:1997-06-01 00:00:00

  • Quality varies across clinical practice guidelines for mammography screening in women aged 40-49 years as assessed by AGREE and AMSTAR instruments.

    abstract:OBJECTIVE:To assess the quality of clinical practice guidelines providing recommendations on the frequency of mammography screening in asymptomatic, average-risk women 40-49 years of age. STUDY DESIGN AND SETTING:We searched the National Guideline Clearinghouse and MEDLINE for guidelines published from 2005 to 2010. F...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.12.005

    authors: Burda BU,Norris SL,Holmer HK,Ogden LA,Smith ME

    更新日期:2011-09-01 00:00:00

  • The level of alcohol consumption at which all-cause mortality is least.

    abstract::Moderate consumers of alcohol have lower mortality than either nondrinkers or heavy drinkers. This systematic review aimed to quantify the level of alcohol consumption (termed the nadir) at which the lowest mortality occurs. Twenty cohort studies reported analyses of all-cause mortality for at least three categories o...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析

    doi:10.1016/s0895-4356(99)00076-1

    authors: White IR

    更新日期:1999-10-01 00:00:00

  • Both clinical epidemiology and population health perspectives can define the role of health care in reducing health disparities.

    abstract:OBJECTIVE:To compare and contrast clinical epidemiology and population health perspectives on the role of health care in reducing socioeconomic disparities in health. STUDY DESIGN AND SETTING:A review of concepts outlined in selected articles on population health and clinical epidemiology and a systematic literature s...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2004.10.020

    authors: Anderson GM,Bronskill SE,Mustard CA,Culyer A,Alter DA,Manuel DG

    更新日期:2005-08-01 00:00:00

  • Reporting of trials presented in conference abstracts needs to be improved.

    abstract:OBJECTIVES:To assess how trial information reported in conference abstracts differs to their subsequent full publication. METHODS:Randomized trials reported at the American Society of Clinical Oncology conference (1992) were identified. CENTRAL and PubMed (December 2002) were searched to identify corresponding full pu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.09.016

    authors: Hopewell S,Clarke M,Askie L

    更新日期:2006-07-01 00:00:00

  • Unpublished data can be of value in systematic reviews of adverse effects: methodological overview.

    abstract:OBJECTIVE:To assess the impact of including unpublished data on adverse effects in systematic reviews. STUDY DESIGN AND SETTING:We carried out a systematic review of methodological evaluations that compared the quantitative reporting of adverse effects data between published and unpublished sources, in particular, the...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.02.009

    authors: Golder S,Loke YK,Bland M

    更新日期:2010-10-01 00:00:00

  • Pooled time series regression analysis in longitudinal studies.

    abstract::Many longitudinal studies attempt to examine changes in outcome measures over time in groups of patients. Applying conventional analytic techniques, such as a single classical linear regression model, to these data will often not result in minimum variance estimates, and may affect the results of tests of significance...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(93)90038-3

    authors: Ward MM,Leigh JP

    更新日期:1993-07-01 00:00:00

  • A case-control evaluation of treatment efficacy: the example of magnesium sulfate prophylaxis against eclampsia in patients with preeclampsia.

    abstract::Randomized trials are the optimal approach for evaluations of treatment efficacy but may not always be feasible. We study the adequacy of the case-control design in evaluating efficacy in a situation where the investigated therapy, namely the administration of magnesium sulfate for the prevention of eclampsia in patie...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(96)00421-0

    authors: Abi-Said D,Annegers JF,Combs-Cantrell D,Suki R,Frankowski RF,Willmore LJ

    更新日期:1997-04-01 00:00:00

  • Do medical devices have enhanced placebo effects?

    abstract::Although the placebo in a clinical trial is often considered simply a baseline against which to evaluate the efficacy of a clinical intervention, there is evidence that the magnitude of placebo effect may be a critical factor in determining the results of a trial. This article examines the question of whether devices ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0895-4356(00)00206-7

    authors: Kaptchuk TJ,Goldman P,Stone DA,Stason WB

    更新日期:2000-08-01 00:00:00

  • The "Lost NNT" can be used to represent uncertainty surrounding number needed to treat.

    abstract:OBJECTIVES:The uncertainty around number needed to treat (NNT) is often represented through a confidence interval (CI). However, it is not clear how the CI can help inform treatment decisions. We developed decision-theoretic measures of uncertainty for the NNT. STUDY DESIGN AND SETTING:We build our argument on the bas...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2012.01.022

    authors: Sadatsafavi M,Ganjizadeh S,Hatala R,Marra C,FitzGerald M

    更新日期:2012-08-01 00:00:00

  • Methods for analyzing matched designs with double controls: excess risk is easily estimated and misinterpreted when evaluating traffic deaths.

    abstract:OBJECTIVES:To demonstrate analytic approaches for matched studies where two controls are linked to each case and events are accumulating counts rather than binary outcomes. A secondary intent is to clarify the distinction between total risk and excess risk (unmatched vs. matched perspectives). STUDY DESIGN AND SETTING...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.02.005

    authors: Redelmeier DA,Tibshirani RJ

    更新日期:2018-06-01 00:00:00

  • The use of clinical trials in comparative effectiveness research on mental health.

    abstract:OBJECTIVES:A large body of comparative effectiveness research (CER) focuses on the use of observational and quasi-experimental approaches. We sought to examine the use of clinical trials as a tool for CER, particularly in mental health. STUDY DESIGN AND SETTING:Examination of three ongoing randomized clinical trials i...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.02.013

    authors: Blanco C,Rafful C,Olfson M

    更新日期:2013-08-01 00:00:00

  • Improving task comprehension in the measurement of health state preferences. A trial of informational cartoon figures and a paired-comparison task.

    abstract::Information concerning people's relative preferences for health care outcomes is usually obtained using questionnaires which ask subjects to imagine health states of various kinds. When using illness- or treatment-specific states, elaborate descriptions of patients' quality of life may adequately convey to the rater a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90083-y

    authors: Hadorn DC,Hays RD,Uebersax J,Hauber T

    更新日期:1992-03-01 00:00:00

  • Prevalence of iron deficiency and iron overload in the adult Icelandic population.

    abstract::The aim of this cross-sectional study was to estimate the prevalence of iron deficiency and overload in the adult population in Iceland, a developed Scandinavian country. The study population consisted of 4240 individuals aged 25-74 years randomly selected from the national roster. Basic hematological, S-iron, S-total...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90090-v

    authors: Jonsson JJ,Johannesson GM,Sigfusson N,Magnusson B,Thjodleifsson B,Magnusson S

    更新日期:1991-01-01 00:00:00

  • Current challenges in clinimetrics.

    abstract::Clinimetrics is a methodologic discipline that focuses on the quality of clinical measurements, for example, diagnostic characteristics and disease outcomes. Different clinimetric properties, such as reproducibility and responsiveness, are important in both the development and the evaluation of measurement instruments...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2003.08.012

    authors: de Vet HC,Terwee CB,Bouter LM

    更新日期:2003-12-01 00:00:00

  • Users identified challenges in applying GRADE to complex interventions and suggested an extension to GRADE.

    abstract:OBJECTIVES:To explore user perspectives on applying the Grading of Recommendations Assessment, Development and Evaluation (GRADE) to systematic reviews of complex interventions. STUDY DESIGN AND SETTING:Thirty-three authors of recent (2013 onward) systematic reviews were contacted regarding their perspectives on using...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.09.010

    authors: Movsisyan A,Melendez-Torres GJ,Montgomery P

    更新日期:2016-02-01 00:00:00

  • Weighing gains and losses in criterion validity studies with test-based enrollment.

    abstract::Criterion validity studies sometimes use designs with test-based enrollment schemes. In such incomplete studies, a Reference Instrument (RI) is applied to unequal sampling fractions of subjects previously identified as positives or negatives by a new Test Instrument (TI+ and TI-). Focusing on sensitivity (Se) and spec...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(03)00162-8

    authors: Reichenheim ME

    更新日期:2003-10-01 00:00:00

  • Developing a stroke severity index based on administrative data was feasible using data mining techniques.

    abstract:OBJECTIVES:Case-mix adjustment is difficult for stroke outcome studies using administrative data. However, relevant prescription, laboratory, procedure, and service claims might be surrogates for stroke severity. This study proposes a method for developing a stroke severity index (SSI) by using administrative data. ST...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.01.009

    authors: Sung SF,Hsieh CY,Kao Yang YH,Lin HJ,Chen CH,Chen YW,Hu YH

    更新日期:2015-11-01 00:00:00

  • Measuring health status using the Health Utilities Index: agreement between raters and between modalities of administration.

    abstract::The aim of this study was to evaluate interrater and intermodality agreement in assessing health status using the Health Utilities Index. A random sample from a Dutch cohort of 14-year-old Very Low Birth Weight children and their parents were invited to participate in a face-to-face (n = 150) or telephone (n = 150) in...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00317-6

    authors: Verrips GH,Stuifbergen MC,den Ouden AL,Bonsel GJ,Gemke RJ,Paneth N,Verloove-Vanhorick SP

    更新日期:2001-05-01 00:00:00

  • Unconditional and conditional incentives differentially improved general practitioners' participation in an online survey: randomized controlled trial.

    abstract:OBJECTIVES:To compare the impact of unconditional and conditional financial incentives on response rates among Australian general practitioners invited by mail to participate in an online survey about cancer care and to investigate possible differential response bias between incentive groups. STUDY DESIGN AND SETTING:...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jclinepi.2014.09.013

    authors: Young JM,O'Halloran A,McAulay C,Pirotta M,Forsdike K,Stacey I,Currow D

    更新日期:2015-06-01 00:00:00

  • Grading the strength of a body of evidence when assessing health care interventions: an EPC update.

    abstract:OBJECTIVES:To revise 2010 guidance on grading the strength of evidence (SOE) of the effectiveness of drugs, devices, and other preventive and therapeutic interventions in systematic reviews produced by the Evidence-based Practice Center (EPC) program, established by the US Agency for Healthcare Research and Quality (AH...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2014.11.023

    authors: Berkman ND,Lohr KN,Ansari MT,Balk EM,Kane R,McDonagh M,Morton SC,Viswanathan M,Bass EB,Butler M,Gartlehner G,Hartling L,McPheeters M,Morgan LC,Reston J,Sista P,Whitlock E,Chang S

    更新日期:2015-11-01 00:00:00

  • Between iatrotropic stimulus and interiatric referral: the domain of primary care research.

    abstract::The "iatrotropic stimulus" is a typical example of Alvan Feinstein's terminology and his clinical way of thinking about medical research. Feinstein specified "interiatric referral" as an additional important factor affecting "the likelihood that patients will appear at the particular setting in which research is being...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00528-0

    authors: Knottnerus JA

    更新日期:2002-12-01 00:00:00

  • Methods to evaluate risks for composite end points and their individual components.

    abstract:OBJECTIVE:Both randomized and observational studies commonly examine composite end points, but the literature on model development and criticism in this setting is limited. STUDY DESIGN AND SETTING:We examined approaches for evaluating heterogeneity in the effects of risk factors for different components of the end po...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2003.02.001

    authors: Glynn RJ,Rosner B

    更新日期:2004-02-01 00:00:00

  • Systematic reviews reveal unrepresentative evidence for the development of drug formularies for poor and nonwhite populations.

    abstract:OBJECTIVE:To explore implications of using systematic drug class reviews to develop U.S. Medicaid drug formularies. We assess racial/ethnic, gender, and socioeconomic status (SES) concordance between Medicaid populations and studies synthesized in Drug Effectiveness Review Project (DERP) systematic reviews. STUDY DESI...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2009.01.009

    authors: Odierna DH,Bero LA

    更新日期:2009-12-01 00:00:00

  • Health care use by inner-city patients with asthma.

    abstract::The purpose of this study was to describe patterns of health care use by inner-city patients with asthma and to identify patients at risk for hospitalization. We performed a retrospective cohort study of 1788 patients with asthma aged 5 to 34 years from a large hospital-based multi-specialty practice in inner-city Ind...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(96)00333-2

    authors: Murray MD,Stang P,Tierney WM

    更新日期:1997-02-01 00:00:00

  • Self-reported medication use validated through record linkage to national prescribing data.

    abstract:OBJECTIVES:Researchers need to be confident about the reliability of epidemiologic studies that quantify medication use through self-report. Some evidence suggests that psychiatric medications are systemically under-reported. Modern record linkage enables validation of self-report with national prescribing data as gold...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2017.10.013

    authors: Hafferty JD,Campbell AI,Navrady LB,Adams MJ,MacIntyre D,Lawrie SM,Nicodemus K,Porteous DJ,McIntosh AM

    更新日期:2018-02-01 00:00:00

  • Risk of bias assessments for blinding of participants and personnel in Cochrane reviews were frequently inadequate.

    abstract:OBJECTIVES:The objective of this study was to analyze adequacy of judgments about risk of bias (RoB) for blinding of participants and personnel (performance bias) in Cochrane systematic reviews of randomized controlled trials (RCTs). STUDY DESIGN AND SETTING:We extracted judgments and supporting comments for performan...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.05.012

    authors: Barcot O,Boric M,Dosenovic S,Poklepovic Pericic T,Cavar M,Puljak L

    更新日期:2019-09-01 00:00:00