The fading of reported effectiveness. A meta-analysis of randomised controlled trials.

Abstract:

BACKGROUND:The "real" effect size of a medical therapy is constant over time. In contrast, the effect size reported in randomised controlled trials (RCTs) may change over time because the sum of all kinds of bias influencing the reported effectiveness is not necessarily constant. As this would affect the validity of meta-analyses, we tested the hypothesis that the reported effect size decreases over time. Furthermore, we tested three hypotheses that would explain a possible change. METHODS:Because of well established outcome measures, the lipid-lowering drugs Pravastatin and Atorvastatin (serum low-density lipoprotein cholesterol, LDL-C) and the anti-glaucoma drugs Timolol and Latanoprost (intraocular pressure, IOP) were chosen for this investigation. Studies were identified by a standardized MEDLINE search. RCTs investigating the above identified medications administered as monotherapy, and in defined dosages, were included. Publication year, baseline (= pre-treatment value in the treatment group of interest) and post intervention means, number of patients and the assignment to experimental or control group were extracted for each study. RESULTS:A total of 625 citations were screened; 206 met the inclusion criteria. The reported effect size of Pravastatin (change of reported effect size in five years: -3.22% LDL-C, P < .0001), Timolol (-0.56 mmHg, P < .0001) and Latanoprost (-1.78 mmHg, P = .0074) decreased over time, while there was no significant change for Atorvastatin (+0.31% LDL-C, P = .8618). Multiple regression analysis showed that baseline values were the most important influencing factor; study size or treatment group did not play a significant role. CONCLUSION:The effectiveness of medical therapies reported in RCTs decreases over time in three of the four investigated pharmaceuticals, caused mainly by baseline differences. We call this phenomenon "fading of reported effectiveness". Under this condition the validity of a meta-analysis may be impaired. Therefore we propose to observe this phenomenon in future meta-analyses in order to guarantee a maximum of transparency.

journal_name

BMC Med Res Methodol

authors

Gehr BT,Weiss C,Porzsolt F

doi

10.1186/1471-2288-6-25

subject

Has Abstract

pub_date

2006-05-11 00:00:00

pages

25

issn

1471-2288

pii

1471-2288-6-25

journal_volume

6

pub_type

杂志文章,meta分析
  • Parental compliance--an emerging problem in Liverpool community child health surveys 1991-2006.

    abstract:BACKGROUND:Compliance is a critical issue for parental questionnaires in school based epidemiological surveys and high compliance is difficult to achieve. The objective of this study was to determine trends and factors associated with parental questionnaire compliance during respiratory health surveys of school childre...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-53

    authors: Koshy G,Brabin BJ

    更新日期:2012-04-20 00:00:00

  • Imputation of a true endpoint from a surrogate: application to a cluster randomized controlled trial with partial information on the true endpoint.

    abstract:BACKGROUND:The Anglia Menorrhagia Education Study (AMES) is a randomized controlled trial testing the effectiveness of an education package applied to general practices. Binary data are available from two sources; general practitioner reported referrals to hospital, and referrals to hospital determined by independent a...

    journal_title:BMC medical research methodology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1186/1471-2288-3-17

    authors: Nixon RM,Duffy SW,Fender GR

    更新日期:2003-09-24 00:00:00

  • Bikeability and methodological issues using the active commuting route environment scale (ACRES) in a metropolitan setting.

    abstract:BACKGROUND:Route environments can positively influence people's active commuting and thereby contribute to public health. The Active Commuting Route Environment Scale (ACRES) was developed to study active commuters' perceptions of their route environments. However, bicycle commuters represent a small portion of the pop...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-6

    authors: Wahlgren L,Schantz P

    更新日期:2011-01-17 00:00:00

  • Automated inter-rater reliability assessment and electronic data collection in a multi-center breast cancer study.

    abstract:BACKGROUND:The choice between paper data collection methods and electronic data collection (EDC) methods has become a key question for clinical researchers. There remains a need to examine potential benefits, efficiencies, and innovations associated with an EDC system in a multi-center medical record review study. MET...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/1471-2288-7-23

    authors: Thwin SS,Clough-Gorr KM,McCarty MC,Lash TL,Alford SH,Buist DS,Enger SM,Field TS,Frost F,Wei F,Silliman RA

    更新日期:2007-06-18 00:00:00

  • A proof of principle for using adaptive testing in Routine Outcome Monitoring: the efficiency of the Mood and Anxiety Symptoms Questionnaire -Anhedonic Depression CAT.

    abstract:BACKGROUND:In Routine Outcome Monitoring (ROM) there is a high demand for short assessments. Computerized Adaptive Testing (CAT) is a promising method for efficient assessment. In this article, the efficiency of a CAT version of the Mood and Anxiety Symptom Questionnaire, - Anhedonic Depression scale (MASQ-AD) for use ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-4

    authors: Smits N,Zitman FG,Cuijpers P,den Hollander-Gijsman ME,Carlier IV

    更新日期:2012-01-10 00:00:00

  • Understanding human functioning using graphical models.

    abstract:BACKGROUND:Functioning and disability are universal human experiences. However, our current understanding of functioning from a comprehensive perspective is limited. The development of the International Classification of Functioning, Disability and Health (ICF) on the one hand and recent developments in graphical model...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-10-14

    authors: Kalisch M,Fellinghauer BA,Grill E,Maathuis MH,Mansmann U,Bühlmann P,Stucki G

    更新日期:2010-02-11 00:00:00

  • Mechanisms and pathways to impact in public health research: a preliminary analysis of research funded by the National Institute for Health Research (NIHR).

    abstract:BACKGROUND:The mechanisms and pathways to impacts from public health research in the UK have not been widely studied. Through the lens of one funder (NIHR), our aims are to map the diversity of public health research, in terms of funding mechanisms, disciplinary contributions, and public health impacts, identify exampl...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-0905-7

    authors: Boulding H,Kamenetzky A,Ghiga I,Ioppolo B,Herrera F,Parks S,Manville C,Guthrie S,Hinrichs-Krapels S

    更新日期:2020-02-19 00:00:00

  • Testing the treatment effect on competing causes of death in oncology clinical trials.

    abstract:BACKGROUND:Chemotherapy is expected to reduce cancer deaths (CD), while possibly being harmful in terms of non-cancer deaths (NCD) because of toxicity. Peto's log-rank test is popular in the medical literature, but its operating characteristics are barely known. We compared this test to the most common ones in the stat...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-14-72

    authors: Rotolo F,Michiels S

    更新日期:2014-05-29 00:00:00

  • Consensus workshops on the development of an ADHD medication management protocol using QbTest: developing a clinical trial protocol with multidisciplinary stakeholders.

    abstract:BACKGROUND:The study design and protocol that underpin a randomised controlled trial (RCT) are critical for the ultimate success of the trial. Although RCTs are considered the gold standard for research, there are multiple threats to their validity such as participant recruitment and retention, identifying a meaningful...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0772-2

    authors: Hall CL,Brown S,James M,Martin JL,Brown N,Selby K,Clarke J,Williams L,Sayal K,Hollis C,Groom MJ

    更新日期:2019-06-18 00:00:00

  • Validation of death prediction after breast cancer relapses using joint models.

    abstract:BACKGROUND:Cancer relapses may be useful to predict the risk of death. To take into account relapse information, the Landmark approach is popular. As an alternative, we propose the joint frailty model for a recurrent event and a terminal event to derive dynamic predictions of the risk of death. METHODS:The proposed pr...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0018-x

    authors: Mauguen A,Rachet B,Mathoulin-Pélissier S,Lawrence GM,Siesling S,MacGrogan G,Laurent A,Rondeau V

    更新日期:2015-04-01 00:00:00

  • Enhanced reporting of deaths among Aboriginal and Torres Strait Islander peoples using linked administrative health datasets.

    abstract:BACKGROUND:Aboriginal and Torres Strait Islander peoples are under-reported in administrative health datasets in NSW, Australia. Correct reporting of Aboriginal and Torres Strait Islander peoples is essential to measure the effectiveness of policies and programmes aimed at reducing the health disadvantage experienced b...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-91

    authors: Taylor LK,Bentley J,Hunt J,Madden R,McKeown S,Brandt P,Baker D

    更新日期:2012-07-02 00:00:00

  • Effort, reward and self-reported mental health: a simulation study on negative affectivity bias.

    abstract:BACKGROUND:In the present article, we propose an alternative method for dealing with negative affectivity (NA) biases in research, while investigating the association between a deleterious psychosocial environment at work and poor mental health. First, we investigated how strong NA must be to cause an observed correlat...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-121

    authors: Arial M,Wild P

    更新日期:2011-08-24 00:00:00

  • Crowding in the emergency department in the absence of boarding - a transition regression model to predict departures and waiting time.

    abstract:BACKGROUND:Crowding in the emergency department (ED) is associated with increased mortality, increased treatment cost, and reduced quality of care. Crowding arises when demand exceed resources in the ED and a first sign may be increasing waiting time. We aimed to quantify predictors for departure from the ED, and relat...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0710-3

    authors: Eiset AH,Kirkegaard H,Erlandsen M

    更新日期:2019-03-29 00:00:00

  • Estimating the loss of lifetime function using flexible parametric relative survival models.

    abstract:BACKGROUND:Within cancer care, dynamic evaluations of the loss in expectation of life provides useful information to patients as well as physicians. The loss of lifetime function yields the conditional loss in expectation of life given survival up to a specific time point. Due to the inevitable censoring in time-to-eve...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0661-8

    authors: Jakobsen LH,Andersson TM,Biccler JL,El-Galaly TC,Bøgsted M

    更新日期:2019-01-28 00:00:00

  • Novel study design to assess the utility of the copd assessment test in a primary care setting.

    abstract::The quality of a consultation provided by a physician can have a profound impact on the quality of care and patient engagement in treatment decisions. When the COPD Assessment Test (CAT) was developed, one of its aims was to aid the communication between physician and patient about the impact of COPD. We developed a n...

    journal_title:BMC medical research methodology

    pub_type: 信件

    doi:10.1186/1471-2288-13-63

    authors: Gruffydd-Jones K,Marsden H,Holmes S,Kardos P,Escamilla R,Dal Negro R,Roberts J,Nadeau G,Leather D,Jones P

    更新日期:2013-05-10 00:00:00

  • Centralising and optimising decentralised stroke care systems: a simulation study on short-term costs and effects.

    abstract:BACKGROUND:Centralisation of thrombolysis may offer substantial benefits. The aim of this study was to assess short term costs and effects of centralisation of thrombolysis and optimised care in a decentralised system. METHODS:Using simulation modelling, three scenarios to improve decentralised settings in the North o...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/s12874-016-0275-3

    authors: Lahr MM,van der Zee DJ,Luijckx GJ,Vroomen PC,Buskens E

    更新日期:2017-01-10 00:00:00

  • Survival prediction models since liver transplantation - comparisons between Cox models and machine learning techniques.

    abstract:BACKGROUND:Predicting survival of recipients after liver transplantation is regarded as one of the most important challenges in contemporary medicine. Hence, improving on current prediction models is of great interest.Nowadays, there is a strong discussion in the medical field about machine learning (ML) and whether it...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01153-1

    authors: Kantidakis G,Putter H,Lancia C,Boer J,Braat AE,Fiocco M

    更新日期:2020-11-16 00:00:00

  • Likelihood-based random-effects meta-analysis with few studies: empirical and simulation studies.

    abstract:BACKGROUND:Standard random-effects meta-analysis methods perform poorly when applied to few studies only. Such settings however are commonly encountered in practice. It is unclear, whether or to what extent small-sample-size behaviour can be improved by more sophisticated modeling. METHODS:We consider likelihood-based...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0618-3

    authors: Seide SE,Röver C,Friede T

    更新日期:2019-01-11 00:00:00

  • Error in statistical tests of error in statistical tests.

    abstract:BACKGROUND:A recent paper found that terminal digits of statistical values in Nature deviated significantly from an equiprobable distribution, indicating errors or inconsistencies in rounding. This finding, as well as the discovery that a large percentage of p values were inconsistent with reported test statistics, led...

    journal_title:BMC medical research methodology

    pub_type: 评论,杂志文章

    doi:10.1186/1471-2288-6-45

    authors: Jeng M

    更新日期:2006-09-13 00:00:00

  • Participant recruitment in sensitive surveys: a comparative trial of 'opt in' versus 'opt out' approaches.

    abstract:BACKGROUND:Although in health services survey research we strive for a high response rate, this must be balanced against the need to recruit participants ethically and considerately, particularly in surveys with a sensitive nature. In survey research there are no established recommendations to guide recruitment approac...

    journal_title:BMC medical research methodology

    pub_type: 临床试验,杂志文章

    doi:10.1186/1471-2288-13-3

    authors: Hunt KJ,Shlomo N,Addington-Hall J

    更新日期:2013-01-11 00:00:00

  • Best practice for analysis of shared clinical trial data.

    abstract:BACKGROUND:Greater transparency, including sharing of patient-level data for further research, is an increasingly important topic for organisations who sponsor, fund and conduct clinical trials. This is a major paradigm shift with the aim of maximising the value of patient-level data from clinical trials for the benefi...

    journal_title:BMC medical research methodology

    pub_type: 信件

    doi:10.1186/s12874-016-0170-y

    authors: Hollis S,Fletcher C,Lynn F,Urban HJ,Branson J,Burger HU,Tudur Smith C,Sydes MR,Gerlinger C

    更新日期:2016-07-08 00:00:00

  • Onset of persistent pseudomonas aeruginosa infection in children with cystic fibrosis with interval censored data.

    abstract:BACKGROUND:Persistent Pseudomonas aeruginosa (PPA) infection promotes lung function deterioration in children with cystic fibrosis (CF). Although early CF diagnosis through newborn screening (NBS) has been shown to provide nutritional/growth benefit, it is unclear whether NBS lowers the risk of PPA infection and how th...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0220-5

    authors: Wang W,Chen MH,Chiou SH,Lai HC,Wang X,Yan J,Zhang Z

    更新日期:2016-09-17 00:00:00

  • Sample size calculations for cluster randomised controlled trials with a fixed number of clusters.

    abstract:BACKGROUND:Cluster randomised controlled trials (CRCTs) are frequently used in health service evaluation. Assuming an average cluster size, required sample sizes are readily computed for both binary and continuous outcomes, by estimating a design effect or inflation factor. However, where the number of clusters are fix...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-102

    authors: Hemming K,Girling AJ,Sitch AJ,Marsh J,Lilford RJ

    更新日期:2011-06-30 00:00:00

  • The efficiency and effectiveness of utilizing diagrams in interviews: an assessment of participatory diagramming and graphic elicitation.

    abstract:BACKGROUND:This paper focuses on measuring the efficiency and effectiveness of two diagramming methods employed in key informant interviews with clinicians and health care administrators. The two methods are 'participatory diagramming', where the respondent creates a diagram that assists in their communication of answe...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-8-53

    authors: Umoquit MJ,Dobrow MJ,Lemieux-Charles L,Ritvo PG,Urbach DR,Wodchis WP

    更新日期:2008-08-08 00:00:00

  • Is a large scale community programme as effective as a community rehabilitation programme delivered in the setting of a clinical trial?

    abstract:BACKGROUND:The rationale for commissioning community pulmonary rehabilitation programmes is based on evidence from randomised clinical trials. However, there are a number of reasons why similar programmes might be less effective outside the environment of a clinical trial. These include a less highly selected patient g...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-103

    authors: Goyder EC,Strong M,Green A,Holmes MW,Miles G,Reddington O,Lawson R,Lee A,Basran G

    更新日期:2013-08-13 00:00:00

  • The use of individual cut points from treadmill walking to assess free-living moderate to vigorous physical activity in obese subjects by accelerometry: is it useful?

    abstract:BACKGROUND:Variation in counts between subjects at a given speed or work rate are the most important source of error in physical activity (PA) measurements with accelerometers. The aim of this study was to explore how the use of individual accelerometer cut points (ICPs) affected the analysis of PA field data. METHODS...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-172

    authors: Aadland E,Steene-Johannessen J

    更新日期:2012-11-15 00:00:00

  • Psychometric properties of an English short version of the Trier Inventory for chronic Stress.

    abstract:BACKGROUND:Although a variety of instruments are available that capture stress experience, the assessment of chronic stress has been hindered by the lack of economical screening instruments. Recently, an English-language version of the Trier Inventory for Chronic Stress (TICS-EN) consisting of 57 items according to a s...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01156-y

    authors: Petrowski K,Braehler E,Schmalbach B,Hinz A,Bastianon C,Ritz T

    更新日期:2020-12-16 00:00:00

  • The triple variable index combines information generated over time from common monitoring variables to identify patients expressing distinct patterns of intraoperative physiology.

    abstract:BACKGROUND:Mean arterial pressure (MAP), bispectral index (BIS), and minimum alveolar concentration (MAC) represent valuable, yet dynamic intraoperative monitoring variables. They provide information related to poor outcomes when considered together, however their collective behavior across time has not been characteri...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0660-9

    authors: Schnetz MP,Hochheiser HS,Danks DJ,Landsittel DP,Vogt KM,Ibinson JW,Whitehurst SL,McDermott SP,Duque MG,Kaynar AM

    更新日期:2019-01-14 00:00:00

  • Validating and updating a risk model for pneumonia - a case study.

    abstract:BACKGROUND:The development of risk prediction models is of increasing importance in medical research - their use in practice, however, is rare. Among other reasons this might be due to the fact that thorough validation is often lacking. This study focuses on two Bayesian approaches of how to validate a prediction rule ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-99

    authors: Held U,Bové DS,Steurer J,Held L

    更新日期:2012-07-20 00:00:00

  • Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity.

    abstract:BACKGROUND:Controlled clinical trials of health care interventions are either explanatory or pragmatic. Explanatory trials test whether an intervention is efficacious; that is, whether it can have a beneficial effect in an ideal situation. Pragmatic trials measure effectiveness; they measure the degree of beneficial ef...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-3-28

    authors: Godwin M,Ruhland L,Casson I,MacDonald S,Delva D,Birtwhistle R,Lam M,Seguin R

    更新日期:2003-12-22 00:00:00