Does updating improve the methodological and reporting quality of systematic reviews?

Abstract:

BACKGROUND:Systematic reviews (SRs) must be of high quality. The purpose of our research was to compare the methodological and reporting quality of original versus updated Cochrane SRs to determine whether updating had improved these two quality dimensions. METHODS:We identified updated Cochrane SRs published in issue 4, 2002 of the Cochrane Library. We assessed the updated and original versions of the SRs using two instruments: the 10 item enhanced Overview Quality Assessment Questionnaire (OQAQ), and an 18-item reporting quality checklist and flow chart based upon the Quality of Reporting of Meta-analyses (QUOROM) statement. At least two reviewers extracted data and assessed quality. We calculated the percentage (with a 95% confidence interval) of 'yes' answers to each question. We calculated mean differences in percentage, 95% confidence intervals and p-values for each of the individual items and the overall methodological quality score of the updated and pre-updated versions using OQAQ. RESULTS:We assessed 53 SRs. There was no significant improvement in the global quality score of the OQAQ (mean difference 0.11 (-0.28; 0.70 p = 0.52)). Updated reviews showed a significant improvement of 18.9 (7.2; 30.6 p < .01) on the OQAQ item assessing whether the conclusions drawn by the author(s) were supported by the data and/or analysis presented in the SR. The QUOROM statement showed that the quality of reporting of Cochrane reviews improved in some areas with updating. Improvements were seen on the items relating to data sources reported in the abstract, with a significant difference of 17.0 (9.8; 28.7 p = 0.01), review methods, reported in the abstract 35 (24.1; 49.1 p = 0.00), searching methods 18.9 (9.7; 31.6 p = 0.01), and data abstraction 18.9 (11.7; 30.9 p = 0.00). CONCLUSION:The overall quality of Cochrane SRs is fair-to-good. Although reporting quality improved on certain individual items there was no overall improvement seen with updating and methodological quality remained unchanged. Further improvement of quality of reporting is possible. There is room for improvement of methodological quality as well. Authors updating reviews should address identified methodological or reporting weaknesses. We recommend to give full attention to both quality domains when updating SRs.

journal_name

BMC Med Res Methodol

authors

Shea B,Boers M,Grimshaw JM,Hamel C,Bouter LM

doi

10.1186/1471-2288-6-27

subject

Has Abstract

pub_date

2006-06-13 00:00:00

pages

27

issn

1471-2288

pii

1471-2288-6-27

journal_volume

6

pub_type

杂志文章
  • Determinants of non- response to a second assessment of lifestyle factors and body weight in the EPIC-PANACEA study.

    abstract:BACKGROUND:This paper discusses whether baseline demographic, socio-economic, health variables, length of follow-up and method of contacting the participants predict non-response to the invitation for a second assessment of lifestyle factors and body weight in the European multi-center EPIC-PANACEA study. METHODS:Over...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-148

    authors: May AM,Adema LE,Romaguera D,Vergnaud AC,Agudo A,Ekelund U,Steffen A,Orfanos P,Slimani N,Rinaldi S,Mouw T,Rohrmann S,Hermann S,Boeing H,Bergmann MM,Jakobsen MU,Overvad K,Wareham NJ,Gonzalez C,Tjonneland A,Halkjaer

    更新日期:2012-09-24 00:00:00

  • Bayes factors for superiority, non-inferiority, and equivalence designs.

    abstract:BACKGROUND:In clinical trials, study designs may focus on assessment of superiority, equivalence, or non-inferiority, of a new medicine or treatment as compared to a control. Typically, evidence in each of these paradigms is quantified with a variant of the null hypothesis significance test. A null hypothesis is assume...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0699-7

    authors: van Ravenzwaaij D,Monden R,Tendeiro JN,Ioannidis JPA

    更新日期:2019-03-29 00:00:00

  • Measuring sidewalk distances using Google Earth.

    abstract:BACKGROUND:Physical activity is an important determinant of health. Walking is the most common physical activity performed by adults and the presence of sidewalks along roads is a determinant of walking. Geographic information systems (GIS) can be used to measure sidewalks; however, GIS sidewalk data are difficult to a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-39

    authors: Janssen I,Rosu A

    更新日期:2012-03-29 00:00:00

  • Overview of systematic reviews of therapeutic ranges: methodologies and recommendations for practice.

    abstract:BACKGROUND:Many medicines are dosed to achieve a particular therapeutic range, and monitored using therapeutic drug monitoring (TDM). The evidence base for a therapeutic range can be evaluated using systematic reviews, to ensure it continues to reflect current indications, doses, routes and formulations, as well as upd...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/s12874-017-0363-z

    authors: Cooney L,Loke YK,Golder S,Kirkham J,Jorgensen A,Sinha I,Hawcutt D

    更新日期:2017-06-02 00:00:00

  • Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity.

    abstract:BACKGROUND:Controlled clinical trials of health care interventions are either explanatory or pragmatic. Explanatory trials test whether an intervention is efficacious; that is, whether it can have a beneficial effect in an ideal situation. Pragmatic trials measure effectiveness; they measure the degree of beneficial ef...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-3-28

    authors: Godwin M,Ruhland L,Casson I,MacDonald S,Delva D,Birtwhistle R,Lam M,Seguin R

    更新日期:2003-12-22 00:00:00

  • Practical considerations for sensitivity analysis after multiple imputation applied to epidemiological studies with incomplete data.

    abstract:BACKGROUND:Multiple Imputation as usually implemented assumes that data are Missing At Random (MAR), meaning that the underlying missing data mechanism, given the observed data, is independent of the unobserved data. To explore the sensitivity of the inferences to departures from the MAR assumption, we applied the meth...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-73

    authors: Héraud-Bousquet V,Larsen C,Carpenter J,Desenclos JC,Le Strat Y

    更新日期:2012-06-08 00:00:00

  • Likelihood-based random-effects meta-analysis with few studies: empirical and simulation studies.

    abstract:BACKGROUND:Standard random-effects meta-analysis methods perform poorly when applied to few studies only. Such settings however are commonly encountered in practice. It is unclear, whether or to what extent small-sample-size behaviour can be improved by more sophisticated modeling. METHODS:We consider likelihood-based...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0618-3

    authors: Seide SE,Röver C,Friede T

    更新日期:2019-01-11 00:00:00

  • Collecting household water usage data: telephone questionnaire or diary?

    abstract:BACKGROUND:Quantitative Microbial Risk Assessment (QMRA), a modelling approach, is used to assess health risks. Inputs into the QMRA process include data that characterise the intensity, frequency and duration of exposure to risk(s). Data gaps for water exposure assessment include the duration and frequency of urban no...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-72

    authors: O'Toole JE,Sinclair MI,Leder K

    更新日期:2009-11-09 00:00:00

  • Empirical study of correlated survival times for recurrent events with proportional hazards margins and the effect of correlation and censoring.

    abstract:BACKGROUND:In longitudinal studies where subjects experience recurrent incidents over a period of time, such as respiratory infections, fever or diarrhea, statistical methods are required to take into account the within-subject correlation. METHODS:For repeated events data with censored failure, the independent increm...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-95

    authors: Villegas R,Julià O,Ocaña J

    更新日期:2013-07-24 00:00:00

  • Evaluation of a modified version of the Posttraumatic Growth Inventory-Short Form.

    abstract:BACKGROUND:Posttraumatic growth is the positive change resulting from traumatic experiences and is typically assessed with retrospective measures like the Posttraumatic Growth Inventory (PTGI). The PTGI was designed to include reference to a specific traumatic event, making it difficult to implement, without change, in...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0344-2

    authors: Kaur N,Porter B,LeardMann CA,Tobin LE,Lemus H,Luxton DD,Millennium Cohort Study Team.

    更新日期:2017-04-20 00:00:00

  • The Global Evidence Mapping Initiative: scoping research in broad topic areas.

    abstract:BACKGROUND:Evidence mapping describes the quantity, design and characteristics of research in broad topic areas, in contrast to systematic reviews, which usually address narrowly-focused research questions. The breadth of evidence mapping helps to identify evidence gaps, and may guide future research efforts. The Globa...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-92

    authors: Bragge P,Clavisi O,Turner T,Tavender E,Collie A,Gruen RL

    更新日期:2011-06-17 00:00:00

  • Writing a discussion section: how to integrate substantive and statistical expertise.

    abstract:BACKGROUND:When discussing results medical research articles often tear substantive and statistical (methodical) contributions apart, just as if both were independent. Consequently, reasoning on bias tends to be vague, unclear and superficial. This can lead to over-generalized, too narrow and misleading conclusions, es...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/s12874-018-0490-1

    authors: Höfler M,Venz J,Trautmann S,Miller R

    更新日期:2018-04-17 00:00:00

  • Best practice for analysis of shared clinical trial data.

    abstract:BACKGROUND:Greater transparency, including sharing of patient-level data for further research, is an increasingly important topic for organisations who sponsor, fund and conduct clinical trials. This is a major paradigm shift with the aim of maximising the value of patient-level data from clinical trials for the benefi...

    journal_title:BMC medical research methodology

    pub_type: 信件

    doi:10.1186/s12874-016-0170-y

    authors: Hollis S,Fletcher C,Lynn F,Urban HJ,Branson J,Burger HU,Tudur Smith C,Sydes MR,Gerlinger C

    更新日期:2016-07-08 00:00:00

  • The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews.

    abstract:BACKGROUND:In the era of evidence based medicine, with systematic reviews as its cornerstone, adequate quality assessment tools should be available. There is currently a lack of a systematically developed and evaluated tool for the assessment of diagnostic accuracy studies. The aim of this project was to combine empiri...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-3-25

    authors: Whiting P,Rutjes AW,Reitsma JB,Bossuyt PM,Kleijnen J

    更新日期:2003-11-10 00:00:00

  • A proof of principle for using adaptive testing in Routine Outcome Monitoring: the efficiency of the Mood and Anxiety Symptoms Questionnaire -Anhedonic Depression CAT.

    abstract:BACKGROUND:In Routine Outcome Monitoring (ROM) there is a high demand for short assessments. Computerized Adaptive Testing (CAT) is a promising method for efficient assessment. In this article, the efficiency of a CAT version of the Mood and Anxiety Symptom Questionnaire, - Anhedonic Depression scale (MASQ-AD) for use ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-4

    authors: Smits N,Zitman FG,Cuijpers P,den Hollander-Gijsman ME,Carlier IV

    更新日期:2012-01-10 00:00:00

  • Nonlinear joint models for individual dynamic prediction of risk of death using Hamiltonian Monte Carlo: application to metastatic prostate cancer.

    abstract:BACKGROUND:Joint models of longitudinal and time-to-event data are increasingly used to perform individual dynamic prediction of a risk of event. However the difficulty to perform inference in nonlinear models and to calculate the distribution of individual parameters has long limited this approach to linear mixed-effe...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0382-9

    authors: Desmée S,Mentré F,Veyrat-Follet C,Sébastien B,Guedj J

    更新日期:2017-07-17 00:00:00

  • Validation of the French version of the Vulnerable Elders Survey-13 (VES-13).

    abstract:BACKGROUND:Identifying and assessing degree and type of frailty among older persons is a major challenge when targeting high risk populations to identify preventive interventions. The Vulnerable Elders Survey-(VES-13) is a simple instrument to identify frailty defined as risk for death, functional decline or institutio...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-0910-x

    authors: Belmin J,Khellaf L,Pariel S,Jarzebowski W,Valembois L,Zeisel J,Lafuente-Lafuente C

    更新日期:2020-02-05 00:00:00

  • Psychometric analysis of the brief symptom inventory 18 (BSI-18) in a representative German sample.

    abstract:BACKGROUND:The BSI-18 contains the three six-item scales somatization, depression, and anxiety as well as the Global Severity Index (GSI), including all 18 items. The BSI-18 is the latest and shortest of the multidimensional versions of the Symptom-Checklist 90-R, but its psychometric properties have not been sufficien...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0283-3

    authors: Franke GH,Jaeger S,Glaesmer H,Barkmann C,Petrowski K,Braehler E

    更新日期:2017-01-26 00:00:00

  • Consistency between stated and revealed preferences: a discrete choice experiment and a behavioural experiment on vaccination behaviour compared.

    abstract:BACKGROUND:Discrete Choice Experiments (DCEs) are increasingly used in studies in healthcare research but there is still little empirical evidence for the predictive value of these hypothetical situations in similar real life circumstances. The aim of this paper is to compare the stated preferences in a DCE and the acc...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0010-5

    authors: Lambooij MS,Harmsen IA,Veldwijk J,de Melker H,Mollema L,van Weert YW,de Wit GA

    更新日期:2015-03-12 00:00:00

  • Incorporating nonlinearity into mediation analyses.

    abstract:BACKGROUND:Mediation is an important issue considered in the behavioral, medical, and social sciences. It addresses situations where the effect of a predictor variable X on an outcome variable Y is explained to some extent by an intervening, mediator variable M. Methods for addressing mediation have been available for ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0296-6

    authors: Knafl GJ,Knafl KA,Grey M,Dixon J,Deatrick JA,Gallo AM

    更新日期:2017-03-21 00:00:00

  • Analytical methods used in estimating the prevalence of HIV/AIDS from demographic and cross-sectional surveys with missing data: a systematic review.

    abstract:BACKGROUND:Sero- prevalence studies often have a problem of missing data. Few studies report the proportion of missing data and even fewer describe the methods used to adjust the results for missing data. The objective of this review was to determine the analytical methods used for analysis in HIV surveys with missing ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00944-w

    authors: Mosha NR,Aluko OS,Todd J,Machekano R,Young T

    更新日期:2020-03-14 00:00:00

  • Automated inter-rater reliability assessment and electronic data collection in a multi-center breast cancer study.

    abstract:BACKGROUND:The choice between paper data collection methods and electronic data collection (EDC) methods has become a key question for clinical researchers. There remains a need to examine potential benefits, efficiencies, and innovations associated with an EDC system in a multi-center medical record review study. MET...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/1471-2288-7-23

    authors: Thwin SS,Clough-Gorr KM,McCarty MC,Lash TL,Alford SH,Buist DS,Enger SM,Field TS,Frost F,Wei F,Silliman RA

    更新日期:2007-06-18 00:00:00

  • Imputation of a true endpoint from a surrogate: application to a cluster randomized controlled trial with partial information on the true endpoint.

    abstract:BACKGROUND:The Anglia Menorrhagia Education Study (AMES) is a randomized controlled trial testing the effectiveness of an education package applied to general practices. Binary data are available from two sources; general practitioner reported referrals to hospital, and referrals to hospital determined by independent a...

    journal_title:BMC medical research methodology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1186/1471-2288-3-17

    authors: Nixon RM,Duffy SW,Fender GR

    更新日期:2003-09-24 00:00:00

  • The use of relative incidence ratios in self-controlled case series studies: an overview.

    abstract:BACKGROUND:The self-controlled case series (SCCS) is a useful design for investigating associations between outcomes and transient exposures. The SCCS design controls for all fixed covariates, but effect modification can still occur. This can be evaluated by including interaction terms in the model which, when exponent...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0225-0

    authors: Hawken S,Potter BK,Little J,Benchimol EI,Mahmud S,Ducharme R,Wilson K

    更新日期:2016-09-23 00:00:00

  • Industry-supported meta-analyses compared with meta-analyses with non-profit or no support: differences in methodological quality and conclusions.

    abstract:BACKGROUND:Studies have shown that industry-sponsored meta-analyses of drugs lack scientific rigour and have biased conclusions. However, these studies have been restricted to certain medical specialities. We compared all industry-supported meta-analyses of drug-drug comparisons with those without industry support. ME...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-8-60

    authors: Jørgensen AW,Maric KL,Tendal B,Faurschou A,Gøtzsche PC

    更新日期:2008-09-09 00:00:00

  • Effectiveness of motivational interviewing, health education and brief advice in a population of smokers who are not ready to quit.

    abstract:BACKGROUND:Motivational Interviewing (MI), Brief Advice (BA) and Health Education (HE) are established smoking cessation induction methods for smokers with low desire to quit. Although randomized controlled trials (RCT's) have been frequently used to assess these interventions the temporal efficacy and effectiveness of...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12874-018-0511-0

    authors: Bani-Yaghoub M,Elhomani A,Catley D

    更新日期:2018-06-13 00:00:00

  • The triple variable index combines information generated over time from common monitoring variables to identify patients expressing distinct patterns of intraoperative physiology.

    abstract:BACKGROUND:Mean arterial pressure (MAP), bispectral index (BIS), and minimum alveolar concentration (MAC) represent valuable, yet dynamic intraoperative monitoring variables. They provide information related to poor outcomes when considered together, however their collective behavior across time has not been characteri...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0660-9

    authors: Schnetz MP,Hochheiser HS,Danks DJ,Landsittel DP,Vogt KM,Ibinson JW,Whitehurst SL,McDermott SP,Duque MG,Kaynar AM

    更新日期:2019-01-14 00:00:00

  • New journal selection for quantitative survey of infectious disease research: application for Asian trend analysis.

    abstract:BACKGROUND:Quantitative survey of research articles, as an application of bibliometrics, is an effective tool for grasping overall trends in various medical research fields. This type of survey has been also applied to infectious disease research; however, previous studies were insufficient as they underestimated artic...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-67

    authors: Takahashi-Omoe H,Omoe K,Okabe N

    更新日期:2009-10-06 00:00:00

  • Measuring health-related quality of life in chronic obstructive pulmonary disease: properties of the EQ-5D-5L and PROMIS-43 short form.

    abstract:BACKGROUND:The Patient Reported Outcomes Measurement Information System 43-item short form (PROMIS-43) and the five-level EQ-5D (EQ-5D-5L) are recently developed measures of health-related quality of life (HRQL) that have potentially broad application in evaluating treatments and capturing burden of respiratory-related...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/1471-2288-14-78

    authors: Lin FJ,Pickard AS,Krishnan JA,Joo MJ,Au DH,Carson SS,Gillespie S,Henderson AG,Lindenauer PK,McBurnie MA,Mularski RA,Naureckas ET,Vollmer WM,Lee TA,CONCERT Consortium.

    更新日期:2014-06-16 00:00:00

  • Measurement and control of bias in patient reported outcomes using multidimensional item response theory.

    abstract:BACKGROUND:Patient-reported outcome (PRO) measures play a key role in the advancement of patient-centered care research. The accuracy of inferences, relevance of predictions, and the true nature of the associations made with PRO data depend on the validity of these measures. Errors inherent to self-report measures can ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0161-z

    authors: Dowling NM,Bolt DM,Deng S,Li C

    更新日期:2016-05-26 00:00:00