Outcomes in systematic reviews of complex interventions never reached "high" GRADE ratings when compared with those of simple interventions.

Abstract:

OBJECTIVES:To investigate the application of the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach and the quality of evidence ratings in systematic reviews of complex interventions. STUDY DESIGN AND SETTING:This study examined all 40 systematic reviews published in three Cochrane Review Groups from 2013 to May 2014: Cochrane Developmental, Psychosocial and Learning Problems Group (CDPLPG); Cochrane Public Health Group (CPHG); and Cochrane Depression, Anxiety, and Neurosis Group (CCDAN). The reviews were coded and classified into "complex" (n = 24) and "simple" (n = 16) intervention review groups based on the predefined complexity dimensions from the extant literature mapped into the PICOTS framework. All the data were analyzed in these two groups to help identify specific patterns of the GRADE ratings in the reviews of complex interventions. RESULTS:Outcomes of complex intervention reviews had higher proportions of "very low" quality of evidence ratings compared with those of simple intervention reviews (37.5% vs. 9.1% for the primary benefit outcomes) and were more frequently downgraded for inconsistency, performance bias, and study design. None of the outcomes of complex intervention reviews (0%) were given "high" GRADE ratings. CONCLUSION:Results suggest that the GRADE assessment may not adequately describe the evidence base of complex interventions.

journal_name

J Clin Epidemiol

authors

Movsisyan A,Melendez-Torres GJ,Montgomery P

doi

10.1016/j.jclinepi.2016.03.014

subject

Has Abstract

pub_date

2016-10-01 00:00:00

pages

22-33

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(16)30026-9

journal_volume

78

pub_type

杂志文章,评审
  • Cross-cultural adaptation of Roland-Morris Disability Questionnaire needs to assess the measurement properties: a systematic review.

    abstract:OBJECTIVE:To assess the cross-cultural adaptations of the Roland-Morris Disability Questionnaire (RMDQ). STUDY DESIGN AND SETTING:English and Chinese databases were searched through December 2017. Cross-cultural adaptation and measurement properties were evaluated using the Guidelines for the Process of Cross-Cultural...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2018.03.011

    authors: Yao M,Zhu S,Tian ZR,Song YJ,Yang L,Wang YJ,Cui XJ

    更新日期:2018-07-01 00:00:00

  • Three ways to quantify uncertainty in individually applied "minimally important change" values.

    abstract:OBJECTIVE:Determining "minimally important change" (MIC) facilitates the interpretation of change scores on multi-item instruments. This article focuses on how MIC values should be interpreted when applied to individual patients. STUDY DESIGN AND SETTING:The MIC value of a hypothetical questionnaire "Q" was determined...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2009.03.011

    authors: de Vet HC,Terluin B,Knol DL,Roorda LD,Mokkink LB,Ostelo RW,Hendriks EJ,Bouter LM,Terwee CB

    更新日期:2010-01-01 00:00:00

  • Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses.

    abstract:OBJECTIVES:To evaluate meta-analyses with trial sequential analysis (TSA). TSA adjusts for random error risk and provides the required number of participants (information size) in a meta-analysis. Meta-analyses not reaching information size are analyzed with trial sequential monitoring boundaries analogous to interim m...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2007.10.007

    authors: Brok J,Thorlund K,Gluud C,Wetterslev J

    更新日期:2008-08-01 00:00:00

  • Time-dependent variability in repeated measurements of cholesterol levels: clinical implications for risk misclassification and intervention monitoring.

    abstract::Intraindividual variability (IIV) in total cholesterol levels based on measurements taken 1 week apart is compared with an estimate based on measurements taken 2 years apart. Single-subject 95% confidence intervals around the mean of two repeated measurements were Xi +/- 21 and +/- 28 mg/dl, respectively, and Xi +/- 3...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(93)90115-h

    authors: Roeback JR,Cook JR,Guess HA,Heyse JF

    更新日期:1993-10-01 00:00:00

  • Mortality in a population with long-term exposure to inorganic selenium via drinking water.

    abstract::We analyzed the 1986-1997 mortality in a cohort of 2065 residents of an Italian municipality which had been exposed to drinking water with a high content of inorganic selenium over a long period of time, and compared it with mortality in the remainder of the municipal population. Mortality from malignant neoplasms inc...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00233-x

    authors: Vinceti M,Nacci G,Rocchi E,Cassinadri T,Vivoli R,Marchesi C,Bergomi M

    更新日期:2000-10-01 00:00:00

  • The use of clinical trials in comparative effectiveness research on mental health.

    abstract:OBJECTIVES:A large body of comparative effectiveness research (CER) focuses on the use of observational and quasi-experimental approaches. We sought to examine the use of clinical trials as a tool for CER, particularly in mental health. STUDY DESIGN AND SETTING:Examination of three ongoing randomized clinical trials i...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.02.013

    authors: Blanco C,Rafful C,Olfson M

    更新日期:2013-08-01 00:00:00

  • An embedded mixed-methods study highlighted a lack of discussions on retention in clinical trial consultations.

    abstract:OBJECTIVES:This study investigated trial consultations to identify whether and to what extent discussions of retention are present. STUDY DESIGN AND SETTING:This embedded mixed-methods study design included a purposive sample of audio-recorded trial consultations obtained from four sites of a large multicenter UK-base...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2020.03.011

    authors: Tunji-Ajayi P,Duncan EM,Gillies K

    更新日期:2020-07-01 00:00:00

  • Assessment of sun sensitivity by questionnaire: validity of items and formulation of a prediction rule.

    abstract::Sun sensitivity is a major risk factor for melanoma, basal cell carcinoma, and squamous cell carcinoma of the skin. Several variables have been used in epidemiologic studies to measure sun sensitivity. The present study assesses their validity and combines them to form a prediction rule for an objective measure of sun...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90104-u

    authors: Weinstock MA

    更新日期:1992-05-01 00:00:00

  • An international survey indicated that unpublished systematic reviews exist.

    abstract:OBJECTIVE:To determine the frequency of unpublished systematic reviews (SRs) and explore factors contributing to their occurrence. STUDY DESIGN AND SETTING:First or corresponding authors from a sample of SRs published in 2005 were asked to participate in a 26-item survey administered through the Internet, facsimile, a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2008.09.014

    authors: Tricco AC,Pham B,Brehaut J,Tetroe J,Cappelli M,Hopewell S,Lavis JN,Berlin JA,Moher D

    更新日期:2009-06-01 00:00:00

  • Hematocrit was not validated as a surrogate end point for survival among epoetin-treated hemodialysis patients.

    abstract:OBJECTIVE:To evaluate the use of hematocrit as a surrogate end point for survival among end-stage renal disease (ESRD) patients treated with epoetin. STUDY DESIGN AND SETTING:Using United States Renal Data System (USRDS) data, we conducted an observational prospective study to analyze the relationships among epoetin d...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.05.002

    authors: Cotter DJ,Stefanik K,Zhang Y,Thamer M,Scharfstein D,Kaufman J

    更新日期:2004-10-01 00:00:00

  • Multivariable adjustments counteract spectrum and test review bias in accuracy studies.

    abstract:OBJECTIVES:The STAndards for Reporting studies of Diagnostic accuracy (STARD) for investigators and editors and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) for reviewers and readers offer guidelines for the quality and reporting of test accuracy studies. These guidelines address and propose some solu...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2008.02.007

    authors: Bachmann LM,ter Riet G,Weber WE,Kessels AG

    更新日期:2009-04-01 00:00:00

  • Measuring health status using the Health Utilities Index: agreement between raters and between modalities of administration.

    abstract::The aim of this study was to evaluate interrater and intermodality agreement in assessing health status using the Health Utilities Index. A random sample from a Dutch cohort of 14-year-old Very Low Birth Weight children and their parents were invited to participate in a face-to-face (n = 150) or telephone (n = 150) in...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00317-6

    authors: Verrips GH,Stuifbergen MC,den Ouden AL,Bonsel GJ,Gemke RJ,Paneth N,Verloove-Vanhorick SP

    更新日期:2001-05-01 00:00:00

  • Controversy and Debate Series on Core Outcome Sets. Paper 1: Improving the generalizability and credibility of core outcome sets (COS) by a large and international participation of diverse stakeholders.

    abstract::Core outcome sets (COSs) are agreed-on standardized sets of outcomes that should be minimally measured in all trials of a given disease. To enhance the uptake of COSs in trials, their generalizability should be increased by a change in the number and diversity of stakeholders involved in their development. Also, their...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2020.01.004

    authors: Chevance A,Tran VT,Ravaud P

    更新日期:2020-09-01 00:00:00

  • Epidemiologic studies of electric and magnetic fields and cancer: a case study of distortions by the media.

    abstract::Articles alleging hazards of electric or magnetic fields, based on epidemiologic studies, have appeared in the popular press. Some of these articles, which contain distortions of the scientific evidence, have been cited in the scientific and medical literature, thereby being given some degree of apparent legitimacy. I...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90154-f

    authors: Jauchem JR

    更新日期:1992-10-01 00:00:00

  • Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings.

    abstract:OBJECTIVE:The uptake of research findings into routine health care is a haphazard and unpredictable process. The usefulness of the results of implementation studies is limited, due in part to the lack of an underlying framework of the important dimensions of research studies in this area and the healthcare settings wit...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.09.002

    authors: Eccles M,Grimshaw J,Walker A,Johnston M,Pitts N

    更新日期:2005-02-01 00:00:00

  • Factors relevant to preventing embolic stroke in patients with non-rheumatic atrial fibrillation.

    abstract::Whether or not to treat patients with non-rheumatic atrial fibrillation with anticoagulants to prevent embolic stroke is a dilemma for physicians. If randomized trials, currently underway, demonstrate a beneficial effect, the dilemma will not be solved because not all of the relevant factors can be addressed by trials...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(91)90219-y

    authors: Flegel KM,Hutchinson TA,Groome PA,Tousignant P

    更新日期:1991-01-01 00:00:00

  • A prospective study of psychological and socioeconomic characteristics, health behavior and morbidity in cigarette smokers prior to quitting compared to persistent smokers and non-smokers.

    abstract::Psychosocial factors influencing smoking cessation were studied in current smokers prior to quitting. Two questionnaires were sent in 1975 and 1981 to adult members of the Finnish Twin Cohort. The 1975 response rate was 89%, and 89% of those eligible replied again in 1981. Analysis was done on data from one twin pair ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90088-1

    authors: Kaprio J,Koskenvuo M

    更新日期:1988-01-01 00:00:00

  • Identifying studies for systematic reviews of diagnostic tests was difficult due to the poor sensitivity and precision of methodologic filters and the lack of information in the abstract.

    abstract:BACKGROUND AND OBJECTIVES:Methods to identify studies for systematic reviews of diagnostic accuracy are less well developed than for reviews of intervention studies. This study assessed (1) the sensitivity and precision of five published search strategies and (2) the reliability and accuracy of reviewers screening the ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.09.011

    authors: Doust JA,Pietrzak E,Sanders S,Glasziou PP

    更新日期:2005-05-01 00:00:00

  • A novel research design can aid disinvestment from existing health technologies with uncertain effectiveness, cost-effectiveness, and/or safety.

    abstract:OBJECTIVES:Disinvestment is critical for ensuring the long-term sustainability of health-care services. Key barriers to disinvestment are heterogeneity between research and clinical settings, absence of evidence of effectiveness of some health technologies, and exposure of patients and organizations to risks and poor o...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2013.08.014

    authors: Haines T,O'Brien L,McDermott F,Markham D,Mitchell D,Watterson D,Skinner E

    更新日期:2014-02-01 00:00:00

  • Congestive heart failure and outpatient risk of venous thromboembolism: a retrospective, case-control study.

    abstract::Although CHF has been considered a risk factor for venous thromboembolism, this has not been directly studied. We hypothesized that congestive heart failure would increase the risk of venous thromboembolism in an outpatient population, and that this risk would increase as patients' ventricular function worsened. We co...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(00)00373-5

    authors: Howell MD,Geraci JM,Knowlton AA

    更新日期:2001-08-01 00:00:00

  • Dyspepsia: how should we measure it?

    abstract::This study developed and validated a multidimensional measure of dyspepsia. A questionnaire was administered to 126 patients with dyspepsia who presented for care at a VA outpatient clinic and a family physician's private office. Dyspepsia-specific health was measured by self-report using: (1) an existing dyspepsia sc...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00245-x

    authors: Kuykendall DH,Rabeneck L,Campbell CJ,Wray NP

    更新日期:1998-02-01 00:00:00

  • Review of mixed treatment comparisons in published systematic reviews shows marked increase since 2009.

    abstract:OBJECTIVES:To identify and summarize published systematic reviews that report results of meta-analyses that combined direct and indirect comparisons. STUDY DESIGN AND SETTING:Narrative review of mixed treatment comparisons (MTCs) reported in systematic reviews of health interventions. MEDLINE, MEDLINE In-Process, Emba...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2013.07.014

    authors: Lee AW

    更新日期:2014-02-01 00:00:00

  • Impact of reminders and method of questionnaire distribution on patient response to mail-back satisfaction survey.

    abstract::Nonresponse and methods of data collection could affect satisfaction measurement. The goal of this study was to estimate the impact of (1) nonresponse and (2) distribution method on evaluation of patient satisfaction in a mail-back study measuring patient opinion of medical and nursing care. The study was conducted in...

    journal_title:Journal of clinical epidemiology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1016/s0895-4356(01)00387-0

    authors: Gasquet I,Falissard B,Ravaud P

    更新日期:2001-11-01 00:00:00

  • Insulin sensitivity markers: predictors of accidents and suicides in Helsinki Heart Study screenees.

    abstract::The purpose of this study was to evaluate whether elements signifying relative insulin sensitivity (IS) were prospectively linked to accidents and suicides in 14,976 Helsinki Heart Study (HHS) screenees. The main outcome measure was hospitalizations and deaths from accidents and suicide attempts determined from Finnis...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(02)00407-9

    authors: Golomb BA,Tenkanen L,Alikoski T,Niskanen T,Manninen V,Huttunen M,Mednick SA

    更新日期:2002-08-01 00:00:00

  • A study of the noninstrumented physical examination of the knee found high observer variability.

    abstract:OBJECTIVE:This study estimated the inter- and intraobserver reliability of a set of noninstrumented physical examination measures for knee pain in older adults. STUDY DESIGN AND SETTING:Forty-five patients from primary care, and 13 patients from secondary care, were each examined by two out of a team of three physical...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.11.004

    authors: Wood L,Peat G,Wilkie R,Hay E,Thomas E,Sim J

    更新日期:2006-05-01 00:00:00

  • Factors associated with serum HCV RNA positivity in anti-HCV antibody positive intravenous drug users.

    abstract::Serum hepatitis C virus (HCV) RNA, HCV genotypes and liver function tests were evaluated in a series of 189 unselected, consecutive anti-HCV positive intravenous drug users (IVDUs). Serum HCV RNA was detected in 106/189 patients. Abnormal liver function tests were associated with alcohol abuse, but not with the presen...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00305-3

    authors: Pirisi M,Toniutto P,Fabris C,Lombardelli T,Falleti E,Tisminetzky SG,Baralle F,Bartoli E

    更新日期:1998-05-01 00:00:00

  • A systematic review identified few methods and strategies describing when and how to update systematic reviews.

    abstract:OBJECTIVE:Systematic reviews (SRs) are convenient summaries of evidence for health care practitioners. They form a basis for clinical practice guidelines and suggest directions for new research. SRs are most helpful if they are current; however, most of them are not being updated. This SR summarizes strategies and meth...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2007.03.008

    authors: Moher D,Tsertsvadze A,Tricco AC,Eccles M,Grimshaw J,Sampson M,Barrowman N

    更新日期:2007-11-01 00:00:00

  • Diagnostic interpretation of electrocardiograms in population-based research: computer program research physicians, or cardiologists?

    abstract::We assessed the performance of diagnostic electrocardiogram (ECG) interpretation by the computer program MEANS and by research physicians, compared to cardiologists, in a physician-based study. To establish a strategy for ECG interpretation in health surveys, we also studied the diagnostic capacity of three scenarios:...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(97)00100-5

    authors: de Bruyne MC,Kors JA,Hoes AW,Kruijssen DA,Deckers JW,Grosfeld M,van Herpen G,Grobbee DE,van Bemmel JH

    更新日期:1997-08-01 00:00:00

  • Reproducibility and validity of a food frequency questionnaire in a case-control study on breast cancer.

    abstract::A 110-item food frequency questionnaire was tested among 152 community controls of the Kuopio Breast Cancer Study. They completed the questionnaire twice and kept two 7-day diet records at 3-month intervals. The intraclass correlations for nutrients varied from 0.49 (thiamine with supplements) to 0.81 (lactose), and f...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(95)00551-x

    authors: Männistö S,Virtanen M,Mikkonen T,Pietinen P

    更新日期:1996-04-01 00:00:00

  • Cyclic seasonal variation in plasma lipid and lipoprotein levels: the Lipid Research Clinics Coronary Primary Prevention Trial Placebo Group.

    abstract::Seasonal plasma lipid and lipoprotein cycles were studied in 1446 hypercholesterolemic 35-59 year-old men followed for 7 years as the placebo group of the Lipid Research Clinics (LRC) Coronary Primary Prevention Trial (CPPT). Separate periodic time series were calculated for each study participant; mean parameter esti...

    journal_title:Journal of clinical epidemiology

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1016/0895-4356(88)90120-5

    authors: Gordon DJ,Hyde J,Trost DC,Whaley FS,Hannan PJ,Jacobs DR,Ekelund LG

    更新日期:1988-01-01 00:00:00