Grading the strength of a body of evidence when assessing health care interventions: an EPC update.

Abstract:

OBJECTIVES:To revise 2010 guidance on grading the strength of evidence (SOE) of the effectiveness of drugs, devices, and other preventive and therapeutic interventions in systematic reviews produced by the Evidence-based Practice Center (EPC) program, established by the US Agency for Healthcare Research and Quality (AHRQ). STUDY DESIGN AND SETTING:A cross-EPC working group reviewed authoritative systems for grading SOE [primarily the approach from the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group] and conducted extensive discussions with GRADE and other experts. RESULTS:Updated guidance continues to be conceptually similar to GRADE. Reviewers are to evaluate SOE separately for each major treatment comparison for each major outcome. We added reporting bias as a required domain and retained study limitations (risk of bias), consistency, directness, and precision (and three optional domains). Additional guidance covers scoring consistency, precision, and reporting bias, grading bodies of evidence with randomized controlled trials and observational studies, evaluating single study bodies of evidence, using studies with high risk of bias, and presenting findings with greater clarity and transparency. SOE is graded high, moderate, low, or insufficient, reflecting reviewers' confidence in the findings for a specific treatment comparison and outcome. CONCLUSION:No single approach for grading SOE suits all reviews, but a more consistent and transparent approach to reporting summary information will make reviews more useful to the broad range of audiences that AHRQ's work aims to reach. EPC working groups will consider ongoing challenges and modify guidance as needed, on issues such as combining trials and observational studies in bodies of evidence, weighting domains, and combining qualitative and quantitative syntheses.

journal_name

J Clin Epidemiol

authors

Berkman ND,Lohr KN,Ansari MT,Balk EM,Kane R,McDonagh M,Morton SC,Viswanathan M,Bass EB,Butler M,Gartlehner G,Hartling L,McPheeters M,Morgan LC,Reston J,Sista P,Whitlock E,Chang S

doi

10.1016/j.jclinepi.2014.11.023

subject

Has Abstract

pub_date

2015-11-01 00:00:00

pages

1312-24

issue

11

eissn

0895-4356

issn

1878-5921

pii

S0895-4356(14)00536-8

journal_volume

68

pub_type

杂志文章
  • Incremental cost-effectiveness analysis: the optimal strategy depends on the strategy set.

    abstract::Evaluating the incremental cost-effectiveness of a technology is critical to understanding the impact of its adoption. The purpose of this study was to evaluate, using a particular example, how the specific alternatives selected for a cost-effectiveness analysis may influence the results of the analysis. In this examp...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(99)00021-9

    authors: Cantor SB,Ganiats TG

    更新日期:1999-06-01 00:00:00

  • Female specialists were more likely to respond to a postal questionnaire about drug treatments for Alzheimer disease.

    abstract:OBJECTIVE:To assess demographic predictors of response for specialists who were mailed a postal questionnaire on drug treatments for Alzheimer disease. STUDY DESIGN AND SETTING:The questionnaire was sent to 317 specialists in Quebec, Canada. Demographic variables included specialty, urban/rural practice, language, sex...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2003.11.008

    authors: Oremus M,Wolfson C

    更新日期:2004-06-01 00:00:00

  • An international survey and modified Delphi approach revealed numerous rapid review methods.

    abstract:OBJECTIVES:To solicit experiences with and perceptions of rapid reviews from stakeholders, including researchers, policy makers, industry, journal editors, and health care providers. STUDY DESIGN AND SETTING:An international survey of rapid review producers and modified Delphi. RESULTS:Forty rapid review producers re...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.08.012

    authors: Tricco AC,Zarin W,Antony J,Hutton B,Moher D,Sherifali D,Straus SE

    更新日期:2016-02-01 00:00:00

  • Stratified randomization for clinical trials.

    abstract::Trialists argue about the usefulness of stratified randomization. For investigators designing trials and readers who use them, the argument has created uncertainty regarding the importance of stratification. In this paper, we review stratified randomization to summarize its purpose, indications, accomplishments, and a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/s0895-4356(98)00138-3

    authors: Kernan WN,Viscoli CM,Makuch RW,Brass LM,Horwitz RI

    更新日期:1999-01-01 00:00:00

  • A full competing risk analysis of hospital-acquired infections can easily be performed by a case-cohort approach.

    abstract:OBJECTIVES:We provide a case-cohort approach and show that a full competing risk analysis is feasible even in a reduced data set. Competing events for hospital-acquired infections are death or discharge from the hospital because they preclude the observation of such infections. STUDY DESIGN AND SETTING:Using surveilla...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.jclinepi.2015.11.011

    authors: Wolkewitz M,Palomar-Martinez M,Olaechea-Astigarraga P,Alvarez-Lerma F,Schumacher M

    更新日期:2016-06-01 00:00:00

  • Measuring importance of outcomes to patients: a cross-sectional survey for the German anal cancer guideline.

    abstract:OBJECTIVE:We aimed to generate evidence on patients' values and preferences to inform the development of the German national Evidence-based Anal Cancer Guideline. STUDY DESIGN AND SETTING:We developed a list of health outcomes based on a systematic search. We then asked anal cancer patients and experts of the guidelin...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2020.09.026

    authors: Werner RN,Gaskins M,Dressler C,Nast A,Schaefer C,Aigner F,Siegel R

    更新日期:2021-01-01 00:00:00

  • The use of clinical trials in comparative effectiveness research on mental health.

    abstract:OBJECTIVES:A large body of comparative effectiveness research (CER) focuses on the use of observational and quasi-experimental approaches. We sought to examine the use of clinical trials as a tool for CER, particularly in mental health. STUDY DESIGN AND SETTING:Examination of three ongoing randomized clinical trials i...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.02.013

    authors: Blanco C,Rafful C,Olfson M

    更新日期:2013-08-01 00:00:00

  • Improving task comprehension in the measurement of health state preferences. A trial of informational cartoon figures and a paired-comparison task.

    abstract::Information concerning people's relative preferences for health care outcomes is usually obtained using questionnaires which ask subjects to imagine health states of various kinds. When using illness- or treatment-specific states, elaborate descriptions of patients' quality of life may adequately convey to the rater a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(92)90083-y

    authors: Hadorn DC,Hays RD,Uebersax J,Hauber T

    更新日期:1992-03-01 00:00:00

  • Postmenopausal estrogen use and invasive versus in situ breast cancer risk.

    abstract::To examine the effect of cancer histopathology on the relationship between estrogen-replacement therapy (ERT) use and breast cancer risk, we performed a case-control study of 109 postmenopausal women 45 years or older with in situ or invasive breast cancer matched to 545 controls. When in situ and invasive tumors were...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/s0895-4356(98)00116-4

    authors: Henrich JB,Kornguth PJ,Viscoli CM,Horwitz RI

    更新日期:1998-12-01 00:00:00

  • Review of mixed treatment comparisons in published systematic reviews shows marked increase since 2009.

    abstract:OBJECTIVES:To identify and summarize published systematic reviews that report results of meta-analyses that combined direct and indirect comparisons. STUDY DESIGN AND SETTING:Narrative review of mixed treatment comparisons (MTCs) reported in systematic reviews of health interventions. MEDLINE, MEDLINE In-Process, Emba...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2013.07.014

    authors: Lee AW

    更新日期:2014-02-01 00:00:00

  • Evaluation of diagnostic tests with multiple diagnostic categories.

    abstract::The evaluation of diagnostic tests attempts to obtain one or more statistical parameters which can indicate the intrinsic diagnostic utility of a test. Sensitivity, specificity and predictive value are not appropriate for this use. The likelihood ratio has been proposed as a useful measure when using a test to diagnos...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90051-0

    authors: Birkett NJ

    更新日期:1988-01-01 00:00:00

  • The Singaporean English and Chinese versions of the EQ-5D achieved measurement equivalence in cancer patients.

    abstract:OBJECTIVE:To assess measurement equivalence of the Singaporean English and Chinese versions of the EuroQol Group's 5-domain questionnaire (EQ-5D) in cancer patients. STUDY DESIGN AND SETTING:Seven hundred and seventy-one ethnic Chinese patients in Singapore were recruited, and they answered either an English or a Chin...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2008.03.007

    authors: Gao F,Ng GY,Cheung YB,Thumboo J,Pang G,Koo WH,Sethi VK,Wee J,Goh C

    更新日期:2009-02-01 00:00:00

  • Diverse criteria and methods are used to compare treatment effect estimates: a scoping review.

    abstract:OBJECTIVES:To determine what criteria researchers use to assess whether the estimates of effect of an intervention on a dichotomous outcome are different when obtained using different study designs. STUDY DESIGN AND SETTING:Scoping review of the literature. We included studies of dichotomous outcomes in which authors ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2016.02.001

    authors: Brignardello-Petersen R,Carrasco-Labra A,Jadad AR,Johnston BC,Tomlinson G

    更新日期:2016-07-01 00:00:00

  • Designing pragmatic trials-what can we learn from lessons learned?

    abstract::Pragmatic trials aim to inform clinical decision making by measuring the effect of a treatment in clinical practice. The purpose of the PRECIS-2 tool is to support in designing a truly pragmatic trial. We comment on a study by Forbes et al., who assessed the applicability of the PRECIS-2 tool. The tool will prove part...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2017.06.006

    authors: Groenwold RHH,Dekkers OM

    更新日期:2017-10-01 00:00:00

  • Unconditional and conditional incentives differentially improved general practitioners' participation in an online survey: randomized controlled trial.

    abstract:OBJECTIVES:To compare the impact of unconditional and conditional financial incentives on response rates among Australian general practitioners invited by mail to participate in an online survey about cancer care and to investigate possible differential response bias between incentive groups. STUDY DESIGN AND SETTING:...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.jclinepi.2014.09.013

    authors: Young JM,O'Halloran A,McAulay C,Pirotta M,Forsdike K,Stacey I,Currow D

    更新日期:2015-06-01 00:00:00

  • Changes to the subscales of two vision-related quality of life questionnaires are proposed.

    abstract:BACKGROUND AND OBJECTIVE:Psychometrically sound questionnaires for the assessment of vision-related quality of life (QOL) are scarce. Therefore, the objective was to further validate two vision-related QOL questionnaires in a Dutch population of visually impaired elderly. METHODS:A total of 329 visually impaired older...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.04.007

    authors: de Boer MR,de Vet HC,Terwee CB,Moll AC,Völker-Dieben HJ,van Rens GH

    更新日期:2005-12-01 00:00:00

  • Does physical activity lower blood pressure: a critical review of the clinical trials.

    abstract::This review critically appraises 22 recent articles of trials of physical activity, as a means of reducing blood pressure. The quality of the literature remains poor and of the 13 controlled trials of habitual activity only one did not have a major design fault. Overall, blood pressure was reduced by physical activity...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/0895-4356(92)90093-3

    authors: Arroll B,Beaglehole R

    更新日期:1992-05-01 00:00:00

  • Methodological shortcomings predicted lower harm estimates in one of two sets of studies of clinical interventions.

    abstract:OBJECTIVES:High quality harms data are necessary to appropriately assess the balance between benefits and harms of interventions. Little is known, however, about whether perceived methodological shortcomings are associated with lower estimates of harms. STUDY DESIGN AND SETTING:Studies reporting harms associated with ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析,评审

    doi:10.1016/j.jclinepi.2006.02.021

    authors: Chou R,Fu R,Carson S,Saha S,Helfand M

    更新日期:2007-01-01 00:00:00

  • Overviews of reviews incompletely report methods for handling overlapping, discordant, and problematic data.

    abstract:OBJECTIVES:The aim of the study was to assess the completeness of reporting of methods in overviews. STUDY DESIGN AND SETTING:Assessment of the adequacy of reporting of methods in a random sample of 50 overviews was based on a published framework of methods for conducting overviews. Descriptive summary statistics were...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2019.09.025

    authors: Lunny C,Brennan SE,Reid J,McDonald S,McKenzie JE

    更新日期:2020-02-01 00:00:00

  • Most meta-analyses of drug interventions have narrow scopes and many focus on specific agents.

    abstract:OBJECTIVE:To assess the extent to which meta-analysis publications of drugs and biologics focus on specific named agents or even only a single agent, and identify characteristics associated with such focus. STUDY DESIGN AND SETTING:We evaluated 499 articles with meta-analyses published in 2010 and estimated how many d...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2012.10.014

    authors: Haidich AB,Pilalas D,Contopoulos-Ioannidis DG,Ioannidis JP

    更新日期:2013-04-01 00:00:00

  • More medical journals should inform their contributors about three key principles of graph construction.

    abstract:OBJECTIVES:To identify key principles of graph construction and to review guidance on graph construction provided by medical journals. STUDY DESIGN AND SETTING:Review of a prevailing model of graph comprehension and survey of authors' instructions for all 120 core medical journals as indexed by PubMed. RESULTS:Graph ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.12.016

    authors: Puhan MA,ter Riet G,Eichler K,Steurer J,Bachmann LM

    更新日期:2006-10-01 00:00:00

  • Hematocrit was not validated as a surrogate end point for survival among epoetin-treated hemodialysis patients.

    abstract:OBJECTIVE:To evaluate the use of hematocrit as a surrogate end point for survival among end-stage renal disease (ESRD) patients treated with epoetin. STUDY DESIGN AND SETTING:Using United States Renal Data System (USRDS) data, we conducted an observational prospective study to analyze the relationships among epoetin d...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2004.05.002

    authors: Cotter DJ,Stefanik K,Zhang Y,Thamer M,Scharfstein D,Kaufman J

    更新日期:2004-10-01 00:00:00

  • Early studies reported extreme findings with large variability: a meta-epidemiologic study in the field of endocrinology.

    abstract:OBJECTIVES:To evaluate the presence of extreme findings and fluctuation in effect size in endocrinology. STUDY DESIGN AND SETTINGS:We systematically identified all meta-analyses published in 2014 in the field of endocrinology. Within each meta-analysis, the effect size of the primary binary outcome was compared across...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,meta分析,评审

    doi:10.1016/j.jclinepi.2015.10.015

    authors: Wang Z,Alahdab F,Almasri J,Haydour Q,Mohammed K,Abu Dabrh AM,Prokop LJ,Alfarkh W,Lakis S,Montori VM,Murad MH

    更新日期:2016-04-01 00:00:00

  • Using the STROBE statement: survey findings emphasized the role of journals in enforcing reporting guidelines.

    abstract:OBJECTIVES:The objective of the study was to identify factors affecting the use of the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement, specifically authors' attitudes toward and experiences with it. STUDY DESIGN AND SETTING:An online survey was distributed to authors of observa...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2019.07.019

    authors: Sharp MK,Bertizzolo L,Rius R,Wager E,Gómez G,Hren D

    更新日期:2019-12-01 00:00:00

  • Beyond Mendelian randomization: how to interpret evidence of shared genetic predictors.

    abstract:OBJECTIVE:Mendelian randomization is a popular technique for assessing and estimating the causal effects of risk factors. If genetic variants which are instrumental variables for a risk factor are shown to be additionally associated with a disease outcome, then the risk factor is a cause of the disease. However, in man...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.08.001

    authors: Burgess S,Butterworth AS,Thompson JR

    更新日期:2016-01-01 00:00:00

  • Assessment of generalized lymphadenopathy in AIDS research: the degree of clinical agreement.

    abstract::The degree of clinical agreement amongst different physicians on the presence or absence of generalized lymphadenopathy was assessed in 32 randomly selected participants from a prospective study of male sexual contacts of men with AIDS or an AIDS-related condition (ARC). Three physicians completed the same standard ex...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/0895-4356(88)90131-x

    authors: Coates RA,Fanning MM,Johnson JK,Calzavara L

    更新日期:1988-01-01 00:00:00

  • An enhancement of ROC curves made them clinically relevant for diagnostic-test comparison and optimal-threshold determination.

    abstract:OBJECTIVES:The receiver operating characteristic curves (ROC curves) are often used to compare continuous diagnostic tests or determine the optimal threshold of a test; however, they do not consider the costs of misclassifications or the disease prevalence. The ROC graph was extended to allow for these aspects. STUDY ...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2015.01.003

    authors: Subtil F,Rabilloud M

    更新日期:2015-07-01 00:00:00

  • A minimal clinically important difference was derived for the Roland-Morris Disability Questionnaire for low back pain.

    abstract:OBJECTIVE:To compare methods commonly used to derive minimal important differences and recommend a rule for defining patients as clinically improved on the low back pain-specific Roland-Morris Disability Questionnaire (RMDQ). METHODS:447 primary care low back pain consulters completed a questionnaire at consultation a...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2005.03.018

    authors: Jordan K,Dunn KM,Lewis M,Croft P

    更新日期:2006-01-01 00:00:00

  • Dependence of the minimal clinically important improvement on the baseline value is a consequence of floor and ceiling effects and not different expectations by patients.

    abstract:OBJECTIVE:Estimates of minimal clinically important improvements (MCIIs) are larger among patients with higher values at baseline, suggesting that these patients require larger changes to appreciate improvements. We examined if baseline dependency of MCIIs was associated with specific patients across three measures, or...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章

    doi:10.1016/j.jclinepi.2013.10.025

    authors: Ward MM,Guthrie LC,Alba M

    更新日期:2014-06-01 00:00:00

  • Quality varies across clinical practice guidelines for mammography screening in women aged 40-49 years as assessed by AGREE and AMSTAR instruments.

    abstract:OBJECTIVE:To assess the quality of clinical practice guidelines providing recommendations on the frequency of mammography screening in asymptomatic, average-risk women 40-49 years of age. STUDY DESIGN AND SETTING:We searched the National Guideline Clearinghouse and MEDLINE for guidelines published from 2005 to 2010. F...

    journal_title:Journal of clinical epidemiology

    pub_type: 杂志文章,评审

    doi:10.1016/j.jclinepi.2010.12.005

    authors: Burda BU,Norris SL,Holmer HK,Ogden LA,Smith ME

    更新日期:2011-09-01 00:00:00