Applying GRADE-CERQual to qualitative evidence synthesis findings-paper 6: how to assess relevance of the data.

Abstract:

BACKGROUND:The GRADE-CERQual (Confidence in Evidence from Reviews of Qualitative research) approach has been developed by the GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working Group. The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. CERQual includes four components for assessing how much confidence to place in findings from reviews of qualitative research (also referred to as qualitative evidence syntheses): (1) methodological limitations, (2) coherence, (3) adequacy of data and (4) relevance. This paper is part of a series providing guidance on how to apply CERQual and focuses on CERQual's relevance component. METHODS:We developed the relevance component by searching the literature for definitions, gathering feedback from relevant research communities and developing consensus through project group meetings. We tested the CERQual relevance component within several qualitative evidence syntheses before agreeing on the current definition and principles for application. RESULTS:When applying CERQual, we define relevance as the extent to which the body of data from the primary studies supporting a review finding is applicable to the context (perspective or population, phenomenon of interest, setting) specified in the review question. In this paper, we describe the relevance component and its rationale and offer guidance on how to assess relevance in the context of a review finding. This guidance outlines the information required to assess relevance, the steps that need to be taken to assess relevance and examples of relevance assessments. CONCLUSIONS:This paper provides guidance for review authors and others on undertaking an assessment of relevance in the context of the CERQual approach. Assessing the relevance component requires consideration of potentially important contextual factors at an early stage in the review process. We expect the CERQual approach, and its individual components, to develop further as our experiences with the practical implementation of the approach increase.

journal_name

Implement Sci

authors

Noyes J,Booth A,Lewin S,Carlsen B,Glenton C,Colvin CJ,Garside R,Bohren MA,Rashidian A,Wainwright M,Tunςalp Ö,Chandler J,Flottorp S,Pantoja T,Tucker JD,Munthe-Kaas H

doi

10.1186/s13012-017-0693-6

subject

Has Abstract

pub_date

2018-01-25 00:00:00

pages

4

issue

Suppl 1

issn

1748-5908

pii

10.1186/s13012-017-0693-6

journal_volume

13

pub_type

杂志文章
  • Priority setting for the implementation of artemisinin-based combination therapy policy in Tanzania: evaluation against the accountability for reasonableness framework.

    abstract:BACKGROUND:Priority setting for artemisinin-based antimalarial drugs has become an integral part of malaria treatment policy change in malaria-endemic countries. Although these drugs are more efficacious, they are also more costly than the failing drugs. When Tanzania changed its National Malaria Treatment Policy in 20...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-7-18

    authors: Mori AT,Kaale EA

    更新日期:2012-03-18 00:00:00

  • Impetus to change: a multi-site qualitative exploration of the national audit of dementia.

    abstract:BACKGROUND:National audit is a key strategy used to improve care for patients with dementia. Audit and feedback has been shown to be effective, but with variation in how much it improves care. Both evidence and theory identify active ingredients associated with effectiveness of audit and feedback. It is unclear to what...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-020-01004-z

    authors: Sykes M,Thomson R,Kolehmainen N,Allan L,Finch T

    更新日期:2020-06-17 00:00:00

  • German language questionnaires for assessing implementation constructs and outcomes of psychosocial and health-related interventions: a systematic review.

    abstract:BACKGROUND:Over the past years, implementation science has gained more and more importance in German-speaking countries. Reliable and valid questionnaires are needed for evaluating the implementation of evidence-based practices. On an international level, several initiatives focused on the identification of questionnai...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-018-0837-3

    authors: Kien C,Schultes MT,Szelag M,Schoberberger R,Gartlehner G

    更新日期:2018-12-12 00:00:00

  • The feasibility of implementing recovery, psychosocial and pharmacological interventions for psychosis: comparison study.

    abstract:BACKGROUND:Clinical guidelines for the treatment of people experiencing psychosis have existed for over a decade, but implementation of recommended interventions is limited. Identifying influences on implementation may help to reduce this translational gap. The Structured Assessment of Feasibility (SAFE) measure is a s...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-015-0262-9

    authors: van der Krieke L,Bird V,Leamy M,Bacon F,Dunn R,Pesola F,Janosik M,Le Boutillier C,Williams J,Slade M

    更新日期:2015-05-23 00:00:00

  • Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention.

    abstract:BACKGROUND:Intervention effects observed in efficacy trials are rarely replicated when the interventions are broadly disseminated, underscoring the need for more information about factors influencing real-life implementation and program impact. Using data from the ongoing national implementation of an evidence-based HI...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-016-0539-7

    authors: Wang B,Stanton B,Deveaux L,Lunn S,Rolle G,Adderley R,Poitier M,Koci V,Marshall S,Gomez P

    更新日期:2017-02-10 00:00:00

  • Community health worker support to improve HIV treatment outcomes for older children and adolescents in Zimbabwe: a process evaluation of the ZENITH trial.

    abstract:BACKGROUND:Community health worker (CHW)-delivered support visits to children living with HIV and their caregivers significantly reduced odds of virological failure among the children in the ZENITH trial conducted in Zimbabwe. We conducted a process evaluation to assess fidelity, acceptability, and feasibility of this ...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-018-0762-5

    authors: Dziva Chikwari C,Simms V,Busza J,Dauya E,Bandason T,Chonzi P,Munyati S,Mujuru H,Ferrand RA

    更新日期:2018-05-23 00:00:00

  • Evaluating the effectiveness of a clinical practice change intervention in increasing clinician provision of preventive care in a network of community-based mental health services: a study protocol of a non-randomized, multiple baseline trial.

    abstract:BACKGROUND:People with a mental illness experience substantial disparities in health, including increased rates of morbidity and mortality caused by potentially preventable chronic diseases. One contributing factor to such disparity is a higher prevalence of modifiable health risk behaviors, such as smoking, inadequate...

    journal_title:Implementation science : IS

    pub_type: 杂志文章,多中心研究

    doi:10.1186/1748-5908-8-85

    authors: Bartlem K,Bowman J,Freund M,Wye P,McElwaine K,Knight J,McElduff P,Gillham K,Wiggers J

    更新日期:2013-08-06 00:00:00

  • The use of tacit and explicit knowledge in public health: a qualitative study.

    abstract:BACKGROUND:Planning a public health initiative is both a science and an art. Public health practitioners work in a complex, often time-constrained environment, where formal research literature can be unavailable or uncertain. Consequently, public health practitioners often draw upon other forms of knowledge. METHODS:T...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-7-20

    authors: Kothari A,Rudman D,Dobbins M,Rouse M,Sibbald S,Edwards N

    更新日期:2012-03-20 00:00:00

  • Economic evaluation of the NET intervention versus guideline dissemination for management of mild head injury in hospital emergency departments.

    abstract:BACKGROUND:Evidence-based guidelines for the management of mild traumatic brain injury (mTBI) in the emergency department (ED) are now widely available, and yet, clinical practice remains inconsistent with the guidelines. The Neurotrauma Evidence Translation (NET) intervention was developed to increase the uptake of gu...

    journal_title:Implementation science : IS

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1186/s13012-018-0834-6

    authors: Mortimer D,Bosch M,Mckenzie JE,Turner S,Chau M,Ponsford JL,Knott JC,Gruen RL,Green SE

    更新日期:2018-12-05 00:00:00

  • Peering into the black box: a meta-analysis of how clinicians use decision aids during clinical encounters.

    abstract:OBJECTIVE:To quantify the extent to which clinicians use clinically-efficacious decision aids as intended during implementation in practice and how fidelity to usage instructions correlates with shared decision making (SDM) outcomes. METHODS:Participant-level meta-analysis including six practice-based randomized contr...

    journal_title:Implementation science : IS

    pub_type: 杂志文章,meta分析

    doi:10.1186/1748-5908-9-26

    authors: Wyatt KD,Branda ME,Anderson RT,Pencille LJ,Montori VM,Hess EP,Ting HH,LeBlanc A

    更新日期:2014-02-22 00:00:00

  • Optimising the value of the evidence generated in implementation science: the use of ontologies to address the challenges.

    abstract::Implementing research findings into healthcare practice and policy is a complex process occurring in diverse contexts; it invariably depends on changing human behaviour in many parts of an intricate implementation system. Questions asked with the aim of improving implementation are multifarious variants of 'What works...

    journal_title:Implementation science : IS

    pub_type: 社论

    doi:10.1186/s13012-017-0660-2

    authors: Michie S,Johnston M

    更新日期:2017-11-14 00:00:00

  • Improving hypertension management through pharmacist prescribing; the rural Alberta clinical trial in optimizing hypertension (Rural RxACTION): trial design and methods.

    abstract:BACKGROUND:Patients with hypertension continue to have less than optimal blood pressure control, with nearly one in five Canadian adults having hypertension. Pharmacist prescribing is gaining favor as a potential clinically efficacious and cost-effective means to improve both access and quality of care. With Alberta be...

    journal_title:Implementation science : IS

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1186/1748-5908-6-94

    authors: Charrois TL,McAlister FA,Cooney D,Lewanczuk R,Kolber MR,Campbell NR,Rosenthal M,Houle SK,Tsuyuki RT

    更新日期:2011-08-11 00:00:00

  • Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change.

    abstract:BACKGROUND:Variation in effectiveness of continuous quality improvement (CQI) interventions between services is commonly reported, but with little explanation of how contextual and other factors may interact to produce this variation. Therefore, there is scant information available on which policy makers can draw to in...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-8-119

    authors: Schierhout G,Hains J,Si D,Kennedy C,Cox R,Kwedza R,O'Donoghue L,Fittock M,Brands J,Lonergan K,Dowden M,Bailie R

    更新日期:2013-10-08 00:00:00

  • Application of the Consolidated Framework for Implementation Research to assess factors that may influence implementation of tobacco use treatment guidelines in the Viet Nam public health care delivery system.

    abstract:BACKGROUND:Services to treat tobacco dependence are not readily available to smokers in low-middle income countries (LMICs) where smoking prevalence remains high. We are conducting a cluster randomized controlled trial comparing the effectiveness of two strategies for implementing tobacco use treatment guidelines in 26...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-017-0558-z

    authors: VanDevanter N,Kumar P,Nguyen N,Nguyen L,Nguyen T,Stillman F,Weiner B,Shelley D

    更新日期:2017-02-28 00:00:00

  • How can continuing professional development better promote shared decision-making? Perspectives from an international collaboration.

    abstract:BACKGROUND:Shared decision-making is not widely implemented in healthcare. We aimed to set a research agenda about promoting shared decision-making through continuing professional development. METHODS:Thirty-six participants met for two days. RESULTS:Participants suggested ways to improve an environmental scan that h...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-6-68

    authors: Légaré F,Bekker H,Desroches S,Drolet R,Politi MC,Stacey D,Borduas F,Cheater FM,Cornuz J,Coutu MF,Ferdjaoui-Moumjid N,Griffiths F,Härter M,Jacques A,Krones T,Labrecque M,Neely C,Rodriguez C,Sargeant J,Schuerman JS,

    更新日期:2011-07-05 00:00:00

  • Collaborative approach to Optimise MEdication use for Older people in Nursing homes (COME-ON): study protocol of a cluster controlled trial.

    abstract:BACKGROUND:Ageing has become a worldwide reality and presents new challenges for the health-care system. Research has shown that potentially inappropriate prescribing, both potentially inappropriate medications and potentially prescribing omissions, is highly prevalent in older people, especially in the nursing home se...

    journal_title:Implementation science : IS

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1186/s13012-016-0394-6

    authors: Anrys P,Strauven G,Boland B,Dalleur O,Declercq A,Degryse JM,De Lepeleire J,Henrard S,Lacour V,Simoens S,Speybroeck N,Vanhaecht K,Spinewine A,Foulon V

    更新日期:2016-03-11 00:00:00

  • Implementation of case management to reduce cardiovascular disease risk in the Stanford and San Mateo Heart to Heart randomized controlled trial: study protocol and baseline characteristics.

    abstract:BACKGROUND:Case management has emerged as a promising alternative approach to supplement traditional one-on-one sessions between patients and doctors for improving the quality of care in chronic diseases such as coronary heart disease (CHD). However, data are lacking in terms of its efficacy and cost-effectiveness when...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-1-21

    authors: Ma J,Lee KV,Berra K,Stafford RS

    更新日期:2006-09-27 00:00:00

  • Creating a knowledge translation trainee collaborative: from conceptualization to lessons learned in the first year.

    abstract::Trainees (e.g., graduate students, residents, fellows) are increasingly identifying knowledge translation as their research discipline. In Canada, a group of trainees have created a trainee-initiated and trainee-led national collaborative to provide a vehicle for trainees to examine the diversity of knowledge translat...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-6-98

    authors: Cornelissen E,Urquhart R,Chan VW,Deforge RT,Colquhoun HL,Sibbald S,Witteman H

    更新日期:2011-08-25 00:00:00

  • Developing the protocol for the evaluation of the health foundation's 'engaging with quality initiative' - an emergent approach.

    abstract::In 2004 a UK charity, The Health Foundation, established the 'Engaging with Quality Initiative' to explore and evaluate the benefits of engaging clinicians in quality improvement in healthcare. Eight projects run by professional bodies or specialist societies were commissioned in various areas of acute care. A develop...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-3-46

    authors: Soper B,Buxton M,Hanney S,Oortwijn W,Scoggins A,Steel N,Ling T

    更新日期:2008-10-30 00:00:00

  • Online self-administered training for post-traumatic stress disorder treatment providers: design and methods for a randomized, prospective intervention study.

    abstract::This paper presents the rationale and methods for a randomized controlled evaluation of web-based training in motivational interviewing, goal setting, and behavioral task assignment. Web-based training may be a practical and cost-effective way to address the need for large-scale mental health training in evidence-base...

    journal_title:Implementation science : IS

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1748-5908-7-43

    authors: Ruzek JI,Rosen RC,Marceau L,Larson MJ,Garvert DW,Smith L,Stoddard A

    更新日期:2012-05-14 00:00:00

  • Examining the implementation of NICE guidance: cross-sectional survey of the use of NICE interventional procedures guidance by NHS Trusts.

    abstract:BACKGROUND:In the UK, NHS hospitals receive large amounts of evidence-based recommendations for care delivery from the National Institute for Health and Care Excellence (NICE) and other organisations. Little is known about how NHS organisations implement such guidance and best practice for doing so. This study was ther...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-015-0283-4

    authors: Lowson K,Jenks M,Filby A,Carr L,Campbell B,Powell J

    更新日期:2015-06-30 00:00:00

  • Research utilization among children's mental health providers.

    abstract:BACKGROUND:Children with emotional and behavioural disorders should be able to count on receiving care that meets their needs and is based on the best scientific evidence available, however, many do not receive these services. Implementation of evidence-based practice (EBP) relies, in part, on the research utilization ...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-3-19

    authors: Barwick MA,Boydell KM,Stasiulis E,Ferguson HB,Blase K,Fixsen D

    更新日期:2008-04-09 00:00:00

  • Correction to: Hospital organizational context and delivery of evidence-based stroke care: a cross-sectional study.

    abstract::Following publication of the original article [1], the authors reported an error in one of the authors' names. In this Correction the incorrect and correct author name are shown. The original article has been corrected. ...

    journal_title:Implementation science : IS

    pub_type: 杂志文章,已发布勘误

    doi:10.1186/s13012-019-0862-x

    authors: Andrew NE,Middleton S,Grimley R,Anderson CS,Donnan GA,Lannin NA,Stroil-Salama E,Grabsch B,Kilkenny MF,Squires JE,Cadilhac DA,Stroke123 Investigators.

    更新日期:2019-02-08 00:00:00

  • Thinking styles and doctors' knowledge and behaviours relating to acute coronary syndromes guidelines.

    abstract:BACKGROUND:How humans think and make decisions is important in understanding behaviour. Hence an understanding of cognitive processes among physicians may inform our understanding of behaviour in relation to evidence implementation strategies. A personality theory, Cognitive-Experiential Self Theory (CEST) proposes a r...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-3-23

    authors: Sladek RM,Bond MJ,Huynh LT,Chew DP,Phillips PA

    更新日期:2008-04-25 00:00:00

  • 'Communicate to vaccinate' (COMMVAC). building evidence for improving communication about childhood vaccinations in low- and middle-income countries: protocol for a programme of research.

    abstract:BACKGROUND:Effective provider-parent communication can improve childhood vaccination uptake and strengthen immunisation services in low- and middle-income countries (LMICs). Building capacity to improve communication strategies has been neglected. Rigorous research exists but is not readily found or applicable to LMICs...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-6-125

    authors: Lewin S,Hill S,Abdullahi LH,de Castro Freire SB,Bosch-Capblanch X,Glenton C,Hussey GD,Jones CM,Kaufman J,Lin V,Mahomed H,Rhoda L,Robinson P,Waggie Z,Willis N,Wiysonge CS

    更新日期:2011-12-02 00:00:00

  • Enablers and barriers to using patient decision aids in early stage breast cancer consultations: a qualitative study of surgeons' views.

    abstract:BACKGROUND:For early stage breast cancer, randomized controlled trials (RCTs) have shown that patient decision aids (PtDAs), when used by surgeons, result in increased patient knowledge about options and different patient treatment choices as compared to standard care. Yet, recent data suggests that PtDAs are used by l...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-014-0174-0

    authors: O'Brien MA,Charles C,Lovrics P,Wright FC,Whelan T,Simunovic M,Kennedy E,Grunfeld E

    更新日期:2014-11-29 00:00:00

  • Using the Theoretical Domains Framework (TDF) to understand adherence to multiple evidence-based indicators in primary care: a qualitative study.

    abstract:BACKGROUND:There are recognised gaps between evidence and practice in general practice, a setting posing particular implementation challenges. We earlier screened clinical guideline recommendations to derive a set of 'high-impact' indicators based upon criteria including potential for significant patient benefit, scope...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-016-0479-2

    authors: Lawton R,Heyhoe J,Louch G,Ingleson E,Glidewell L,Willis TA,McEachan RR,Foy R,ASPIRE programme.

    更新日期:2016-08-08 00:00:00

  • Why a successful task substitution in glaucoma care could not be transferred from a hospital setting to a primary care setting: a qualitative study.

    abstract:BACKGROUND:Healthcare systems are challenged by a demand that exceeds available resources. One policy to meet this challenge is task substitution-transferring tasks to other professions and settings. Our study aimed to explore stakeholders' perceived feasibility of transferring hospital-based monitoring of stable glauc...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/1748-5908-8-14

    authors: Holtzer-Goor KM,Plochg T,Lemij HG,van Sprundel E,Koopmanschap MA,Klazinga NS

    更新日期:2013-01-25 00:00:00

  • The clinician crowdsourcing challenge: using participatory design to seed implementation strategies.

    abstract:BACKGROUND:In healthcare settings, system and organization leaders often control the selection and design of implementation strategies even though frontline workers may have the most intimate understanding of the care delivery process, and factors that optimize and constrain evidence-based practice implementation withi...

    journal_title:Implementation science : IS

    pub_type: 杂志文章

    doi:10.1186/s13012-019-0914-2

    authors: Stewart RE,Williams N,Byeon YV,Buttenheim A,Sridharan S,Zentgraf K,Jones DT,Hoskins K,Candon M,Beidas RS

    更新日期:2019-06-14 00:00:00

  • Measuring team factors thought to influence the success of quality improvement in primary care: a systematic review of instruments.

    abstract:BACKGROUND:Measuring team factors in evaluations of Continuous Quality Improvement (CQI) may provide important information for enhancing CQI processes and outcomes; however, the large number of potentially relevant factors and associated measurement instruments makes inclusion of such measures challenging. This review ...

    journal_title:Implementation science : IS

    pub_type: 杂志文章,评审

    doi:10.1186/1748-5908-8-20

    authors: Brennan SE,Bosch M,Buchan H,Green SE

    更新日期:2013-02-14 00:00:00