Improving the use of research evidence in guideline development: 16. Evaluation.

Abstract:

BACKGROUND:The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the last of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES:We reviewed the literature on evaluating guidelines and recommendations, including their quality, whether they are likely to be up-to-date, and their implementation. We also considered the role of guideline developers in undertaking evaluations that are needed to inform recommendations. METHODS:We searched PubMed and three databases of methodological studies for existing systematic reviews and relevant methodological research. We did not conduct systematic reviews ourselves. Our conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS:Our answers to these questions were informed by a review of instruments for evaluating guidelines, several studies of the need for updating guidelines, discussions of the pros and cons of different research designs for evaluating the implementation of guidelines, and consideration of the use of uncertainties identified in systematic reviews to set research priorities. How should the quality of guidelines or recommendations be appraised? WHO should put into place processes to ensure that both internal and external review of guidelines is undertaken routinely. A checklist, such as the AGREE instrument, should be used. The checklist should be adapted and tested to ensure that it is suitable to the broad range of recommendations that WHO produces, including public health and health policy recommendations, and that it includes questions about equity and other items that are particularly important for WHO guidelines. When should guidelines or recommendations be updated? Processes should be put into place to ensure that guidelines are monitored routinely to determine if they are in need of updating. People who are familiar with the topic, such as Cochrane review groups, should do focused, routine searches for new research that would require revision of the guideline. Periodic review of guidelines by experts not involved in developing the guidelines should also be considered. Consideration should be given to establishing guideline panels that are ongoing, to facilitate routine updating, with members serving fixed periods with a rotating membership. How should the impact of guidelines or recommendations be evaluated? WHO headquarters and regional offices should support member states and those responsible for policy decisions and implementation to evaluate the impact of their decisions and actions by providing advice regarding impact assessment, practical support and coordination of efforts. Before-after evaluations should be used cautiously and when there are important uncertainties regarding the effects of a policy or its implementation, randomised evaluations should be used when possible. What responsibility should WHO take for ensuring that important uncertainties are addressed by future research when the evidence needed to inform recommendations is lacking? Guideline panels should routinely identify important uncertainties and research priorities. This source of potential priorities for research should be used systematically to inform priority-setting processes for global research.

journal_name

Health Res Policy Syst

authors

Oxman AD,Schünemann HJ,Fretheim A

doi

10.1186/1478-4505-4-28

subject

Has Abstract

pub_date

2006-12-08 00:00:00

pages

28

issn

1478-4505

pii

1478-4505-4-28

journal_volume

4

pub_type

杂志文章
  • Intervention Scalability Assessment Tool: A decision support tool for health policy makers and implementers.

    abstract:BACKGROUND:Promising health interventions tested in pilot studies will only achieve population-wide impact if they are implemented at scale across communities and health systems. Scaling up effective health interventions is vital as not doing so denies the community the most effective services and programmes. However, ...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-019-0494-2

    authors: Milat A,Lee K,Conte K,Grunseit A,Wolfenden L,van Nassau F,Orr N,Sreeram P,Bauman A

    更新日期:2020-01-03 00:00:00

  • SUPPORT Tools for evidence-informed health Policymaking (STP) 10: Taking equity into consideration when assessing the findings of a systematic review.

    abstract::This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers. In this article we address considerations of equity. Inequities can be defined as "differences in health which are not only unnecessary and avoidabl...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-7-S1-S10

    authors: Oxman AD,Lavis JN,Lewin S,Fretheim A

    更新日期:2009-12-16 00:00:00

  • Informing the establishment of the WHO Global Observatory on Health Research and Development: a call for papers.

    abstract::In May 2013, the WHO Member States requested the WHO to establish a Global Observatory on Health Research and Development (R&D), as part of a strategic work-plan to promote innovation, build capacity, improve access, and mobilize resources to address diseases that disproportionately affect the world's poorest countrie...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-13-9

    authors: Adam T,Røttingen JA,Kieny MP

    更新日期:2015-02-02 00:00:00

  • Striving for better health through health research in post-conflict Timor-Leste.

    abstract::The Cabinet of Health Research and Development (CHRD) has recently been established as the first health research institute in one of the world's newest nations, Timor-Leste. We discuss the development of this initiative to build health research capacity within the context of Timor-Leste's health system, history and fu...

    journal_title:Health research policy and systems

    pub_type: 社论

    doi:10.1186/1478-4505-10-13

    authors: Martins N,Hawkins Z

    更新日期:2012-04-10 00:00:00

  • Housing, income support and mental health: points of disconnection.

    abstract::There exists a disconnection between evolving policies in the policy arenas of mental health, housing, and income support in Canada. One of the complexities associated with analysing the intersection of these policies is that federal, provincial, and municipal level policies are involved. Canada is one of the few deve...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-5-14

    authors: Forchuk C,Joplin L,Schofield R,Csiernik R,Gorlick C,Turner K

    更新日期:2007-12-12 00:00:00

  • Policy assessment and policy development for physical activity promotion: results of an exploratory intervention study in 15 European nations.

    abstract:BACKGROUND:Purpose of the study was to test a theoretical model to assess and develop policies for the promotion of physical activity among older people as part of an international intervention study. METHODS:248 semi-standardized interviews with policy-makers were conducted in 15 European nations. The questionnaire a...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-10-14

    authors: Rütten A,Abu-Omar K,Gelius P,Dinan-Young S,Frändin K,Hopman-Rock M,Young A

    更新日期:2012-04-18 00:00:00

  • An internal health systems research portfolio assessment of a low-income country research institution.

    abstract:BACKGROUND:In order to determine the type and amount of health systems research being conducted within ICDDR,B (also known as the Centre), a leading research institution in Bangladesh, an internal review of all on-going research protocols was conducted in September 2007. METHODS:A review of all ongoing research protoc...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-8-8

    authors: Koehlmoos TP,Walker DG,Gazi R

    更新日期:2010-04-06 00:00:00

  • Is peer review useful in assessing research proposals in Indigenous health? A case study.

    abstract:BACKGROUND:There has been considerable examination and critique of traditional (academic) peer review processes in quality assessment of grant applications. At the same time, the use of traditional research processes in Indigenous research has been questioned. Many grant funding organisations have changed the compositi...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-7-2

    authors: Street J,Baum F,Anderson IP

    更新日期:2009-02-13 00:00:00

  • Analysing key influences over actors' use of evidence in developing policies and strategies in Nigeria: a retrospective study of the Integrated Maternal Newborn and Child Health strategy.

    abstract:BACKGROUND:Evidence-informed policymaking has been promoted as a means of ensuring better outcomes. However, what counts as evidence in policymaking lies within a spectrum of expert knowledge and scientifically generated information. Since not all forms of evidence share an equal validity or weighting for policymakers,...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0098-z

    authors: Mbachu CO,Onwujekwe O,Chikezie I,Ezumah N,Das M,Uzochukwu BS

    更新日期:2016-04-12 00:00:00

  • Evaluation of a training program for medicines-oriented policymakers to use a database of systematic reviews.

    abstract:BACKGROUND:Suboptimal prescribing and medications use is a problem for health systems globally. Systematic reviews are a comprehensive resource that can help guide evidence-informed decision-making and implementation of interventions addressing such issues; however, a barrier to the use of systematic reviews is their i...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0140-1

    authors: Colquhoun HL,Lowe D,Helis E,Belanger D,Ens B,Hill S,Mayhew A,Taylor M,Grimshaw JM

    更新日期:2016-09-21 00:00:00

  • What do we think we are doing? How might a clinical information network be promoting implementation of recommended paediatric care practices in Kenyan hospitals?

    abstract:BACKGROUND:The creation of a clinical network was proposed as a means to promote implementation of a set of recommended clinical practices targeting inpatient paediatric care in Kenya. The rationale for selecting a network as a strategy has been previously described. Here, we aim to describe network activities actually...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-017-0172-1

    authors: English M,Ayieko P,Nyamai R,Were F,Githanga D,Irimu G

    更新日期:2017-02-02 00:00:00

  • Indicators of sustainable capacity building for health research: analysis of four African case studies.

    abstract:BACKGROUND:Despite substantial investment in health capacity building in developing countries, evaluations of capacity building effectiveness are scarce. By analysing projects in Africa that had successfully built sustainable capacity, we aimed to identify evidence that could indicate that capacity building was likely ...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-9-14

    authors: Bates I,Taegtmeyer M,Squire SB,Ansong D,Nhlema-Simwaka B,Baba A,Theobald S

    更新日期:2011-03-28 00:00:00

  • Cross-sector cooperation in health-enhancing physical activity policymaking: more potential than achievements?

    abstract:BACKGROUND:The cooperation of actors across policy fields and the need for cross-sector cooperation as well as recommendations on how to implement cross-sector cooperation have been addressed in many national and international policies that seek to solve complex issues within societies. For such a purpose, the relevant...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0103-6

    authors: Hämäläinen RM,Aro AR,Lau CJ,Rus D,Cori L,Syed AM,REsearch into POlicy to enhance Physical Activity (REPOPA) Consortium.

    更新日期:2016-04-29 00:00:00

  • Research dissemination workshops: observations and implications based on an experience in Burkina Faso.

    abstract:BACKGROUND:In Burkina Faso, malaria remains the primary cause of healthcare use, morbidity and child mortality. Therefore, efforts are needed to support the knowledge transfer and application of the results of numerous studies to better formulate and implement programs in the fight against the malaria pandemic. To this...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-017-0205-9

    authors: Mc Sween-Cadieux E,Dagenais C,Somé PA,Ridde V

    更新日期:2017-06-02 00:00:00

  • Application of the i-PARIHS framework for enhancing understanding of interactive dissemination to achieve wide-scale improvement in Indigenous primary healthcare.

    abstract:BACKGROUND:Participatory research approaches improve the use of evidence in policy, programmes and practice. Few studies have addressed ways to scale up participatory research for wider system improvement or the intensity of effort required. We used the integrated Promoting Action on Research Implementation in Health S...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-018-0392-z

    authors: Laycock A,Harvey G,Percival N,Cunningham F,Bailie J,Matthews V,Copley K,Patel L,Bailie R

    更新日期:2018-11-29 00:00:00

  • Implementing without guidelines, learning at the coalface: a case study of health promoters in an era of community health workers in South Africa.

    abstract:BACKGROUND:Internationally, there has been renewed focus on primary healthcare (PHC). PHC revitalisation is one of the mechanisms to emphasise health promotion and prevention. However, it is not always clear who should lead health promotion activities. In some countries, health promotion practitioners provide health pr...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-020-00561-5

    authors: Rwafa-Ponela T,Eyles J,Christofides N,Goudge J

    更新日期:2020-05-14 00:00:00

  • Does a consumer training work? a follow-up survey of the PartecipaSalute training programs.

    abstract:BACKGROUND:When properly trained through training programs on epidemiology, clinical research and healthcare policy, members of patients'/consumers' organizations could be helpful for a patient-oriented healthcare system. Since 2006 the not for profit project PartecipaSalute has organized periodic editions of a trainin...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-10-27

    authors: Mosconi P,Satolli R,Colombo C,Villani W

    更新日期:2012-09-01 00:00:00

  • Post-doctoral research fellowship as a health policy and systems research capacity development intervention: a case of the CHESAI initiative.

    abstract:BACKGROUND:Building capacity in health policy and systems research (HPSR), especially in low- and middle-income countries, remains a challenge. Various approaches have been suggested and implemented by scholars and institutions using various forms of capacity building to address challenges regarding HPSR development. T...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0159-3

    authors: Lembani M,Teddy G,Molosiwa D,Hwabamungu B

    更新日期:2016-12-20 00:00:00

  • Supporting the use of research evidence in decision-making in crisis zones in low- and middle-income countries: a critical interpretive synthesis.

    abstract:BACKGROUND:Decision-makers in crisis zones are faced with the challenge of having to make health-related decisions under limited time and resource constraints and in light of the many factors that can influence their decisions, of which research evidence is just one. To address a key gap in the research literature abou...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-020-0530-2

    authors: Khalid AF,Lavis JN,El-Jardali F,Vanstone M

    更新日期:2020-02-18 00:00:00

  • Communities of practice for supporting health systems change: a missed opportunity.

    abstract:BACKGROUND:Communities of practice (CoPs) have been used in the health sector to support professional practice change. However, little is known about how CoPs might be used to influence a system that requires change at and across various levels (i.e. front line care, organizational, governmental). In this paper we exam...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-015-0023-x

    authors: Kothari A,Boyko JA,Conklin J,Stolee P,Sibbald SL

    更新日期:2015-07-25 00:00:00

  • Applying for, reviewing and funding public health research in Germany and beyond.

    abstract::Public health research is complex, involves various disciplines, epistemological perspectives and methods, and is rarely conducted in a controlled setting. Often, the added value of a research project lies in its inter- or trans-disciplinary interaction, reflecting the complexity of the research questions at hand. Thi...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0112-5

    authors: Gerhardus A,Becher H,Groenewegen P,Mansmann U,Meyer T,Pfaff H,Puhan M,Razum O,Rehfuess E,Sauerborn R,Strech D,Wissing F,Zeeb H,Hummers-Pradier E

    更新日期:2016-06-13 00:00:00

  • Exempting low-risk health and medical research from ethics reviews: comparing Australia, the United Kingdom, the United States and the Netherlands.

    abstract:BACKGROUND:Disproportionate regulation of health and medical research contributes to research waste. Better understanding of exemptions of research from ethics review in different jurisdictions may help to guide modification of review processes and reduce research waste. Our aim was to identify examples of low-risk hum...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-019-0520-4

    authors: Scott AM,Kolstoe S,Ploem MCC,Hammatt Z,Glasziou P

    更新日期:2020-01-28 00:00:00

  • Exploring linkages between research, policy and practice in the Netherlands: perspectives on sexual and reproductive health and rights knowledge flows.

    abstract:BACKGROUND:The attention to and demand for stronger linkages between research, policy and practice are increasing, especially in fields concerned with sensitive and challenging issues such as sexual and reproductive health and rights (SRHR). The study described in this article was conducted in the Netherlands among act...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-017-0201-0

    authors: de Haas B,van der Kwaak A

    更新日期:2017-05-12 00:00:00

  • Who is excluded and how? An analysis of community spaces for maternal and child health in Pakistan.

    abstract:BACKGROUND:The maternal, newborn, and child health (MNCH) indicators of Pakistan depict the deplorable state of the poor and rural women and children. Many MNCH programmes stress the need to engage the poor in community spaces. However, caste and class based hierarchies and gendered social norms exclude the lower caste...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-015-0043-6

    authors: Aziz A,Khan FA,Wood G

    更新日期:2015-11-25 00:00:00

  • The Quality Improvement Demonstration Study: an example of evidence-based policy-making in practice.

    abstract:BACKGROUND:Randomized trials have long been the gold-standard for evaluating clinical practice. There is growing recognition that rigorous studies are similarly needed to assess the effects of policy. However, these studies are rarely conducted. We report on the Quality Improvement Demonstration Study (QIDS), an exampl...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-6-5

    authors: Shimkhada R,Peabody JW,Quimbo SA,Solon O

    更新日期:2008-03-25 00:00:00

  • Community-based organizations in the health sector: a scoping review.

    abstract::Community-based organizations are important health system stakeholders as they provide numerous, often highly valued programs and services to the members of their community. However, community-based organizations are described using diverse terminology and concepts from across a range of disciplines. To better underst...

    journal_title:Health research policy and systems

    pub_type: 杂志文章,评审

    doi:10.1186/1478-4505-10-36

    authors: Wilson MG,Lavis JN,Guta A

    更新日期:2012-11-21 00:00:00

  • The political undertones of building national health research systems--reflections from The Gambia.

    abstract::In developing countries building national health research systems is a movement similar to a political leadership contest. Increasingly, political campaigns to select leaders depend less on ideologies and political messages and more on promising change that will promptly improve the quality of life of the voters. In t...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-7-13

    authors: Palmer A,Anya SE,Bloch P

    更新日期:2009-05-29 00:00:00

  • Quantity and quality of obesity-related research in Arab countries: assessment and comparative analysis.

    abstract:BACKGROUND:Obesity is a serious worldwide medical condition, considered by some researchers as one of the most serious public health problems of the 21st century. The main objective of this study was to assess the quantity and quality of obesity-related research from Arab countries and compare it with that from non-Ara...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-12-33

    authors: Sweileh WM,Zyoud SH,Al-Jabi SW,Sawalha AF

    更新日期:2014-07-08 00:00:00

  • Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods.

    abstract:BACKGROUND:In the funding of health research and public health research it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence. Many methods are used in the identification of research priorities, however, these can be resource intensive, costly and lo...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-017-0252-2

    authors: Turner S,Ollerhead E,Cook A

    更新日期:2017-10-09 00:00:00

  • New directions in evidence-based policy research: a critical analysis of the literature.

    abstract::Despite 40 years of research into evidence-based policy (EBP) and a continued drive from both policymakers and researchers to increase research uptake in policy, barriers to the use of evidence are persistently identified in the literature. However, it is not clear what explains this persistence - whether they represe...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-12-34

    authors: Oliver K,Lorenc T,Innvær S

    更新日期:2014-07-14 00:00:00