Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews.

Abstract:

BACKGROUND:How to assess the impact of research is of growing interest to funders, policy makers and researchers mainly to understand the value of investments and to increase accountability. Broadly speaking the term "research impact" refers to the contribution of research activities to achieve desired societal outcomes. The aim of this overview is to identify the most common approaches to research impact assessment, categories of impact and their respective indicators. METHODS:We systematically searched the relevant literature (PubMed, The Cochrane Library (1990-2009)) and funding agency websites. We included systematic reviews, theoretical and methodological papers, and empirical case-studies on how to evaluate research impact. We qualitatively summarised the included reports, as well the conceptual frameworks. RESULTS:We identified twenty-two reports belonging to four systematic reviews and 14 primary studies. These publications reported several theoretical frameworks and methodological approaches (bibliometrics, econometrics, ad hoc case studies). The "payback model" emerged as the most frequently used. Five broad categories of impact were identified: a) advancing knowledge, b) capacity building, c) informing decision-making, d) health benefits, e) broad socio-economic benefits. For each proposed category of impact we summarized a set of indicators whose pros and cons are presented and briefly discussed. CONCLUSIONS:This overview is a comprehensive, yet descriptive, contribution to summarize the conceptual framework and taxonomy of an heterogeneous and evolving area of research. A shared and comprehensive conceptual framework does not seem to be available yet and its single components (epidemiologic, economic, and social) are often valued differently in different models.

journal_name

Health Res Policy Syst

authors

Banzi R,Moja L,Pistotti V,Facchini A,Liberati A

doi

10.1186/1478-4505-9-26

subject

Has Abstract

pub_date

2011-06-24 00:00:00

pages

26

issn

1478-4505

pii

1478-4505-9-26

journal_volume

9

pub_type

杂志文章
  • Implementing without guidelines, learning at the coalface: a case study of health promoters in an era of community health workers in South Africa.

    abstract:BACKGROUND:Internationally, there has been renewed focus on primary healthcare (PHC). PHC revitalisation is one of the mechanisms to emphasise health promotion and prevention. However, it is not always clear who should lead health promotion activities. In some countries, health promotion practitioners provide health pr...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-020-00561-5

    authors: Rwafa-Ponela T,Eyles J,Christofides N,Goudge J

    更新日期:2020-05-14 00:00:00

  • The development of ORACLe: a measure of an organisation's capacity to engage in evidence-informed health policy.

    abstract:BACKGROUND:Evidence-informed policymaking is more likely if organisations have cultures that promote research use and invest in resources that facilitate staff engagement with research. Measures of organisations' research use culture and capacity are needed to assess current capacity, identify opportunities for improve...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-015-0069-9

    authors: Makkar SR,Turner T,Williamson A,Louviere J,Redman S,Haynes A,Green S,Brennan S

    更新日期:2016-01-14 00:00:00

  • Indicators of sustainable capacity building for health research: analysis of four African case studies.

    abstract:BACKGROUND:Despite substantial investment in health capacity building in developing countries, evaluations of capacity building effectiveness are scarce. By analysing projects in Africa that had successfully built sustainable capacity, we aimed to identify evidence that could indicate that capacity building was likely ...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-9-14

    authors: Bates I,Taegtmeyer M,Squire SB,Ansong D,Nhlema-Simwaka B,Baba A,Theobald S

    更新日期:2011-03-28 00:00:00

  • Exempting low-risk health and medical research from ethics reviews: comparing Australia, the United Kingdom, the United States and the Netherlands.

    abstract:BACKGROUND:Disproportionate regulation of health and medical research contributes to research waste. Better understanding of exemptions of research from ethics review in different jurisdictions may help to guide modification of review processes and reduce research waste. Our aim was to identify examples of low-risk hum...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-019-0520-4

    authors: Scott AM,Kolstoe S,Ploem MCC,Hammatt Z,Glasziou P

    更新日期:2020-01-28 00:00:00

  • Transforming the practice of medicine through team science.

    abstract:BACKGROUND:The translation of biomedical research discoveries into clinical practice is marked by extended timelines (averaging 17 years) and multiple sequential process steps. However, even after a drug, device, diagnostic tool or unique therapeutic procedure successfully navigates through clinical testing to approval...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-020-00619-4

    authors: Pitzen JH,Dieter HL,Gronseth DL,Dahl AK,Boyle VL,Maran T,Harper CM Jr,Gores GJ

    更新日期:2020-09-17 00:00:00

  • Housing, income support and mental health: points of disconnection.

    abstract::There exists a disconnection between evolving policies in the policy arenas of mental health, housing, and income support in Canada. One of the complexities associated with analysing the intersection of these policies is that federal, provincial, and municipal level policies are involved. Canada is one of the few deve...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-5-14

    authors: Forchuk C,Joplin L,Schofield R,Csiernik R,Gorlick C,Turner K

    更新日期:2007-12-12 00:00:00

  • Hospital-based health technology assessment (HTA) in Finland: a case study on collaboration between hospitals and the national HTA unit.

    abstract:BACKGROUND:This study examines, as a part of the European Union funded Adopting Hospital Based Health Technology Assessment (AdHopHTA) project, the results and barriers of collaboration between Finnish hospitals and the national health technology assessment (HTA) agency, Finohta. A joint collaborative HTA program has e...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0095-2

    authors: Halmesmäki E,Pasternack I,Roine R

    更新日期:2016-04-05 00:00:00

  • Incremental cost and health gains of the 2016 WHO antenatal care recommendations for Rwanda: results from expert elicitation.

    abstract:OBJECTIVES:High-quality evidence of effectiveness and cost-effectiveness is rarely available and relevant for health policy decisions in low-resource settings. In such situations, innovative approaches are needed to generate locally relevant evidence. This study aims to inform decision-making on antenatal care (ANC) re...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-019-0439-9

    authors: Hitimana R,Lindholm L,Mogren I,Krantz G,Nzayirambaho M,Sengoma JS,Pulkki-Brännström AM

    更新日期:2019-04-05 00:00:00

  • Knowledge translation for realist reviews: a participatory approach for a review on scaling up complex interventions.

    abstract:BACKGROUND:Knowledge syntheses that use a realist methodology are gaining popularity. Yet, there are few reports in the literature that describe how results are summarised, shared and used. This paper aims to inform knowledge translation (KT) for realist reviews by describing the process of developing a KT strategy for...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-018-0374-1

    authors: Boyko JA,Riley BL,Willis CD,Stockton L,Zummach D,Kerner J,Robinson K,Chia M

    更新日期:2018-10-22 00:00:00

  • The influence of cost-per-DALY information in health prioritisation and desirable features for a registry: a survey of health policy experts in Vietnam, India and Bangladesh.

    abstract:BACKGROUND:Economic evaluation has been implemented to inform policy in many areas, including coverage decisions, technology pricing, and the development of clinical practice guidelines. However, there are barriers to evidence-based policy in low- and middle-income countries (LMICs) that include limited stakeholder awa...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0156-6

    authors: Teerawattananon Y,Tantivess S,Yamabhai I,Tritasavit N,Walker DG,Cohen JT,Neumann PJ

    更新日期:2016-12-03 00:00:00

  • Research impact of systems-level long-term care research: a multiple case study.

    abstract:BACKGROUND:Traditional reporting of research outcomes and impacts, which tends to focus on research product publications and grant success, does not capture the value, some contributions, or the complexity of research projects. The purpose of this study was to understand the contributions of five systems-level research...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-017-0185-9

    authors: Kothari A,Peter N,Donskov M,Luciani T

    更新日期:2017-03-21 00:00:00

  • Using an equity-based framework for evaluating publicly funded health insurance programmes as an instrument of UHC in Chhattisgarh State, India.

    abstract:BACKGROUND:Universal health coverage (UHC) has provided the impetus for the introduction of publicly funded health insurance (PFHI) schemes in the mixed health systems of India and many other low- and middle-income countries. There is a need for a holistic understanding of the pathways of impact of PFHI schemes, includ...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-020-00555-3

    authors: Nandi S,Schneider H

    更新日期:2020-05-25 00:00:00

  • Translating evidence into policy for cardiovascular disease control in India.

    abstract:: Cardiovascular diseases (CVD) are leading causes of premature mortality in India. Evidence from developed countries shows that mortality from these can be substantially prevented using population-wide and individual-based strategies. Policy initiatives for control of CVD in India have been suggested but evidence of e...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-9-8

    authors: Gupta R,Guptha S,Joshi R,Xavier D

    更新日期:2011-02-09 00:00:00

  • Communities of practice for supporting health systems change: a missed opportunity.

    abstract:BACKGROUND:Communities of practice (CoPs) have been used in the health sector to support professional practice change. However, little is known about how CoPs might be used to influence a system that requires change at and across various levels (i.e. front line care, organizational, governmental). In this paper we exam...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-015-0023-x

    authors: Kothari A,Boyko JA,Conklin J,Stolee P,Sibbald SL

    更新日期:2015-07-25 00:00:00

  • Improving the use of research evidence in guideline development: 9. Grading evidence and recommendations.

    abstract:BACKGROUND:The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the ninth of a series of 16 reviews that have been prepared as b...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-4-21

    authors: Schünemann HJ,Fretheim A,Oxman AD

    更新日期:2006-12-05 00:00:00

  • Four normative perspectives on public health policy-making and their preferences for bodies of evidence.

    abstract::Calls for evidence-informed public health policy-making often ignore that there are multiple, and often competing, bodies of potentially relevant evidence to which policy-makers have recourse in identifying policy priorities and taking decisions. In this paper, we illustrate how policy frames may favour the use of spe...

    journal_title:Health research policy and systems

    pub_type: 信件

    doi:10.1186/s12961-020-00614-9

    authors: Schoemaker CG,van Loon J,Achterberg PW,den Hertog FRJ,Hilderink H,Melse J,Vonk RAA,van Oers H

    更新日期:2020-08-24 00:00:00

  • System within systems: challenges and opportunities for the Expanded Programme on Immunisation in Pakistan.

    abstract:BACKGROUND:Pakistan has one of the highest infant and child mortality rates in the world, half of these occurring due to vaccine-preventable diseases. The country started its Expanded Programme on immunisation (EPI) in 1978. However, the programme's performance is often questioned, as the Immunisation rates have been c...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-019-0452-z

    authors: Haq Z,Shaikh BT,Tran N,Hafeez A,Ghaffar A

    更新日期:2019-05-17 00:00:00

  • An integrative review of potential enablers and barriers to accessing mental health services in Ghana.

    abstract:INTRODUCTION:The importance of accessible mental health treatment is a global concern, particularly when one in five people will experience a mental health problem in their lifespan. This is no less important in Ghana; however, no studies have yet attempted to appraise and synthesise the potential enablers and barriers...

    journal_title:Health research policy and systems

    pub_type: 杂志文章,评审

    doi:10.1186/s12961-018-0382-1

    authors: Badu E,O'Brien AP,Mitchell R

    更新日期:2018-11-16 00:00:00

  • Developing the agenda for European Union collaboration on non-communicable diseases research in Sub-Saharan Africa.

    abstract:BACKGROUND:Health research is increasing in Africa, but most resources are currently chanelled towards infectious diseases and health system development. While infectious diseases remain a heavy burden for some African countries, non-communicable diseases (NCDs) account for more than half of all deaths globally and WHO...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-8-13

    authors: McCarthy M,Maher D,Ly A,Ndip A

    更新日期:2010-05-19 00:00:00

  • Learning sites for health system governance in Kenya and South Africa: reflecting on our experience.

    abstract:BACKGROUND:Health system governance is widely recognised as critical to well-performing health systems in low- and middle-income countries. However, in 2008, the Alliance for Health Policy and Systems Research identified governance as a neglected health systems research issue. Given the demands of such research, the Al...

    journal_title:Health research policy and systems

    pub_type: 信件

    doi:10.1186/s12961-020-00552-6

    authors: RESYST\/DIAHLS learning site team.

    更新日期:2020-05-11 00:00:00

  • Analysing key influences over actors' use of evidence in developing policies and strategies in Nigeria: a retrospective study of the Integrated Maternal Newborn and Child Health strategy.

    abstract:BACKGROUND:Evidence-informed policymaking has been promoted as a means of ensuring better outcomes. However, what counts as evidence in policymaking lies within a spectrum of expert knowledge and scientifically generated information. Since not all forms of evidence share an equal validity or weighting for policymakers,...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0098-z

    authors: Mbachu CO,Onwujekwe O,Chikezie I,Ezumah N,Das M,Uzochukwu BS

    更新日期:2016-04-12 00:00:00

  • Is peer review useful in assessing research proposals in Indigenous health? A case study.

    abstract:BACKGROUND:There has been considerable examination and critique of traditional (academic) peer review processes in quality assessment of grant applications. At the same time, the use of traditional research processes in Indigenous research has been questioned. Many grant funding organisations have changed the compositi...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-7-2

    authors: Street J,Baum F,Anderson IP

    更新日期:2009-02-13 00:00:00

  • Role and use of evidence in policymaking: an analysis of case studies from the health sector in Nigeria.

    abstract:BACKGROUND:Health policymaking is a complex process and analysing the role of evidence is still an evolving area in many low- and middle-income countries. Where evidence is used, it is greatly affected by cognitive and institutional features of the policy process. This paper examines the role of different types of evid...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-015-0049-0

    authors: Onwujekwe O,Uguru N,Russo G,Etiaba E,Mbachu C,Mirzoev T,Uzochukwu B

    更新日期:2015-10-24 00:00:00

  • SUPPORT Tools for evidence-informed health Policymaking (STP) 10: Taking equity into consideration when assessing the findings of a systematic review.

    abstract::This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers. In this article we address considerations of equity. Inequities can be defined as "differences in health which are not only unnecessary and avoidabl...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-7-S1-S10

    authors: Oxman AD,Lavis JN,Lewin S,Fretheim A

    更新日期:2009-12-16 00:00:00

  • Analysis of the Health Product Profile Directory - a new tool to inform priority-setting in global public health.

    abstract:BACKGROUND:The Health Product Profile Directory (HPPD) is an online database describing 8-10 key characteristics (such as target population, measures of efficacy and dosage) of product profiles for medicines, vaccines, diagnostics and other products that are intended to be accessed by populations in low- and middle-inc...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-019-0507-1

    authors: Terry RF,Plasència A,Reeder JC

    更新日期:2019-12-12 00:00:00

  • Implementing performance-based financing in peripheral health centres in Mali: what can we learn from it?

    abstract:INTRODUCTION:Numerous sub-Saharan African countries have experimented with performance-based financing (PBF) with the goal of improving health system performance. To date, few articles have examined the implementation of this type of complex intervention in Francophone West Africa. This qualitative research aims to und...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-020-00566-0

    authors: Coulibaly A,Gautier L,Zitti T,Ridde V

    更新日期:2020-06-03 00:00:00

  • Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods.

    abstract:BACKGROUND:In the funding of health research and public health research it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence. Many methods are used in the identification of research priorities, however, these can be resource intensive, costly and lo...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-017-0252-2

    authors: Turner S,Ollerhead E,Cook A

    更新日期:2017-10-09 00:00:00

  • Regulatory scientists' work has important ramifications for public health and should be open to public scrutiny.

    abstract::The Swedish Medical Products Agency (MPA) objects to the fact that we occasionally refer to one of its senior ex-employees by name. However, names of individual MPA assessors, Food and Drug Administration (FDA) reviewers, and European Medicines Agency rapporteurs and co-rapporteurs are cited in regulatory documents an...

    journal_title:Health research policy and systems

    pub_type: 评论,信件

    doi:10.1186/s12961-018-0371-4

    authors: Mulinari S,Davis C

    更新日期:2018-11-15 00:00:00

  • A comparative evaluation of PDQ-Evidence.

    abstract:BACKGROUND:A strategy for minimising the time and obstacles to accessing systematic reviews of health system evidence is to collect them in a freely available database and make them easy to find through a simple 'Google-style' search interface. PDQ-Evidence was developed in this way. The objective of this study was to ...

    journal_title:Health research policy and systems

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12961-018-0299-8

    authors: Johansen M,Rada G,Rosenbaum S,Paulsen E,Motaze NV,Opiyo N,Wiysonge CS,Ding Y,Mukinda FK,Oxman AD

    更新日期:2018-03-15 00:00:00

  • Community-based organizations in the health sector: a scoping review.

    abstract::Community-based organizations are important health system stakeholders as they provide numerous, often highly valued programs and services to the members of their community. However, community-based organizations are described using diverse terminology and concepts from across a range of disciplines. To better underst...

    journal_title:Health research policy and systems

    pub_type: 杂志文章,评审

    doi:10.1186/1478-4505-10-36

    authors: Wilson MG,Lavis JN,Guta A

    更新日期:2012-11-21 00:00:00