Designing evaluation studies to optimally inform policy: what factors do policy-makers in China consider when making resource allocation decisions on healthcare worker training programmes?

Abstract:

BACKGROUND:In light of the gap in evidence to inform future resource allocation decisions about healthcare provider (HCP) training in low- and middle-income countries (LMICs), and the considerable donor investments being made towards training interventions, evaluation studies that are optimally designed to inform local policy-makers are needed. The aim of our study is to understand what features of HCP training evaluation studies are important for decision-making by policy-makers in LMICs. We investigate the extent to which evaluations based on the widely used Kirkpatrick model - focusing on direct outcomes of training, namely reaction of trainees, learning, behaviour change and improvements in programmatic health indicators - align with policy-makers' evidence needs for resource allocation decisions. We use China as a case study where resource allocation decisions about potential scale-up (using domestic funding) are being made about an externally funded pilot HCP training programme. METHODS:Qualitative data were collected from high-level officials involved in resource allocation at the national and provincial level in China through ten face-to-face, in-depth interviews and two focus group discussions consisting of ten participants each. Data were analysed manually using an interpretive thematic analysis approach. RESULTS:Our study indicates that Chinese officials not only consider information about the direct outcomes of a training programme, as captured in the Kirkpatrick model, but also need information on the resources required to implement the training, the wider or indirect impacts of training, and the sustainability and scalability to other settings within the country. In addition to considering findings presented in evaluation studies, we found that Chinese policy-makers pay close attention to whether the evaluations were robust and to the composition of the evaluation team. CONCLUSIONS:Our qualitative study indicates that training programme evaluations that focus narrowly on direct training outcomes may not provide sufficient information for policy-makers to make decisions on future training programmes. Based on our findings, we have developed an evidence-based framework, which incorporates but expands beyond the Kirkpatrick model, to provide conceptual and practical guidance that aids in the design of training programme evaluations better suited to meet the information needs of policy-makers and to inform policy decisions.

journal_name

Health Res Policy Syst

authors

Wu S,Legido-Quigley H,Spencer J,Coker RJ,Khan MS

doi

10.1186/s12961-018-0292-2

subject

Has Abstract

pub_date

2018-02-23 00:00:00

pages

16

issue

1

issn

1478-4505

pii

10.1186/s12961-018-0292-2

journal_volume

16

pub_type

杂志文章
  • Cross-sector cooperation in health-enhancing physical activity policymaking: more potential than achievements?

    abstract:BACKGROUND:The cooperation of actors across policy fields and the need for cross-sector cooperation as well as recommendations on how to implement cross-sector cooperation have been addressed in many national and international policies that seek to solve complex issues within societies. For such a purpose, the relevant...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0103-6

    authors: Hämäläinen RM,Aro AR,Lau CJ,Rus D,Cori L,Syed AM,REsearch into POlicy to enhance Physical Activity (REPOPA) Consortium.

    更新日期:2016-04-29 00:00:00

  • An academic perspective of participation in healthcare redesign.

    abstract::Healthcare redesign, based on building collaborative capacity between academic and clinical partners, should create a method to facilitate flow between the key elements of health service improvement. However, utilising the skills and resources of an organisation outside of the health facility may not always have the d...

    journal_title:Health research policy and systems

    pub_type: 信件

    doi:10.1186/s12961-019-0486-2

    authors: Prior SJ,Mather C,Miller A,Campbell S

    更新日期:2019-11-20 00:00:00

  • Blending integrated knowledge translation with global health governance: an approach for advancing action on a wicked problem.

    abstract:BACKGROUND:The persistence of health inequities is a wicked problem for which there is strong evidence of causal roots in the maldistribution of power, resources and money within and between countries. Though the evidence is clear, the solutions are far from straightforward. Integrated knowledge translation (IKT) ought...

    journal_title:Health research policy and systems

    pub_type: 杂志文章,评审

    doi:10.1186/s12961-019-0424-3

    authors: Plamondon KM,Pemberton J

    更新日期:2019-03-04 00:00:00

  • The Paris Declaration in practice: challenges of health sector aid coordination at the district level in Zambia.

    abstract:BACKGROUND:The increasing resources available for and number of partners providing health sector aid have stimulated innovations, notably, the Paris Declaration on Aid Effectiveness, which aim to improve aid coordination. In this, one of the first studies to analyse implementation of aid coordination below national lev...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-7-14

    authors: Sundewall J,Forsberg BC,Jönsson K,Chansa C,Tomson G

    更新日期:2009-06-08 00:00:00

  • The Life Science Exchange: a case study of a sectoral and sub-sectoral knowledge exchange programme.

    abstract:BACKGROUND:Local and national governments have implemented sector-specific policies to support economic development through innovation, entrepreneurship and knowledge exchange. Supported by the Welsh Government through the European Regional Development Fund, The Life Science Exchange® project was created with the aim t...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0105-4

    authors: Perkins BL,Garlick R,Wren J,Smart J,Kennedy J,Stephens P,Tudor G,Bisson J,Ford DV

    更新日期:2016-04-27 00:00:00

  • Role and use of evidence in policymaking: an analysis of case studies from the health sector in Nigeria.

    abstract:BACKGROUND:Health policymaking is a complex process and analysing the role of evidence is still an evolving area in many low- and middle-income countries. Where evidence is used, it is greatly affected by cognitive and institutional features of the policy process. This paper examines the role of different types of evid...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-015-0049-0

    authors: Onwujekwe O,Uguru N,Russo G,Etiaba E,Mbachu C,Mirzoev T,Uzochukwu B

    更新日期:2015-10-24 00:00:00

  • Public health research support through the European structural funds in central and eastern Europe and the Mediterranean.

    abstract:BACKGROUND:Public health research provides evidence for practice across fields including health care, health promotion and health surveillance. Levels of public health research vary markedly across European Union (EU) countries, and are lowest in the EU's new member states (in Central and Eastern Europe and the Mediter...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-10-12

    authors: McCarthy M

    更新日期:2012-04-05 00:00:00

  • Analysing key influences over actors' use of evidence in developing policies and strategies in Nigeria: a retrospective study of the Integrated Maternal Newborn and Child Health strategy.

    abstract:BACKGROUND:Evidence-informed policymaking has been promoted as a means of ensuring better outcomes. However, what counts as evidence in policymaking lies within a spectrum of expert knowledge and scientifically generated information. Since not all forms of evidence share an equal validity or weighting for policymakers,...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0098-z

    authors: Mbachu CO,Onwujekwe O,Chikezie I,Ezumah N,Das M,Uzochukwu BS

    更新日期:2016-04-12 00:00:00

  • SUPPORT Tools for evidence-informed health Policymaking (STP) 10: Taking equity into consideration when assessing the findings of a systematic review.

    abstract::This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers. In this article we address considerations of equity. Inequities can be defined as "differences in health which are not only unnecessary and avoidabl...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-7-S1-S10

    authors: Oxman AD,Lavis JN,Lewin S,Fretheim A

    更新日期:2009-12-16 00:00:00

  • Policy context and narrative leading to the commissioning of the Australian Indigenous Burden of Disease study.

    abstract:BACKGROUND:Burden of disease (BoD) studies have been conducted in numerous international settings since the early 1990's. Two national BoD studies have been undertaken in Australia, in 1998 and 2003, although neither study estimated the BoD specifically for Indigenous Australians. In 2005 the Australian Government Depa...

    journal_title:Health research policy and systems

    pub_type: 杂志文章,评审

    doi:10.1186/s12961-015-0004-0

    authors: Botfield JR,Zwi AB,Hill PS

    更新日期:2015-03-15 00:00:00

  • Evaluation of a training program for medicines-oriented policymakers to use a database of systematic reviews.

    abstract:BACKGROUND:Suboptimal prescribing and medications use is a problem for health systems globally. Systematic reviews are a comprehensive resource that can help guide evidence-informed decision-making and implementation of interventions addressing such issues; however, a barrier to the use of systematic reviews is their i...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0140-1

    authors: Colquhoun HL,Lowe D,Helis E,Belanger D,Ens B,Hill S,Mayhew A,Taylor M,Grimshaw JM

    更新日期:2016-09-21 00:00:00

  • Continuation rates and reasons for discontinuation of intra-uterine device in three provinces of Pakistan: results of a 24-month prospective client follow-up.

    abstract:BACKGROUND:Long-acting reversible contraceptives, such as the intrauterine device (IUD), remain underutilised in Pakistan with high discontinuation rates. Based on a 24-month prospective client follow-up (nested within a larger quasi-experimental study), this paper presents the comparison of two intervention models, on...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-015-0040-9

    authors: Hameed W,Azmat SK,Ishaque M,Hussain W,Munroe E,Mustafa G,Khan OF,Abbas G,Ali S,Asghar QJ,Ali S,Ahmed A,Hamza HB

    更新日期:2015-11-25 00:00:00

  • Results of a multi-country exploratory survey of approaches and methods for IMCI case management training.

    abstract:BACKGROUND:The Integrated Management of Childhood Illness Strategy (IMCI) is effective in improving management of sick children, and thus child survival. It is currently recommended that in-service IMCI case management training (ICMT) occur over 11-days; that the participant: facilitator ratio should be

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-7-18

    authors: Goga AE,Muhe LM,Forsyth K,Chopra M,Aboubaker S,Martines J,Mason EM

    更新日期:2009-07-17 00:00:00

  • The impact of HIV and AIDS research: a case study from Swaziland.

    abstract:BACKGROUND:Swaziland is experiencing the world's worst HIV and AIDS epidemic. Prevalence rose from four percent of antenatal clinic attendees in 1992 to 42.6 percent in 2004. The Report 'Reviewing 'Emergencies' for Swaziland: Shifting the Paradigm in a New Era' published in 2007 bought together social and economic indi...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-9-S1-S9

    authors: Whiteside A,Henry FE

    更新日期:2011-06-16 00:00:00

  • A comparative evaluation of PDQ-Evidence.

    abstract:BACKGROUND:A strategy for minimising the time and obstacles to accessing systematic reviews of health system evidence is to collect them in a freely available database and make them easy to find through a simple 'Google-style' search interface. PDQ-Evidence was developed in this way. The objective of this study was to ...

    journal_title:Health research policy and systems

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12961-018-0299-8

    authors: Johansen M,Rada G,Rosenbaum S,Paulsen E,Motaze NV,Opiyo N,Wiysonge CS,Ding Y,Mukinda FK,Oxman AD

    更新日期:2018-03-15 00:00:00

  • Quantity and quality of obesity-related research in Arab countries: assessment and comparative analysis.

    abstract:BACKGROUND:Obesity is a serious worldwide medical condition, considered by some researchers as one of the most serious public health problems of the 21st century. The main objective of this study was to assess the quantity and quality of obesity-related research from Arab countries and compare it with that from non-Ara...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-12-33

    authors: Sweileh WM,Zyoud SH,Al-Jabi SW,Sawalha AF

    更新日期:2014-07-08 00:00:00

  • An approach to measuring and encouraging research translation and research impact.

    abstract:BACKGROUND:Research translation, particularly in the biomedical area, is often discussed but there are few methods that are routinely used to measure it or its impact. Of the impact measurement methods that are used, most aim to provide accountability - to measure and explain what was generated as a consequence of fund...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0131-2

    authors: Searles A,Doran C,Attia J,Knight D,Wiggers J,Deeming S,Mattes J,Webb B,Hannan S,Ling R,Edmunds K,Reeves P,Nilsson M

    更新日期:2016-08-09 00:00:00

  • Striving for better health through health research in post-conflict Timor-Leste.

    abstract::The Cabinet of Health Research and Development (CHRD) has recently been established as the first health research institute in one of the world's newest nations, Timor-Leste. We discuss the development of this initiative to build health research capacity within the context of Timor-Leste's health system, history and fu...

    journal_title:Health research policy and systems

    pub_type: 社论

    doi:10.1186/1478-4505-10-13

    authors: Martins N,Hawkins Z

    更新日期:2012-04-10 00:00:00

  • Analysis of the policymaking process in Burkina Faso's health sector: case studies of the creation of two health system support units.

    abstract:BACKGROUND:Burkina Faso has made a number of health system policy decisions to improve performance on health indicators and strengthen responsiveness to health-related challenges. These included the creation of a General Directorate of Health Information and Statistics (DGISS) and a technical unit to coordinate perform...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-017-0173-0

    authors: Zida A,Lavis JN,Sewankambo NK,Kouyate B,Moat K,Shearer J

    更新日期:2017-02-13 00:00:00

  • Analysis of the Health Product Profile Directory - a new tool to inform priority-setting in global public health.

    abstract:BACKGROUND:The Health Product Profile Directory (HPPD) is an online database describing 8-10 key characteristics (such as target population, measures of efficacy and dosage) of product profiles for medicines, vaccines, diagnostics and other products that are intended to be accessed by populations in low- and middle-inc...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-019-0507-1

    authors: Terry RF,Plasència A,Reeder JC

    更新日期:2019-12-12 00:00:00

  • Implementing without guidelines, learning at the coalface: a case study of health promoters in an era of community health workers in South Africa.

    abstract:BACKGROUND:Internationally, there has been renewed focus on primary healthcare (PHC). PHC revitalisation is one of the mechanisms to emphasise health promotion and prevention. However, it is not always clear who should lead health promotion activities. In some countries, health promotion practitioners provide health pr...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-020-00561-5

    authors: Rwafa-Ponela T,Eyles J,Christofides N,Goudge J

    更新日期:2020-05-14 00:00:00

  • Impact of NIHR HTA Programme funded research on NICE clinical guidelines: a retrospective cohort.

    abstract:BACKGROUND:It is vitally important that there is a connection between health research and clinical practice. Indications as to the impact of the research on evidence-based practice and policy can be obtained by tracking the use of outputs of health research, especially its use in clinical guidelines (CGs). This study a...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-015-0025-8

    authors: Turner S,Bhurke S,Cook A

    更新日期:2015-08-22 00:00:00

  • Indicators of sustainable capacity building for health research: analysis of four African case studies.

    abstract:BACKGROUND:Despite substantial investment in health capacity building in developing countries, evaluations of capacity building effectiveness are scarce. By analysing projects in Africa that had successfully built sustainable capacity, we aimed to identify evidence that could indicate that capacity building was likely ...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-9-14

    authors: Bates I,Taegtmeyer M,Squire SB,Ansong D,Nhlema-Simwaka B,Baba A,Theobald S

    更新日期:2011-03-28 00:00:00

  • Developing the agenda for European Union collaboration on non-communicable diseases research in Sub-Saharan Africa.

    abstract:BACKGROUND:Health research is increasing in Africa, but most resources are currently chanelled towards infectious diseases and health system development. While infectious diseases remain a heavy burden for some African countries, non-communicable diseases (NCDs) account for more than half of all deaths globally and WHO...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-8-13

    authors: McCarthy M,Maher D,Ly A,Ndip A

    更新日期:2010-05-19 00:00:00

  • An internal health systems research portfolio assessment of a low-income country research institution.

    abstract:BACKGROUND:In order to determine the type and amount of health systems research being conducted within ICDDR,B (also known as the Centre), a leading research institution in Bangladesh, an internal review of all on-going research protocols was conducted in September 2007. METHODS:A review of all ongoing research protoc...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-8-8

    authors: Koehlmoos TP,Walker DG,Gazi R

    更新日期:2010-04-06 00:00:00

  • Housing, income support and mental health: points of disconnection.

    abstract::There exists a disconnection between evolving policies in the policy arenas of mental health, housing, and income support in Canada. One of the complexities associated with analysing the intersection of these policies is that federal, provincial, and municipal level policies are involved. Canada is one of the few deve...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-5-14

    authors: Forchuk C,Joplin L,Schofield R,Csiernik R,Gorlick C,Turner K

    更新日期:2007-12-12 00:00:00

  • Post-doctoral research fellowship as a health policy and systems research capacity development intervention: a case of the CHESAI initiative.

    abstract:BACKGROUND:Building capacity in health policy and systems research (HPSR), especially in low- and middle-income countries, remains a challenge. Various approaches have been suggested and implemented by scholars and institutions using various forms of capacity building to address challenges regarding HPSR development. T...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-016-0159-3

    authors: Lembani M,Teddy G,Molosiwa D,Hwabamungu B

    更新日期:2016-12-20 00:00:00

  • How do we define the policy impact of public health research? A systematic review.

    abstract:BACKGROUND:In order to understand and measure the policy impact of research we need a definition of research impact that is suited to the task. This article systematically reviewed both peer-reviewed and grey literature for definitions of research impact to develop a definition of research impact that can be used to in...

    journal_title:Health research policy and systems

    pub_type: 杂志文章,评审

    doi:10.1186/s12961-017-0247-z

    authors: Alla K,Hall WD,Whiteford HA,Head BW,Meurk CS

    更新日期:2017-10-02 00:00:00

  • The Quality Improvement Demonstration Study: an example of evidence-based policy-making in practice.

    abstract:BACKGROUND:Randomized trials have long been the gold-standard for evaluating clinical practice. There is growing recognition that rigorous studies are similarly needed to assess the effects of policy. However, these studies are rarely conducted. We report on the Quality Improvement Demonstration Study (QIDS), an exampl...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/1478-4505-6-5

    authors: Shimkhada R,Peabody JW,Quimbo SA,Solon O

    更新日期:2008-03-25 00:00:00

  • Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods.

    abstract:BACKGROUND:In the funding of health research and public health research it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence. Many methods are used in the identification of research priorities, however, these can be resource intensive, costly and lo...

    journal_title:Health research policy and systems

    pub_type: 杂志文章

    doi:10.1186/s12961-017-0252-2

    authors: Turner S,Ollerhead E,Cook A

    更新日期:2017-10-09 00:00:00