Elsevier

Health Policy

Volume 121, Issue 9, September 2017, Pages 937-946
Health Policy

Review
How have systematic priority setting approaches influenced policy making? A synthesis of the current literature

https://doi.org/10.1016/j.healthpol.2017.07.003Get rights and content

Highlights

  • Systematic approaches to healthcare priority setting can improve policy making.

  • There is need to assess if the common approaches have impacted policy making.

  • While some have been used, their complexity and resource requirements hamper their institutionalization.

Abstract

Background

There is a growing body of literature on systematic approaches to healthcare priority setting from various countries and different levels of decision making. This paper synthesizes the current literature in order to assess the extent to which program budgeting and marginal analysis (PBMA), burden of disease & cost-effectiveness analysis (BOD/CEA), multi-criteria decision analysis (MCDA), and accountability for reasonableness (A4R), are reported to have been institutionalized and influenced policy making and practice.

Methods

We searched for English language publications on health care priority setting approaches (2000–2017). Our sources of literature included PubMed and Ovid databases (including Embase, Global Health, Medline, PsycINFO, EconLit).

Findings

Of the four approaches PBMA and A4R were commonly applied in high income countries while BOD/CEA was exclusively applied in low income countries. PBMA and BOD/CEA were most commonly reported to have influenced policy making. The explanations for limited adoption of an approach were related to its complexity, poor policy maker understanding and resource requirements.

Conclusions

While systematic approaches have the potential to improve healthcare priority setting; most have not been adopted in routine policy making. The identified barriers call for sustained knowledge exchange between researchers and policy-makers and development of practical guidelines to ensure that these frameworks are more accessible, applicable and sustainable in informing policy making.

Section snippets

Introduction/Background

Priority setting, (PS), a process involving decision making about the allocation of resources between the competing claims of different services, different patient groups or different elements of care [1], is one of the most critical health policy challenge because of the gap between the increasing population health demands and needs and the resources that should meet them [2]. Several priority setting frameworks have been developed to provide guidance for the policy makers who have to make

Methods

This was a scoping literature review. Our sources of literature included PubMed and Ovid databases (including Embase, Global Health, Medline, PsycINFO). We searched for peer-reviewed literature on priority setting in health care published between January 2000 and March 2017. Search terms included “priority setting”, “resource allocation”, “health care”, “health systems”, “health interventions”, “approaches”, “initiatives” and “frameworks”. Subsequent searches involved a combination of the

Data extraction and synthesis

The following steps were followed;

  • i)

    Developing the data extraction tool: LK & SDR developed the data extraction tool based on the relevant themes namely; name of the framework, countries and level of application; priority setting case, health issue or health program; paper type; decision maker satisfaction or perception of the utility of the approach, whether or not the framework/priorities influenced policy making.

  • ii)

    Data extraction: Using the data extraction tool, SDR read through the selected

Results

This section is organised according to the frameworks. For each framework there is a description of the framework and the reported country/region and level of its application, an assessment of ‘decision maker perspectives on its utility, and whether or not the framework is reported to have impacted policy or to have been adopted for routine policy making (Table 4).

Program budgeting and marginal analysis (PBMA)

The program budgeting and marginal analysis (PBMA) approach relies on two fundamental economic principles in its approach to priority setting: opportunity cost and marginal analysis [11]. The notion of opportunity cost implies that if resources are invested in one area, there are benefits that are given up in another area. Marginal analysis is concerned with the last unit of production of any two or more given programs. Marginal analysis allows decision makers to identify the best mix of

Multi-criteria decision analysis (MCDA)

We retrieved and reviewed twenty papers that described the application of the Multi- criteria decision analysis (MCDA) approach. Multi-criteria decision analysis facilitates the use of multiple explicit criteria in priority setting [4]. The process consists of four steps: 1) identifying policy criteria and metrics; 2) identifying a series of alternatives based on various combinations of policy criteria; 3) measuring performance of alternatives by criteria (through discrete choice experiment

Accountability for reasonableness

Accountability for reasonableness (A4R), is an ethics-based, and process-driven framework that focuses on ensuring that the priority setting process is fair [59]. According to this framework, a fair PS process should fulfill four conditions namely: Publicity: both the decisions and rationales of used in PS must be made publicized; Relevance: the rationales that guide the PS process must be considered to be relevance by “fair-minded” people in the context in which the framework is being applied;

Burden of disease and cost-effectiveness analysis (BOD & CEA)

The BOD/CEA approach was first introduced in the World Bank’s World Development Report of 1993, ‘Investing in Health’ [85]. In this approach, effectiveness is evaluated based on both mortality and morbidity data, under a composite measure; the Disability Adjusted Life Year (DALYs) [86]. DALYs are then used in CEA, whereby interventions with the most favorable cost-effectiveness ratio are prioritized. In many contexts, the most cost- effective interventions comprise the essential or basic health

Discussion

While there is a wealth of literature on approaches to priority setting, there is a paucity of synthesizes of the current literature to assesses the degree to which the approaches that have been developed to guide priority setting have influenced policy making and have been institutionalized. This paper filled this gap.

There were relatively limited peer review publications reporting on the degree to which all the approaches have influenced policy making and have been institutionalized. Although

Conclusion

This review found that while the intention of developing the priority setting approaches is for them to eventually be used to guide routine policy making, to date, not many have been integrated into routine practice. Sited limitations included technical complexity of the approaches and the resource requirements. Conversely, although some approaches, e.g. BOD/CEA, were perceived to be complex by some stakeholders, they have been integrated into routine policy making. This could be explained by

References (115)

  • R. Klein

    Rationing in the fiscal ice age

    Health Economics, Policy and Law

    (2010)
  • C. Mitton et al.

    Public participation in health care priority setting: a scoping review

    Health Policy (New York)

    (2009)
  • P.A. Ubel et al.

    “Rationing” health care: not all definitions are created equal

    Archives of Internal Medicine

    (1998)
  • R. Baltussen et al.

    Priority setting of health interventions: the need for multi-criteria decision analysis

    Cost Effectiveness and Resource Allocation [Internet]

    (2006)
  • C. Ham et al.

    International experience of rationing

  • N. Smith et al.

    Introducing new priority setting and resource allocation processes in a Canadian Healthcare Organization: a case study analysis informed by multiple streams theory

    Kerman University of Medical Sciences [Internet]

    (2016)
  • S.L. Sibbald et al.

    Priority setting: what constitutes success? A conceptual framework for successful priority setting

    BMC Health Services Research [Internet]

    (2009)
  • A. Tsourapas et al.

    Evaluating “success” in programme budgeting and marginal analysis: a literature review

    Journal of Health Services Research & Policy

    (2011)
  • L. Kapiriri et al.

    Successful priority setting in low and middle income countries: a framework for evaluation

    Health Care Analysis

    (2010)
  • L. Sabik et al.

    Priority setting in health care: lessons from the experiences of eight countries

    International Journal for Equity in Health [Internet]

    (2008)
  • C.R. Mitton et al.

    Setting priorities and allocating resources in health regions: lessons from a project evaluating program budgeting and marginal analysis (PBMA)

    Health Policy (New York)

    (2003)
  • C. Mitton et al.

    Listening to the decision makers: sustainability of PBMA in Alberta

    Applied Health Economics and Health Policy

    (2004)
  • C. Mitton et al.

    A priority-setting framework for Canadian regional health authorities

    Healthcare Management Forum [Internet]

    (2000)
  • C.R. Mitton et al.

    The evolution of PBMA: towards a macro-level priority setting framework for health regions

    Health Care Management Science

    (2003)
  • C. Mitton et al.

    Resource allocation in health care: health economics and beyond

    Health Care Analysis

    (2003)
  • C. Mitton et al.

    Setting priorities in Canadian regional health authorities: a survey of key decision makers

    Health Policy (New York)

    (2002)
  • S. Patten et al.

    From the trenches: views from decision-makers on health services priority setting

    Health Services Management Research

    (2005)
  • J. Gibson et al.

    Ethics and economics: does programme budgeting and marginal analysis contribute to fair priority setting?

    Journal of Health Services Research & Policy

    (2006)
  • C. Mitton et al.

    Priority setting in a Canadian surgical department: a case study using program budgeting and marginal analysis

    Canadian Journal of Surgery

    (2003)
  • B. Urquhart et al.

    Introducing priority setting and resource allocation in home and community care programs

    Journal of Health Services Research & Policy

    (2008)
  • F. Dionne et al.

    Evaluation of the impact of program budgeting and marginal analysis in Vancouver Island Health Authority

    Journal of Health Services Research & Policy

    (2009)
  • C. Mitton et al.

    Difficult decisions in times of constraint: criteria based resource allocation in the Vancouver coastal health authority

    BMC Health Services Research [Internet]

    (2011)
  • E. Cornelissen et al.

    Changing priority setting practice: the role of implementation in practice change

    Health Policy (New York) [Internet]

    (2014)
  • E. Cornelissen et al.

    Determining and broadening the definition of impact from implementing a rational priority setting approach in a healthcare organization

    Social Science & Medicine [Internet]

    (2014)
  • S.L. Sibbald et al.

    Evaluating priority setting success in healthcare: a pilot study

    BMC Health Services Research [Internet]

    (2010)
  • C. Mitton et al.

    Allocating limited resources in a time of fiscal constraints: a priority setting case study from Dalhousie University faculty of medicine

    Academic Medicine

    (2013)
  • N. Smith et al.

    A qualitative evaluation of program budgeting and marginal analysis in a Canadian Pediatric Tertiary Care Institution

    Applied Health Economics and Health Policy

    (2016)
  • L.R. Henderson et al.

    The costs of caring for stroke patients in a GP-led community hospital: an application of programme budgeting and marginal analysis

    Health & Social Care in the Community

    (2001)
  • J.M. Charles et al.

    Use of programme budgeting and marginal analysis as a framework for resource reallocation in respiratory care in North Wales, UK

    Journal of Public Health (Oxford)

    (2015)
  • R.T. Edwards et al.

    A national Programme Budgeting and Marginal Analysis (PBMA) of health improvement spending across Wales: disinvestment and reinvestment across the life course

    BMC Public Health

    (2014)
  • P. Miller et al.

    Programme approach to managing informed commissioning

    Health Services Management Research

    (2001)
  • E. Goodwin et al.

    Using programme budgeting and marginal analysis (PBMA) to set priorities: reflections from a qualitative assessment in an english primary care trust

    Social Science & Medicine [Internet]

    (2013)
  • M. Airoldi et al.

    STAR–people-powered prioritization: a 21st-century solution to allocation headaches

    Medical Decision Making [Internet]

    (2014)
  • M.E. Otim et al.

    Acceptability of programme budgeting and marginal analysis as a tool for routine priority setting in Indigenous health

    The International Journal of Health Planning and Management

    (2015)
  • C. Mitton et al.

    Twenty-five years of programme budgeting and marginal analysis in the health sector, 1974–1999

    Journal of Health Services Research & Policy

    (2001)
  • M. Haas et al.

    Using programme budgeting and marginal analysis to assist population based strategic planning for coronary heart disease

    Health Policy (New York)

    (2001)
  • J. Astley et al.

    Evidence-based priority setting

    Australian Health Review

    (2001)
  • P. Bohmer et al.

    Maximising health gain within available resources in the New Zealand public health system

    Health Policy (New York)

    (2001)
  • F. Dionne et al.

    The challenge of obtaining information necessary for multi-criteria decision analysis implementation: the case of physiotherapy services in Canada

    Cost Effectiveness and Resource Allocation [Internet]

    (2013)
  • E. Cornelissen et al.

    Fit for purpose? Introducing a rational priority setting approach into a community care setting

    Journal of Health Organization and Management

    (2016)
  • B. Urquhart et al.

    Introducing priority setting and resource allocation in home and community care programs

    Journal of Health Services Research & Policy

    (2008)
  • T. Defechereux et al.

    Health care priority setting in Norway a multicriteria decision analysis

    BMC Health Services Research [Internet]

    (2012)
  • C. Aenishaenslin et al.

    Multi-criteria decision analysis as an innovative approach to managing zoonoses: results from a study on Lyme disease in Canada

    BMC Public Health [Internet]

    (2013)
  • R. Cox et al.

    Multi-criteria decision analysis tools for prioritising emerging or re-emerging infectious diseases associated with climate change in Canada

    PLoS One

    (2013)
  • F. Dionne et al.

    Developing a multi-criteria approach for drug reimbursement decision making: an initial step forward

    Journal of Population Therapeutics and Clinical Pharmacology

    (2015)
  • A. Mirelman et al.

    Decision-making criteria among 1 national policymakers in five countries: a discrete choice experiment eliciting relative preferences for equity and efficiency

    Value Health [Internet]

    (2012)
  • M.J.M. Hummel et al.

    Using the analytic hierarchy process to elicit patient preferences

    The Patient–Patient-Centered Outcomes Research [Internet]

    (2012)
  • K. Marsh et al.

    Prioritizing investments in public health: a multi-criteria decision analysis

    Journal of Public Health (United Kingdom)

    (2013)
  • R. Baltussen et al.

    Balancing efficiency, equity and feasibility of HIV treatment in South Africa–development of programmatic guidance

    Cost Effectiveness and Resource Allocation

    (2013)
  • J. Miot et al.

    Field testing of a multicriteria decision analysis (MCDA) framework for coverage of a screening test for cervical cancer in South Africa

    Cost Effectiveness and Resource Allocation [Internet]

    (2012)
  • Cited by (26)

    • Priority Setting as an Ethical Imperative in Managing Global Dialysis Access and Improving Kidney Care

      2021, Seminars in Nephrology
      Citation Excerpt :

      The initial goal should be to address the needs of the disadvantaged in sustainable and scalable ways. Priority setting is inherently a value-laden process, and cannot be whittled down to technical considerations of clinical or cost-effectiveness alone; diverse frameworks therefore increasingly are being used simultaneously.81,82 Evidence is needed to feed into the deliberative process, but interpretation of the evidence requires a broad perspective and consideration of multiple ethical principles and values, with a willingness to learn and adapt such that decision making can be optimized in an iterative fashion.83

    • Applying priority-setting frameworks: A review of public and vulnerable populations’ participation in health-system priority setting

      2020, Health Policy
      Citation Excerpt :

      The fact that the stipulations of the frameworks are not being followed may reflect that many of the included studies were research projects. Feasibility of comprehensive stakeholder participation that includes not only the powerful stakeholders, but also publics and vulnerable groups, can be limited in the context of a research project rather than implementation of the frameworks in actual policymaking contexts [18,23]. Disconnects between the foundational papers and applications of the frameworks may also point to some practical limitations of public participation.

    View all citing articles on Scopus
    View full text