Share the article

Policy  –  Develop a national action plan

Evaluate progress

Monitoring and evaluation through analysis and reporting of quality indicators is an integral part of any health policy.

Evaluation of the national action plan

In order to ensure that implementation of the national action plan on antimicrobial resistance occurs as planned, continuous monitoring is important. Results should be fed back to government parties and members of the stakeholder platform in a timely manner and in a format that can be interpreted and used by the respective party. Periodic evaluation is important to understand if goals are being accomplished and to identify aspects that may need improvement.

Develop a monitoring and evaluation plan

When monitoring health reforms, assessments of the level of inputs (financial, human, and logistics), the dynamics, processes and the outputs of implementation are in focus. Evaluation then assesses the extent to which the policy’s different activities have achieved the outcome and impact objectives. In other words, if the policy has had the effect it intended and what could be addressed and improved.

Often evaluation is done by measuring indicators, however, in addition, the collection of descriptive data can be helpful to give a comprehensive view of the extent to which changes are occurring. When developing a monitoring and evaluation framework, the multisectoral coordinating group should consider:

  • What is the specific aim(s) of the policy/intervention?
  • What measure(s) monitor the policy implementation process?
  • What measure(s) would show progress in achieving stated aims?
  • How to collect and record such data?
  • Who will analyze and interpret the data?
  • How does the results of such data then influence stakeholders and/or policy?

Annual target plans

One way of increasing the likeliness of actual implementation is to set up annual target plans. Such target plans help in planning for short and long term goals of the policy and to go from policy into action. Moreover, they can serve as important tools for budget planning and allocation. It is advisable that the annual target plans also include clear and measurable indicators to allow monitoring and evaluation of the process.

Measurement and indicators

An essential part of the planning of the monitoring and evaluation plan is the development of adequate indicators. It is important that indicators represent the progress towards implementing the activity or achieving the outcome. Indicators used to monitor implementation of the antibiotic resistance policy can be divided into different groups:

Indicator Groups for Monitoring and Evaluation:

Indicator Group Description Example(s)
Input Indicators measuring resources used/needed in implementing policy Financial cost of:

  • Infrastructure
  • Human resources
  • Consumables
Process Indicators measuring action points relating to programme implementation
  • Working groups formed
  • Training sessions held
  • Launch of public awareness campaign
Output Indicators measuring the number or presence of intended products/outputs
  • Number of infection control programs initiated
  • Dosages of antibiotics distributed
Outcome Indicators that assess the quantity and quality of the policy implemented
  • Decrease of inappropriate use of antibiotics in agriculture or veterinary medicine
  • Decrease in targeted drug-resistant infections
Impact Indicators assessing the achievement of longer term goals relating to broader policy aims
  • Health Status of the population
  • Reduced risk of pandrug resistance

Implementation plan, indicators and targets for WHO’s South East Asia’s Regional Office (SEARO) strategy on prevention and containment of antimicrobial resistance (2010-2015):

The WHO SEARO regional strategy 2010-15 recognized the need for a wide range of activities to contain antimicrobial resistance and the need for commitment from a wide variety of players. The strategy states that endorsement by all countries of the region is needed for sustained action. It provides an implementation framework with suggestions of activities that could be included together with a list of suggested indicators and targets. Many of these regional indicators could be transferable to the national level. The strategy and the different indicators were followed up in regional meetings and workshops where country reports on current status and progress were presented.

In MEASURE you can find specific tools and resources for measuring various aspects of antibiotic resistance and use (such as point prevalence survey protocols and knowledge, attitudes, beliefs and practice questionnaires):

Analyzing and communicating results

Data collected from monitoring and evaluation efforts should be analyzed by the multisectoral coordinating group and additional key stakeholders.

Results from monitoring indicators (such as input and process indicators) can inform discussions related to future implementation strategies, whilst results from evaluation indicators (such as output, outcome or impact indicators) can also be used in future resource allocation decisions. Information for both sets are needed, as a failure of impact may be due to a failure in implementation.

Results should be fed back to collaborating partners and interested stakeholders, especially management. Communication methods and content should be tailored to the audience, and reporting should be transparent to promote confidence in the national action plan. Positive progress should be acknowledged and public recognition should be made of the contributions and successes of all partners involved in the project. Affirmation of hard work will provide incentive for stakeholders to continue to be involved in the process.

Selected Resources

Resource Description 
Monitoring and evaluation of the global action plan on antimicrobial resistance: framework and recommended indicators Guidance with indicators. Framework to help obtain and analyze standardized data to assess the success of the global action plan on antimicrobial resistance (GAP) and inform operational and strategic decisions on resistance at both national and global levels. Recommends indicators to be compiled on a national level as well as indicators to be collected on a global level from secondary sources.
FAO Antimicrobial Resistance Policy Review and Development Framework Guide from FAO to help decision-makers and technical staff to review, develop and implement national policies on antimicrobial use and resistance in food animal production. Covers both AMR-specific and AMR-relevant policies. The Framework is designed to help countries review and update their national policies and provides examples from countries that facilitate effective national responses to AMR. Developed for governments in Asia and the Pacific.
Building Coalitions for Containing Antimicrobial Resistance: A Guide Guidance by SIAPS offers guidance on how to formulate and implement a plan and evaluate outcomes. Also provides a number of templates and sample interview forms that can be adapted for different local contexts. The chapter “Monitor and evaluate” gives an overview of the M&E process with country examples. An older version is available in Spanish and French.
ECDC, EFSA and EMA Joint Scientific Opinion on a list of outcome indicators as regards surveillance of antimicrobial resistance and antimicrobial consumption in humans and food-producing animals Indicators. Suggestion of outcome indicators with a ‘One Health’ perspective to support assessment of progress made in the implementation of actions against antibiotic resistance in EU Member States. Provides rationale for selection, describes methodology, and provides example of calculation of indicators. Established by European health and food safety agencies. Examples: Human medicine: proportion of Escherichia coli bacteria resistant to third-generation cephalosporins. Veterinary medicine: proportion of E. coli in food-producing animals that are susceptible or resistant to a number of antibiotics.
Monitoring, evaluation and review of national health strategies: a country-led platform for information and accountability Guidance from WHO to policy makers and health practitioners on how to strengthen the monitoring, evaluation and review of national health strategies. , available in English, French and Spanish.
Guidelines for Monitoring and Evaluation of Health Sector Reforms in the African Region Guideline published by the WHO’s Regional Office for the African Region. It offers guidance to member states on how to integrate M&E into the process of health care planning. It also provides a background to health sector reform implementation and proposes a conceptual framework for identifying key questions and indicators for monitoring and evaluating these reforms.
Evaluating Policy Influence and Advocacy Guidance on evaluating policy influence and advocacy from Better Evaluation, a global collaboration aimed at improving evaluation practice.
An analysis of national action plans on antimicrobial resistance in Southeast Asia using a governance framework approach Journal article reviewing the content of ten national action plans from countries in Southeast Asia. Uses an antimicrobial resistance governance framework to evaluate policy design, implementation tools, one health engagement, monitoring and evaluation and sustainability. Also analyses alignment with the global action plan (GAP) on antimicrobial resistance.

More from "Develop a national action plan"

1.
Food and Agriculture Organization of the United Nation - FAO. Antimicrobial Resistance Policy Review and Development Framework. Preprint at https://www.fao.org/documents/card/es/c/CA1486EN/ (2018).
1.
World Health Organization - WHO. Guidelines for Monitoring and Evaluation of Health Sector Reforms in the African Region. Preprint at https://www.afro.who.int/publications/guidelines-monitoring-and-evaluation-health-sector-reforms-african-region.
1.
Better Evaluation. Evaluating Policy Influence and Advocacy. https://www.betterevaluation.org/en/themes/policy_influence_advocacy.
1.
Monitoring, evaluation and review of national health strategies: a country-led platform for information and accountability. (World Health Organization - WHO, 2011).
1.
World Health Organization - WHO, Food and Agriculture Organization of the United Nation - FAO & World Organisation for animal health - OIE. Monitoring and evaluation of the global action plan on antimicrobial resistance: framework and recommended indicators. (World Health Organization, 2019).
1.
Chua, A. Q., Verma, M., Hsu, L. Y. & Legido-Quigley, H. An analysis of national action plans on antimicrobial resistance in Southeast Asia using a governance framework approach. The Lancet Regional Health - Western Pacific 7, 100084 (2021).
1.
WHO Regional Office for South-East Asia. Regional strategy on prevention and containment of antimicrobial resistance, 2010-2015. Preprint at https://apps.who.int/iris/handle/10665/205853 (2010).
1.
SIAPS. Building Coalitions for Containing Antimicrobial Resistance: A Guide. Submitted to the US Agency for International Development by the Systems for Improved Access to Pharmaceuticals and Services Program. Arlington, VA: Management Sciences for Health. http://siapsprogram.org/publication/building-coalitions-for-containing-antimicrobial-resistance-a-guide/ (2017).
1.
ECDC, EMA Committee for Medicinal Products for Veterinary Use (CVMP) & EFSA Panel on Biological Hazards (BIOHAZ). ECDC, EFSA and EMA Joint Scientific Opinion on a list of outcome indicators as regards surveillance of antimicrobial resistance and antimicrobial consumption in humans and food-producing animals. EFSA Journal 15, n/a-n/a (2017).
1.
World Health Organization - WHO. Child Health and Development - Indicators. http://www.emro.who.int/child-health/research-and-evaluation/indicators/All-Pages.html.