M&E Sourcebook: Case Studies - Examples

CAMI/ARC:

Mitigation Grant for Risk Management and Community Preparedness, 2001-2003. Final impact evaluation report, 2003.

See full length evaluation report.

1. Type of project/programme evaluated

   The project focused on training in disaster preparedness/prevention and response. It provided necessary equipment to respond to an emergency and included some small structural mitigation projects. It was carried out in El Salvador, Guatemala, Honduras and Nicaragua, four countries affected excessively during Hurricane Mitch due to poor risk management (in particular, a lack of preparedness, readiness and response capabilities), poorly trained emergency personnel and an over centralisation of disaster services in the capital. The project aimed to build the capacity of four Central American National Societies to monitor and respond to disasters. The goal was to reduce excess morbidity, mortality, and property loss by: training chapter staff and local emergency committees to develop, become trained in, and institutionalize standard disaster response procedures; training households and schools in disaster preparedness/response; and training a corps of Red Cross volunteers, who will be community-based, to provide disaster preparedness training and follow up in their communities. Specifically, the project's goals and objectives were:

   • Project Goal: Decrease excess morbidity and mortality caused by natural disasters through increasing the capacity of four Red Cross National Societies to monitor and respond to such disasters.

   • Objective #1. Improve the timeliness and appropriateness of mitigation responses of Red Cross National Societies and communities to disaster through developing sustainable protocols and training personnel in operation centers and emergency committees.

   • Objective #2. Increase knowledge, self-efficacy and skills in Disaster Preparedness and response of individuals and households through incorporating risk management concepts in formal and informal education methods.

   • Objective #3. Increased technical capabilities of 4 Central American National Societies to implement community based education programs for disaster preparedness and response.

   Specific interventions were then grouped under the objectives.

2. Evaluation method(s) applied

   The evaluation focuses on whether or not the CAMI project interventions achieved their intended outcomes in an efficient, effective and sustainable manner. The methodological approach was mainly quantitative, designed to measure the state of preparedness before and after project interventions. A series of objective (impact) and output indicators were developed to measure performance against baseline data which were collected at the start of the project and against project targets. The evaluation also compared cost per beneficiary across the four project countries. A participatory methodology was only used during the project implementation phase to assess risk/vulnerability and identify priority mitigation micro-projects. Little stakeholder participation took place during the evaluation phase. Quantitative data were collected through interviews, household surveys, project documentation, direct observation and through simulations or drills (e.g. "safe conditions" in schools were assessed through the administrative preparation of the school: observation of a written emergency plan and the existence of evacuation routes and risk maps).