e) Qualitative Impact Protocol (QuIP)
The Qualitative Impact Protocol is a methodology designed to attribute change (i.e. outcomes and impacts) to an intervention through narratives, stories, and in-depth interviews with intervention recipients. Although it has been successfully used by humanitarian actors, it requires highly trained, independent data collectors, meaning that it may be challenging for National Societies with scarce resources. This method has not yet been used to evaluate anticipatory action programmes. More information on this methodology can be found in the toolbox.
f) Participatory Impact Assessment
Participatory impact assessment (PIA) is based upon participatory rural appraisal (PRA) which is similar in approach and philosophy to Red Cross Red Crescent vulnerability and capacity assessments. It has three main objectives:
- to identify the factors leading to change in people’s lives;
- to determine which of these factors can be linked to a specific intervention;
- to determine the importance of each factor.
PIA allows communities to participate in the definition of indicators rather than relying on pre-determined or prescribed targets. Rather than attempting to compare results to non-participants in a programme, it asks participants to describe change over time. Many activities begin with a ranking or scoring activity, followed by an open-ended discussion to understand the results of the ranking. While the activities are often considered qualitative, when repeated in a standardized way, the ranking and scoring activities can yield some numerical data and quantitative insights or “participatory numbers.” This methodology has been used outside of anticipatory action to evaluate livestock interventions, particularly in pastoralist settings. A guide to participatory impact assessment can be found in the toolbox.
g) People-first Impact Method (P-FIM)
The people-first impact method (P-FIM) is a community engagement tool that respects the right and ability of communities to take to lead in the design, implementation, and evaluation of aid programs. Ideally, it would be employed from the start (i.e. feasibility study and EAP design stage), to ensure that anticipatory action programs in general, and specific actions in particular, address genuine community needs and integrate community abilities and solutions in an added-value cost-effective and sustainable approach. P-FIM builds trust, two-way engagement, and transparency between agencies and communities. It identifies the most critical areas for community-led action without introducing organizational bias or pre-conceived and (possibly) untested assumptions. Through two-way dialogue facilitated by trained local teams who live and work in the context, P-FIM brings to light what people believe are the most critical issues and forces impacting their lives, positive and negative. It is valuable in identifying appropriate interventions and adds value and relevance to existing agency tools by allowing communities to lead in the selection and development of MEAL plans and tools, such as theories of change or post-distribution surveys.
As a community engagement approach, P-FIM fits naturally with MEAL: engaging the community allows communities to shape MEAL components, ensuring they are easily understood by communities and agency frontline staff and volunteers. P-FIM challenges agencies to develop simple easily understood tools. Like PIA, it helps agency staff and volunteers understand what communities and organizations feel should be monitored and evaluated and how. In the P-FIM approach, the evaluation questions used in focus group, key informant interviews, and other discussions are defined by communities themselves with the National Society. Similarly, P-FIM engages communities in selecting and designing other (perhaps more academic) methods to be used for evaluation.
Welthungerhilfe uses the method to inform its anticipatory action programs. The toolbox includes a guide explaining the full P-FIM approach and an overview of how P-FIM two-way engagement can be applied to MEAL at all stages of a programme. Within those documents, you will find contact information to request a 2-day, practical P-FIM training for your team.
h) INDABA
INDABA is an innovative participatory video process that allows communities to design, collect, edit and develop their own stories through a mobile application that can be used onsite and in remote contexts. IFRC’s Strategic Planning Department in coordination with National Society counterparts, developed and is supporting this qualitative approach in PMER for long term and emergency contexts. It has been rolled out in Colombia, Egypt, Eswatini, Gambia, Honduras, Indonesia, Kenya and Namibia. Examples can be found on IFRC’s PMER (Planning Monitoring Evaluation and Reporting) YouTube page.
This qualitative approach relies strongly on community engagement in the process to allow for feedback not only at the community level, but also at the level of disaggregated groups (e.g. the elderly, women, men, and youth). The process is adaptable to context and uses different facilitation methods (photos, story boarding cards, sectorial cards with questions, tags, dice etc.) to engage participants, put them into the context of the project or programme and allow them to share feedback that can inform improvement. The online process has been simplified to allow community members to easily design, tag, edit and create their own videos.
Although not yet explicitly applied to anticipatory action, the INDABA method that could be relevant to anticipatory action for the following reasons:
- It is a community-based approach. Communities are the first to detect early warning signs of crises;
- The feedback collected through video stories can provide the IFRC network, partners and donors with real time feedback on anticipatory action rooted in local knowledge.
- Story telling is a strong tradition in many cultures. The production and sharing of video stories could allow people to describe their experience of anticipatory action in their own ways. It could also help promote peer-to-peer knowledge transfer in anticipatory action.