Evaluating in conflict and fragile settings: A West African Case study

Abstract Information: Conflict is a major threat to sustainable growth and development in Africa and worldwide. Given the many different conflict analysis models and frameworks, evaluators need to have an understanding of conflict and fragility as the basis for their work. One of the main challenges specific to evaluations in fragile and conflict-affected settings is understanding and adapting to violent conflict, while mitigating the risk that evaluations themselves become part of the conflict or cause harm to those involved (OECD, 2012). Other challenges addressed are: complexity, weak theoretical foundations, challenges to data collection, attribution, a highly political environment, multiple actors and multiple agendas.

While there are many approaches to evaluation, those associated with conflict and fragile contexts are the most striking. In the evolving field of conflict and fragility where approaches to evaluation are likely to vary overtime, with the evolution of certainty and/or uncertainty about risks, impacts and solutions, it is challenging to frame and design evaluations effectively.

Studies (OECD, 2012; World Bank, 2009, 2010; N. Beaudeliau, 2010; D. N. Barton, 2010; N. Lamhauge et al., 2011) highlight a combination of challenges (ambiguous definition of fragility, reconstruct of the theory of change, shifting baselines, attribution, and time lags between interventions and outcomes) that affect evaluation frameworks in fragile settings.

Beyond theoretical considerations and assumptions, substantive issues remain. How should evaluation be conducted in conflict and fragile contexts in order to meet the required quality standards and its intended role? Knowing that context matters, this paper will survey the options that could enhance methods and approaches in order to enable managers and actors to take informed decisions and plan strategically. It focuses on a literature review of methods and approaches from evaluations of conflict and fragile related programmes and highlights the main challenges of dealing with uncertainty and fragility. In addition to experiences from international humanitarian NGOs such as the Norwegian Refugee Council (NRC), the presentation finally addresses propositions that would improve evaluations in the context of conflict and fragility helping thus to improve programming with the hope of strengthening self-reliance and resilience of affected populations.

Relevance Statement: This presentation explores tools and methodologies that have been tested and validated in fragile settings-West Africa. It will specifically focus on experiences and case studies from the Democratic Republic of the Congo, Northeast Nigeria and Burkina Faso. This provides the audience (all levels) with additional insights about how to use evaluation to voice the needs and priorities of project participants living in conflict or fragile settings. The paper outlines flexible approaches to primary data collection using both quantitative and qualitative consultative tools. It includes options and considerations for different contexts to enable their applicability in crises that are rapid onset, slow onset or protracted in nature. The aspiration in these experiences in West Africa is that they will evolve over time from a consultative process to a more inclusive one that value the unique perspectives and experiences of participants.
Based on lessons and feedbacks, the paper will highlight key good practices, practical ways to effectively involve participants in fragile settings especially conflict, violence that affect them. Finally, and crucially, key recommendations would enable humanitarian-centered agencies, researchers, conference participants responding to humanitarian crises to better support participants to realize their rights.