Abstract Information: Bringing local voices to the forefront of evaluation and learning is an ongoing challenge for evaluation practitioners. USAID/Liberia’s Data, Evaluation, Learning, and Technical Assistance (DELTA) program (implemented by International Business Initiatives and Social Impact) is tasked with supporting USAID’s broad goals in monitoring, evaluation, and collaboration, learning, and adapting. DELTA is working to change the dynamics of evaluation systems by testing how some of our most adaptive and locally rooted evaluation methods can help create more timely feedback loops between Liberia’s citizens and USAID/Liberia, all the way up at strategy levels. This roundtable will share how a team of evaluators used a systems lens to pilot three approaches to explore how to make donor processes and practices more locally led: (1) local system mapping; (2) developmental evaluation; and (3) beneficiary feedback loops using Most Significant Change as a participatory monitoring tool. Participants will learn about the team’s successes and challenges using each of these approaches, which were considered more effective, and what will be carried forward. Participants will also shape the evolution of locally led approaches by sharing ideas for how to strengthen feedback loops in meaningful ways. Ultimately, this session will share our journey to rethink how we can use our MEL tools to create a more direct line of communication between program participants and the donor’s north star. Come join to help shape the story.
Relevance Statement: Our sector tells many stories about shifting power, about how development practices need to change. This session will explore how evaluation tools can turn the stories of Liberian voices into action, both at programmatic and strategy levels. USAID/Liberia is developing a Localization Strategy alongside its existing Country Development Cooperation Strategy (CDCS). Social Impact and International Business Initiatives (IBI) are using a suite of monitoring, evaluation, and learning (MEL) tools to craft, monitor, and co-create solutions under the Localization Strategy. The following MEL tools not only capture the stories, but more importantly, they provide platforms and spaces to share back, jointly make sense of what efforts are making an impact, and collectively shape a new story around what the path forward should look like.
Tool 1: Local System Mapping as the Basis of the Localization Strategy The first step has been to start with mapping the local system to understand the current landscape of actors; the context within which they operate; and their motivations, enablers, and inhibitors.
Tool 2: Developmental Evaluation to Implement the Localization Strategy Once the Localization Strategy is finalized, one tool being explored is to conduct a Developmental Evaluation of the Localization Strategy. The Developmental Evaluation can serve as the platform to continuously gather evidence to address emergent needs and convening Liberian organizations to make sense of evidence, ideate solutions, then test and decide which solutions to bring to scale. Participants will learn how Developmental Evaluations allow us to conduct monitoring and evaluation at a systems level, recognize that change is not achieved along linear paths, and shift power to local voices.
Tool 3: Beneficiary Feedback Loops to Measure Progress of the Localization Strategy and CDCS In tandem, we are piloting Most Significant Change as a participatory monitoring tool. This will enable USAID/Liberia to create a shared understanding of what changes are most significant from the perspective of Liberians so that more effort can be invested in creating even more of those positive changes.
The suite of MEL tools were crafted with one purpose in mind: creating a channel for Liberian voices to drive the donor’s strategy. This can only be done through reform of donor practices and processes, having Liberian organizations identify where their seat at the table is most crucial, and how we can move toward initiatives originating and being managed locally, with support from donors.
The audience will walk away with new stories about how to use systems mapping, developmental evaluations, and most significant change in their own work. Moreover, the panel will deepen the conversation around how to a holistic view of the interrelated and complex elements influencing locally-led development and to identify strategic levers to affect change.