LocationsPart 1 - Beyond Numbers: Transforming Development by Learning, and Leading for Lasting Impact
Innovative Strategies for Measuring Impact: Insights from 14 African Countries
September 16, 2024
This blog is presented in two parts. In Part 1, we will highlight the innovative actions being taken by UNDP Country Offices to drive progress and development in data collection and impact measurement. Part 2 will focus on refining strategies, addressing bottlenecks, and enhancing the effectiveness of Monitoring, Evaluation, and Learning (MEL) frameworks.
Behind every number, lies a story – a life, a struggle, a dream. People are at the core of our work at UNDP. and this was at the center of our conversation during the regional gathering of M&E officers from across 14 countries in Africa. This was the guiding principle of our recent regional workshop in Nairobi, where Monitoring and Evaluation (M&E) officers from 14 African countries gathered to discuss how to better listen to people and learn from our successes and setbacks to refine our strategies for meaningful, lasting change.
Coinciding with our workshop, the 'Nane Nane' protests[1] in Kenya served as a stark reminder that development is not merely about projects or policies—it’s about addressing the underlying issues that fuel public frustration.
This powerful backdrop underscored our commitment to not only measure progress but to ensure that our actions truly meet the needs of the people we serve: Are we truly making a difference where it matters the most? Who are the people most affected? Who, directly or indirectly, influences these outcomes?
As events unfolded, our discussions on impact measurement assumed renewed significance, emphasizing the need for deeper reflection on our methods. How can we ensure that interventions go beyond surface-level to address the root causes of unrest? How do we measure the impact of our work in a way that truly captures thecomplexities on the ground?
It is not just about tallying numbers or ticking boxes, but also about understanding the social, economic, and political contexts that shape outcomes
The multi-dimensional nature of development demands a nuanced approach to measuring its impact. It is not just about tallying numbers or ticking boxes, but also about understanding the social, economic, and political contexts that shape outcomes. Engaging a broad spectrum of stakeholders, ranging from governments and NGOs to community leaders and citizens, is essential for creating and measuring change.
As development practitioners, it is essential we continuously reassess our approaches to drive enduring, effective changes for communities.
Why Measuring Impact is More Critical than Ever in our Development Efforts
UNDP is spearheading a transformative shift from traditional aid models to dynamic partnerships that prioritize openness, accountability, and tangible results for people’s lives. As we embrace these changes, the importance of measuring our impact has never been greater. It is essential to ensure that our efforts align with evolving priorities and deliver meaningful, lasting outcomes.
This shift is reflected in the UNDP Strategic Plan for 2022-2025, which emphasizes on the importance of learning from our work, making the necessary adjustments, and using thoughtful approaches to tackle the challenges faced by communities. By doing so, our actions not only address immediate needs, but also foster long-term progress. UNDP’s Strategic Plan uses a "3x6x3" framework, which integrates three key areas of change, six strategic solutions, and three essential enablers to effectively guide our efforts toward achieving the Sustainable Development Goals (SDGs) our efforts towards achieving the Sustainable Development Goals (SDGs).
Transforming the way we measure impact: Insights from 14 Country Offices in Africa
Reflecting on recent developments in Kenya but also in the Sahel, it is clear that our approach to measuring and understanding impact must adapt to evolving needs. This is not simply an abstract challenge, but a critical issue countries across Africa have to address more tangibly. During our workshop in Nairobi, representatives from 14 countries[2] shared their approaches for transforming challenges into opportunities for meaningful change. Their experiences offer valuable lessons for refining our strategies and ensuring more meaningful and targeted efforts.
- Zimbabwe and Angola: Redefining Development with Inclusive Governance and Portfolio Approaches
The concept of social contract has gained importance in Zimbabwe. The country is rethinking its approach to governance and economic development, focusing on rebuilding institutional trust and providing more accessible services, even to remote communities. Through its programming framework, UNDP Zimbabwe tackles deep-rooted challenges, such as the effects of climate change on livelihoods and communities; governance and institutional strengthening; and economic stagnation. Central to this shift is the adoption of a Portfolio Approach, aimed at scaling successful initiatives and aligning them with a well-defined Theory of Change, a process UNDP country office refers to as ‘country office re-piloting.’ The portfolio approach is, therefore, anchored on the Country Programme Document[3]’s Theory of Change. This defines the transformative agenda in the Country Office’s programmatic approach, from addressing challenges through individual or collective projects, to acknowledging that system challenges are best addressed through system responses, underlining the importance of the portfolio approach. It is envisioned that this will ensure that development efforts are both impactful and sustainable, harnessing the diversity and synergies owing to the multidimensional nature of the development challenges in Zimbabwe.
A few countries in Africa are at the primary stages of this portfolio approach and UNDP [4] Angola is pioneering in its adoption. The Country Office has initiated small-scale projects demonstrating significant potential for mobilizing resources and influencing policies. These initial successes are now paving the way for more comprehensive and integrated strategies, with far-reaching and enduring effects, across various sectors.
- DRC and Burundi: Advancing Monitoring, Evaluation and Learning Through Digital Transformation
Digital innovation is transforming Monitoring, Evaluation and Learning (MEL) systems in the DRC and Burundi.
Burundi implemented a digital monitoring and evaluation system that significantly improved data accuracy and supported timely decision-making through advanced visualization features. This system has not only been replicated in Madagascar with our support but is also set to be adopted in Mauritania. The experience has also been shared with Congo Brazzaville. Embracing digital tools is vital in ensuring accurate data and making well-informed decisions, based on valuable insights.
Owing to the vast size of the DRC, adopting digital data collection techniques addresses the challenges in data availability, quality, and management.
- Rwanda’s Strategy: Connecting Culture, Data, and Storytelling for Impact
Rwanda’s experience underscores the need to adapt data collection and reporting methods to suit cultural and linguistic contexts. In a nation where Kinyarwanda, French, and English are all widely spoken, our Country Office in Rwanda has effectively engaged the youth through social media and digital platforms. This forward-thinking strategy has proven successful in gathering data and communicating developmental outcomes in ways that resonate with different audiences. By blending storytelling with results, Rwanda uses data-driven narratives to clearly demonstrate the impact of its development initiatives and drive continued progress.
- Kenya’s Unified Approach: Strengthening Collaboration and Data-Driven Decision-Making
Kenya showcases how a unified platform for reporting and Monitoring, Evaluation and Learning (MEL) can strengthen collaboration between civil society organizations (CSOs) and project stakeholders. This system not only streamlines data collection, but also fosters transparency and accountability. By tapping into its rich pool of citizen-generated data, particularly on social accountability and governance, Kenya is unlocking valuable insights for more informed decision-making. Though still underutilized, this data has the potential to guide initiatives that are more closely aligned with the needs and aspirations of the people. Kenya’s approach underscores the critical role of leveraging this resource to scale impactful development efforts.
Overcoming Data Management Challenges
Despite these significant progress, several of the 14 UNDP country offices gathered at our Nairobi workshop continue to face common data management challenges. These include inconsistent data standards, limited capacity for data verification, and outdated technology -- all of which hinder effective data collection and use. The workshop focused on addressing these issues, identifying the gaps as well as sharing and testing the tools developed by the Regional Bureau for better data readability, validation, and visualization. These efforts are vital for the continued success of development programs.
Bridging Data, Actions, and Broader Outcomes – A Layered Framework for Impact Measurement
To better align compelling narratives with reliable data, the Regional Bureau has developed a refined approach to impact measurement. This framework places data at the center of the process, guiding each step, from assessment and intervention to evaluation of broader social and environmental effects. Using data as reference points, this approach aims to provide a more accurate and holistic understanding of the impact of our work, ensuring that our efforts produce tangible and enduring outcomes. Data serves as the foundation for documenting the "Actions" undertaken across UNDP country offices, translating into measurable outcomes as defined by performance indicators in various thematic areas. This approach supports the organization's overarching theory of change and transformative agenda.
[1] "Nane Nane" protests, referring to the date 8 August ("eight eight") in Swahili, are ongoing demonstrations by activists who are calling for the resignation of President William Ruto’s administration.
[2] Angola, Burundi, Cabo Verde, DRC, Ethiopia, Kenya, Mauritius/Seychelles, Mauritania, Mozambique, Rwanda, Senegal, South Africa, Zambia, Zimbabwe
[3] Country Programme Documents (CPD) are the strategic plan developed jointly by UNDP and each country UNDP works in, which outlines how UNDP will work with the specific country to address its development needs and priorities
[4]Only a few countries are currently exploring this approach (not the 46 country offices). This approach will be increasingly used and as the policy has recently been adopted by the organization.
Figure 1 - The diagram highlights how data supports each layer of our impact measurement approach, guiding the progression from data collection to broader societal outcomes.