Learning and reflecting on Evidence Informed Policy Making
Updated: Apr 19, 2021
Courtesy of Alan Levine, under CC at flickr.com
After three years, 11 countries, 1, 164 people trained and 26 public engagement
VakaYiko Symposium 2016: a space for reflection
Earlier this month, INASP gathered 40 VakaYiko partners and stakeholders in Accra for the VakaYiko Symposium on Approaches to Building Capacity for EIPM. Representatives from ministries, parliaments, think tanks, universities and NGOs in 12 countries gathered to share our experience. We discussed everything from evidence for gender policy in Sudan to building networks for evidence informed policy in Peru.
So what have we learned?
VakaYiko aimed to try out different approaches to building capacity for evidence use, across a wide range of country and institutional contexts. Here are five key things we’ve learned—and you can read more in our new report on lessons learned from our programme.
Evidence informed policy making is relevant and important to policymakers in a wide range of political and economic contexts. It’s not only for rich countries or for ‘open’ democratic systems. We relied on trusted local partners with credibility and political savviness to understand how EIPM applies in these different contexts and frame it in an appropriate way. We also tried hard to make our EIPM Toolkit relevant and practical in resource-constrained environments. But we wish we’d included a research component to our programme which could have analysed EIPM in our different country contexts more deeply.
A broad definition of evidence is essential. We looked at four different kinds of evidence: data, citizen knowledge, practice informed knowledge, and research [ref]. This was a good fit for the researchers and policy analysts we were working with, many of whom are relying mainly on statistics and stakeholder consultations for their evidence. Research often comes at the bottom of the list: it’s seen as time consuming, expensive and inaccessible to many. So an approach to EIPM which rests solely on complex, highly academic tools like randomised controlled trials (RCTs), systematic reviews, and evidence gap maps would not be relevant in many of the contexts we’ve worked in.
We started with an assumption that there were at least three levels of capacity needed for EIPM: individual civil servants with the skills to access, appraise and use evidence; organisational processes for systematically gathering and using evidence; and a wider enabling environment of engaged citizens. We’ve now added a fourth cross-cutting dimension: networks. Networks within and between government departments, as well as between different parts of the research system, are fundamental to building capacity for EIPM. In addition to our public engagement strand of work, we used our approaches at all the other levels to strengthen networks—for example, inviting external speakers from other parts of the research-to-policy system to training workshops and training different departments within one institution together.
A holistic approach which addresses multiple levels of capacity at the same time is most effective. In some countries, we focused on just one level: for example, training or organisational processes. In other countries, we focused on multiple levels at the same time, combining events with pairing schemes, or training with policy dialogues. In cases where multiple levels are targeted at once, it’s important to ‘join up’ the different components though—for example, having pairing scheme participants as speakers at events. And while our results show that developing core skills of civil servants through adult learning approaches is a fundamental part of strengthening capacity for EIPM, in future we would combine these trainings with more in-depth organisational work.
Navigating Payment by Results effectively. Our programme was funded under the UK Department for International Development (DfID)’s new ‘Payment by Results’ (PBR) model, which was a new way of working for many of us. Several partners felt that PBR’s tight timescales and specific pre-defined milestones inhibited the kinds of flexible, adaptive working which is important for working with pubic institutions in highly politicised contexts. However, over the years we became more accustomed to PBR models, adjusting our internal systems and processes and developing new ways of phrasing milestones to allow for maximum flexibility. We benefited from an open and reflective relationship with our DfID advisor.
VakaYiko has been granted a short extension from DfID. We’ll be using this to work more deeply at an organisational level in the Ministry of Youth in Zimbabwe and the Parliament of Ghana, through a series of strategic workshops on evidence use. We’re also welcoming two new partners: the African Centre for Parliamentary Affairs, who will be coordinating a learning exchange scheme between our 3 Parliaments (Ghana, Uganda and Zimbabwe), and the Ghana Institute of Management and Public Administration (GIMPA), where we will be piloting our EIPM Toolkit.
This post first appeared on the INASP blog here and at the Effective Institutions Platform here.