What does it mean to be a responsible evaluator? Five key reflections from the 13th EES Biennial Conference

In this blog, Marta Arranz, Andrea Azevedo and Alexia Pretari share their reflections from the 13th European Evaluation Society (EES) Biennial Conference, commenting on some of the emerging debates, and inviting other evaluators to join in and share their views. It was our first EES conference and we were approaching it with curiosity and excitement. Three intense days ahead. A …

DAC criteria: The hand that rocks the cradle

Stephen Porter gives his thoughts on the OECD’s latest consultation on the revision of the Development Assistance Committee’s evaluation criteria (DAC criteria). The Organisation for Economic Co-operation and Development (OECD) has launched a consultation on revising the Development Assistance Committee’s (DAC) evaluation criteria through a survey. The DAC criteria are important because they inform how international development is undertaken within commitments …

Leaving no one behind in our evaluation practice

Stephen Porter reflects on the importance of understanding why people are left behind in development practice and acknowledging what goes unseen and unsaid in evaluations. Leave no one behind is a call for action within the Sustainable Development Goals. The Goals are meant to be met for all people, especially groups who are marginalized and vulnerable. In the Sustainable Development …

Sampling strategies for gendered impact evaluations

How can evaluators ensure that gendered power dimensions are accounted for in impact evaluations? Alexia Pretari reflects on the relative merits of two approaches. Oxfam’s approach to building resilience involves bringing about changes ‘in the very structures that cause and maintain poverty and injustice’ (transformative capacity), and building active citizenship involves addressing power imbalances, including building power within. While working …

Improving data quality with digital data collection

Emily Tomkys Valteri, Alexia Pretari and Simone Lombardini share practical tips to help improve quality in survey data collection, and introduce the latest case study in the ‘Going Digital’ series. Sometimes survey data doesn’t add up: two household members are married to each other and yet have different marital statuses, consent statements have not been fully read, percentages of income …

How to measure women’s empowerment so that it reflects the views and opinions of all women interviewed in a study

Ensuring all voices are heard in evaluation processes is challenging but essential. Natalie Naïri Quinn from Oxford University and Oxfam’s Simone Lombardini present their analysis from a discrete choice experiment conducted in Tunisia. Measuring women’s empowerment has become more and more important for assessing development projects aimed at supporting women. Different measurement tools are available; but while most of them …

Reflecting on the use of qualitative comparative analysis

Guest blog by Johannes Meuer, Anne Ellersiek, Daniel Shephard and Christian Rupietta – the evaluation team who undertook a meta review of Oxfam’s effectiveness reviews of policy influence, citizens voice and good governance initiatives. During the last few years, there has been increasing interest in using Qualitative Comparative Analysis (QCA) as an alternative method for evaluation of policy change or advocacy …

Technical learning from the meta-analysis of women’s empowerment projects

Kristen McCollum, consultant at the International Fund for Agricultural Development (IFAD), shares with us the learning from Oxfam’s meta-analyses on women’s empowerment. When we first decided to conduct a meta-analysis on women’s empowerment Effectiveness Reviews (ERs), the idea was to go where no impact evaluation had gone before. While the Effectiveness Reviews give us a rigorous measurement of the impact …

Findings from a meta-review of influencing initiatives

Ruth Mayne shares learning from a recent meta-review of Oxfam and partners’ policy influencing, citizen’s voice and governance initiatives around the world.  NB. This blog post deals with the findings of the influencing meta-review. In the next couple of weeks we will publish a separate post from the authors of the review explaining their methodology. Sign up for our Real …