DPME’s Design clinic confirms the importance of participation
DPME’s Design clinic confirms the importance of participation
The Department of Planning, Monitoring, and Evaluation (DPME) held its design clinic on the 6th and 7th of September 2022 in Pretoria. Facilitating it has been a professional highlight – it was inspiring to see so many people grappling with complex development challenges and unwieldy government institutions, coming away feeling more empowered and clearer about how their work will benefit from an evaluation.
However, one thing that comes up in conversation at each recurring design clinic, is the importance of participation for both the success of the evaluation, and the programme. The tricky thing about participation is that it reflects both a cause, and an effect of programme performance. Good evaluations happen when a team of people sitting at different places in a sector come together to solve a collective problem around programme performance. When you get the right mix of people in a room, you can often see a programme improve from the evaluation design stage.
However, often when there’s a problem that needs to be solved in a programme, you see reflections of this problem in the evaluation design. Maybe people are frustrated with the programme, and as a response, they have made that project less central in their work day. Maybe people have written the problem off as ‘too hard.’ Maybe someone cannot convince their boss that the programme is important enough to release them from their regular work for two days.
Maybe someone knows there is a performance problem, but worries that the transparency in evaluations will lead to bad press. Maybe ownership and will is strong, but administrative processes have not allowed the right people to be identified and invited. Whatever the issue is, you can learn a lot about a programme from multiple stakeholder participation in an evaluation.
At the closing of the two day workshop, one participant asked about civil society – that stakeholder that must always balance being sufficiently constructive, and sufficiently critical. The question was about whether or how a constructive role could be carved out for civil society actors through an evaluation. DPME Deputy Director-General Godfrey Mashamba responded with a call to invite and include civil society actors in the evaluation process moving forward.
Coming from a background in civil society myself, my mind immediately went to all of the challenges of working with government – different paces of expected change, the many, many layers of bureaucracy and many accompanying meetings. A lack of trust on both sides. But, those difficult negotiation processes are exactly where evaluation shines. I think broader civil society inclusion in the evaluation system moving forward can only be a strength for governance in the sector.
SAMEA Conference 2022 Multipaper Session
On the Thursday 22 September 2022, Twende Mbele hosted a multi-paper session at the SAMEA Biannual Conference titled,‘Can Horizontal Leadership Approaches Augment the Practice of Monitoring, Evaluation and Learning in the Public Sector’.
Born from research and discussion paper, the purpose of this presentation by Philip Browne and Stanley Ntakumba, was to stimulate further discussions on whether, from within the constraints of public sector MEL practice, there are opportunities for forms of horizontal leadership to be established that are disruptive of conventional and constraining leadership practices.
To gain further insights on the presentations by the respective panelists, please click the links below for the presentations-
Philip Browne: https://bit.ly/3Tf3qOD
Stanley Ntakumba: https://bit.ly/3C7eOVz
SAMEA Conference 2022 Panel Discussion
On Thursday the 22 September, Twende Mbele hosted a panel discussion title,‘Using experience to adapt a guideline on Rapid Evaluations in the public sector’ at the SAMEA Biannual Conference.
The purpose of this session was to update the existing Twende Mbele Rapid Evaluation Guideline from the lessons learned in the adaption and piloting of rapid evaluations in the partner countries. This session facilitated by Mine Pabari, included presentations by the Chief Director of the DPME, Ms Thokozile Molaiwa who spoke to the lessons emerging from South Africa, and Dr Ayabulela Dlakavu who presented on the lessons emerging from three partner countries.
For a quick read on the findings, click the links below for the respective presentations:
Mrs Thokozile Molaiwa: https://bit.ly/3ruXXXR
Dr Ayabulela Dlakavu: https://bit.ly3STw9YY
DPME Evaluation Design Clinic – 6, 7 September 2022
As part of the National Evaluation System (NES), a system of Evaluation Design Clinic is used to facilitate stakeholder participation in the conceptualisation and design of the evaluations prioritised in the National Evaluation Plan (NEP). The last Design Clinic was held in September 2021 with custodian departments and proposing parties on the evaluations identified for the periods 2021/22 and 2022/23. The Design Clinic facilitated stakeholder engagements on problem analysis, programme theory building or refinements where it existed, development of terms of reference (scope, focus, evaluation purpose, questions and methodology), and identification of key stakeholders for each evaluation. The DPME will be hosting a Design Clinic in 2022 for the NEP evaluations planned for 2023/24 and 2024/25.
The objectives of the evaluation Design Clinic is to ensure that the following are developed and achieved:
- A draft theory of change for the programmes/ policies being evaluated in 2023/24 and 2024/25,
- Elements of a draft TOR including the evaluation purpose and evaluation questions are developed, and
- Workshop participants are introduced to the 1-1.5 pager summary for evaluations included in the National Evaluation Plan.
Below are some blogs written with regards to the design clinic. Click the link below for a quick read:
Formation sur l’évaluation rapide pour les organisations de la société civile, ministère de l’éducation et ministère du développement – 7 et 8 juillet 2022
Les 7 et 8 juillet 2022
Le Bénin a accueilli une formation sur l’évaluation rapide pour les organisations de la société civile, le ministère de l’éducation et le ministère du développement.
CreativeBox
