A Practical Program Evaluation Model for the Limpopo Department of Agriculture

Abstract

This thesis explores practical program evaluation (PPE) that contributes to creating value (quantity and quality) for social betterment. The purpose is to propose a PPE model for the Limpopo Department of Agriculture (LDA). The perceived low use of program evaluation process and results has been a major concern in the South African public service in the recent decade. The study addresses the issue in question by first reviewing the Government-wide Monitoring and Evaluation System (GWM&ES) at the national level. The GWM&ES is a policy framework guiding program evaluation roll-out across all spheres of government. Secondly, the history and evolution of program evaluation theory is reviewed. Trends and lessons show where the field is heading to help prevent mistakes of the past. The GWM&ES and theory are fundamental forces shaping the type of PPE model that can be proposed. We noted that the GWM&ES is still underdeveloped and the theory is moving towards utility of evaluations rather than objectivity. The thesis indicates that PPE is underpinned by five epistemic elements of programming, knowledge construction, valuing, evaluation use (influence) and evaluation practice. • Our programming strategy proposed logic models as a heuristic way of designing social betterment initiatives which in turn simplifies the evaluation making it practical. • To construct knowledge, our position is in the realist paradigm - adopting an eclectic view - suggesting the mixed-method approach which is pragmatic, contextual, responsive and consequential. We reconcile the quantitative-qualitative dichotomy. • We posit that evaluation of social betterment is value-laden; therefore evaluations should be explicit about values. Further, they should advocate issues of democracy, justice and equality while considering cultural differences. • Utility of evaluation for social betterment rests on its use and influence. The literature noted low evaluation influence. The major findings surrounding evaluation use (and misuse) are highlighted. However, two simple factors remain the most important: tailoring evaluation to stakeholders needs and involving program staff in the design and implementation of program evaluation. • Given the time, budget and skills constraints when conducting an evaluation, we addressed how evaluation practice theory supports PPE. We presented (i) ways to commission an evaluation, (ii) the purpose of evaluation, (iii) the role of an evaluator, and (iv) the questions that should be asked.