Please use this identifier to cite or link to this item:
Title: Meta-evaluations in government and government institutions: A case study example from the Australian Centre for International Agricultural Research
Contributor(s): Madzivhandila, T Percy (author); Griffith, Garry (author)orcid ; Fleming, Euan (author); Nesamvuni, AE (author)
Publication Date: 2010
Handle Link:
Abstract: In this paper we draw on impact assessment work of the Australian Centre for International Agricultural Research (ACIAR) to present an example of meta-evaluation - an evaluation of evaluations - in an agricultural research, development and extension setting. We explore quality issues relating to evaluation studies in the context of government institutions. Program evaluation standards (PES) are divided into categories of utility, feasibility, propriety and accuracy to provide a framework for the meta-evaluation. The PES are presented as a universal measure of evaluation study quality. The intent of using them here is to judge the adequacy of PES as a universal quality measure or meta-evaluation base and to extract useful insights from ACIAR program evaluation activities when developing a meta-evaluation model for the Limpopo Department of Agriculture (LDA). Our meta-evaluation is undertaken of 63 impact assessment reports. First, the literature guiding the conduct of a meta-evaluation is reviewed. Second, an assessment (the meta-evaluation) of the evaluation studies is carried out for 19 sampled reports from a population of relevant reports fitting the dimension of the analysis, and results are presented and discussed. Also, lessons learned are presented, using the framework provided by the meta-evaluation criteria. Third, taking into account the lessons learned, implications are drawn for a proposed systematic meta-evaluation of the LDA. Finally, we conclude that all the PES cannot be equally emphasized in a meta-evaluation model. At ACIAR, 70% of the standards were at least partially addressed. Therefore, we succeeded in using the PES in judging the ACIAR evaluation quality. As such, they can be an important base when developing an evaluation model but should be applied in a contextualized manner.
Publication Type: Conference Publication
Conference Name: AARES 2010: 54th Annual Conference of the Australian Agricultural and Resource Economics Society, Adelaide, Australia, 10th - 12th February, 2010
Source of Publication: Proceedings of the 54th Annual Conference of the Australian Agricultural and Resource Economics Society
Publisher: AARES: Australian Agricultural and Resource Economics Society
Place of Publication: Online
Field of Research (FOR): 070199 Agriculture, Land and Farm Management not elsewhere classified
140201 Agricultural Economics
140202 Economic Development and Growth
HERDC Category Description: E2 Non-Refereed Scholarly Conference Publication
Other Links:
Statistics to Oct 2018: Visitors: 221
Views: 262
Downloads: 0
Appears in Collections:Conference Publication

Files in This Item:
3 files
File Description SizeFormat 
Show full item record

Page view(s)

checked on Dec 29, 2018
Google Media

Google ScholarTM






Items in Research UNE are protected by copyright, with all rights reserved, unless otherwise indicated.