Please use this identifier to cite or link to this item: https://hdl.handle.net/1959.11/8905
Title: Meta-evaluations in government and government institutions: A case study example from the Australian Centre for International Agricultural Research
Contributor(s): Madzivhandila, T Percy (author); Griffith, Garry  (author)orcid ; Fleming, Euan  (author); Nesamvuni, AE (author)
Publication Date: 2010
Handle Link: https://hdl.handle.net/1959.11/8905
Abstract: In this paper we draw on impact assessment work of the Australian Centre for International Agricultural Research (ACIAR) to present an example of meta-evaluation - an evaluation of evaluations - in an agricultural research, development and extension setting. We explore quality issues relating to evaluation studies in the context of government institutions. Program evaluation standards (PES) are divided into categories of utility, feasibility, propriety and accuracy to provide a framework for the meta-evaluation. The PES are presented as a universal measure of evaluation study quality. The intent of using them here is to judge the adequacy of PES as a universal quality measure or meta-evaluation base and to extract useful insights from ACIAR program evaluation activities when developing a meta-evaluation model for the Limpopo Department of Agriculture (LDA). Our meta-evaluation is undertaken of 63 impact assessment reports. First, the literature guiding the conduct of a meta-evaluation is reviewed. Second, an assessment (the meta-evaluation) of the evaluation studies is carried out for 19 sampled reports from a population of relevant reports fitting the dimension of the analysis, and results are presented and discussed. Also, lessons learned are presented, using the framework provided by the meta-evaluation criteria. Third, taking into account the lessons learned, implications are drawn for a proposed systematic meta-evaluation of the LDA. Finally, we conclude that all the PES cannot be equally emphasized in a meta-evaluation model. At ACIAR, 70% of the standards were at least partially addressed. Therefore, we succeeded in using the PES in judging the ACIAR evaluation quality. As such, they can be an important base when developing an evaluation model but should be applied in a contextualized manner.
Publication Type: Conference Publication
Conference Details: AARES 2010: 54th Annual Conference of the Australian Agricultural and Resource Economics Society, Adelaide, Australia, 10th - 12th February, 2010
Source of Publication: Proceedings of the 54th Annual Conference of the Australian Agricultural and Resource Economics Society
Publisher: Australian Agricultural and Resource Economics Society (AARES)
Place of Publication: Australia
Fields of Research (FoR) 2008: 070199 Agriculture, Land and Farm Management not elsewhere classified
140201 Agricultural Economics
140202 Economic Development and Growth
Socio-Economic Objective (SEO) 2008: 919999 Economic Framework not elsewhere classified
910205 Industry Policy
910501 Agricultural and Environmental Standards
HERDC Category Description: E2 Non-Refereed Scholarly Conference Publication
Publisher/associated links: http://purl.umn.edu/59098
http://ageconsearch.umn.edu/bitstream/59098/2/Madzivhandila%2c%20Percy.pdf
Appears in Collections:Conference Publication

Files in This Item:
3 files
File Description SizeFormat 
Show full item record

Page view(s)

1,064
checked on Mar 7, 2023
Google Media

Google ScholarTM

Check


Items in Research UNE are protected by copyright, with all rights reserved, unless otherwise indicated.