Please use this identifier to cite or link to this item:
Title: Comparative assessment of the measures of thematic classification accuracy
Contributor(s): Liu, Canran (author); Frazier, Paul  (author); Kumar, Lalit  (author)orcid 
Publication Date: 2007
DOI: 10.1016/j.rse.2006.10.010
Handle Link:
Abstract: Accuracy assessment of classified imagery is an important task in remote sensing. Various measures have been developed to describe and compare the accuracy of maps and the performance of different classifiers, but the extent to which these measures are consistent with each other is largely unknown. In this paper the consistency of fourteen category-level and twenty map-level accuracy measures was tested on 595 published error matrices using nonparametric correlation coefficients (Spearman's "rho" and Kendall's "tau-b") as well as the probability of concordance. The results show that four groups can be identified for the category-level measures and three groups for map-level measures. The consistency among the measures within a group is generally higher than that among the measures from different groups though all the measures at the same level are highly consistent with each other. We recommend that user's accuracy and producer's accuracy and the overall accuracy should be provided as primary accuracy measures and the two relative entropy change measures and the mutual information normalized by the arithmetic mean of the entropies on map and ground truthing be provided as supplementary measures. The chance-corrected, error matrix-normalized and user's and producer's accuracy-combined measures were found to contain estimation and interpretation problems at both category- and map-levels and are therefore not recommended for general use.
Publication Type: Journal Article
Source of Publication: Remote Sensing of Environment, 107(4), p. 606-616
Publisher: Elsevier
Place of Publication: New York, United States
ISSN: 0034-4257
Field of Research (FOR): 050299 Environmental Science and Management not elsewhere classified
Peer Reviewed: Yes
HERDC Category Description: C1 Refereed Article in a Scholarly Journal
Statistics to Oct 2018: Visitors: 265
Views: 271
Downloads: 0
Appears in Collections:Journal Article
School of Environmental and Rural Science

Files in This Item:
3 files
File Description SizeFormat 
Show full item record


checked on Nov 30, 2018

Page view(s)

checked on Mar 4, 2019
Google Media

Google ScholarTM



Items in Research UNE are protected by copyright, with all rights reserved, unless otherwise indicated.