By now, you have generated your classification map, great! But can you rely on the map’s information? To underpin the meaningfulness of your results, a validation is needed.
\nThe validation of remote sensing data is the last step in our workflow. The purpose of this chapter is to describe standard and advanced methods for validating a classification map.<\/p>\n
In this chapter, the following content awaits you:<\/p>\n
Validation Intro<\/strong><\/a> <\/a><\/p>\n Training dataset<\/strong>: A model is initially fit on a training sample dataset. The model iteratively learn from those training samples and tries to map data \\(x\\) to output response \\(y\\).<\/p>\n Testing dataset<\/strong>: During training, algorithms often use a testing dataset for an unbiased evaluation of a model fit while tuning the model’s hyperparameter, e.g., \\(mtry\\) for RF, or \\(\\gamma\\) and \\(C\\) for SVM. The testing dataset is generated internally, e.g., in the form of OOB samples in RF, or cross validation in SVM. <\/p>\n Validation dataset<\/strong>: Finally, a validation dataset is completely independent from the other two datasets and provides an unbiased evaluation of a model fit. <\/p>\n All right, so what is the best validation practice for remote sensing studies?<\/p>\n In the following, we want to present a best practice workflow for a classification in detail.<\/p>\n <\/br><\/br><\/p>\n
\n– training, testing, validation – use the right terminology
\n– best validation practice for remote sensing
\nCreate Samples in R<\/strong><\/a>
\n– stratified random sampling in R
\n– generation and export of point coordinates as shapefile for usage in QGIS
\nLabel Samples in QGIS<\/strong><\/a>
\n– import of point shapefile
\n– label points according to their class membership
\n– use Landsat and very high resolution basemaps as validation basis for labeling
\n– save labeled point shapefile
\nAccuracy Statistics in R<\/strong><\/a>
\n– generate a complete accuracy matrix in R
\n– calculate confidence intervalls for overall accuracies
\n– calculate kappa statistics
\nArea Adjusted Accuracies<\/strong><\/a>
\n– calculate area weighted accuracy statistics according to Olofsson et al. 2014<\/a>\n<\/div>\nValidation Intro<\/h1>\n
\n
\n
\n