1. Reference data & Accuracy Assessment Dr. Russ Congalton Kamini Yadav

2. Generating more No-Crop samples for Australia The Error Matrix was generated from 1,118 ground samples collected by Pardha in August 2014 in Australia The error matrix and accuracy estimates were not statistically valid and balanced The samples for Crop and No-Crop were neither balanced nor proportional to crop/no-crop area in GCE v.2 Map

3. Crop/No-Crop Area Proportionality GCE v.2 ClassPixel Count (PC) Area sq. m. (PC * 250*250) Area % Cropland 16205071387816937500 Cropland 26363457397716062500 Cropland 31051096569312500 Cropland 4 18932511832812500 Cropland 5 23723514827187500 Cropland 655076134422562500 Total Cropland1365095885318487500012.06316576 No-Crop621946000000088 Total Area 7072644875000 Class No. of Samples Sample %Crop Area % Crop10611.4101184112 No crop82388.5898815988 Total929 Samples in Crop/No-Crop Maintain proportional samples to GCE v.2 Crop/No- Crop area

4. No-Crop Samples Only 36 samples were of No-Crop out of 1118 (1/3 rd ground validation samples) 800 random samples have been generated in No-Crop region of the map The center part of Australia has been removed to avoid sample because there is almost no possibility for cropland

5. Crop Samples Generate samples separately for Crop and No-Crop Regions 106 Crop samples randomly selected from 1082 ground collected samples to balance the ratio No-Crop samples (36 original +787 out of 800 new samples)

6. The Error Matrix Original Balanced

7. Buffer GCE v.2 Map Cropland Area Generate Euclidean distance layer of GCE v.2 cropland class to No-Crop It calculates distance of crop pixels from No-Crop pixels Within Australia bound, out of 0-24 range of pixel values, the range of 0 -1 and 0-2 map units are selected for the buffer 1 and buffer 2 700 and 800 Random samples have been generated (250x250m) for Buffer 1 and 2 resp. that are proportional to crop area using Goggle Imagery

8. Buffered GCE v.2 Cropland Map

9. Crop Buffer 1 (250m)

10. Samples proportional to Crop Area in Buffer 1 Crop Buffer 0-1 ED Area (sq. m.)Area %No. of SamplesSample % Crop 85318487500015.9022007610317.25293 No Crop451201512500084.09 59785.28571 Total (Buffer Area 1) 5365200000000 700 The Error Matrix *ED- Euclidean Distance in map units

11. Crop Buffer 2 (500m)

12. Samples proportional to Crop Area in Buffer 2 Crop Buffer 0-2 ED Area (sq. m.)Area %No. of SamplesSample % Crop 85318487500013.0893314482 11.42061 No Crop566498512500087 718 89.75 Total (Buffer Area 2) 6518170000000 800 *ED- Euclidean Distance in map units

13. Error Matrices Comparison Crop/No-Crop Accuracy Matrix Reference Data CroplandNo-CropSum PointsUser Accuracy Map Data Cropland1021311588.70% No-Crop481081499.51% Sum Points106823929 Producer Accuracy 96.23%98.42% 98.17% Kappa =0.912711616 Reference Data CroplandNo-CropSum PointsUser Accuracy Map Data Cropland55157078.57% No-Crop4858263092.38% Sum Points 103597700 Producer Accuracy 53.40%97.49% 91.00% Kappa =0.586614173 Reference Data CroplandNo-CropSum PointsUser Accuracy Map Data Cropland58318965.17% No-Crop2468771196.62% Sum Points 82718800 Producer Accuracy 70.73%95.68% 93.13% Kappa =0.639946319 Sampling separately in Crop/No-Crop Sampling in Crop Buffer of 250m Sampling in Crop Buffer of 500m

14. Conclusion High accuracy (98%) when sampling in the whole continent stratified by Crop and No-Crop class 91% overall accuracy when sampling performed in a Crop buffer of 250m 93% overall accuracy when sampling in a crop buffer of 500m Non-proportional sampling results in high accuracy that might not be a valid assessment Area Proportional sampling results in a reasonable, statistically valid accuracy estimates

15. North America Accuracy Assessment Data Received The crop type map of AEZ 5, 6 and 7 with 7 composite classified labels. Cross-walked and resampled CDL reference map according to the classification scheme of classified map (7 CDL composite labels). Sub-regions boundaries for each AEZ of North America. CSV files of the generated reference data for three AEZ (5, 6 and 7). The file consists of training, validation and untouched samples.

16. Steps to Perform Accuracy Assessment The quality of the data received from North America team has been examined All the possible issues and questions has been documented and given to Russ Need to take some decisions and actions in order to perform the accuracy assessment

17. Thanks !!