ACCURACY ASSESSMENT SOUTH AMERICA, NORTH AMERICA KAMINI YADAV DR. RUSSELL CONGALTON

SOUTH AMERICA First call on May 20 th, 2016 Need more discussion on training and validation data Some points need further discussion: Tile Classification (12 tiles) Cropland Mask (Giri and Long, 2014); Cropland classification limited to other vegetation and also to barren land in Tile 71 Need more information on how training samples have been collected such as sample size, year of data collection

TRAINING SAMPLES Training samples- Different size polygons Distribution of Samples- Random..?? How homogeneous different polygons are? Stratification- how different tiles are differentiated based on cropland?? (Share the source or the shape file) Sample Size – Number of crop/No- Crop samples Any validation by mapping team?? Any statistical information on crop/no- crop estimates from other sources??

BRAZIL IRRIGATION DATA Green: Training 30m Cropland map (Giri and Ying) Zones/Strata within Brazil Accurate Cropland Extent Remove training samples Select Validation samples

NORTH AMERICA: CROP/NO- CROP 350 SAMPLES Zone 11 Reference Data CroplandNo-CropSum PointsUser Accuracy Map Data Cropland % No-Crop % Sum Points Producer Accuracy % Reference Data CroplandNo-CropSum PointsUser Accuracy Map Data Cropland % No-Crop % Sum Points Producer Accuracy 93.75%99.68% 99.14% Zone 12 *No Omission and Commission errors No-Crop No-data Crop

CROP TYPE ASSESSMENT ZonesCorn-SoyabeanWheat-BarleyPotatoAlfalfaCottonRiceOther CropsFallowTotal Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Total2,7751, , ,537 Number of samples in each zone for each crop type based on minimum distance and area proportional criteria Blue: Required samples Red: Insufficient samples

Reference Data AlfalfaCorn-SoybeanRiceCottonPotatoWheat-BarleyOther-CropsFallowTotalUser Accuracy Map Data Alfalfa % Corn-Soybean % Rice % Cotton % Potato % Wheat-Barley % Other-Crops % Fallow % Total Producer Accuracy33.33%98.50%0.00%72.22%0.00%92.86%50.00%41.67% 72.55% One example from Zone 6 ZonesCrop types Zone 2Corn-Soybean Zone 5Rice, Potato Zone 6Rice, Potato Zone 8Potato Zone 9Potato Zone 10Alfalfa Zone 11Wheat-Barley Zone 12Wheat-Barley ZonesOverall Accuracy Zone % Zone % Zone % Zone % Zone % Zone % Zone % Zone % Zone % Zone % Zone % Zone % Crop types with zero User’s and Producer’s accuracy in few zones i.e., No correct diagonal samples

OVERALL ACCURACY Reference Data CroplandNo-CropTotalUser Accuracy Map Data Cropland % No-Crop73,5683, % Total 6093,5754,184 Producer Accuracy 98.85%99.80% 99.67% Reference Data Alfalfa Corn- SoybeanRiceCottonPotato Wheat- Barley Other- CropsFallowTotalUser Accuracy Map Data Alfalfa % Corn-Soybean1572, , % Rice % Cotton % Potato % Wheat-Barley , , % Other-Crops , % Fallow % Total 7912, ,3941, ,537 Producer Accuracy67.13%93.52%64.33%67.16%33.16%82.64%69.56%57.41% 75.80% Crop/no-crop assessment Crop type assessment

REFERENCE DATA PROTOCOLS TUNISIA REFERENCE DATA Samples in the same field: Avoid spatial autocorrelation Validation samples should be placed either across the road or in different crop type field Validation samples: Blue Training samples: green Correlation: Red

CONTD.. Training and Validation split: 60-40% Refer reference data collection protocols and the summary notes on recent discussion on reference data from VHRI on cropland.org Based on the protocols, refine Tunisia data and ingest into the database Joint workshop on reference data collection has been proposed to be conducted in Flagstaff before July meeting (on July 19) (Prasad’s suggestion)

Thanks…!!