1. ACCURACY ASSESSMENT SOUTH AMERICA, NORTH AMERICA KAMINI YADAV DR. RUSSELL CONGALTON

2. SOUTH AMERICA First call on May 20 th, 2016 Need more discussion on training and validation data Some points need further discussion: Tile Classification (12 tiles) Cropland Mask (Giri and Long, 2014); Cropland classification limited to other vegetation and also to barren land in Tile 71 Need more information on how training samples have been collected such as sample size, year of data collection

3. TRAINING SAMPLES Training samples- Different size polygons Distribution of Samples- Random..?? How homogeneous different polygons are? Stratification- how different tiles are differentiated based on cropland?? (Share the source or the shape file) Sample Size – Number of crop/No- Crop samples Any validation by mapping team?? Any statistical information on crop/no- crop estimates from other sources??

4. BRAZIL IRRIGATION DATA Green: Training 30m Cropland map (Giri and Ying) Zones/Strata within Brazil Accurate Cropland Extent Remove training samples Select Validation samples

5. NORTH AMERICA: CROP/NO- CROP 350 SAMPLES Zone 11 Reference Data CroplandNo-CropSum PointsUser Accuracy Map Data Cropland410 100.00% No-Crop0308 100.00% Sum Points 41308349 Producer Accuracy 100.00% Reference Data CroplandNo-CropSum PointsUser Accuracy Map Data Cropland3013196.77% No-Crop231431699.37% Sum Points 32315347 Producer Accuracy 93.75%99.68% 99.14% Zone 12 *No Omission and Commission errors No-Crop No-data Crop

6. CROP TYPE ASSESSMENT ZonesCorn-SoyabeanWheat-BarleyPotatoAlfalfaCottonRiceOther CropsFallowTotal Zone 25494 19062 98203701 Zone 3622165912058 68166749 Zone 4892035410192 82129750 Zone 5151212517165595106756 Zone 6266168186354378860754 Zone 7297142516154 8656801 Zone 8299145516951527854799 Zone 933571506068718758800 Zone 1039568505655526856800 Zone 1132850 705711773695 Zone 1222425 108 15737551 Zone 13276 106 382 Total2,7751,3943857927373281,1309978,537 Number of samples in each zone for each crop type based on minimum distance and area proportional criteria Blue: Required samples Red: Insufficient samples

7. Reference Data AlfalfaCorn-SoybeanRiceCottonPotatoWheat-BarleyOther-CropsFallowTotalUser Accuracy Map Data Alfalfa210000000 100.00% Corn-Soybean252620015311131782.65% Rice0000000000.00% Cotton0003910214390.70% Potato0000000000.00% Wheat-Barley71000156312421971.23% Other-Crops10337132944912734.65% Fallow0002000252792.59% Total 632663754181688860754 Producer Accuracy33.33%98.50%0.00%72.22%0.00%92.86%50.00%41.67% 72.55% One example from Zone 6 ZonesCrop types Zone 2Corn-Soybean Zone 5Rice, Potato Zone 6Rice, Potato Zone 8Potato Zone 9Potato Zone 10Alfalfa Zone 11Wheat-Barley Zone 12Wheat-Barley ZonesOverall Accuracy Zone 278.74% Zone 372.63% Zone 468.80% Zone 563.10% Zone 672.55% Zone 778.90% Zone 869.71% Zone 973.13% Zone 1075.75% Zone 1177.12% Zone 1274.23% Zone 1398.69% Crop types with zero User’s and Producer’s accuracy in few zones i.e., No correct diagonal samples

8. OVERALL ACCURACY Reference Data CroplandNo-CropTotalUser Accuracy Map Data Cropland602760998.85% No-Crop73,5683,57599.80% Total 6093,5754,184 Producer Accuracy 98.85%99.80% 99.67% Reference Data Alfalfa Corn- SoybeanRiceCottonPotato Wheat- Barley Other- CropsFallowTotalUser Accuracy Map Data Alfalfa5315938392127869676.29% Corn-Soybean1572,5966594129661321403,37976.83% Rice1621120011523689.41% Cotton218549518262057586.09% Potato170012733014190.07% Wheat-Barley5421119361,1521341411,55873.94% Other-Crops3864438351827861011,24862.98% Fallow750360622157370481.39% Total 7912,7763287373831,3941,1309988,537 Producer Accuracy67.13%93.52%64.33%67.16%33.16%82.64%69.56%57.41% 75.80% Crop/no-crop assessment Crop type assessment

9. REFERENCE DATA PROTOCOLS TUNISIA REFERENCE DATA Samples in the same field: Avoid spatial autocorrelation Validation samples should be placed either across the road or in different crop type field Validation samples: Blue Training samples: green Correlation: Red

10. CONTD.. Training and Validation split: 60-40% Refer reference data collection protocols and the summary notes on recent discussion on reference data from VHRI on cropland.org Based on the protocols, refine Tunisia data and ingest into the database Joint workshop on reference data collection has been proposed to be conducted in Flagstaff before July meeting (on July 19) (Prasad’s suggestion)

11. Thanks…!!