1. Stennis Space Center IKONOS V&V 1 NASA Scientific Data Purchase IKONOS V&V Overview Mary Pagnutti

2. Stennis Space Center IKONOS V&V 2 Stennis Space Center NASA Scientific Data Purchase (SDP) Began with $50 Million appropriation for NASA purchase of scientific data sets for commercial sources Goal: Test new way of doing business; tap new sources of data Managed by NASA Commercial Remote Sensing Program, Stennis Space Center, MS Phased Approach –Phase I - simulated / prototypical data sets received and reviewed –Phase II - selection of products and data purchase over 3 years Firm fixed price contracts - cash on delivery of data

3. Stennis Space Center IKONOS V&V 3 Perspective: SDP is an experiment –Can the commercial sector provide useful, cost effective data to the science community? –Only one satellite (no backup), buy data while we can Assumptions –Space Imaging will attempt to provide high quality data –NASA Stennis will trust but verify –Releasing data in a timely fashion is important –Feedback from users is important Competition is developing –Earth Watch, Orbital, Russian Spin Data, West Indian Aerospace –Methodologies developed will be used again. IKONOS SDP V&V Philosophy

4. Stennis Space Center IKONOS V&V 4 IKONOS V&V Activities Performance Product V&V Characterization (Sample V&V data sets) Shipment Verification (All acquired data sets) Data Format Meta File Location / Coverage Cloud Cover General Statistics – mean – standard deviation – pixel histogram – fraction of saturated pixels Auto Report generation Thumbnail generation Band-to-band registration MODTRAN / radiance intercomparison NIIRS evaluation when appropriate Product Characterization (Sample V&V data sets) Image Quality –Spatial –SNR Geometric Accuracy –Positional Accuracy –DEM evaluation Radiometric Performance –Spectral Characterization Applications Utility (Sample V&V data sets) University of Maryland assessment Obtain feedback from ESE Researchers

5. Stennis Space Center IKONOS V&V 5 Joint Agency Commercial Imagery Evaluation (JACIE) Team Formed IKONOS one meter panchromatic image of Jefferson Memorial in Washington, D.C. Joint NASA / NIMA / USGS team focused on characterizing commercial remote sensing system performances Overall performance assessment to meet each agency’s mission requirements –NASA - System Characterization –NIMA- Photogrammetry –USGS - Cartographic Assessment Improved communications with industry –More productive interchanges between industry and government –Minimize duplication of effort –Reduction in costs incurred by industry and government

6. Stennis Space Center IKONOS V&V 6 SCIENCE USERS JACIE TEAM EOS Validation Teams U of Maryland U of Arizona S.Dakota State U SDP IKONOS Characterization Team

7. Stennis Space Center IKONOS V&V 7 IKONOS Validation Sites SDSU SSC BeltsvilleKonza Prairie Sevilleta WSMR Maricopa U of A Morrison Quad. Ivanpah Railroad Valley Lunar Lake Lake Tahoe Stillman Creek USGS-EDC Kaintuck Hollow Quad Big Springs

8. Stennis Space Center IKONOS V&V 8 IKONOS Validation Sites Overview

9. Stennis Space Center IKONOS V&V 9 NASA Stennis Space Center, Mississippi Site: Scattered buildings within heavily wooded area, man-made reservoirs and canal. Elevation 5.5m - 10m. 30.388 degrees N, 89.61 degrees W Targets: 2 orthogonal concrete edge targets (70x80m oriented E-W, 80x80m oriented N-S) 130m concrete radial target (96.4 deg arc, 0.08-5.0m range), 4 step concrete grayscale target (35x40m each) over 40 known GPS markers known to within 2 cm 4 step gray tarps (20mx20m each) In-Situ Instrumentation: Cimel Sunphotometer, Shadowband Radiometer, ASD and GER Spectro- radiometers, SSC Weather Station, Radiosonde balloon launch,Pyronometer, Goniometer. Coincident Collects: Landsat 7 Purpose: Spatial, geometric and radiometric characterization, BRDF evaluation. Concrete edge, radial and 4 step grayscale targets IKONOS Image Area ATLAS image and showing known GPS points at SSC Radiometric Tarp Coupons

10. Stennis Space Center IKONOS V&V 10 Image Quality Characterization

11. Stennis Space Center IKONOS V&V 11 Big Springs, TX Edge Target Three 15 m x 15 m squares Northing and easting edges allow MTF analyses in two directions Edges are aligned approx 8 deg off true north and true east IKONOS Panchromatic Band

12. Stennis Space Center IKONOS V&V 12 Image Quality Characterization, cont’d.

13. Stennis Space Center IKONOS V&V 13 Uniform Sites Selection for SNR Utilize NASA Scientific Data Purchase EarthSat Databuy –TM data for Africa –30 meter GSD data –Develop algorithms to find most uniform scenes for Radiometry & SNR estimates Libya TM Scene Tight Gaussian Histogram Indicate Uniform Scenes African Map with Sites

14. Stennis Space Center IKONOS V&V 14 Geometric Accuracy Characterization * 90% circular error

15. Stennis Space Center IKONOS V&V 15 Geometric Accuracy Assessment USGS EROS Data Center –Brookings, South Dakota (SDSU) –Sioux Falls, South Dakota (EDC) –Each site surveyed 50+ points throughout 11x11 km scene USGS –Morrison Quad –Kaintuck Hollow Quad –Utilize USGS database for both sites NASA CRSP –Stennis Space Center –Utilize site survey & Geodetic Targets Brookings South Dakota Fast Static Survey Checked to less than five cm. horizontal using two Trimble 4000ssi units over B Order monuments.

16. Stennis Space Center IKONOS V&V 16 Radiometric Performance Characterization

17. Stennis Space Center IKONOS V&V 17 Radiometric Performance Characterization, cont’d.

18. Stennis Space Center IKONOS V&V 18 Radiometric Performance Characterization, contd.

19. Stennis Space Center IKONOS V&V 19 Radiometric Vicarious Calibration Approaches Reflectance Method –Measurement of ground reflectance and atmospheric properties allows prediction of Top-of-the-Atmosphere (TOA) radiance estimates –Typically require ground teams and a great deal of coordination Radiance Method –Coincident collect with well characterized airborne or satellite system

20. Stennis Space Center IKONOS V&V 20 Reflectance Method Method: Utilize ground reflectance measurements (Spectroradiometer) and atmospheric measurements (Sun Photometer & Radiosonde) to determine radiometric accuracy of new commercial satellite systems (IKONOS) Sun Photometer Spectroradiometer Commercial Satellite Radiosonde Balloon

21. Stennis Space Center IKONOS V&V 21 Radiance Method Method: Utilize coincident airborne or spaceborne calibrated imagery (e.g. Landsat 7) to determine radiometric accuracy of new commercial satellite systems (IKONOS) Commercial Satellite Well Characterized System (Aircraft or Satellite)

22. Stennis Space Center IKONOS V&V 22 IKONOS Characterization Status Spatial Characterization –Three acquisitions have been made (received std original imagery only) –Four SI archive images have been acquired –Two acquisitions are pending collection –Awaiting two precision original images –All but one image has been evaluated Geometric Characterization –Three acquisitions have been made (received std original imagery only) –Two acquisitions are pending collection (same as above) –Two DEM acquisitions scheduled for spring 2001 –Two have been evaluated Radiometric Characterization –Six acquisitions have been made and evaluated (received std original imagery only) –Two acquisitions are pending collection (same as above)

23. Stennis Space Center IKONOS V&V 23 IKONOS Characterization Summary Preliminary Findings: Geometric Characterizations show imagery is well within specification Spatial Characterizations indicate imagery meets MTF and SNR specifications Radiometric Characterizations indicate potential concerns with the red and NIR bands No serious issues associated with on-board compression have been found

24. Stennis Space Center IKONOS V&V 24 Backup

25. Stennis Space Center IKONOS V&V 25 IKONOS Sensor Facts from SI Web Site

26. Stennis Space Center IKONOS V&V 26 IKONOS Sensor Facts from SI Web Site, cont’d.

27. Stennis Space Center IKONOS V&V 27 IKONOS Sensor Facts from SI Web Site, cont’d.

28. Stennis Space Center IKONOS V&V 28 IKONOS Sensor Facts from SI Web Site, cont’d.

29. Stennis Space Center IKONOS V&V 29 Stennis Target Set Positive Systems Image Expanded View of Target EdgeTarget: 70x80 meters and 70x70 meters 8:1 contrast ratio

30. Stennis Space Center IKONOS V&V 30 Edge Response Foot Print Focal plane array undersamples edge with classical cross section sampling Solution: Sample tilted edge to improve sampling

31. Stennis Space Center IKONOS V&V 31 Edge Response Relationship to Line Spread Function

32. Stennis Space Center IKONOS V&V 32 Modulation Transfer Function MTF is a measure of an imaging system’s ability to recreate the spatial frequency content of scene MTF is the magnitude of the Fourier Transform of the Point Spread Function / Line Spread Function. 1.0 Cut-off Spatial frequency MTF

33. Stennis Space Center IKONOS V&V 33 SNR Estimate Example Results Histograms of Mean/Std of 5x5 Pixel Blocks TM data Location of Histogram Peak is a measure of the SNR

34. Stennis Space Center IKONOS V&V 34 GPS Accuracies Trimble Pathfinder or Geo Explorer –Raw - 10 meters –Coarse mode corrected - 5 meters per measurement reading –Coarse mode corrected - averaging data 2 meter –Fine mode corrected - averaging 10 minutes of differentially corrected data gives sub-meter Geo Explorer Pathfinder

35. Stennis Space Center IKONOS V&V 35 Radiometric Error Associated with Finite Size Tarp Insert Measured Reflectances Figures For typical background/tarp reflectances, the error at the center pixels will be less than a few percent Cross Sectional Plot of Response Finite Size of Tarp will limit Radiometric Accuracy Simulated 20 m Tarp Image with 4 m GSD with MTF @ Nyquist of 0.1

36. Stennis Space Center IKONOS V&V 36 CRSP Tarp Sample Data Tarp Sample Data Reflectance Data Tarp Samples are Spectrally Flat Over Region of Interest

37. Stennis Space Center IKONOS V&V 37 GPS Accuracies Trimble 4000ssi Survey grade GPS units –Static survey- 5mm + 1ppm in base line distance. –Fast Static - Based on conditions and Satellite geometry –Real Time Kinematic (RTK) - less than five centimeters horizontal and vertical Brookings South Dakota Fast Static Survey Checked to less than five cm. horizontal using two Trimble 4000ssi units over B Order monuments.

38. Stennis Space Center IKONOS V&V 38 Radiometric Vicarious Calibration Background Radiometric stability of remote sensing data is critical for long term studies On-orbit calibration sources are not always stable or reliable Methods which independently verify the radiometric calibration of remote sensing data are essential Vicarious calibrations use natural well characterized scenes

39. Stennis Space Center IKONOS V&V 39 CRSP Radiometric Tarp Sample Examination Samples were obtained of the 4 grayscale radiometric tarps procured by CRSP. These samples were tested in the laboratory under conditions similar to those encountered in the field. These tests were performed to evaluate specified reflectivity values. 4” tarp Samples 50% <5% 20% 30%

40. Stennis Space Center IKONOS V&V 40 Desired Calibration Site Characteristics Bright and Uniform –High reflectance minimizes atmospheric uncertainties –Uniformity allows statistically meaningful results Stable –Long term studies are facilitated with stability Low Precipitation and Cloud Cover –Maintains stability and increases chance of acquisition Large –Several swath widths in extent or more to avoid adjacency effects

41. Stennis Space Center IKONOS V&V 41 Tarp Deployment at SSC

42. Stennis Space Center IKONOS V&V 42 SDP Shipment Verification Shipment content and media count Mission document review Approximate geographic coverage Comparison with original task order File readability General image quality 100% visual inspection of JPEG quicklooks Discrepancy report (As Needed) Shipment tracking database Shipment verification report

43. Stennis Space Center IKONOS V&V 43 NASA IKONOS V&V Focus IKONOS Data Product Characterization MTF and spatial resolution SNR estimates Geometric accuracies of imagery Radiometric accuracies of products Band-to-band registration of multispectral products Intercomparison of IKONOS, Landsat 7 and other satellite imagery Quantitative System Characterizations: 1m GSD PAN4m GSD MS

44. Stennis Space Center IKONOS V&V 44 IKONOS Spectral Characterization

45. Stennis Space Center IKONOS V&V 45 IKONOS Spectral Bandpasses Provided by Space Imaging

46. Stennis Space Center IKONOS V&V 46 Well Characterized Site Method Method: Utilize well characterized satellite systems (Landsat-7), not necessarily coincident, and well characterized sites (African deserts) to determine the radiometric accuracy of new commercial satellite systems (IKONOS) Commercial Satellite Calibrated Satellite

47. Stennis Space Center IKONOS V&V 47 NASA CRSP Tarps Portable radiometric characterization of 4 m class GSD systems and smaller MTF characterization of 1 m class GSD systems and smaller SNR estimation on 1 m class GSD systems Fiducial markers for remote uniform sites

48. Stennis Space Center IKONOS V&V 48 CRSP Tarp Specifications Size and Shape –20 m x 20 m Reflectivity –Spectral Range 400-1000 nm –Tarp 1 < 5 % –Tarp 2 20-25 % –Tarp 3 30-40 % –Tarp 4 50-55 % Spatial Uniformity –Standard deviation of 9 equally space reflectivity measurements <1% of absolute reflectance Spectral Uniformity –<10% variation/100 nm band Deployability –Less than 2 hours with 2 people in less than 3m/s wind Maintainability –Meet Specifications for 60 Deployments or two years which ever comes first