Data Sources Sources, integration, quality, error, uncertainty.

Slides:



Advertisements
Similar presentations
REQUIRING A SPATIAL REFERENCE THE: NEED FOR RECTIFICATION.
Advertisements

Copyright, © Qiming Zhou GEOG1150. Cartography Data Models for Computer Cartography.
Copyright, © Qiming Zhou GEOG1150. Cartography Sources of Data.
Major Operations of Digital Image Processing (DIP) Image Quality Assessment Radiometric Correction Geometric Correction Image Classification Introduction.
Topographic mapping in Fiji: Challenges and opportunities Conway Pene 2012 Pacific GIS&RS Conference November 2012, Suva.
WFM 6202: Remote Sensing and GIS in Water Management © Dr. Akm Saiful IslamDr. Akm Saiful Islam WFM 6202: Remote Sensing and GIS in Water Management Akm.
Leila Talebi, Anika Kuczynski, Andrew Graettinger, and Robert Pitt
Radiometric and Geometric Errors
Digital Elevation Models GLY 560: GIS and Remote Sensing for Earth Scientists Class Home Page:
1 CPSC 695 Data Quality Issues M. L. Gavrilova. 2 Decisions…
Multiple Criteria for Evaluating Land Cover Classification Algorithms Summary of a paper by R.S. DeFries and Jonathan Cheung-Wai Chan April, 2000 Remote.
Geographic Information Systems and Science SECOND EDITION Paul A. Longley, Michael F. Goodchild, David J. Maguire, David W. Rhind © 2005 John Wiley and.
GIS Overview. What is GIS? GIS is an information system that allows for capture, storage, retrieval, analysis and display of spatial data.
June 15, 2015June 15, 2015June 15, THE COURSE Mapping and Surveying Geographical Information Systems Importance of Data Global Positioning Systems.
Introduction, Satellite Imaging. Platforms Used to Acquire Remote Sensing Data Aircraft Low, medium & high altitude Higher level of spatial detail Satellite.
GEODETIC CONTROL SURVEYS
Data Input How do I transfer the paper map data and attribute data to a format that is usable by the GIS software? Data input involves both locational.
GIS Tutorial 1 Lecture 6 Digitizing.
Digitizing There are three primary methods for digitizing spatial information: Manual Methods include: Tablet Digitizing Heads-up Digitizing An Automated.
Spatial Data: Elements, Levels and Types. Spatial Data: What GIS Uses Bigfoot Sightings: Spatial Data.
9. GIS Data Collection.
Data Acquisition Lecture 8. Data Sources  Data Transfer  Getting data from the internet and importing  Data Collection  One of the most expensive.
Aerial photography and satellite imagery as data input GEOG 4103, Feb 20th Adina Racoviteanu.
REMOTE SENSING and AERIAL PHOTOGRAPHY Roger Wheate NREM100 Fall 2010.
Data Quality Data quality Related terms:
EG1106: GI: a primer Field & Survey data collection 19 th November 2004.
GEOMATICS AND GEOINFORMATICS IN MODERN INFORMATION SOCIETY PROJECTION OF NEW TRENDS INTO THEIR CURRICULA AT THE UNIVERSITY OF WEST BOHEMIA IN PILSEN Jiří.
The Geographer’s Tools
Accuracy Assessment. 2 Because it is not practical to test every pixel in the classification image, a representative sample of reference points in the.
Support the spread of “good practice” in generating, managing, analysing and communicating spatial information Using Remote Sensing Imagery By: J.Verplanke,
1 Image Pre-Processing. 2 Digital Image Processing The process of extracting information from digital images obtained from satellites Information regarding.
An Object-oriented Classification Approach for Analyzing and Characterizing Urban Landscape at the Parcel Level Weiqi Zhou, Austin Troy& Morgan Grove University.
Data source for Google earth
Data Quality Issues-Chapter 10
GSP 270 Digitizing with an Introduction to Uncertainty and Metadata
earthobs.nr.no Land cover classification of cloud- and snow-contaminated multi-temporal high-resolution satellite images Arnt-Børre Salberg and.
Geo-referenced Information Processing System. ISPRS Geoprocessing Technologies to collect and treat spatial information for a specific goal. Geoprocessing.
Introduction to Remote Sensing. Outline What is remote sensing? The electromagnetic spectrum (EMS) The four resolutions Image Classification Incorporation.
Using spectral data to discriminate land cover types.
GIS Data Quality.
Land Cover Classification Defining the pieces that make up the puzzle.
Orthorectification using
Data input 1: - Online data sources -Map scanning and digitizing GIS 4103 Spring 06 Adina Racoviteanu.
Remotely Sensed Data EMP 580 Fall 2015 Dr. Jim Graham Materials from Sara Hanna.
Stages in data collection projects. (Source: John Jensen) Spatial and temporal characteristics of commonly used Earth observation remote-sensing systems.
Write the question, and answer in complete sentences. a.What is the difference between absolute and relative location? b.What are the five themes of geography?
Data Sources Sources, integration, quality, error, uncertainty.
How do we represent the world in a GIS database?
Geographic Information Systems Data Analysis. What is GIS Data ?
West Hills College Farm of the Future The Precision-Farming Guide for Agriculturalists Chapter Five Remote Sensing.
Chapter 4. Remote Sensing Information Process. n Remote sensing can provide fundamental biophysical information, including x,y location, z elevation or.
DATA QUALITY AND ERROR  Terminology, types and sources  Importance  Handling error and uncertainty.
Geographic Information Systems in Water Science Unit 4: Module 16, Lecture 3 – Fundamental GIS data types.
Satellite Imagery and Remote Sensing DeeDee Whitaker SW Guilford High EES & Chemistry
Raster data models Rasters can be different types of tesselations SquaresTrianglesHexagons Regular tesselations.
Final Review Final will cover all lectures, book, and class assignments. New lectures since last test are 18 – 26, summarized here. Over half the test.
BOT / GEOG / GEOL 4111 / Field data collection Visiting and characterizing representative sites Used for classification (training data), information.
Distance measure Point A: UTM Eastings = 450,000m; Northings = 4,500,000m Point B: UTM Eastings = 550,000m; Northings = 4,500,000m.
SGM as an Affordable Alternative to LiDAR
Active Remote Sensing for Elevation Mapping
OSNI ® MAPPING PRODUCTS FROM LAND & PROPERTY SERVICES (LPS)
Electro-optical systems Sensor Resolution
Satellite Imagery and Remote Sensing DeeDee Whitaker SW Guilford High EES & Chemistry
Integrated spatial data LIDAR Mapping for Coastal Monitoring Dr Alison Matthews Geomatics Manager Environment Agency Geomatics Group.
Integrating LiDAR Intensity and Elevation Data for Terrain Characterization in a Forested Area Cheng Wang and Nancy F. Glenn IEEE GEOSCIENCE AND REMOTE.
26. Classification Accuracy Assessment
GEOGRAPHICAL INFORMATION SYSTEM
Factsheet #11 Understanding multiscale dynamics of landscape change through the application of remote sensing & GIS Small Stream Mapping Method: Local.
Image Information Extraction
Landsat (same day) data viewer
Presentation transcript:

Data Sources Sources, integration, quality, error, uncertainty

Data acquisition Land surveying (geodesy), GPS Aerial photography Satellite images Laser altimetry Digitizing of paper maps Scanning of paper maps Statistical data (e.g. from census bureaus) Surface and soil measurements

Land measurement, GPS Measuring devices: theodolites, laser range finders, GPS (for angles, distances and location), Dutch reference systems: –RD-net (Rijksdriehoeksmeting) –GPS-kernnet (415 points) Field sketches Important for attributes (street names, which crops exactly, etc.) and for verification

GPS GPS: precision of up to a few meters (a few centimeters for differential GPS) –Based on 30 satellites –3D coordinates Can also be used for tracking objects: cars, animals, criminals  gives trajectory data

Aerial photography Most important source for the Topographic Survey (TDN) Aerial photos are digitized by hand, and interpreted by the eye Precision (resolution) of ~15 cm

digital air photo, 15 cm resolution

Satellite images Measured electromagnetic radiation (reflection) Of types of surface coverage the reflected wave lengths are known approximately (for instance, vegetation reflects much infra-red) Also called: remote sensing Resolution Landsat: 30x30 m; SPOT 20x20 m or 10x10 monochromatic EROS pan: 1.8 m, IKONOS: 0.82 m, QuickBird: 0.60 m, GeoEye: 0.41 m Spatial, temporal, spectral resolution E.g.: RapidEye has 5 equivalent 5 m spatial resolution satellites that cover every point on earth daily

Landsat Thematic Mapper, 30 m resolution, Cape Breton Island

IKONOS, 82 cm (Singapore)

QuickBird, 60 cm

Laser altimetry (LIDAR data) For elevation data, gives 3D point cloud Precision ~10 cm Correction is needed

Correction of laser altimetry data Filtering elevation data to remove towns, trees, cars

Digitizing of paper maps

Redraw bounding lines, add attributes (same as for aerial photography) With digitizer tablet or table, or heads-up digitising Line mode or stream mode After digitizing the topology must be added, and attributes must be added

Scanning of paper maps Convert a map by a scanner into a pixel image Automatic interpretation difficult and error- prone  checking and correction necessary Vector scanning exists too

Statistical data Surveys, by questionnaires or interviews Human-geographic of economic-geographic: number of dogs per 1000 households, income, political preference Usually collected by the CBS (NL), Census Bureau (USA), or by marketing bureaus Usually a sample (subset) of the population is interviewed Results are often mapped as a choropleth map (administrative regions with shades-of-a- color-coded meaning, classified)

Soil measurements For non-visible data like pollution, temperature, soil type Choose sampling strategy –Ideal: random sampling –Practice: sampling in easily accessible areas (cannot take a soil sample under a building) –Additional samples in ‘interesting’ areas

Sensors RFID tags: Radio frequency identification: for tracking objects; can give trajectories Wireless sensor networks –Sensors that have limited computing power and can communicate –Energy consumption problem Smartdust: hypothetical wireless sensor network system

Using existing data sets Data collection is expensive: if possible, buy existing data sets (provided they are available and the quality is sufficient  need meta- data)

Data integration Convert data from two different sources in order to compare, and make analysis possible Same date of sources desirable Same level of aggregation desirable (highest level determines the level of comparison)

Integration of not aggregated and aggregated data population density life expectancy

Data integration and data consistency

105 m111 m

Edge matching Integration of digitized data sets based on adjacent map sheets or aerial photos Idea: create seamless digital data set

Data quality, I Precision: number of known decimals, depending on measuring device Accuracy: absense of systematic bias (No faulty fine- tuning) precise accurate both neither

Data quality, II Validitity: degree in which data is relevant for an application (complex geographic variables) E.g.: income for well-being; temperature for good weather Reliability: up-to-date, not old for purpose E.g.: data of last week is out-of-date for temperature, but not for land cover

Geometric and topological quality Absence of error Presence of consistenty

Sources of geometrical and topological errors Digitizing Integration Generalization Raster-vector conversion Edge-matching

Mismatch of boundaries of different themes

Digitizing errors

Other sources and problems Wrong attachment of geometry and attributes Missing attribute data Uncertainty at classification of satellite images Clouds in satellite images, shadows in aerial photos Unknown quality (e.g. precision) of paper maps used for digitizing: missing metadata Deforming of paper maps

Dealing with error/uncertainty Errors in data have consequences for e.g. the cost of projects –Provide metadata (when data collected, how, what equipment) –Visualize uncertainty E.g. classification of satellite images for land cover grass: 0.86 forest: 0.08 water: 0.03 … grass: 0.34 forest: 0.31 water: 0.25 … Confusion: 1 - (p max - p second )

Dealing with error/uncertainty Errors in data have consequences for e.g. the cost of projects –Provide metadata (when data collected, how, what equipment) –Visualize uncertainty –Provide bounds on the range of outcomes (cost) of an analysis, based on an uncertainty model and Monte-Carlo simulation