Gunnar Misund1 REAL TIME MANAGEMENT OF MASSIVE 2D DATASETS Gunnar Misund.

Slides:



Advertisements
Similar presentations
A Ridiculously Easy & Seriously Powerful SQL Cloud Database Itamar Haber AVP Ops & Solutions.
Advertisements

Autodesk Integrations Overview SmartDesk A seamlessly integrated, affordable, out-of-the-box, Windows based drawing and document management tool for.
Integrating 3D Geodata in Service-Based Visualization Systems Jan Klimke, Dieter Hildebrandt, Benjamin Hagedorn, and Jürgen Döllner Computer Graphics Systems.
4. Geomatikk kollokvium 2/06/03The OneMap Project Gunnar Misund, Østfold University College, Norway PROJECT ONEMAP.
Multi-user and internet mapping. Multi-user environments Simple file server solution, LAN (Novel, Windows network) View from everywhere, edit from one.
Components of GIS.
An Operational Metadata Framework For Searching, Indexing, and Retrieving Distributed GIServices on the Internet By Ming-Hsiang.
The State of the Art in Distributed Query Processing by Donald Kossmann Presented by Chris Gianfrancesco.
Center for Modeling & Simulation.  A Map is the most effective shorthand to show locations of objects with attributes, which can be physical or cultural.
4.3.4 Spatial Data Integration 1 UPA Package 4, Module 3 SPATIAL DATA INTEGRATION.
Raster Based GIS Analysis
Introduction to GIS and ArcGIS How a GIS works Introduction to ArcGIS The ArcGIS Interface.
IS 466 ADVANCED TOPICS IN INFORMATION SYSTEMS LECTURER : NOUF ALMUJALLY 20 – 11 – 2011 College Of Computer Science and Information, Information Systems.
West Hills College Farm of the Future. West Hills College Farm of the Future Where are you NOW?! Precision Agriculture – Lesson 3.
 Image Search Engine Results now  Focus on GIS image registration  The Technique and its advantages  Internal working  Sample Results  Applicable.
Overview Distributed vs. decentralized Why distributed databases
Geographic Information Systems
NPS Introduction to GIS: Lecture 1
Barry Biediger Utah Automated Geographic Reference Center (AGRC) October 28, 2004 Database Issues.
©Silberschatz, Korth and Sudarshan18.1Database System Concepts Centralized Systems Run on a single computer system and do not interact with other computer.
From Topographic Maps to Digital Elevation Models Daniel Sheehan IS&T Academic Computing Anne Graham MIT Libraries.
1 Alternate Title Slide: Presentation Name Goes Here Presenter’s Name Infrastructure Solutions Division Date GIS Perfct Ltd. Autodesk Value Added Reseller.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
 Distributed Software Chapter 18 - Distributed Software1.
Spatial data Visualization spatial data Ruslan Bobov
VAP What is a Virtual Application ? A virtual application is an application that has been optimized to run on virtual infrastructure. The application software.
IWC Database Overview of technology and application 13 th July 2010.
GROUP 4 FATIN NUR HAFIZAH MULLAI J.DHANNIYA FARAH AN-NUR MOHAMAD AZUWAN LAU WAN YEE.
WA LOCAL GOVERNMENT GIS FOCUS GROUP Referential Topology - the Local Government perspective.
GIS Application Development for the Internet:
2 TerraViva! SEDAC Software produced by ISciences LLC based in Ann Arbor MI Provides visualization of SEDAC and remote sensing/ biophysical datasets in.
Applied Cartography and Introduction to GIS GEOG 2017 EL Lecture-2 Chapters 3 and 4.
Copyright 2010, The World Bank Group. All Rights Reserved. COVERAGE, FRAMES & GIS, Part 2 Quality assurance for census 1.
Major parts of ArcGIS ArcView -Basic mapping, editing and Analysis tools ArcEditor -all of ArcView plus Adds ability to deal with topological and network.
GTOPO30 Global 30-arc-second (1-km) elevation model - “Best available” global DEM - Initial release: March Widely used for climate modeling, land.
Spatial Databases: Data Collection Spring, 2015 Ki-Joune Li.
8. Geographic Data Modeling. Outline Definitions Data models / modeling GIS data models – Topology.
The 2000 Decennial Census School District Project: Using Census Data for the School District Mapping System **** Development and Implementation Tai A.
Guide to Linux Installation and Administration, 2e1 Chapter 2 Planning Your System.
Massively Distributed Database Systems - Distributed DBS Spring 2014 Ki-Joune Li Pusan National University.
Applied Mathematics 1 Do we have to see everything - all the time? …or is it at all possible? Dr. ing. Rune Aasgaard.
URBDP 422 Urban and Regional Geo-Spatial Analysis Lecture 2: Spatial Data Models and Structures Lab Exercise 2: Topology January 9, 2014.
Geographic Information Systems Temporal GIS Lecture 8 Eng. Osama Dawoud.
GIS Data Structures How do we represent the world in a GIS database?
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
Otto is a system to maintain and analyze your hours on the job Job journal in familiar Outlook style calendar format – Maintaining your hours in.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
INTRODUCTION TO GIS  Used to describe computer facilities which are used to handle data referenced to the spatial domain.  Has the ability to inter-
Client-Server Paradise ICOM 8015 Distributed Databases.
Topic Distributed DBMS Database Management Systems Fall 2012 Presented by: Osama Ben Omran.
Web Design and Development. World Wide Web  World Wide Web (WWW or W3), collection of globally distributed text and multimedia documents and files 
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Applied Mathematics 1 Distributed visualization of terrain models How to get the whole world into a coffee mug... Rune Aasgaard.
Features Of SQL Server 2000: 1. Internet Integration: SQL Server 2000 works with other products to form a stable and secure data store for internet and.
Towards Unifying Vector and Raster Data Models for Hybrid Spatial Regions Philip Dougherty.
Spatial Data Models Geography is concerned with many aspects of our environment. From a GIS perspective, we can identify two aspects which are of particular.
1 Information Retrieval and Use De-normalisation and Distributed database systems Geoff Leese September 2008, revised October 2009.
OSNI ® MAPPING PRODUCTS FROM LAND & PROPERTY SERVICES (LPS)
Progressive transmission of spatial data Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
Generalisation process and generalisation tools in Maanmittauslaitos
GEOGRAPHICAL INFORMATION SYSTEM
INTRODUCTION TO GEOGRAPHICAL INFORMATION SYSTEM
Accessing Spatial Information from MaineDOT
Chapter 19: Distributed Databases
Geographical information system: Definition and components
NPS Introduction to GIS: Lecture 1 Based on NIMC and Other Sources.
OU BATTLECARD: Oracle Data Integrator
ArcGIS Pro: An Introduction Overview
Presentation transcript:

Gunnar Misund1 REAL TIME MANAGEMENT OF MASSIVE 2D DATASETS Gunnar Misund

2 Shuttle Radar Topography Mission (Mission to Earth) Landing - May terabytes of raw data 2 years of post processing Virtual Earth: 3D model of 80% of the continental area, 30m mesh 20m horizontal resolution, 4m vertical

Gunnar Misund3 ONE WORLD – ONE MAP On-the-fly generation of user defined maps in real time, typically via Internet servers Any combination of layers Any selection, from global to street level views Any resolution, from large graphical desktop displays to small PDA/cellular screens Frequently updated in formation Such servers already present, e.g. Still more to do

Gunnar Misund4 Mostly DCW data: coasts, rivers, political boundaries Canada: Elevation contours, roads, utilities etc. (”upgraded” DCW) US coast: 1: Total ca points

Gunnar Misund5

6

7

8

9

10

Gunnar Misund11

Gunnar Misund12

Gunnar Misund13

Gunnar Misund14

Gunnar Misund15 N50 1: map sheet Ca points

Gunnar Misund16

Gunnar Misund17

Gunnar Misund18

Gunnar Misund19

Gunnar Misund20

Gunnar Misund21 Approximation: Simplification vs. Data Reduction Simplification (smoothing): Reducing the (visual) complexity of a geometric object Data reduction (thinning): Reducing the amount of data (often 2D/3D) needed to represent a geometric object within a given tolerance Mostly treated as two aspects of same phenomenon

Gunnar Misund22 Cartographic Generalization Road and river network, 3 different scales:

Gunnar Misund23 Level of Detail (LOD)

Gunnar Misund24 MASSIVE MAPS SERVERS – SOME REQUIREMENTS I Efficient storage: –The size of the database should propotional with the size of the dataset –Multiple representations should be avoided, prone to inconstency problems Efficient retrieval: –Efficient window query –Efficient approximation of the data in the query window –The combined query/approximation requests must run in sublinear time –Can’t afford to inspect every point in the data set –Should be close to logaritmic order –Must run in external memory Efficient maintaince: –Removals, additions and modifications must run in sublinear time

Gunnar Misund25 MASSIVE MAPS SERVERS – SOME REQUIREMENTS II Generalization: –Selection, aggregation and possible deformations should be performed more or less automatically Topology preservation: –Elevation contours must not cross, road networks have to remain consistent after a query process Scalability: –Operations should be decomposable: Spatial partitioning allow for parallell methods –Should facilitate fusion of data from heterogenous sources Implementation: –Simple methods are easy to implement and maintain

Gunnar Misund26

Gunnar Misund27

Gunnar Misund28 1W1M: ONE WORLD – ONE MAP Long term project, coordinated from HiØ –Provide free access for all internet users to a virtual map with global coverage Gateway –Consumer side of 1W1M –Retrieval of customized maps for any area, in any resolution –Free of charge –”Common” users will receive a graphic depiction as the result of the query (e.g. a JPEG image) –Producers are have access to fully functional GIS data Clearinghouse –Producer side of 1W1M –Any party can submit public domain geodata –Approval of submissions based on ”peer review”

Gunnar Misund29 COMMENTS One World – One Map solutions are technologically within reach New user demands, new sources of data and new technology calls for –new geodata models –rethinking of the generalization consept –distributed and integrated storage and retrival systems –increased focus on standards and integration issue