Advanced Geospatial Techniques: Aiding Earth Observation Applications

Slides:



Advertisements
Similar presentations
ASIAES Project Overview Satellite Image Network for Natural Hazard Management in ASEAN+3 region Pakorn Apaphant Geo-Informatics and Space Technology Development.
Advertisements

Online Analytical Processing OLAP
OLAP Services Business Intelligence Solutions. Agenda Definition of OLAP Types of OLAP Definition of Cube Definition of DMR Differences between Cube and.
A Java Architecture for the Internet of Things Noel Poore, Architect Pete St. Pierre, Product Manager Java Platform Group, Internet of Things September.
MS DB Proposal Scott Canaan B. Thomas Golisano College of Computing & Information Sciences.
Advanced Topics COMP163: Database Management Systems University of the Pacific December 9, 2008.
Components and Architecture CS 543 – Data Warehousing.
Data and Knowledge Management
Copyright © 2014 Pearson Education, Inc. 1 It's what you learn after you know it all that counts. John Wooden Key Terms and Review (Chapter 6) Enhancing.
Distributed Data Analysis & Dissemination System (D-DADS) Prepared by Stefan Falke Rudolf Husar Bret Schichtel June 2000.
Online Analytical Processing (OLAP) Hweichao Lu CS157B-02 Spring 2007.
This presentation was scheduled to be delivered by Brian Mitchell, Lead Architect, Microsoft Big Data COE Follow him Contact him.
S EEQ C ORPORATION Big Data Oregon Connections Telecommunications Conference Dustin Johnson October 23, 2014.
material assembled from the web pages at
OnLine Analytical Processing (OLAP)
Geographic Information Systems Temporal GIS Lecture 8 Eng. Osama Dawoud.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Big Data Yuan Xue CS 292 Special topics on.
Smart Grid Big Data: Automating Analysis of Distribution Systems Steve Pascoe Manager Business Development E&O - NISC.
BIG DATA. Big Data: A definition Big data is a collection of data sets so large and complex that it becomes difficult to process using on-hand database.
BIG DATA/ Hadoop Interview Questions.
BIG DATA BIGDATA, collection of large and complex data sets difficult to process using on-hand database tools.
GIS IN THE CLOUD Cloud computing furnishes scalable GIS technology that is maintained off premises and delivered on demand as services via the Internet.
Big Data-An Analysis. Big Data: A definition Big data is a collection of data sets so large and complex that it becomes difficult.
Data Analytics (CS40003) Introduction to Data Lecture #1
Supervisor : Prof . Abbdolahzadeh
Energy Management Solution
Network Data Collection Infrastructure to Detect Security Anomalies
Short History of Data Storage
Device Maintenance and Management, Parental Control, and Theft Protection for Home Users Made Easy with Remo MORE and Power of Azure MICROSOFT AZURE APP.
Organizations Are Embracing New Opportunities
Data Platform and Analytics Foundational Training
Data Platform Modernization
The Future? Or the Past and Present?
Big Data Enterprise Patterns
Business Critical Application Platform
Chapter 13 The Data Warehouse
Microsoft Build /22/ :52 PM © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY,
Couchbase Server is a NoSQL Database with a SQL-Based Query Language
Enabling Scalable and HA Ingestion and Real-Time Big Data Insights for the Enterprise OCJUG, 2014.
So far we have covered … Basic visualization algorithms
Energy Management Solution
Test Automation for IoT solutions A Paradigm shift
Datamining : Refers to extracting or mining knowledge from large amounts of data Applications : Market Analysis Fraud Detection Customer Retention Production.
Business Critical Application Platform
Online Analytical Processing OLAP
Welcome! Power BI User Group (PUG)
Storage Systems for Managing Voluminous Data
Big Data The huge amount of data being collected and stored about individuals, items, and activities and to the process of drawing useful information from.
Massively Parallel Cloud Data Storage Systems
Big Data - in Performance Engineering
MANAGING DATA RESOURCES
Data Platform Modernization
DeFacto Planning on the Powerful Microsoft Azure Platform Puts the Power of Intelligent and Timely Planning at Any Business Manager’s Fingertips Partner.
Data Security for Microsoft Azure
Accelerate Your Self-Service Data Analytics
FDA Objectives and Implementation Planning
Welcome! Power BI User Group (PUG)
Azure's Performance, Scalability, SQL Servers Automate Real Time Data Transfer at Low Cost MINI-CASE STUDY “Azure offers high performance, scalable, and.
Big Data Overview.
XtremeData on the Microsoft Azure Cloud Platform:
Overview of big data tools
Cloud computing mechanisms
Designing Complex Tabular Models
Building a Threat-Analytics Multi-Region Data Lake on AWS
Introducing Citilabs’ Scenario Based Master Network Data Model
Big DATA.
WGISS-47 Earth Observation Services Metadata ISRO Use Cases
Big Data.
Presentation transcript:

Advanced Geospatial Techniques: Aiding Earth Observation Applications WGISS-47 Nitant Dube Space Applications Centre, ISRO Ahmedabad, INDIA

CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3

Geospatial Data Challenges More and More Geospatial Data are becoming unstructured Exponential growth in data volume Requirements of Data availability/access on demand Data Security Interoperability to support new technologies/applications 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3

CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3 Geospatial Databases Geo-relational Databases Relational Databases + Geo-spatial attributes in separate file Spatially Enabled Databases Geo-spatial attributes are also part of relational database Supports advanced geo-spatial SQL queries NoSQL Does not require fixed schema and usually avoid join operations, Good in Horizontal scaling Geo-spatial support: MongoDB, BigTable, Cassandra, CouchDB In-memory Database Database management system, which primarily uses main memory or hybrid approach for data storage as compared to conventional disk based storage (Apache Ignite) Cloud Database Database runs typically on cloud and provide access to database as service (DBaaS) 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3

Geospatial Data Processing Big Data (In mature stage) Addresses issues of processing data that is too large for conventional data processing architectures Cloud Computing (Operational) Resource and data on demand as service Real time Data Processing (Future) Customized chips or FPGA for processing on real time data stream Real time maps for Autonomous vehicle navigation Location Based services Real time Information services 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3

Augmented Data Analytics Next generation data and analytics paradigm Emphasis is on automation of data discovery, preparation and insight discovery using machine learning techniques. Automatically generates actions from insights Earth Observation Applications Automated feature extraction using deep learning techniques (Applications in Urban management) Automated event tracking using machine learning techniques (Oil Spill, forest fires, cyclone, Heavy rains) Natural Resource and Crop Monitoring (Monitoring of Forest cover and Crop yield) 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3

High Definition Maps: Autonomous Navigation High Definition Maps (HD Maps) Maps with High accuracy ( centimeter level) Dynamic composition using sensors on multiple autonomous vehicles in the vicinity Capability for machines to understand maps Sharing of maps using ad-hoc network Source: /www.geospatialworld.net 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3

CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3 Earth-Digital Twin Development of Digital Earth Model which updates in Near Real time using concepts of Digital Twin Earth Observation Data which can contribute towards development of Earth Digital Twin Satellite data Ground Observations Model Forecast Applications Real time insight into earth processes Understanding of multiple parameter dependency 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3

CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3 Data cubes Data cubes are gaining importance as it is an innovative approach to organize and analyze data, which is difficult and time consuming using conventional methods. Provides a portable environment of analysis ready products for quick analysis and interpretation by end users. Limitations High Dimensionality Curse : i.e. complexity of data cube (both for creation and execution of operator on the cube) increases exponentially with increase in dimension of data. Requires High Performance computing environment for creation of Data cubes 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3

CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3 Dwarf Data cubes Dwarf is a highly compressed structure for computing ,storing and querying data cubes. Dwarf identifies prefix and suffix structural redundancies and factors them out. Advantages Volume reduction of huge orders, for some type of data sets 1:400000 reduction in volume is reported. (We need to explore for earth observation data what volume reductions are possible) Dwarf data cubes can be created using standard desktops or server machines as compared to HPC requirements for Data cubes. Dwarf cubes provide analysis ready products, with minimum latencies, even on laptops. http://nanocubes.net/ 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3

Thank you nitant@sac.isro.gov.in 6/13/2019 CEOS, WGISS-47, Silver Spring, Maryland, USA, April 29-May 3