The visualization of pollution data distribution in Taiwan, using Open Data and R BY CHENG CHANG LU & YU LAN CHIANG.

Slides:



Advertisements
Similar presentations
Objectives to improve citizens awareness and comfort industrial competitiveness efficiency of public administrations by enhancing and supporting the use,
Advertisements

Introduction to Geospatial Analysis in R SURF – 24 April 2012 Daniel Marlay.
CFR 250/590 Introduction to GIS, Autumn 1999 Data Search & Import © Phil Hurvitz, find_data 1  Overview Web search engines NSDI GeoSpatial Data.
Spatial Data Infrastructure: Concepts and Components Geog 458: Map Sources and Errors March 6, 2006.
Baburao Kamble (Ph.D) University of Nebraska-Lincoln Data Analysis Using R Week3: Data Input/Output (Import/Export) in R.
GIS for Environmental Science
4.3.1 GIS 1 GEOGRAPHICAL INFORMATION SYSTEMS (GIS) UPA Package 4, Module 3.
© 2011 United HealthCare Services, Inc. 1 Image Library.
IS 466 ADVANCED TOPICS IN INFORMATION SYSTEMS LECTURER : NOUF ALMUJALLY 20 – 11 – 2011 College Of Computer Science and Information, Information Systems.
METS What is METS ? What is METS ? A schema that provides a flexible mechanism for encoding descriptive, administrative, and structural metadata for a.
Oct 31, 2000Database Management -- Fall R. Larson Database Management: Introduction to Terms and Concepts University of California, Berkeley School.
Geog 458: Map Sources and Errors January 20, 2006 Data Storage and Editing.
©2005 Austin Troy. All rights reserved Lecture 3: Introduction to GIS Part 1. Understanding Spatial Data Structures by Austin Troy, University of Vermont.
Basic And Advanced SAS Programming
Something basic about GIS. What is GIS ? GIS = Geographic Information Systems Three components: Geography – the real world Information – data and information.
North Carolina Geospatial Data Archiving Project (NCGDAP) Project Overview Partnership –University library (NCSU) and state agency (NCCGIA) –$520,000 funding,
Mobile App Monetization: Understanding the Advertising Ecosystem Vaibhav Rastogi.
Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.
Interfacing R with GIS Xiaogang (Marshall) Ma School of Science Rensselaer Polytechnic Institute Tuesday, Apr 02, 2013 GIS in the Sciences ERTH 4750 (38031)
Using the SAS® Information Delivery Portal
material assembled from the web pages at
GIS concepts, skills and tools
1 The Development of Taiwan Geospatial One-Stop (TGOS) Portal Lan, Kun-Yu Officer Information Center, MOI July, 2008.
MapServer Support for Web Coverage Services Stephen Lime - Minnesota DNR Dr. Thomas E. Burk - University of Minnesota MUM Ottawa, Canada.
GIS On The Web: An Overview of ArcIMS. *The easy flow of geographic data can offer real-life solutions in many societal sectors, including municipal government,
Data visualization as a library service? Examples from Chalmers Library.
Sherry Lake Candidate for Metadata Specialist for User Projects.
By Lu Instructor: Leo F. Estrada TA:Nic Jay Aulston&: Peter Capone-Newton.
A.Batchimeg GDAL Geospatial Data Abstraction Library GDAL Geospatial Data Abstraction Library
An Internet of Things: People, Processes, and Products in the Spotfire Cloud Library Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist.
Long-Term Preservation of At- Risk Digital Geospatial Data: A Cooperative Agreement with Library of Congress Steve Morris NCSU Libraries Zsolt Nagy NC.
Using free and/or open source tools to build workflows to manipulate and process LiDAR data Christopher Crosby.
DIGITAL ELEVATION MODELING GEOG 421: DR. SHUNFU HU, SIUE Project One Steve Klaas Fall 2013.
Alexandria Digital Earth ProtoType DIGITAL LIBRARIES AND ENVIRONMENTAL INFORMATION Terence R. Smith Alexandria Digital Library Project.
1 Introduction and Demonstration of TGOS Portal Yao-Chun Chuang Yao-Chun Chuang Officer, Information Center Ministry of the Interior, ROC Ministry of the.
Harry Williams, Cartography1 INTRODUCTION TO GIS A Geographic Information System is a combination of software and hardware that can store, manipulate,
THE SPACIAL CHARACTER OF URBAN CRIME —— BASED ON CHESTER FIELD AND ITS SUROUNDING AREA JIE GAO. UP206A. FEB, 2012.
North Carolina Geospatial Data Archiving Project : Cooperative Project with Library of Congress on Preservation of Digital Geospatial Data Partners: NCSU.
Capstone Projects: OpenGL and C++ Usage Study Edgardo Molina City College of New York.
Geography Markup Language (GML). What is GML? – Scope  The Geography Markup Language is  a modeling language for geographic information  an encoding.
Midterm Activities: Due by Friday Process Journals must be in YOUR words Track 2 First finish Tutorial 2, then complete and print process journals for:
1 Overview Finding and importing data sets –Searching for data –Importing data_.
Field trip 24 February 2005 Departs 0915 from Town Lodge.
Central Region Snowfall Analysis Brian P. Walawender NWS Central Region Headquarters Matt W. Davis NWS WFO La Crosse, WI 5/26/2011.
U.S. Environmental Protection Agency Central Data Exchange Pilot Project Promoting Geospatial Data Exchange Between EPA and State Partners. April 25, 2007.
Introduction to Geographic Information Systems Fall 2013 (INF 385T-28620) Dr. David Arctur Research Fellow, Adjunct Faculty University of Texas at Austin.
ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.
E-Government Initiative Geospatial Information One-Stop FGDC Coordination Group January 10, 2002 John Moeller.
SP5 - Neuroinformatics 3DSomaMS Tutorial Computational Intelligence Group Technical University of Madrid.
Introduction to Metadata March 2016 What is Metadata?
Presented by: Shahab Spring Introduction Data Analytics Plugins Learning Resources.
Jacksonville SQL Saturday May 9, 2015 Introduction to Power BI.
All rights reserved. © 2009 Tableau Software Inc. Advanced Mapping Techniques Austin Dahl, Dirk Karis, Robert Morton Tableau Software.
Geospatial Data Abstraction Library(GDAL) Sabya Sachi.
Statistical Exploratory Analysis with “EnQuireR” 1.Introduction 2.Installation 3.How to 4.Report.
The BOP (Billion Object Platform) and WorldMap / Dataverse Integration Harvard Center for Geographic Analysis Tuesday, July 12, 2016 Ben Lewis, Mercè Crosas,
GIS Basic Training June 7, 2007 – ICIT Midyear Conference
GEOGRAPHICAL INFORMATION SYSTEM
Environment Canterbury Rates
Harry Williams, Cartography
Touring Data with Power Map
Spatial Data Processing
Using QGIS, GRASS and PostGIS to answer some difficult questions
Learn R! GIS.
Smart Integration Express
QGIS, the data model, use and storage
ESRM 250/CFR 520 Autumn 2009 Phil Hurvitz
Parallel Feature Identification and Elimination from a CFD Dataset
Introduction to Citation Analysis with Sci2
Data Analytics Case Study
Presentation transcript:

The visualization of pollution data distribution in Taiwan, using Open Data and R BY CHENG CHANG LU & YU LAN CHIANG

Outline Target Data acquisition and clean up Use R to analyze and visualize geospatial data Use Shiny to share results The impression

Target Big Data Data Sources Geospatial data processing Visualization

Data acquisition and clean up TGOS(Taiwan Geospatial One Stop) Metadata Data structures, definitions and content analysis Data used :  pollution petition case distribution map of 2013  County (city) administrative boundaries (the island of Taiwan region)

TGOS URL: TGOS Introduction

Metadata data about data Reality:

Data structures, definitions and content analysis Pollution petition case distribution map of 2013(TWD97) From_Org,To_Org Columns Case_exnum Columns Reference: Pollution petition admissible network system Pollution petition admissible network system Polltion_* Columns Case_date Columns County (city) administrative boundaries (the island of Taiwan region)(WGS84) Geocoding Reference: Spatial Reference GDAL - Geospatial Data Abstraction Library Spatial Reference GDAL - Geospatial Data Abstraction Library

Use R to analyze and visualize geospatial data 1. The target of analyzation and visualization The spatial distribution of different types of pollution 2. Loading and analyzing data Installation and usage of rgdal Data compilation and conversion 3. Data visualization Use classInt and RColorBrewer build palette Use plot and spplot charting 4. Use Shiny build interactive interface and results Encoding problem

Geospatial data processing Geocoding conversion: #Geocoding to convert WGS84 EPSG <- make_EPSG() EPSG[3826,3] harzard.linglat <- spTransform(harzard_s, CRS("+proj=longlat +ellps=WGS84 +datum=WGS84 +no_defs")) county.linglat <- spTransform(county_s, CRS("+proj=longlat +ellps=WGS84 +datum=WGS84 +no_defs"))

Geospatial data processing Use sp package over function to merge data sc.linglat <-over(harzard.linglat, county.linglat) Use subset function to remove useless columns cc2 <- subset(cc,select=c(SerID,ALIAS,D_NAME,D_NAME1)) RDS file format to accelerate the use of data access saveRDS(harzard_sc.linglat, "data/harzard.rds") saveRDS(county.linglat, "data/county.rds")

Data visualization Use classInt and RColorBrewer function 8 color palette to create a range of intervals aliquots Use plot and spplot charting

Use Shiny share results Use selectInput object to select pollution build three results show chart, map and dataTableOutpu renderDataTable the "Big5", "UTF8" encoding issues

DEMO

The impression Rich packages Active community forums