Efrat Frank, Ashraf Memon, Vishu Nandigam, Chaitan Baru

Slides:

Advertisements

Similar presentations

U.S. Department of the Interior U.S. Geological Survey Agency Report, WGISS #22 September 15, 2006 Lyndon R. Oleson U.S. Geological Survey Center for Earth.

Advertisements

LAS format and processing DTMs from tins and local binning Arrowsmith.

Web Accessible Virtual Research Environment for Ecosystem Science Community Presentation by Siddeswara Guru.

Interoperable Data Systems for Satellite, Airborne and Terrestrial LiDAR Data C. Meertens and J. McWhirter, UNAVCO S-J. S.Khalsa and T. Haran, NSIDC/CU.

NASA LiDAR and the EarthScope Spatial Data Explorer Fred Pieper March 2006.

IS 466 ADVANCED TOPICS IN INFORMATION SYSTEMS LECTURER : NOUF ALMUJALLY 20 – 11 – 2011 College Of Computer Science and Information, Information Systems.

Celso Ferreira¹, Francisco Olivera², Dean Djokic³ ¹ PH.D. Student, Civil Engineering, Texas A&M University ( ² Associate.

The GEON LiDAR Workflow: An Internet-Based Tool for the Distribution and Processing of LiDAR Point Cloud Data Christopher J. Crosby, J Ramón Arrowsmith,

2. Point Cloud x, y, z, … Complete LiDAR Workflow 1. Survey 4. Analyze / “Do Science” 3. Interpolate / Grid USGS Coastal & Marine.

Digital Topography FE Lecture 2a. From Last Week: Grid the roads and stands using various grid sizes. Overlay and comment. Grid the stands, roads,

Update on ASU GEON Activities J Ramon Arrowsmith GEON PI Meeting Reston, VA May 13, 2006.

ASU GEON NODE J Ramón Arrowsmith Department of Geological Sciences Arizona State University, Tempe, AZ

Lsevlet: web-based processing tool for LiDAR data J Ramon Arrowsmith December 14, 2004.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Active tectonics, Digital Elevation Model analysis, and remote sensing in GEON PI Meeting update.

Lidar data processing update October 15, 2005 Ramon Arrowsmith Chris Crosby Department of Geological Sciences Arizona State University Efrat Frank, Ashraf.

1 CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Global Earth Observation Grid Workshop, Bangkok, Thailand, March Integration Platform.

SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.

A Kepler-based Three Tier Architecture applied to LiDAR Interpolation and Analysis Efrat Frank, Ilkay Altintas San Diego Supercomputer Center, UCSD Configuration.

Introduction to GIS. Watershed Discretization (model elements) + Land Cover Soil Rain Results Intersect model elements with Digital Elevation Model (DEM)

Mobile Mapping Systems (MMS) for infrastructural monitoring and mapping are becoming more prevalent as the availability and affordability of solutions.

GEON: The User Perspective Choonhan Youn Dogan Seber, Chaitan Baru, Ashraf Memon San Diego Supercomputer Center, University of California at San Diego.

OpenTopography 2: A Cyberinfrastructure-Enabled Facility for High-Resolution Topographic Data and Tools PI: Chaitan Baru (SDSC) Co-PIs: J Ramon Arrowsmith.

6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.

Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.

Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Image processing, LiDAR and high resolution 2D interpolation and 3D visualization for data integration.

Introduction to Information Retrieval CS 5604: Information Storage and Retrieval ProjCINETViz by Maksudul Alam, S M Arifuzzaman, and Md Hasanuzzaman Bhuiyan.

ESRM 250 & CFR 520: Introduction to GIS © Phil Hurvitz, KEEP THIS TEXT BOX this slide includes some ESRI fonts. when you save this presentation,

GEON Science Application Demos

NSF Meeting on Cyberinfrastructure for Surficial Processes, Jan.18-19, 2006 Slide 1 GEON: The Geosciences Network Chaitan Baru San Diego Supercomputer.

, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.

, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES High Performance Computing applications in GEON: From Design to Production Dogan Seber.

material assembled from the web pages at

Service Computation 2010November 21-26, Lisbon.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM The Spatial Information Services Stack – infrastructure for the AuScope Community Earth.

Intro. To GIS Lecture 9 Terrain Analysis April 24 th, 2013.

Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.

LINDA’S INTERVIEWSGAP ANALYSES Task 1: DEVELOP OBJECTIVE FUNCTIONS AND INTERFACE ELEMENTS IMPORTANT TO STAKEHOLDERS Drivers, Goals, Barriers Spatial habitat.

Enabling Access to High-Resolution LiDAR Topography through Cyberinfrastructure-Based Data Distribution and Processing Christopher J. Crosby, J Ramón Arrowsmith.

1 Cyberinfrastructure Summer Institute for Geoscientists July 18-22, 2005 San Diego Supercomputer Center.

Accelerating Scientific Exploration Using Workflow Automation Systems Terence Critchlow (LLNL) Ilkay Altintas (SDSC) Scott Klasky(ORNL) Mladen Vouk (NCSU)

INFSO-RI Enabling Grids for E-sciencE ES applications in EGEEII – M. Petitdidier –11 February 2008 Earth Science session Wrap up.

Technical Workshops | Esri International User Conference San Diego, California Creating Geoprocessing Services Kevin Hibma, Scott Murray July 25, 2012.

1 Ilkay ALTINTAS - July 24th, 2007 Ilkay ALTINTAS Director, Scientific Workflow Automation Technologies Laboratory San Diego Supercomputer Center, UCSD.

Where to find LiDAR: Online Data Resources.

Using free and/or open source tools to build workflows to manipulate and process LiDAR data Christopher Crosby.

Sensor Placement Application and Snowpack Distribution Model from LiDAR Data Zeshi Zheng Graduate Students Systems Engineering UC Berkeley.

IPlant Collaborative Hands-on Cyberinfrastructure Workshop – Part 2 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 29, 2015,

GEON PI Meeting, March h, 2004, Blacksburg, VA C YBERINFRASTRUCTURE FOR THE G EOSCIENCES GEON IT Update PI Meeting, Blacksburg, VA March 21-23, 2004.

WEB MINING. In recent years the growth of the World Wide Web exceeded all expectations. Today there are several billions of HTML documents, pictures and.

Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs (SEEK), EAR (GEON), DOE DE-FC02-01ER25486.

GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma

6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.

The Global Land Cover Facility is sponsored by NASA and the University of Maryland.The GLCF is a founding member of the Federation of Earth Science Information.

1 CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August Web Services – The Motivation.

Amir Iqbal L Mahwish Khan L Rabia Akhtar L Nida Sarwar L Cloud Computing Based – Online IDE.

1 Overview Importing data from generic raster files Creating surfaces from point samples Mapping contours Calculating summary attributes for polygon features.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM The NCRIS AuScope Community Earth Model Bruce Simons.

GEONSearch: From Searching to Recommending GeoInformatics 2006 May 10-12, Reston, Virginia Ullas Nambiar, Bertram Ludaescher Dept. of Computer Science.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Active tectonics, Digital Elevation Model analysis, and remote sensing in GEON J Ramón Arrowsmith.

1 TCS Confidential. 2 Objective : In this session we will be able to learn:  What is Cloud Computing?  Characteristics  Cloud Flavors  Cloud Deployment.

PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.

Field Drainage Technology LiDAR John Nowatzki Extension Ag Machine Systems Specialist.

CyberGIS Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall

GEON IT Solutions: Products and Demos Chaitan Baru San Diego Supercomputer Center.

A LiDAR Processing Toolkit

MATLAB Distributed, and Other Toolboxes

Introduction to Geographic Information Science

The Challenge of Community LiDAR data

Presentation transcript:

Efrat Frank, Ashraf Memon, Vishu Nandigam, Chaitan Baru The GEON LiDAR Workflow: An Internet-Based Tool for the Distribution and Processing of LiDAR Point Cloud Data Christopher J. Crosby, J Ramón Arrowsmith, Jeffrey Connor, Gilead Wurman Efrat Frank, Ashraf Memon, Vishu Nandigam, Chaitan Baru

LiDAR Introduction Survey Interpolate / Grid Process & Classify R. Haugerud, U.S.G.S LiDAR Introduction Survey Interpolate / Grid Process & Classify D. Harding, NASA Point Cloud x, y, zn, … Analyze / “Do Science”

Project goal: Democratize access to LiDAR point cloud data using cyberinfrastructure available through the GEON project.

~1.1 million data points interpolated to produce this DEM Data typically viewed as DEM Creation of DEMs require interpolation of huge quantities of point data. Currently difficult to access and process these data volumes.

~1.2 billion data points Example Data Set: Northern San Andreas fault and associated marine terraces. Flown February 2003 Funded by NASA in collaboration w/ USGS. ~418 Square Miles ~1.2 billion data points

The Computational Challenge: LiDAR/ALSM generates massive data volumes - billions of returns are common. Distribution of these volumes of point cloud data to users via the internet represents a significant challenge. Processing and analysis of these data requires significant computing resources not available to most geoscientists. Interpolation of these data challenges typical GIS / interpolation software. our tests indicate that ArcGIS, Matlab and similar software packages struggle to interpolate even a small portion of these data.

“GEON was designed as an equal collaboration between Information Technology (IT) and Geoscience researchers, with the goal of developing an enabling IT platform to facilitate the next generation of Geoscience research.” Distributed network: ASU node “Agassiz”:

The Vision: Conceptual GEON LiDAR Workflow Utilize the cyberinfrastructure developed by GEON to offer online data distribution, interpolation to grid, and analysis of large LiDAR datasets. Utilize modular web services to complete a variety of processing and analysis tasks. Completely internet-based workflow: Point cloud to visualization Offer users control of interpolation and analysis parameters. Conceptual GEON LiDAR Workflow

Triangular Interpolation Network (TIN) Inverse Distance Weighted (IDW) Kriging Regularized Spline with Tension and smoothing (RST) Figure from Helena Mitasova (NCSU): http://skagit.meas.ncsu.edu/~helena/gmslab/index.html

Goal = interactive processing environment for iteration and exploration of various interpolation and processing options. Optimize landscape representation based upon application of the data. By using distributed computing resources, user is able to quickly run multiple jobs and compare results. Similar iteration may take days or weeks on a single local machine. Leave computationally intensive data processing to resources available through GEON and offer user downloadable products in common file formats.

Products: Hillshade of DEM Slope Map Aspect Map Profile Curvature Map

Implementation Overview: Internet-based LiDAR processing workflow that utilizes advanced spatial databases (IBM DB2), GRASS Open Source GIS, Kepler Workflow manager and web service technology to distribute, interpolate, and analyze LiDAR data. GRASS GIS

GLW Status Three datasets online: Northern San Andreas Fault West Rainier Seismic Zone Eastern California Shear Zone NCALM / Mike Oskin PI Total of ~2.5 billion LiDAR returns available via GLW. ~60 registered users More data sets in the queue: Southern San Andreas Laser Scan (B4 Project) Hector Mine EQ NCALM Napa Valley Others…

Areas of Development: Interactive vegetation filtering / feature extraction (implement open source algorithms) Additional interpolation algorithms (TIN, Kriging, moving window etc.) Additional analysis tools (Hillshade, Watershed analysis) New products/formats Web-based Viz: Interface with GEON web-based mapping (2 & 3D) Terrestrial LiDAR specific workflow

LViz Download LViz version 1.2: http://lidar.asu.edu/LViz.html Visualization of LiDAR point cloud data & interpolated surfaces FREE Download LViz version 1.2: http://lidar.asu.edu/LViz.html

More information on the GLW and LViz is available @: GEON LiDAR Workflow could be adopted as a valuable infrastructure resource for democratizing access to future LiDAR point cloud datasets for the geoscience community More information on the GLW and LViz is available @: http://www.geongrid.org/science/lidar.html http://lidar.asu.edu Please send feedback to: chris.crosby@asu.edu