The GEON LiDAR Workflow: An Internet-Based Tool for the Distribution and Processing of LiDAR Point Cloud Data Christopher J. Crosby, J Ramón Arrowsmith,

Slides:

Advertisements

Similar presentations

LAS format and processing DTMs from tins and local binning Arrowsmith.

Advertisements

Web Accessible Virtual Research Environment for Ecosystem Science Community Presentation by Siddeswara Guru.

Coordination of Indiana GIS through dissemination of data and data products, education and outreach, adoption of standards, and building partnerships Simplifying.

Interoperable Data Systems for Satellite, Airborne and Terrestrial LiDAR Data C. Meertens and J. McWhirter, UNAVCO S-J. S.Khalsa and T. Haran, NSIDC/CU.

IS 466 ADVANCED TOPICS IN INFORMATION SYSTEMS LECTURER : NOUF ALMUJALLY 20 – 11 – 2011 College Of Computer Science and Information, Information Systems.

Celso Ferreira¹, Francisco Olivera², Dean Djokic³ ¹ PH.D. Student, Civil Engineering, Texas A&M University ( ² Associate.

GIS in GEON Cyberinfrastructure Presented by Ashraf Memon Presented by Ashraf Memon.

2. Point Cloud x, y, z, … Complete LiDAR Workflow 1. Survey 4. Analyze / “Do Science” 3. Interpolate / Grid USGS Coastal & Marine.

Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.

Digital Topography FE Lecture 2a. From Last Week: Grid the roads and stands using various grid sizes. Overlay and comment. Grid the stands, roads,

GIS Applications in Meteorology and Hydrology John S. Quinlan NWS Albany, NY.

Update on ASU GEON Activities J Ramon Arrowsmith GEON PI Meeting Reston, VA May 13, 2006.

ASU GEON NODE J Ramón Arrowsmith Department of Geological Sciences Arizona State University, Tempe, AZ

Lsevlet: web-based processing tool for LiDAR data J Ramon Arrowsmith December 14, 2004.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Active tectonics, Digital Elevation Model analysis, and remote sensing in GEON PI Meeting update.

Lidar data processing update October 15, 2005 Ramon Arrowsmith Chris Crosby Department of Geological Sciences Arizona State University Efrat Frank, Ashraf.

1 CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Global Earth Observation Grid Workshop, Bangkok, Thailand, March Integration Platform.

SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.

A Kepler-based Three Tier Architecture applied to LiDAR Interpolation and Analysis Efrat Frank, Ilkay Altintas San Diego Supercomputer Center, UCSD Configuration.

1 Alternate Title Slide: Presentation Name Goes Here Presenter’s Name Infrastructure Solutions Division Date GIS Perfct Ltd. Autodesk Value Added Reseller.

Introduction to GIS. Watershed Discretization (model elements) + Land Cover Soil Rain Results Intersect model elements with Digital Elevation Model (DEM)

UNDERSTANDING LIDAR LIGHT DETECTION AND RANGING LIDAR is a remote sensing technique that can measure the distance to objects on and above the ground surface.

GEON: The User Perspective Choonhan Youn Dogan Seber, Chaitan Baru, Ashraf Memon San Diego Supercomputer Center, University of California at San Diego.

OpenTopography 2: A Cyberinfrastructure-Enabled Facility for High-Resolution Topographic Data and Tools PI: Chaitan Baru (SDSC) Co-PIs: J Ramon Arrowsmith.

6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.

Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.

Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Image processing, LiDAR and high resolution 2D interpolation and 3D visualization for data integration.

Introduction to Information Retrieval CS 5604: Information Storage and Retrieval ProjCINETViz by Maksudul Alam, S M Arifuzzaman, and Md Hasanuzzaman Bhuiyan.

ESRM 250 & CFR 520: Introduction to GIS © Phil Hurvitz, KEEP THIS TEXT BOX this slide includes some ESRI fonts. when you save this presentation,

© 2005 The MathWorks December 2 nd, 2005 MATLAB ® and HDF Accelerating Engineering Productivity and Scientific Discovery.

GEON Science Application Demos

NSF Meeting on Cyberinfrastructure for Surficial Processes, Jan.18-19, 2006 Slide 1 GEON: The Geosciences Network Chaitan Baru San Diego Supercomputer.

, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.

Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.

, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.

Service Computation 2010November 21-26, Lisbon.

Intro. To GIS Lecture 9 Terrain Analysis April 24 th, 2013.

Enabling Access to High-Resolution LiDAR Topography through Cyberinfrastructure-Based Data Distribution and Processing Christopher J. Crosby, J Ramón Arrowsmith.

1 Cyberinfrastructure Summer Institute for Geoscientists July 18-22, 2005 San Diego Supercomputer Center.

Efrat Frank, Ashraf Memon, Vishu Nandigam, Chaitan Baru

Technical Workshops | Esri International User Conference San Diego, California Creating Geoprocessing Services Kevin Hibma, Scott Murray July 25, 2012.

1 Ilkay ALTINTAS - July 24th, 2007 Ilkay ALTINTAS Director, Scientific Workflow Automation Technologies Laboratory San Diego Supercomputer Center, UCSD.

Advanced GIS Using ESRI ArcGIS 9.3 3D Analyst part 2.

Where to find LiDAR: Online Data Resources.

Using free and/or open source tools to build workflows to manipulate and process LiDAR data Christopher Crosby.

Sensor Placement Application and Snowpack Distribution Model from LiDAR Data Zeshi Zheng Graduate Students Systems Engineering UC Berkeley.

IPlant Collaborative Hands-on Cyberinfrastructure Workshop – Part 2 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 29, 2015,

ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.

WEB MINING. In recent years the growth of the World Wide Web exceeded all expectations. Today there are several billions of HTML documents, pictures and.

Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs (SEEK), EAR (GEON), DOE DE-FC02-01ER25486.

GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma

BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.

1 CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August Web Services – The Motivation.

1 Overview Importing data from generic raster files Creating surfaces from point samples Mapping contours Calculating summary attributes for polygon features.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Hierarchies of visualization needs in earth science with particular applications to surface process.

Big Data Analytics Platforms. Our Team NameApplication Viborov MichaelApache Spark Bordeynik YanivApache Storm Abu Jabal FerasHPCC Oun JosephGoogle BigQuery.

GEONSearch: From Searching to Recommending GeoInformatics 2006 May 10-12, Reston, Virginia Ullas Nambiar, Bertram Ludaescher Dept. of Computer Science.

1 Circuitscape Capstone Presentation Team Circuitscape Katie Rankin Mike Schulte Carl Reniker Sean Collins.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Active tectonics, Digital Elevation Model analysis, and remote sensing in GEON J Ramón Arrowsmith.

1 TCS Confidential. 2 Objective : In this session we will be able to learn:  What is Cloud Computing?  Characteristics  Cloud Flavors  Cloud Deployment.

A Use Case for GEON 1 A user request of the form: “For a given region (i.e. lat/long extent, plus depth), return a 3D structural model with accompanying.

OSSIM Technology Overview Mark Lucas. “Awesome” Open Source Software Image Map (OSSIM)

PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.

CyberGIS Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall

GEON IT Solutions: Products and Demos Chaitan Baru San Diego Supercomputer Center.

SIMULATION COMPONENT AND MODFLOW DATA MODEL. Simulation Component.

MATLAB Distributed, and Other Toolboxes

Lidar Image Processing

The Challenge of Community LiDAR data

Presentation transcript:

The GEON LiDAR Workflow: An Internet-Based Tool for the Distribution and Processing of LiDAR Point Cloud Data Christopher J. Crosby, J Ramón Arrowsmith, Jeffrey Connor, Gilead Wurman Efrat Frank, Ashraf Memon, Vishu Nandigam, Chaitan Baru

Project goal: Democratize access to LiDAR point cloud data using cyberinfrastructure under development by the GEON project.

LViz A FREE application for 3D visualization of LiDAR / ALSM point and interpolated data. Developed by Jeffrey Conner in the ASU Active Tectonics Group. Import of LiDAR point cloud data (delimited text file) or interpolated surfaces (in ascii grid format) User control over display settings such as data and background color

LViz:

~1.1 million data points interpolated to produce this DEM Data typically viewed as DEM Creation of DEMs required interpolation of huge quantities of point data. Currently difficult to access and process these data volumes.

~1.2 billion data points Example Data Set: Northern San Andreas fault and associated marine terraces. Flown February 2003 Funded by NASA in collaboration w/ USGS. ~418 Square Kilometers

The Computational Challenge: LiDAR/ALSM generates massive data volumes - billions of returns are not uncommon in these data sets. Distribution of these volumes of point cloud data to users via the internet represents a significant challenge. Processing and analysis of these data requires significant computing resources not available to most geoscientists. Interpolation of these data challenges typical GIS / interpolation software. –our tests indicate that ArcGIS, Matlab and similar software packages struggle to interpolate even a small portion of these data.

“GEON was designed as an equal collaboration between Information Technology (IT) and Geoscience researchers, with the goal of developing an enabling IT platform to facilitate the next generation of Geoscience research.” Distributed network: ASU node “Agassiz”:

The Vision: Utilize the cyberinfrastructure developed by GEON to offer online data distribution, interpolation to grid, and analysis of large LiDAR datasets. Utilize modular web services to complete a variety of processing and analysis tasks. Completely internet-based workflow: –Point cloud to visualization Offer users control of interpolation and analysis parameters. Conceptual GEON LiDAR Workflow

Triangular Interpolation Network (TIN)Inverse Distance Weighted (IDW) KrigingRegularized Spline with Tension and smoothing (RST) Figure from Helena Mitasova (NCSU):

Goal is to provide an interactive processing environment where users can iterate and explore various interpolation and processing options. –Optimize landscape representation based upon application of the data. By using distributed computing resources, user is able to quickly run multiple jobs and compare results. –Similar iteration may take days or weeks on a single local machine. Leave computationally intensive data processing to resources available through GEON and offer user downloadable products in common file formats they can work with locally.

Products: Hillshade of DEM Slope Map Aspect Map Profile Curvature Map

Implementation Overview: Internet-based LiDAR processing workflow that utilizes advanced spatial databases (IBM DB2), GRASS Open Source GIS, Kepler Workflow manager and web service technology to distribute, interpolate, and analyze LiDAR data. GRASS GIS

GLW Status Three datasets online: 1.Northern San Andreas Fault 2.West Rainier Seismic Zone 3.Eastern California Shear Zone NCALM / Mike Oskin PI Total of ~2.5 billion LiDAR returns available via GLW. More data sets in the queue: Hector Mine EQ NCALM Napa Valley Others…

Areas of Development: Interactive vegetation filtering / feature extraction (implement open source algorithms) Additional interpolation algorithms (TIN, Kriging, moving window etc.) Additional analysis tools (Hillshade, Watershed analysis) New products/formats Web-based Viz: –Interface with GEON web- based mapping (2 & 3D) Conceptual GEON LiDAR Workflow

GEON LiDAR Workflow could be adopted as a valuable infrastructure resource for democratizing access to future LiDAR point cloud datasets for the geoscience community More information on the GLW is Please send feedback to: