Integrating Geographical Information Systems and Grid Applications

Slides:



Advertisements
Similar presentations
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Advertisements

Pulan Yu School of Informatics Indiana University Bloomington Web service based Varuna.Net.
Snejina Lazarova Senior QA Engineer, Team Lead CRMTeam Dimo Mitev Senior QA Engineer, Team Lead SystemIntegrationTeam Telerik QA Academy SOAP-based Web.
E-DECIDER: QuakeSim Tools and Products Marlon Pierce, Co-Investigator Margaret Glasscoe, PI
1 Integrating Geographical Information Systems and Grid Services for Earthquake Forecasting Marlon Pierce Community Grids Lab Indiana University May 4,
QuakeSim Science Gateway: ACES Update Marlon Pierce, Jun Wang, Yu Ma, Jun Ji, Xiaoming Gao, Geoffrey Fox Indiana University.
E-DECIDER Workshop: QuakeSim Tools and Products Marlon Pierce Indiana University.
Integrating Geographical Information Systems and Grid Applications Marlon Pierce Contributions: Ahmet Sayar, Galip Aydin, Mehmet Aktas, Harshawardhan Gadgil.
The Problem: Integrating Data, Applications, and Client Devices The key issue we try to solve is building the distributed computing infrastructure that.
Service Oriented Architecture for Geographic Information Systems Supporting Real Time Data Grids Galip Aydin Department Of Computer Science Indiana University.
Indiana University QuakeSim Activities Marlon Pierce, Geoffrey Fox, Xiaoming Gao, Jun Ji, Chao Sun.
Using AJAX Galip Aydin, Ahmet Sayar, and Marlon Pierce Community Grids Lab Indiana University.
Client/Server Architectures
Windows.Net Programming Series Preview. Course Schedule CourseDate Microsoft.Net Fundamentals 01/13/2014 Microsoft Windows/Web Fundamentals 01/20/2014.
Integrating Geographical Information Systems and Grid Applications Marlon Pierce Contributions: Yili Gong,
HPSearch Design & Development via Scripting Harshawardhan Gadgil Dr. Geoffrey Fox, Dr. Marlon Pierce.
Integrating Geographical Information Systems and Grid Applications Marlon Pierce Contributions: Ahmet Sayar, Galip Aydin, Mehmet Aktas, Harshawardhan Gadgil.
Department of Biomedical Informatics Service Oriented Bioscience Cluster at OSC Umit V. Catalyurek Associate Professor Dept. of Biomedical Informatics.
High Performance Web Service Architecture for Sensors and Geographic Information Systems Galip Aydin.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
GML Data Models and Web Services for GPS and Earthquake Catalogs Marlon Pierce, Galip Aydin Community Grids Lab, Indiana University
QuakeSim Work: Web Services, Portlets, Real Time Data Services Marlon Pierce Contributions: Ahmet Sayar,
Implementing Geographical Information System Services for SERVOGrid Marlon Pierce Community Grids Lab Indiana University.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Community Grids Lab SERVOGrid CCE Review May Geoffrey Fox and Marlon Pierce Indiana University.
Using Topic-Based Publish/Subscribe for Managing Real Time GPS Streams Marlon Pierce, Galip Aydin, Zhigang Qi Community Grids Lab Indiana University 1.
GPS Sensor Web Time Series Analysis Using SensorGrid Technology Robert Granat 1, Galip Aydin 2, Zhigang Qi 2, Marlon Pierce 2 1 Science Data Understanding.
SensorGrid Galip Aydin June SensorGrid A flexible computing environment for coupling real-time data sources to High Performance Geographic Information.
Ipgdec5-01 Remarks on Web Services PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce, Shrideep Pallickara, Choonhan Youn Computer Science,
SensorGrid High Performance Web Service Architecture for Geographic Information Systems Thesis Proposal Galip Aydin
QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University
1 SERVOGrid Basics SERVOGrid is our project to build a distributed computing infrastructure to support earthquake simulation codes. –We use Web Services.
Integrating Geographical Information Systems and Grid Applications Marlon Pierce Contributions: Ahmet Sayar,
November Geoffrey Fox Community Grids Lab Indiana University Net-Centric Sensor Grids.
1 MESSAGE EXCHANGE FOR Web Service-Based Mapping Services AHMET SAYAR INDIANA UNIVERSITY COMMUNITY GRIDS LAB. COMPUTER SCIENCE DEPARTMENT August 17, 2005.
SOAP-based Web Services Telerik Software Academy Software Quality Assurance.
Some comments on Portals and Grid Computing Environments PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics,
1 Integrating Geographical Information Systems and Grid Services for Earthquake Forecasting Marlon Pierce Community Grids Lab Indiana University May 4,
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
DEMO SNAPSHOTS Ahmet Sayar 04/30/2006.
Integrating Geographical Information Systems and Grid Applications Marlon Pierce Contributions: Ahmet Sayar,
1 Web Service Information Systems and Applications GGF16 Semantic Grid Workshop Athens Greece February Geoffrey Fox Computer Science, Informatics,
Interacting Data Services for Distributed Earthquake Modeling Marlon Pierce, Choonhan Youn, and Geoffrey Fox Community Grids Lab Indiana University.
1 Implementing Geographic Information System Grid Services Using Distributed Messaging Systems Marlon Pierce Community Grids Lab Indiana University December.
Scripting based architecture for Management of Streams and Services in Real-time Grid Applications Authors Harshawardhan Gadgil, Geoffrey Fox, Shrideep.
Kai Li, Allen D. Malony, Sameer Shende, Robert Bell
DELLSOFT Technologies Pvt. Ltd.
Integrating Geographical Information Systems and Grid Applications
Web Services CO5027.
CHAPTER 3 Architectures for Distributed Systems
Accessing Spatial Information from MaineDOT
Representational State Transfer
CH#3 Software Designing (Object Oriented Design)
#01 Client/Server Computing
Some remarks on Portals and Web Services
Service-centric Software Engineering
GeoFEST tutorial What is GeoFEST?
HPSearch Service Management & Administration Tool
Distributed Systems through Web Services
SLAC monitoring Web Services
Distributed System using Web Services
Information Services for Dynamically Assembled Semantic Grids
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
Gordon Erlebacher Florida State University
Service-Oriented Computing: Semantics, Processes, Agents
New Tools In Education Minjun Wang
Distributed System using Web Services
#01 Client/Server Computing
Software Architecture Taxonomy
Presentation transcript:

Integrating Geographical Information Systems and Grid Applications Marlon Pierce (mpierce@cs.indiana.edu) Contributions: Ahmet Sayar, Galip Aydin, Mehmet Aktas, Harshawardhan Gadgil Community Grids Lab Indiana University

Geographical Information Systems and Grid Applications Pattern Informatics Earthquake forecasting code developed by Prof. John Rundle (UC Davis) and collaborators. Uses seismic archives as input Regularized Dynamic Annealing Hidden Markov Method (RDAHMM) Time series analysis code by Dr. Robert Granat (JPL). Can be applied to GPS and seismic archives. Can be applied to real-time data. GeoFEST Finite element method code developed by Dr. Jay Parker (JPL) and Prof. Greg Lyzenga (JPL/Harvey Mudd College) Uses fault models as input. Virtual California Prof. Rundle’s UC-Davis group Used for simulating time evolution of fault systems using fault and fault friction models.

Pattern Informatics in a Grid Environment PI in a Grid environment: Hotspot forecasts are made using publicly available seismic records. Southern California Earthquake Data Center Advanced National Seismic System (ANSS) catalogs Code location is unimportant, can be a service through remote execution Results need to be stored, shared, modified Grid/Web Services can provide these capabilities Problems: How do we provide programming interfaces (not just user interfaces) to the above catalogs? How do we connect remote data sources directly to the PI code. How do we automate this for the entire planet? Solutions: Use GIS services to provide the input data, plot the output data Web Feature Service for data archives Web Map Service for generating maps Use HPSearch tool to tie together and manage the distributed data sources and code.

Plotting Google satellite maps with QuakeTables fault overlays for Los Angeles.

…  Web Map Client WSDL Aggregating WMS Stubs Stubs HTTP SOAP WSDL “REST” WFS + Seismic Rec. WFS + State Bounds … WMS + OnEarth Or Google Maps

Tying It All Together: HPSearch HPSearch is an engine for orchestrating distributed Web Service interactions It uses an event system and supports both file transfers and data streams. Legacy name HPSearch flows can be scripted with JavaScript HPSearch engine binds the flow to a particular set of remote services and executes the script. HPSearch engines are Web Services, can be distributed interoperate for load balancing. Boss/Worker model ProxyWebService: a wrapper class that adds notification and streaming support to a Web Service. More info: http://www.hpsearch.org

WMS Data Filter HPSearch PI Code Runner HPSearch WFS GML WS Context Data can be stored and retrieved from the 3rd part repository (Context Service) WS Context (Tambora) WFS (Gridfarm001) NaradaBroker network: Used by HPSearch engines as well as for data transfer WMS HPSearch (TRex) Data Filter (Danube) Virtual Data flow WMS submits script execution request (URI of script, parameters) HPSearch hosts an AXIS service for remote deployment of scripts PI Code Runner (Danube) Accumulate Data Run PI Code Create Graph Convert RAW -> GML HPSearch (Danube) GML (Danube) Actual Data flow HPSearch controls the Web services Final Output pulled by the WMS HPSearch Engines communicate using NB Messaging infrastructure

RDAHMM: GPS Time Series Segmentation Slide Courtesy of Robert Granat, JPL GPS displacement (3D) length two years. Divided automatically by HMM into 7 classes. Features: Dip due to aquifer drainage (days 120-250) Hector Mine earthquake (day 626) Noisy period at end of time series Complex data with subtle signals is difficult for humans to analyze, leading to gaps in analysis HMM segmentation provides an automatic way to focus attention on the most interesting parts of the time

SOPAC GPS Services

GIS and Collaboration Tools

(Next set shows non-slideshow version)

Electric Power and Natural Gas data Zoom-in Zoom-out FeatureInfo mode Measure distance mode Clear Distance Drag and Drop mode Refresh to initial map

Overlaid Outage Area - I Basic Steps: Select Energy Power AND Natural Gas Data and Update Layer List rendered on the map Click on “Overlay Outage” button See the outage area on the map

Overlaid Outage Area - II Basic Steps: Select Energy Power Data and Update Layer List rendered on the map Click on “Overlay Outage” button Use zoom-in mapping tool below to get same outage area in more detail See the outage area on the map

Getting Info about specific EP Data by clicking on the map Basic Steps: Select Energy Power Data and Update Layer List rendered on the map Select (i) from the mapping tools below. Click on any feature data on the map. See the information for selected feature in pop-up window

Google Hybrid Map and Feature Information call to WMS Natural Gas Layer Electric Power Layer

NaradaBrokering: Message Transport for Distributed Services NB is a distributed messaging software system. http://www.naradabrokering.org NB system virtualizes transport links between components. Supports TCP/IP, parallel TCP/IP, UDP, SSL. See e.g. http://grids.ucs.indiana.edu/ptliupages/publications/AllHands2005NB-Paper.pdf for trans-Atlantic parallel tcp/ip timings.