Sarat Sreepathi North Carolina State University Internet2 – SURAgrid Demo Dec 6, 2006.

Slides:



Advertisements
Similar presentations
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Advertisements

Online Filtering, Smoothing & Probabilistic Modeling of Streaming Data In short, Applying probabilistic models to Streams Bhargav Kanagal & Amol Deshpande.
DESIGN PROCESS OPTIMIZATION INTEGRATION TRADES SIMULATION VISUALIZATION Copyright 2010 Phoenix Integration, Inc. All rights reserved. Grant Soremekun Business.
All Hands Meeting, 2006 Title: Grid Workflow Scheduling in WOSE (Workflow Optimisation Services for e- Science Applications) Authors: Yash Patel, Andrew.
EU-GRID Work Program Massimo Sgaravatto – INFN Padova Cristina Vistoli – INFN Cnaf as INFN members of the EU-GRID technical team.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
A Workflow Approach to Designed Reservoir Study Presented by Zhou Lei Center for Computation and Technology Louisiana State University June 25, 2007.
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
Particle Filters for Mobile Robot Localization 11/24/2006 Aliakbar Gorji Roborics Instructor: Dr. Shiri Amirkabir University of Technology.
Bayesian Filtering for Location Estimation D. Fox, J. Hightower, L. Liao, D. Schulz, and G. Borriello Presented by: Honggang Zhang.
WORKFLOWS IN CLOUD COMPUTING. CLOUD COMPUTING  Delivering applications or services in on-demand environment  Hundreds of thousands of users / applications.
Bayesian Filtering for Robot Localization
Darema Dr. Frederica Darema NSF Dynamic Data Driven Application Systems (Symbiotic Measurement&Simulation Systems) “A new paradigm for application simulations.
4.x Performance Technology drivers – Exascale systems will consist of complex configurations with a huge number of potentially heterogeneous components.
18:15:32Service Oriented Cyberinfrastructure Lab, Grid Deployments Saul Rioja Link to presentation on wiki.
Research and Projects Name: Aloysius. A. EDOH Name: Alo Address: Ext 3344.
Tufts Wireless Laboratory School Of Engineering Tufts University “Network QoS Management in Cyber-Physical Systems” Nicole Ng 9/16/20151 by Feng Xia, Longhua.
A Lightweight Platform for Integration of Resource Limited Devices into Pervasive Grids Stavros Isaiadis and Vladimir Getov University of Westminster
Identify steps for understanding and solving the
Young Suk Moon Chair: Dr. Hans-Peter Bischof Reader: Dr. Gregor von Laszewski Observer: Dr. Minseok Kwon 1.
1 GISolve – TeraGrid GIScience Gateway Shaowen Wang Department of Geography and Grid Research & educatiOn ioWa (GROW) The University of Iowa May.
Towards Low Overhead Provenance Tracking in Near Real-Time Stream Filtering Nithya N. Vijayakumar, Beth Plale DDE Lab, Indiana University {nvijayak,
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
Evaluation of Non-Uniqueness in Contaminant Source Characterization based on Sensors with Event Detection Methods Jitendra Kumar 1, E. M. Zechman 1, E.
Presenter: Sabine Roller Coordinator: Hubert Hérenger High Performance Computing Center Stuttgart (HLRS) Business Experiment.
IntelliSense.io Beyond the hype - Real World Applications / Solutions of Internet of Things.
MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation 1 Dynamic Sensor Resource Management for ATE MURI.
Copyright © 2012, SAS Institute Inc. All rights reserved. ANALYTICS IN BIG DATA ERA ANALYTICS TECHNOLOGY AND ARCHITECTURE TO MANAGE VELOCITY AND VARIETY,
1 Distributed and Optimal Motion Planning for Multiple Mobile Robots Yi Guo and Lynne Parker Center for Engineering Science Advanced Research Computer.
1 Distribution Statement “A” (Approved for Public Release, Distribution Unlimited)5/15/2012 Advanced Radio Frequency Mapping (RadioMap) Dr. John Chapin.
AN ADAPTIVE CYBERINFRASTRUCTURE FOR THREAT MANAGEMENT IN URBAN WATER DISTRIBUTION SYSTEMS Kumar Mahinthakumar North Carolina State University DDDAS Workshop,
Superscheduling and Resource Brokering Sven Groot ( )
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
1 “~DDDAS” proposals awarded in FY00 ITR Competition Pingali, Adaptive Software for Field-Driven Simulations; CCF
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
Service-oriented Resource Broker for QoS-Guaranteed in Grid Computing System Yichao Yang, Jin Wu, Lei Lang, Yanbo Zhou and Zhili Sun Centre for communication.
Design, Optimization, and Control for Multiscale Systems
Groundwater Modeling, Inverse Characterization, and Parallel Computing Kumar Mahinthakumar NC State University.
1 CALL 6 Key Action IV Introduction and Action Lines: IV.1.2, IV.2.1, IV.2.2, IV.2.4 Brussels, 16. Jan 2001 Colette Maloney European Commission.
Assessing the Impact of Alternative Pipe Groupings on Multi-Objective Water Distribution Network Masoud Asadzadeh Bryan Tolson.
Model-Centric Smart Grid for Big Data
AN ADAPTIVE CYBERINFRASTRUCTURE FOR THREAT MANAGEMENT IN URBAN WATER DISTRIBUTION SYSTEMS Kumar Mahinthakumar North Carolina State University DDDAS BOF,
Internet of Things. IoT Novel paradigm – Rapidly gaining ground in the wireless scenario Basic idea – Pervasive presence around us a variety of things.
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
Content caching and scheduling in wireless networks with elastic and inelastic traffic Group-VI 09CS CS CS30020 Performance Modelling in Computer.
Addressing Non-uniqueness in Source Characterization for Multiple Contaminant Source Scenarios in Water Distribution Systems Jitendra Kumar 1, Emily M.
Fault Tolerant Grid Workflow in Water Threat Management Master’s project / thesis seminar Young Suk Moon Chair: Prof. Gregor von Laszewski Reader: Observer:
WIRELESS INTEGRATED NETWORK SENSORS
Adaptive Integrated Framework (AIF): a new methodology for managing impacts of multiple stressors in coastal ecosystems A bit more on AIF, project components.
IE-OR Seminar April 18, 2006 Evolutionary Algorithms in Addressing Contamination Threat Management in Civil Infrastructures Ranji S. Ranjithan Department.
LEAD Project Discussion Presented by: Emma Buneci for CPS 296.2: Self-Managing Systems Source for many slides: Kelvin Droegemeier, Year 2 site visit presentation.
Collection and storage of provenance data Jakub Wach Master of Science Thesis Faculty of Electrical Engineering, Automatics, Computer Science and Electronics.
Smart Grid Big Data: Automating Analysis of Distribution Systems Steve Pascoe Manager Business Development E&O - NISC.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
Effects of Measurement Uncertainties on Adaptive Source Characterization in Water Distribution Networks Li Liu, E. Downey Brill, G. Mahinthakumar, James.
Resource Optimization for Publisher/Subscriber-based Avionics Systems Institute for Software Integrated Systems Vanderbilt University Nashville, Tennessee.
AMSA TO 4 Advanced Technology for Sensor Clouds 09 May 2012 Anabas Inc. Indiana University.
Workload Management Workpackage
CIM Modeling for E&U - (Short Version)
Rosetta Science Ground Segment Overview
High Performance Computing and Monte Carlo Methods
EPANET-MATLAB Toolkit An Open-Source Software for Interfacing EPANET with MATLAB™ Demetrios ELIADES, Marios KYRIAKOU, Stelios VRACHIMIS and Marios POLYCARPOU.
Data Stream Management System (DSMS)
DrillSim July 2005.
A RESERVOIR MANAGEMENT REVOLUTION
ExaO: Software Defined Data Distribution for Exascale Sciences
Computational Elements of Robust Civil Infrastructure
Planning and Scheduling in Manufacturing and Services
Wide Area Workload Management Work Package DATAGRID project
In Distributed Systems
Presentation transcript:

Sarat Sreepathi North Carolina State University Internet2 – SURAgrid Demo Dec 6, 2006

Our Team North Carolina State University Mahinthakumar, Brill, Ranji (PI’s) Sreepathi, Liu (Grad Students) Zechman (Post-Doc) University of Chicago Von Laszewski (PI) University of Cincinnati Uber (PI) Feng (Post-Doc) University of South Carolina Harrison (PI) 2 Greater Cincinnati Water Works

Water Distribution Security Problem 3

Water Distribution Problem 4

Why is this an important problem? Potentially lethal and public health hazard Cause short term chaos and long term issues Diversionary action to cause service outage Reduction in fire fighting capacity Distract public & system managers 5

What needs to be done? Determine Location of the contaminant source(s) Contamination release history Identify threat management options Sections of the network to be shut down Flow controls to Limit spread of contamination Flush contamination 6

DDDAS Aspects Dynamic Data Driven Application Systems Dynamic Data Optimization Simulation Workflow Computer Resources Data Driven and Vice Versa Water Demand Data Water Quality Data 7

Key DDDAS Developments Algorithm and Model Development Dynamic Optimization Bayesian Data Sampling and Probabilistic Assessment Model Auto Calibration Model Skeletonization Network Assessment using Back Tracking Middleware Development Adaptive Workflow Engine Adaptive Resource Management Controller Designs Cincinnati Application Scenario Development Source Identification Sensor Network Design Flow control design 8

Water Distribution Network Modeling Solve for network hydraulics (i.e., pressure, flow) Depends on Water demand/usage Properties of network components Uncertainty/variability Dynamic system Solve for contamination transport Depends on existing hydraulic conditions Spatial/temporal variation time series of contamination concentration 9

Source Identification Problem Find: L(x,y), {M t }, T 0 Minimize Prediction Error ∑ i,t || C i t (obs) – C i t (L(x,y), {M t }, T 0 ) || where L(x,y) – contamination source location (x,y) M t – contaminant mass loading at time t T 0 – contamination start time C i t (obs) – observed concentration at sensors C i t (L(x,y), {M t }, T 0 ) – concentration from system simulation model i – observation (sensor) location t – time of observation 10 unsteady nonlinear uncertainty/error

Interesting challenges Non-unique solutions Due to limited observations (in space & time) Resolve non-uniqueness Incrementally adaptive search Due to dynamically updated information stream Optimization under dynamic environments Search under noisy conditions Due to data errors & model uncertainty Optimization under uncertain environments 11

Resolving non-uniqueness Underlying premise In addition to the “optimal” solution, identify other “good” solutions that fit the observations Are there different solutions with similar performance in objective space? Search for alternative solutions 12

Where we are now… Optimization Algorithms for Source Characterization Dynamic optimization (ADOPT) – WDSA06 Non-uniqueness (EAGA) – WDSA06 Implementation Coarse-grained parallelism Real-time visualization Seamless job submission on Teragrid Simple workflow Demo at I2 meeting Project Website: 13

Preliminary Architecture 14 Parallel EPANET(MPI) EPANET-Driver Optimization Toolkit Sensor Data Grid Resources EPANET Middleware

Graphical Monitoring Interface 15

Challenges Problem complexity Improved search algorithms for multiple sources, non-uniqueness, dynamic source characteristics Using Grid resources Adaptive resource query and allocation Adaptive work migration Integration into workflow engine 16

What’s Next? Dynamic optimization for determining optimal location of sensors and optimal sampling frequency True integration of workflow engine into the cyberinfrastructure Backtracking to improve source identification search efficiency 17

Our Cyberinfrastructure 18 Grid Resource Broker and Scheduler Adaptive Simulation Controller Adaptive Optimization Controller Sensors & Data Mobile RF AMR Sensors Static RF AMR Sensor Network Static Water Quality Sensor Network Resource Needs Resource Availability Bayesian Monte- Carlo Engine Optimization Engine Simulation Model Grid Computing Resources Adaptive Wireless Data Receptor and Controller Deci sions Dat a Adaptive Workflow Portal Algorithms & Models Middleware & Resources Model Param eters Model Outputs

Questions? 19