How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU)‏ [presenter] Zhao Juan (CNIC)‏ [presenter] Bi Shuren (CNIC)‏ Silvio.

Slides:



Advertisements
Similar presentations
A Lightweight Platform for Integration of Mobile Devices into Pervasive Grids Stavros Isaiadis, Vladimir Getov University of Westminster, London {s.isaiadis,
Advertisements

Pricing for Utility-driven Resource Management and Allocation in Clusters Chee Shin Yeo and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS)
The Access Grid Ivan R. Judson 5/25/2004.
INDIANAUNIVERSITYINDIANAUNIVERSITY GENI Global Environment for Network Innovation James Williams Director – International Networking Director – Operational.
Kejun Dong, Kai Nan CNIC/CAS CNIC Resources And Activities Update Resources Working Group PRAGMA11 Workshop, Oct.16/17 Osaka, Japan.
Cultural Heritage in REGional NETworks REGNET Technological Implementation Plan – D12.
Danny Powell Executive Director
Prof. Natalia Kussul, PhD. Andrey Shelestov, Lobunets A., Korbakov M., Kravchenko A.
Inetrconnection of CNGrid and European Grid Infrastructure Depei Qian Beihang University Feb. 20, 2006.
Introduction Why do we need Mobile OGSI.NET? Drawbacks:
© 2005 AT&T, All Rights Reserved. 11 July 2005 AT&T Enhanced VPN Services Performance Reporting and Web Tools Presenter : Sam Levine x111.
GLOBAL SCI CONSUMER NETWORK: Resources for online communication Frans Penninx (Dutch SCI Association) Sara Rubinelli (University of Lucerne and Swiss Paraplegic.
International Hurricane Research Center & Cyberinfrastructure Enabled Hurricane Mitigation Disaster Prediction and Prevention Panel TERENA Networking Conference.
Agreement-based Distributed Resource Management Alain Andrieux Karl Czajkowski.
Dan Bradley Computer Sciences Department University of Wisconsin-Madison Schedd On The Side.
High Performance Computing Course Notes Grid Computing.
FIU Academic Community Workshop Date: November 30, 2007 Graduate Fellowship Opportunity for Science and Engineering.
An Introduction to the Open Science Data Cloud Heidi Alvarez Florida International University Robert L. Grossman University of Chicago Open Cloud Consortium.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
Model Driven Development reduces the problem-implementation gap by redefining the role of models and using platforms for translating and realizing the.
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
The Old World Meets the New: Utilizing Java Technology to Revitalize and Enhance NASA Scientific Legacy Code Michael D. Elder Furman University Hayden.
CI Days: Planning Your Campus Cyberinfrastructure Strategy Russ Hobby, Internet2 Internet2 Member Meeting 9 October 2007.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
GPU Performance Prediction GreenLight Education & Outreach Summer Workshop UCSD. La Jolla, California. July 1 – 2, Javier Delgado Gabriel Gazolla.
Application Performance Prediction Javier Delgado Feb. 9, 2009 X.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
Transparent Grid Enablement Using Transparent Shaping and GRID superscalar I. Description and Motivation II. Background Information: Transparent Shaping.
Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.
1 Pan-American Advanced Studies Institute (PASI) Program Grid Computing and Advanced Networking Technologies for e-Science Mendoza, Argentina May 15-21,
Web Services Load Leveler Enabling Autonomic Meta-Scheduling in Grid Environments Objective Enable autonomic meta-scheduling over different organizations.
What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.
Research and Educational Networking and Cyberinfrastructure Russ Hobby, Internet2 Dan Updegrove, NLR University of Kentucky CI Days 22 February 2010.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
The Future of the iPlant Cyberinfrastructure: Coming Attractions.
A modeling approach for estimating execution time of long-running Scientific Applications Seyed Masoud Sadjadi 1, Shu Shimizu 2, Javier Figueroa 1,3, Raju.
RI User Support in DEISA/PRACE EEF meeting 2 November 2010, Geneva Jules Wolfrat/Axel Berg SARA.
Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters
ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.
Partnership for International Research and Education A Global Living Laboratory for Cyberinfrastructure Application Enablement Enhanced Grid Enabled Weather.
National Center for Supercomputing Applications Barbara S. Minsker, Ph.D. Associate Professor National Center for Supercomputing Applications and Department.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
Presented by: Marlon Bright 19 June 2008 Advisor: Masoud Sadjadi, Ph.D. REU – Florida International University.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
Evolving Interfaces to Impacting Technology: The Mobile TeraGrid User Portal Rion Dooley, Stephen Mock, Maytal Dahan, Praveen Nuthulapati, Patrick Hurley.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.
A Collaborative Platform Based on SAGE Javier Delgado.
Weather Research & Forecasting Model Xabriel J Collazo-Mojica Alex Orta Michael McFail Javier Figueroa.
Global CyberBridges: Hurricane Mitigation enabled by ICT Heidi Alvarez, Florida International University 9 th Annual Global LambdaGrid Workshop October.
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
Cyberinfrastructure Overview Russ Hobby, Internet2 ECSU CI Days 4 January 2008.
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
TeraPaths: A QoS Enabled Collaborative Data Sharing Infrastructure for Petascale Computing Research The TeraPaths Project Team Usatlas Tier 2 workshop.
WRF - REU Project Presentation Michael McFail Xabriel J Collazo-Mojica Javier Figueroa Alex Orta.
1 Expanding the Application Base of the SAGE Collaboration Platform Javier Delgado.
Cloud Computing Shannon McManus Michael Weihert. What is Cloud Computing?
Weather Research and Forecasting (WRF) Portal Seychelles Martinez School of Computing and Information Sciences Florida International University Elias Rodriguez.
Euro-Par, HASTE: An Adaptive Middleware for Supporting Time-Critical Event Handling in Distributed Environments ICAC 2008 Conference June 2 nd,
PEER 2003 Meeting 03/08/031 Interdisciplinary Framework Major focus areas Structural Representation Fault Systems Earthquake Source Physics Ground Motions.
1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.
Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter,
Workload Management Workpackage
OpenMosix, Open SSI, and LinuxPMI
Recap: introduction to e-science
Grid Means Business OGF-20, Manchester, May 2007
Data/Analysis Challenges in the Electronic Business Environment
Data/Analysis Challenges in the Electronic Business Environment
Web Development by Mark Mizubayashi Program Manager Tim Fahey
VIFI : Virtual Information Fabric for Data-Driven Discovery from Distributed Fragmented Repositories PI: Dr. Ashit Talukder Bank of America Endowed Chair.
Presentation transcript:

How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU)‏ [presenter] Zhao Juan (CNIC)‏ [presenter] Bi Shuren (CNIC)‏ Silvio Luiz Stanzani (UniSantos)‏ Mark Eirik Scortegagna Joselli (UFF)‏ Javier Figueroa (FIU/UM)‏ Advisors S. Masoud Sadjadi Heidi Alvarez Universidade de São Paulo Chinese American Networking Symposium. Oct. 20 – 22, 2008

Outline Background and Motivation Role of Cyber-infrastructure Project Overview Project Status Cyber-infrastructure Contributions Conclusion

Background of Global CyberBridges Improves technology training for international collaboration  Software usage  Logistical issues (e.g. time zones, holidays, etc.)‏ Collaborate for the purpose of scientific advancement  Visualization Modalities  Weather Prediction  Bioinformatics

Hurricane Mitigation Background Computationally Intensive Improvement requires cross- disciplinary expertise High Performance Computing  Meta-scheduling  Resource Allocation  Work flow Management Weather Modeling  Weather Research and Forecasting (WRF)‏ Image Source:

Motivation Hurricanes cost coastal regions financial and personal damage Damage can be mitigated, but  Impact area prediction is inaccurate  Simulation using commodity computers is not precise Alarming Statistics  40% of (small-medium sized) companies shut down within 36 months, if forced closed for 3 or more days after a hurricane  Local communities lose jobs and hundreds of millions of dollars to their economy If 5% of businesses in South Florida recover one week earlier, then we can prevent $219,300,000 in non- property economic losses Hurricane Andrew, Florida 1992 Katrina, New Orleans 2005 Ike, Cuba 2008

Why Apply Cyberinfrastructure to Research & Learning? Preparation for a globalized workforce  Innovation is now driven by global collaboration  Diverse (and complementary) expertise Enable transparent cyberinfrastructure In Global CyberBridges, students are the bridges

Hurricane Mitigation Project Overview Goals  High-resolution forecasts with guaranteed simulation execution times  Human-friendly portal  High-resolution visualization modality

High Resolution Hurricane Forecasting We create:  A distributed software model that can run on heterogeneous computing nodes at multiple sites simultaneously to improve Speed of results Resolution of the numerical model Scalability of requests by interested parties  In other words, we need to grid-enable WRF WRF Information:

WRF Portal

Modeling WRF Behavior An Incremental Process Paradox of computationally-intensive jobs:  Underestimated execution time = killed job  Overestimated execution time = prohibitive queue time Grid computing drawbacks  Less reliable than cluster computing  No built in quality assurance mechanism  Hurricane prediction is time-sensitive, so it needs to work around this

Modeling WRF Behavior Meta-scheduler addresses the quality assurance issue To predict execution time, model the software  Pick a representative simulation domain  Execute it on various platforms with various configurations  Devise a model for execution time prediction and implement it in software  Test model  Adjust until prediction accuracy is within 10 percent

Modeling WRF Behavior Mathematical Modeling Profiling Code Inspection & Modeling An Incremental Process Parameter Estimation

Current Execution Prediction Accuracy Adequate accuracy on multiple platforms Cross-cluster:  8-node, 32-bit Intel Cluster  16-node, 64-bit Intel Cluster  Different (simulated) CPU speed and number-of- node executions Inter-cluster on MareNostrum Supercomputer of Barcelona Supercomputing Center  Up to 128-nodes MareNostrum Info:

Visualization Platform Collaboration  e-Learning  Cross-disciplinary video conferencing  Desktop sharing High-resolution Visualization Built on top of the Scalable Adaptive Graphics Environment (SAGE)‏ SAGE is developed by the cavern group at the Electronic Visualization Laboratory. # SCI # ANI

Case in point – High resolution visualization

SAGE Scalable  Hundreds of Screens can be used  Built with high-performance applications in mind Extensible  Provides API for creating custom SAGE applications  But this is also a problem Porting an application is not trivial There's a lot of applications out there!

Enhancements to SAGE Porting the Mozilla Firefox Web browser  Many emerging applications are web-based  The web browser is the platform  Native SAGE Web Browser would give optimal performance Remote Desktop Enhancement  A responsive remote desktop modality is essential for collaboration and e-Learning  Users can share their display for all collaborators to see  Non-portable applications can be displayed also

Enhancements to SAGE (cont.)‏ Wii Remote input interface  A traditional mouse makes it difficult to work with a large display

Global CyberBridges Overall Contributions Weather Forecasting  Students in different scientific fields from 3 different continents exposed to the problem through a remote class  Grid-computing related methodologies for addressing these problems have been presented  Collaborative publications in progress Visualization  Based on the difficulties we had in the class, we are trying to implement a cutting-edge e-Learning environment based on SAGE  We are working together to publish this work

Conclusion e-Learning is difficult,  Primitive nature of videoconferencing software  Different time zones  Holiday and Vacation periods Global collaboration  Learning to work with people around the world is essential. This has been the most valuable lesson  We have done important research in the process

Acknowledgments Global CyberBridges NSF CI-TEAM OCI MareNostrum Supercomputer support NSF-PIRE OISE Scalable Adaptive Graphics Environment (SAGE) NSF SCI , ANI NSF research assistance grants: HRD , CNS , CNS , CNS , IIS

Thank You! Any Questions? Heidi Alvarez. Director, Center for Internet Augmented Research and Assessment. FIU )‏ S. Masoud Sadjadi. Professor and Co-PI of Global Cyberbridges Javier Delgado, Research Assistant, FIU Zhao Juan, Research Assistant, CNIC Javier Figueroa, Research Assistant, FIU Shuren Bi, Research Assistant, CNIC Mark Joselli, Research Assistant, UFF Silvio Luiz Stanzani, Research Assistant, USP