Southern California Earthquake Center - SCEC SCEC/CME Tom Jordan (USC) Bernard Minster (SIO) Carl Kesselman (ISI) Reagan Moore (SDSC) Phil Maechling (USC)

Slides:



Advertisements
Similar presentations
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
Advertisements

SCEC/ITR All-Hands Meeting October 11, 2002 Introduction by Tom Jordan.
Edward (Ned) Field USGS, Pasadena plus Tom Jordan, Nitin Gupta, Vipin Gupta, Phil Maechling, Allin Cornell, Ken Campbell, Sid Hellman, & Steve Rock OpenSHA.
CyberShake Project and ShakeMaps. CyberShake Project CyberShake is a SCEC research project that is a physics-based high performance computational approach.
10/09/2007CIG/SPICE/IRIS/USAF1 Broadband Ground Motion Simulations for a Mw 7.8 Southern San Andreas Earthquake: ShakeOut Robert W. Graves (URS Corporation)
1 High Performance Computing at SCEC Scott Callaghan Southern California Earthquake Center University of Southern California.
Chronopolis: Preserving Our Digital Heritage David Minor UC San Diego San Diego Supercomputer Center.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
Modern Data Management Overview Storage Resource Broker Reagan W. Moore
March 7, 2008NGA-East 2nd Workshop1 RECENT DEVELOPMENTS IN STRONG MOTION SIMULATIONS FOR CEUS Paul Somerville and Robert Graves URS Pasadena MOTIVATION:
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.
Southern California Earthquake Center Toward a Collaboratory for System-Level Earthquake Science Tom Jordan Southern California Earthquake Center University.
1 The SCEC Broadband Ground Motion Simulation Platform Paul Somerville, Scott Callaghan, Philip Maechling, Robert Graves, Nancy Collins, Kim Olsen, Walter.
National Partnership for Advanced Computational Infrastructure Digital Library Architecture Reagan Moore Chaitan Baru Amarnath Gupta George Kremenek Bertram.
San Diego Supercomputer CenterUniversity of California, San Diego Preservation Research Roadmap Reagan W. Moore San Diego Supercomputer Center
Working Group: Practical Policy Rainer Stotzka, Reagan Moore.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES High Performance Computing applications in GEON: From Design to Production Dogan Seber.
Rule-Based Data Management Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar {moore, schroede, mwan, {moore, schroede, mwan,
NSF Geoinformatics Project (Sept 2012 – August 2014) Geoinformatics: Community Computational Platforms for Developing Three-Dimensional Models of Earth.
VISUALIZING EARTHQUAKE SIMULATION DATA Amit Chourasia 1, Steve Cutchin 1, Alex DeCastro 1, Geoffrey Ely 2 1 San Diego Supercomputer Center 2 Scripps Institute.
SCEC/CME Project - How Earthquake Simulations Drive Middleware Requirements Philip Maechling SCEC IT Architect 24 June 2005.
1 SCEC Broadband Platform Development Using USC HPCC Philip Maechling 12 Nov 2012.
1.UCERF3 development (Field/Milner) 2.Broadband Platform development (Silva/Goulet/Somerville and others) 3.CVM development to support higher frequencies.
AMIT CHOURASIA VISUALIZATION SCIENTIST VISUALIZATION SERVICES SAN DIEGO SUPERCOMPUTER CENTER PRESENTED AT : GEOINFORMATICS 2007, MAY 18 TH VISUAL REPRESENTATION.
Simulations of Large Earthquakes on the Southern San Andreas Fault Amit Chourasia Visualization Scientist San Diego Supercomputer Center Presented to:
OPENQUAKE Mission and Vision It is GEM’s mission to engage a global community in the design, development and deployment of state-of-the-art models and.
Rule-Based Preservation Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar Richard Marciano {moore, schroede, mwan, sekar,
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Management of Distributed Data Reagan W. Moore.
Fig. 1. A wiring diagram for the SCEC computational pathways of earthquake system science (left) and large-scale calculations exemplifying each of the.
On Parallel Time Domain Finite Difference Computation of the Elastic Wave Equation and Perfectly Matched Layers (PML) Absorbing Boundary Conditions (With.
Pegasus: Running Large-Scale Scientific Workflows on the TeraGrid Ewa Deelman USC Information Sciences Institute
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
SCEC Community Modeling Environment (SCEC/CME): SCEC TeraShake Platform: Dynamic Rupture and Wave Propagation Simulations Seismological Society of America.
Philip Maechling Southern California Earthquake Center
SIG: Synthetic Seismogram Exchange Standards (formats & metadata) Is it time to establish exchange standards for synthetic seismograms? IRIS Annual Workshop.
Validation of physics-based ground motion earthquake simulations using a velocity model improved by tomographic inversion results 1 Ricardo Taborda, 1.
06/22/041 Data-Gathering Systems IRIS Stanford/ USGS UNAVCO JPL/UCSD Data Management Organizations PI’s, Groups, Centers, etc. Publications, Presentations,
Visualizing TERASHAKE Amit Chourasia Visualization Scientist Visualization Services San Diego Supercomputer center Geon Visualization Workshop March 1-2,
Phase 1: Comparison of Results at 4Hz Phase 1 Goal: Compare 4Hz ground motion results from different codes to establish whether the codes produce equivalent.
Southern California Earthquake Center CyberShake Progress Update 3 November 2014 through 4 May 2015 UGMS May 2015 Meeting Philip Maechling SCEC IT Architect.
Unified Structural Representation (USR) The primary mission of the USR Focus Area has been the development of a unified, object-oriented 3-D representation.
Southern California Earthquake Center SCEC Collaboratory for Interseismic Simulation and Modeling (CISM) Infrastructure Philip J. Maechling (SCEC) September.
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
1 1.Used AWP-ODC-GPU to run 10Hz Wave propagation simulation with rough fault rupture in half-space with and without small scale heterogeneities. 2.Used.
National Archives and Records Administration1 Integrated Rules Ordered Data System (“IRODS”) Technology Research: Digital Preservation Technology in a.
Southern California Earthquake Center SI2-SSI: Community Software for Extreme-Scale Computing in Earthquake System Science (SEISM2) Wrap-up Session Thomas.
Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore
Visualizing large scale earthquake simulations Amit Chourasia Visualization Scientist San Diego Supercomputer Center Presented to: Advanced User Support,
Southern California Earthquake Center CyberShake Progress Update November 3, 2014 – 4 May 2015 UGMS May 2015 Meeting Philip Maechling SCEC IT Architect.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
PEER 2003 Meeting 03/08/031 Interdisciplinary Framework Major focus areas Structural Representation Fault Systems Earthquake Source Physics Ground Motions.
Collection-Based Persistent Archives Arcot Rajasekar, Richard Marciano, Reagan Moore San Diego Supercomputer Center Presented by: Preetham A Gowda.
Preservation Data Services Persistent Archive Research Group Reagan W. Moore October 1, 2003.
Data Infrastructure in the TeraGrid Chris Jordan Campus Champions Presentation May 6, 2009.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
SCEC CyberShake on TG & OSG: Options and Experiments Allan Espinosa*°, Daniel S. Katz*, Michael Wilde*, Ian Foster*°,
Data Grids, Digital Libraries and Persistent Archives: An Integrated Approach to Publishing, Sharing and Archiving Data. Written By: R. Moore, A. Rajasekar,
SCEC Capability Simulations on TeraGrid
National Center for Supercomputing Applications University of Illinois at Urbana-Champaign Recent TeraGrid Visualization Support Projects at NCSA Dave.
Seismic Hazard Analysis Using Distributed Workflows
Policy-Based Data Management integrated Rule Oriented Data System
Joseph JaJa, Mike Smorul, and Sangchul Song
Scott Callaghan Southern California Earthquake Center
SCEC Community Modeling Environment (SCEC/CME)
High-F Project Southern California Earthquake Center
Philip J. Maechling (SCEC) September 13, 2015
Large Data Visualization of Seismic Data (TeraShake)
High-Performance Computing (HPC) IS Transforming Seismology
Technical Issues in Sustainability
Southern California Earthquake Center
Presentation transcript:

Southern California Earthquake Center - SCEC SCEC/CME Tom Jordan (USC) Bernard Minster (SIO) Carl Kesselman (ISI) Reagan Moore (SDSC) Phil Maechling (USC)

SCEC Member Institutions (October 1, 2005)

SCEC/CME - Terashake Kim B. Olsen (SDSU) Bernard Minster (IGPP) Reagan Moore (SDSC) Steve Day (SDSU) Phil Maechling (USC) Tom Jordan (USC) Marcio Faerman (SDSC) Geoffrey Ely (IGPP) Boris Shkoller (IGPP) Carey Marcinkovich (EXxonMobil) Jacobo Bielak (CMU) David Okaya (USC) Ralph Archuleta (UCSB) Steve Cutchin (SDSC) Amit Chourasia (SDSC) George Kremenek (SDSC) Yuanfang Hu (SDSC) Arun Jagatheesan (SDSC) Nancy Wilkins-Diehr (SDSC) Richard Moore (SDSC) Bryan Banister (SDSC) Leesa Brieger (SDSC) Amit Majumdar (SDSC) Yifeng Cui (SDSC) Giridhar Chukkapalli (SDSC) Qiao Xin (SDSC) Donald Thorp (SDSC) Patricia Kovatch (SDSC) Larry Diegel (SDSC) Tom Sherwin (SDSC) Christopher Jordan (SDSC) Marcus Thiebaux (ISI) Julio Lopez (CMU)

SCEC/CME Digital Library Reagan W. Moore staff- SDSC PI Marcio Faermanpostdoc (now in Brazil)- dig lib George Kremenekstaff- data management Yuanfang Hugraduate student- dig lib Jing Zhugraduate student- dig lib Patrick Yaugraduate student- vis Amit Chourasiastaff (contributed effort) - vis Stephen Cutchinstaff (contributed effort) - vis Yifeng Cuistaff (contributed effort) - application Amitava Majumdarstaff (contributed effort) - application

Seismic Hazard Analysis Intensity measure: peak ground acceleration (PGA)Intensity measure: peak ground acceleration (PGA) Interval: 50 yearsInterval: 50 years Probability of exceedance: 2%Probability of exceedance: 2% Definition:Specification of the maximum intensity of shaking expected at a site during a fixed time interval Example:National seismic hazard maps (

Web Sites SCEC/CME – SCEC Digital Library – SCEC Terashake Simulations – Storage Resource Broker – Visualizations –

Intensity Measures Earthquake Forecast Model Attenuation Relationship 1 Standardized seismic hazard analysis Ground motion simulation Physics-based earthquake forecasting Ground-motion inverse problem AWM Ground Motions SRM Unified Structural Representation Faults Motions Stresses Anelastic model 2 AWP = Anelastic Wave Propagation SRM = Site Response Model RDMFSM 3 FSM = Fault System Model RDM = Rupture Dynamics Model Invert Other Data Geology Geodesy 4 Physics-basedsimulations Empiricalrelationships Improvement of models Seismic Hazard Analysis Computational Pathways

Unified Structural Representation Tectonic models Structural models Community Fault ModelCommunity Block Model Crustal Motion Map

IM Rup n,i Intensity-MeasureRelationship Earthquake-RuptureForecast Time Span Type, Level Source i Site OpenSHA A Computational Platform Seismic Hazard Analysis Pathway 1 OpenSHA Platform Field, Jordan & Cornell (2003)

Intensity Measures Earthquake Forecast Model Attenuation Relationship 1 Standardized seismic hazard analysis Ground motion simulation Physics-based earthquake forecasting Ground-motion inverse problem AWM Ground Motions SRM Unified Structural Representation Faults Motions Stresses Anelastic model 2 AWP = Anelastic Wave Propagation SRM = Site Response Model RDMFSM 3 FSM = Fault System Model RDM = Rupture Dynamics Model Invert Other Data Geology Geodesy 4 Physics-basedsimulations Empiricalrelationships Improvement of models Seismic Hazard Analysis Computational Pathways

SCEC Computations Terashake - simulate earthquakes in Southern California Cybershake - seismic hazard assessment Earthworks - simulate each observed earthquake

TS2.dyn.200m 30x 256 procs, 12 hrs, TG IA-64 GPFS Datastar GPFS Okaya 200m Media Okaya 100m Media 100m Reformatting 100m Transform 100m Filtering 200m moment rate HPSS SAM-QFS SDSC IA-64 TS2.dyn.100m 10x 1024 procs, 35 hrs Initial 200m Stress modify Initial 100m Stress modify TS2.wav.200m 3x 1024 procs, 35 hrs NCSA IA-64 Datastar p690 Datastar p655 Register to Digital Library SRB Visualization Analysis TeraShake-2 Simulations Network TG IA-64 GPFS-wan NCSA-SAN SDSC-SAN

Application Optimization

Goal –Capability for physics-based probabilistic seismic hazard calculation in Southern California, accounting for source complexity and 3D earth structure Design –All significant sources from 2002 National Seismic Hazard Mapping Project –Site-oriented Green functions optimized for 3D earth structure –Full representation of source complexity by stochastic sampling Plans –Phase I (2005): 6 sites, kinematic sources, low frequency (< 0.5 Hz) –Phase II (2006): 625 sites, pseudo-dynamic sources –Phase III (2007): Full map, dynamic sources Requirements –35,000 SU runtime per site & 10 TB data volume per site for Phases I & II –10 TB data volume must be accessible across grid during seismogram synthesis CyberShake Platform

Visualization Applications and Analyses SCEC Portal (OGCE portlets) Digital Library Services (seismogram extraction) Data grid (Storage Resource Broker) Teragrid Network (TCP/IP communication) Hardware (distributed storage systems) Vertical integration SCEC Digital Library A publication resource for earthquake science data

SCEC Digital Library

SCEC Portal Original portal based on OGCE portlet technology Migrating to GridSphere portlet technology and JSR168 compliant portlets –Compatibility with GEON portlets –Compatibility with generic SRB portlets Interface between user access and data storage within the SRB data grid

Digital Library Components Organization structure –Categorized simulation data by experiment Metadata attributes –Query on input parameters Naming –Logical file names Security –One-time passwords for administrative access

Organization

Metadata Metadata purposes Support browsing Support queries Support provenance Support knowledge

Analysis Tools Seismogram extraction –1-Terabyte data set per simulation –Data kept on disk –Backup copy on tape –Dynamically linked from portal to registered simulations

Seismogram Extraction

Challenges Size of data –SCEC digital library holds over 130 Terabytes of data –Replication of data needed to ensure preservation Planned analyses are substantially larger –Expect 600 Terabytes of simulation results Planned services (dynamic evaluation of each earthquake) will require automation –Dynamic creation of visualizations and access services

Research Challenges Data integrity –Commodity bit error rates are designed for GB data sets –Replication, federation, automated validation Efficient access to large scale data –MPI-IO interface to SRB data grid (OSU) Efficient parsing of data structures –Integration of HDF5 technology with data grids –Integration of Data Format Description Language Integration with digital library and preservation standards –METS - Metadata Encoding and Transmission Standard –AIP - Archival Information Package

Storage Resource Broker Collection hierarchy –Schema extension –Bulk metadata loading –Query Distributed storage –Replication –Audit trails, quotas, checksums, versions –Access controls –Support for all types of storage systems

Conclusions SCEC/CME is developing a digital library that holds the state-of-the-art simulations of large earthquakes in Southern California –Organizes simulation data, derived data products –Integrating access to observational data as next step SCEC/CME collaboration and ETF have been critical to this success –Large scale visualizations required Teragrid resources –Data movement rates (10 TBs per day) require Teragrid networks –Storage of results done on Teragrid storage systems Future opportunities –Integration with GIS systems to composite views on data –Interoperability between related NSF programs (GEON, NEESgrid) –Integration of knowledge management systems on top of digital library

Visualizations

Visualizations

Movies –Surface displacement magnitude Mapped on surface topography Contoured –Velocity magnitude –Peak velocity magnitude –Velocity components Images –Peak spectral acceleration

TeraShake