IT at the IRIS DMC: Synergy with the CIG By Tim Ahern, IRIS DMS Program Manager By Tim Ahern, IRIS DMS Program Manager.

Slides:



Advertisements
Similar presentations
Web Services at IRIS DMC Joanna Muench Linus Kamb.
Advertisements

ASL QC Procedures Status and plans. GSN ANSS Traditional Waveform Review  The “morning run” Daily summarizes problems with availability, timing,
GSN Quality Assurance System Concepts of Operations GSN-QC Coordination Meeting IRIS DMC - 11/16/2011.
March 25-27, 2002EarthScope IT Workshop USArray Breakout Group The USArray system: Sensor  Collection point Collection point  Archive Archive  User.
Development of a Web-based, Multimedia Database for Collection, Organization and Analysis of Biomedical Signals M.S.C.S. Problem Report Defense Lan Guo.
IRIS Services Initiative Improving Data Access and Integration for the GeoSciences Linus Kamb, Joanna Muench, Tim Ahern IRIS Data Management Center.
Background basics of Across-the-Internet on-Demand Service DMS Workshop Stevenson, WA Wed 08 June 2005 David Okaya Univ. Southern California Basic design.
DAME Architecture Hybrid distributed data mining model Integrates the client-server and mobile agent paradigms Adopting the most suitable approach for.
12 Chapter 12 Client/Server Systems Database Systems: Design, Implementation, and Management, Fifth Edition, Rob and Coronel.
Chapter 14 The Second Component: The Database.
What is adaptive web technology?  There is an increasingly large demand for software systems which are able to operate effectively in dynamic environments.
Improved Quality Control for Seismic Networks ---MUSTANG.
LOFAR Self-Calibration Using a Blackboard Software Architecture ADASS 2007Marcel LooseASTRON, Dwingeloo.
Introduction to client/server architecture
Centralized and Client/Server Architecture and Classification of DBMS
Numerical Grid Computations with the OPeNDAP Back End Server (BES)
August 13-19, 2010Data Management Workshop Foz do Iguassu- Brazil Seismic Quality Assurance Rick Benson IRIS DMC Rick Benson IRIS DMC.
Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.
Project Title: Find New Buddy (FNB) web service Group Number:3 Group Members: Ankur Aggarwal ( ) Saurebh Raut ( ) Siddharth Kodwani ( )
N Tropy: A Framework for Analyzing Massive Astrophysical Datasets Harnessing the Power of Parallel Grid Resources for Astrophysical Data Analysis Jeffrey.
By Tim Ahern, Program Manager IRIS DMS A “Short” Introduction to the IRIS Data Management Center Data Holdings, Data Organization, and Data Access.
By Tim Ahern, Rick Benson, Rob Casey, Chad Trabant and Bruce Weertman and many more talented people at the IRIS DMC.
GEON Science Application Demos
Exam 2 Terminology Review MIS Question 1 The second generation of the Web: A. Ecommerce B. Internet2 C. Web 2.0 D. All of the above.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES High Performance Computing applications in GEON: From Design to Production Dogan Seber.
Accessing Data Using Web Services. IRIS Services – service.iris.edu FDSN Web services dataselect station event Documentation IRIS web services fedcatalog.
® IBM Software Group © 2007 IBM Corporation J2EE Web Component Introduction
EPOS & EarthScope 1 Progress report WP5 Torild van Eck (ORFEUS/EPOS) Tim Ahern (IRIS/EarthScope/SAGE) Chuck Meertens (UNAVCO/EarthScope/GAGE) Fran Boler.
Accessing Data through Web Services. IRIS Services – service.iris.edu  FDSN Web services  dataselect  station  event  Documentation Documentation.
Web Services at IRIS Implementations, Directions, and International Coordination Tim Ahern, Director of Data Services, IRIS Web Services Team: Bruce Weertman,
By Tim Ahern Program Manager, IRIS Data Management System Secretary, FDSN 9-11 May 2007 Kiel, Germany The International Federation of Digital Seismographic.
FDSN WG III Coordination of Products, Tools and Services.
8-13 January 2012, Bangkok, Thailand Institute of Seismology, National Academy of Sciences, Kyrgyz Republic.
1 SCEC Broadband Platform Development Using USC HPCC Philip Maechling 12 Nov 2012.
AppDynamics Ohio User Group. What is ExactTarget? Software as a Service Marketing 500 million s sent a day 200 million web transactions a day.
Facilitate – Collaborate – Educate Tuesday, January 10, 11:05am Data Management Workshop Bangkok Thailand, January 2011.
By Tim Ahern, Program Manager IRIS DMS A “Short” Introduction to the IRIS Data Management Center Data Holdings, Data Organization, and Data Access.
Where to find LiDAR: Online Data Resources.
Rick Benson Saturday, Aug 14, 14:00 August 13-19, 2010Data Management Workshop Foz do Iguassu- Brazil.
By Tim Ahern, Director of Data Services, IRIS A short introduction to the IRIS Data Management System Data Holdings, Data Organization, and Data Access.
IT as a Tool to Provide Seamless Access to Diverse Data Sets By Tim Ahern Program Manager Data Management System The IRIS Consortium By Tim Ahern Program.
Tim Ahern Non Real Time SEED Request Tools. Workshop Representation Europe – ORFEUS Germany – Geofon United States - IRIS FDSN Centers with Significant.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Lee Lueking 1 The Sequential Access Model for Run II Data Management and Delivery Lee Lueking, Frank Nagy, Heidi Schellman, Igor Terekhov, Julie Trumbo,
Web Services The Seismic Data Portal is supported by several web data services, including services providing: event ( waveform (
Learning Teams Red - Favorite hobbies Green - Favorite place on earth Blue – Teaching situation (Grade level, courses, etc) Yellow – Favorite activity.
By Tim Ahern, Director of Data Services, IRIS An Overview of IRIS Incorporated Research Institutions for Seismology.
29 March 2004 Steven Worley, NSF/NCAR/SCD 1 Research Data Stewardship and Access Steven Worley, CISL/SCD Cyberinfrastructure meeting with Priscilla Nelson.
SUPERCOMPUTING 2002, Baltimore, , SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing.
© 1stworks Corp. The Connected Community 85% of US corporations have a PC 75% of these PCs have an Internet connection 50% of US households have a PC 80%
CISC 849 : Applications in Fintech Namami Shukla Dept of Computer & Information Sciences University of Delaware iCARE : A Framework for Big Data Based.
Federation of Digital Broad-Band Seismograph Networks The FDSN and Sustainable Seismic Networks Tim Ahern FDSN Archive for Continuous Data.
Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.
SAC: An Overview SAC ( “Seismic Analysis Code” ) was originally developed by LLNL An interactive program for time-series data with emphasis placed on.
FDSN Working Group II Data Exchange and Data Centers By Bernard Dost, ORFEUS Data Centre, deBilt Netherland Tim Ahern FDSN Data Center for Continuous Data.
Aditya P. Mathur Professor Department of Computer Science Purdue University, West Lafayette Wednesday January 19, 2011 Capsules, Micropayments, and the.
RDA Data Support Section. Topics 1.What is it? 2.Who cares? 3.Why does the RDA need CISL? 4.What is on the horizon?
By Tim Ahern, Program Manager IRIS DMS An Overview IRIS Incorporated Research Institutions for Seismology.
Tim Ahern IRIS Director of Data Services Active Source Data Management Workshop January 2014 – Tucson, Arizona.
Performing Fault-tolerant, Scalable Data Collection and Analysis James Jolly University of Wisconsin-Madison Visualization and Scientific Computing Dept.
VIEWS b.ppt-1 Managing Intelligent Decision Support Networks in Biosurveillance PHIN 2008, Session G1, August 27, 2008 Mohammad Hashemian, MS, Zaruhi.
SAC: An Overview SAC ( “Seismic Analysis Code” ) was originally developed by LLNL SAC ( “Seismic Analysis Code” ) was originally developed by LLNL An interactive.
Thurs Nov 12, 12:45 Nov 8-17, 2009Data Management Workshop Cairo, Egypt.
Requesting a Standardized Data Set for the FDSN Network
Requesting a Standardized Data Set for the FDSN Network
Load Weighting and Priority
USArray Quality Assurance
Introduction to client/server architecture
Capacity Analysis, cont. Realistic Server Performance
Growing importance of metadata for synthetics: Calculating and Sharing Synthetic Seismic Data Dogan Seber University of California, San Diego San Diego.
Presentation transcript:

IT at the IRIS DMC: Synergy with the CIG By Tim Ahern, IRIS DMS Program Manager By Tim Ahern, IRIS DMS Program Manager

IRIS DMS - Future Directions  On-line access to all data  Enhanced User Services  Pre-calculated Data Metrics  On-demand Data Metrics  Processing Frameworks  Networked Data Centers  Software development  On-line access to all data  Enhanced User Services  Pre-calculated Data Metrics  On-demand Data Metrics  Processing Frameworks  Networked Data Centers  Software development

On-line data Tier 1 and Tier2 Data Expandable Primary SATA RAID 50 terabyte Class 1 Data Class 2 Data Class 1or 2 Data Tape ftp BU D 1.2 petabyte capacity Currently 36 terabytes Growing at 10 tbyte/year Electronic Reception of Data

Data mining: pre-calculated data metrics

Enhanced Data Selection Station-Channel-Time DMC Data Services User Requests Current QA Parameters Pre-computed estimates DBMS Tables Return only data meeting pre-computed metrics Pre-computed Primary RAID Tier 1 Data Disk Resources Cluster Computer Data Refinement Services On-demand Return only data meeting dynamically defined metrics Data filtering by placing “significant” computational power next to the actual on-line data”

How enhanced services might be implemented! BandPass Filter Rotate2 D Synthetic Correlation Web Services Community Developed Traditional Data Services Traditional User Requirements: 1. Select events meeting some criteria 2. Select stations with a distance constraint 3. For all broadband channels select ones with a 3 BH channels 4. Select channels with QUACK S/N > something Enhanced Data Requirements: 1.Rotate horizontals 2.Filter each channel through three 1 octave filters 3.Calculate 2d synthetics in each band 4.Perform correlation between synthetic and observed data 5.Return data with correlation > 0.9 to user BandPass Filter BandPass Filter BandPass Filter BandPass Filter BandPass Filter Disk Resources Cluster Computer Enhanced Data Services >0.9

Processing Frameworks Web Services Distributed Web Services Web Services IRIS Developed Web Services Community Developed Disk Resources Cluster Computer Data Refinement Services Based on Web Services or next generation paradigm Opportunity to work with the CIG

Access to Distributed Data Centers Network Seismogram Events DHI Data Center DHI Clients jWEED Network Seismogram Events DHI Data Center Network Seismogram Events DHI Data Center Network Seismogram Events DHI Data Center IRIS DMC - NCEDC - SCEDC - SCEPP and soon ORFEUS - ISC - NEIC Providing an API to Seismic Data Centers CORBA today. Web Services Tomorrow

Clickable access to data centers

Software Development  Web Services Distributed Framework  User developed and shared tools  Providing access to Legacy Applications  Seismic Analysis Code  Get SAC to be Open-Source  Limited to IRIS members at this time  Provide Web-services access to SAC functionality  Tool for seamless access to distributed data  Basic Analysis of data with datasets such as USArray in mind  Web Services Distributed Framework  User developed and shared tools  Providing access to Legacy Applications  Seismic Analysis Code  Get SAC to be Open-Source  Limited to IRIS members at this time  Provide Web-services access to SAC functionality  Tool for seamless access to distributed data  Basic Analysis of data with datasets such as USArray in mind