Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces.

Slides:



Advertisements
Similar presentations
Common Instrument Middleware Architecture and Federation of Instrument Resources for X-ray Crystallography Rick McMullen Indiana University.
Advertisements

NG-CHC Northern Gulf Coastal Hazards Collaboratory Simulation Experiment Integration Sandra Harper 1, Manil Maskey 1, Sara Graves 1, Sabin Basyal 1, Jian.
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
CGW 2009 Vine Toolkit A uniform access and portal solution to existing grid middleware services P.Dziubecki, T.Kuczynski, K.Kurowski, D.Szejnfeld, D.Tarnawczyk,
Virtual SharePoint Summit 2010 hosted by Rackspace Overcoming Collaboration Challenges with SharePoint Chris Samson Leslie Sistla Virtual SharePoint Summit.
Internet Infrastructure and Emerging Technologies Term project Internet Infrastructure and Emerging Technologies Term project.
May 17, Capabilities Description of a Rapid Prototyping Capability for Earth-Sun System Sciences RPC Project Team Mississippi State University.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
17 May 2006 Rapid Prototyping Capability for Earth-Sun System Sciences Preliminary Design Robert J. Moorhead Mississippi State University.
Mike Smorul Saurabh Channan Digital Preservation and Archiving at the Institute for Advanced Computer Studies University of Maryland, College Park.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
A Semantic Workflow Mechanism to Realise Experimental Goals and Constraints Edoardo Pignotti, Peter Edwards, Alun Preece, Nick Gotts and Gary Polhill School.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Developing Reusable Software Infrastructure – Middleware – for Multiscale Modeling Wilfred W. Li, Ph.D. National Biomedical Computation Resource Center.
CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
Department of Biomedical Informatics Service Oriented Bioscience Cluster at OSC Umit V. Catalyurek Associate Professor Dept. of Biomedical Informatics.
DISTRIBUTED COMPUTING
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES High Performance Computing applications in GEON: From Design to Production Dogan Seber.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
ANSTO E-Science workshop Romain Quilici University of Sydney CIMA CIMA Instrument Remote Control Instrument Remote Control Integration with GridSphere.
Miguel Branco CERN/University of Southampton Enabling provenance on large-scale e-Science applications.
A DΙgital Library Infrastructure on Grid EΝabled Technology ETICS Usage in DILIGENT Pedro Andrade
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
Installation and Development Tools National Center for Supercomputing Applications University of Illinois at Urbana-Champaign The SEASR project and its.
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
Information Resources and Communications University of California, Office of the President UC-Wide Activities in Support of Research and Scholarship David.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
RPC infrastructure Progress Report, July RPC Infrastructure: Timeline YearYear 1Year 2Year 3Year 4Year 5 Quarter Q1Q1 Q2Q2 Q3Q3 Q4Q4 Q1Q1 Q2Q2 Q3Q3.
Tools for collaboration How to share your duck tales…
Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
Policy Based Data Management Data-Intensive Computing Distributed Collections Grid-Enabled Storage iRODS Reagan W. Moore 1.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
1 Media Grid Initiative By A/Prof. Bu-Sung Lee, Francis Nanyang Technological University.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
Interoperability from the e-Science Perspective Yannis Ioannidis Univ. Of Athens and ATHENA Research Center
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
© 2013, published by Flat World Knowledge Chapter 10 Understanding Software: A Primer for Managers 10-1.
Recording Actor Provenance in Scientific Workflows Ian Wootten, Shrija Rajbhandari, Omer Rana Cardiff University, UK.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
1 Gateways. 2 The Role of Gateways  Generally associated with primary sites in ESG-CET  Provides a community-facing web presence  Can be branded as.
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
Università di Perugia Enabling Grids for E-sciencE Status of and requirements for Computational Chemistry NA4 – SA1 Meeting – 6 th April.
Portals and my Grid Stefan Rennick Egglestone Mixed Reality Laboratory University of Nottingham.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
Application Web Service Toolkit Allow users to quickly add new applications GGF5 Edinburgh Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University.
Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University
+ Support multiple virtual environment for Grid computing Dr. Lizhe Wang.
GO-ESSP The Earth System Grid The Challenges of Building Web Client Geo-Spatial Applications Eric Nienhouse NCAR.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
VIEWS b.ppt-1 Managing Intelligent Decision Support Networks in Biosurveillance PHIN 2008, Session G1, August 27, 2008 Mohammad Hashemian, MS, Zaruhi.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
International Planetary Data Alliance Registry Project Update September 16, 2011.
TOWARDS AN ARCHITECTURE FOR NATIONAL DATA SERVICES Ian Foster Director, Computation Institute Argonne National Laboratory & The University of
Simulation Production System
Discovering Computers 2010: Living in a Digital World Chapter 14
Enable computational and experimental  scientists to do “more” computational chemistry by providing capability  computing resources and services at their.
Recap: introduction to e-science
CSC 480 Software Engineering
DIGITAL LIBRARY.
The ViroLab Virtual Laboratory for Viral Diseases
Presentation transcript:

Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces Institute

Rapid Prototyping Capabilities * The overall goal of the NASA Rapid Prototyping Capability is to speed the evaluation of potential uses of NASA research products and technologies to improve future operational systems by reducing the time to access, configure, and assess the effectiveness of NASA products and technologies. The infrastructure to support the RPC is thus expected to provide the capability to rapidly evaluate innovative methods of linking science observations. * Robert Moorhead (MSU/GRI) – principal investigator Computational infrastructure + collaborative environment

RPC in an example of e-Science Many, many more, in particular in biology & medicine System-Level Science is the broad understanding of how complex, multiphenomena physical system behave and how their constituent components interact and interrelate. System-level Science integrates not only different disciplines but also, typically, software systems, data, computing resources, and people. System-level science is usually a team pursuit. Data comes from different sources, different groups develop component models, team members provide specialized expertise, and the often substantial computing and data resources required for success are themselves diverse and distributed. Grid Computing Virtual Organizations Ian Foster ANL and University of Chicago “father of Grid Computing”

New Web Revolution The Web 0.5 Digital Enterprise 2.0 Grid Computing e-Science 2.0 The Web 2.0 The Web 1.0 SOA Server hopping Document exchange Dynamic Content, Publishing E-Commerce E-banking,… Community Content, Collaboration Social Networking, Rich Interfaces Database Access, Search Cloud Computing, AJAX, mashups Architecture of participation Collective intelligence User-created content Convergent, emergent Unplanned innovation Freeform simplicity

RPC Experiments Data Access Data providers (DAAC, NOAA, etc) Derived data product (model outputs) Simulated data Data (Geo)processing Re-sampling, re-projecting, time series, maps & features, etc. input deck generation … Computational Models Data Publishing Data Analysis Data Storage Semantic metadata Processing Abstraction Model Data Abstraction Model Run Abstraction Experiment Description Experimental Procedure Description of Results Analysis Procedure Conclusions from Evaluation (Recommendation for ISS) (Two ways of describing them) The delivery mechanisms for the evaluation of the use of the NASA-provided resources Prototyping The capability to integrate tools and data to perform such evaluations Rapid

Interactive Web SitePrivate Space for Collaboration TDS-based Data Explorer Tools for Data Processing Performance Metrics WorkbenchProvenance DEMONSTRATION

What’s under the hood? Apache/Tomcat server (J2EE) GridSphere portlet container THREDDS (Unidata) GUI (JSP) Local Storage Service Bus (ServiceMix) HEG ARTTSPT HPC 2 Storage HPC 2 clusters Wiki (MediaWiki) Globus GRAMgridFTP Web access Content aggregation Portlets SOA Grid Computing REST AJAX

Current Work Support for NASA LIS RPC experiment * Valentine Anantharaj (MSU/GRI) - PI Web Browser REST/AJAX Service Bus LIS post- processor Job Submission Service Job Monitoring Service File Transfer Service TDS Service LIS input deck generator Standalone TDS clients Create input deck Request execution Create execution environment Stage files in Listen to job status changes Post- process outputs Create metadata and provenance Post results on TDS Initialized by userOrchestrated services: workflow

Support for LIS experiments Set LIS parameters Create LIS input deck Run LIS

Monitor the status The post-processed file is automatically transferred to the TREDDS server

This concludes my presentation on Cyberinfrastructure for of the Rapid Prototyping Capability System Tomasz Haupt Cooperative Computing Group Center for Advanced Vehicular Systems Mississippi State University 

Interactive Web Site for describing RPC experiments

Private space for discussions

TDS-based data repository (data explorer)

Tools for data processing (currently HEG)

Performance Metrics Workbench (currently multispectral viewer)

Provenance

Electronic Journals