SAN DIEGO SUPERCOMPUTER CENTER Choonhan Youn Viswanath Nandigam, Nancy Wilkins-Diehr, Chaitan Baru San Diego Supercomputer Center, University of California,

Slides:

Advertisements

Similar presentations

Peter Berrisford RAL – Data Management Group SRB Services.

Advertisements

Some notes on CyberGIS in hydrology Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD TeraGrid CyberGIS Workshop, February.

SAN DIEGO SUPERCOMPUTER CENTER The Integration of 2 Science Gateways: CyberGIS + OpenTopography Choonhan Youn, Nancy Wilkins-Diehr, SDSC Christopher Crosby,

Background Chronopolis Goals Data Grid supporting a Long-term Preservation Service Data Migration Data Migration to next generation technologies Trust.

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO SDSC RP Update October 21, 2010.

Accelerating TauDEM as a Scalable Hydrological Terrain Analysis Service on XSEDE 1 Ye Fan 1, Yan Liu 1, Shaowen Wang 1, David Tarboton 2, Ahmet Yildirim.

A Service Platform for On-Line Games DebanJan Saha, Dambit Sahu, Anees Shaikh (IBM TJ Watson Research Center, NY) Presented by Gary Huang March 17, 2004.

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO IEEE Symposium of Massive Storage Systems, May 3-5, 2010 Data-Intensive Solutions.

ARCS Data Analysis Software An overview of the ARCS software management plan Michael Aivazis California Institute of Technology ARCS Baseline Review March.

Workshop on Cyber Infrastructure in Combustion Science April 19-20, 2006 Subrata Bhattacharjee and Christopher Paolini Mechanical.

SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.

Simo Niskala Teemu Pasanen

Dogan Seber, PhD San Diego Supercomputer Center University of California, San Diego I. DLESE Library II. DISCOVER OUR EARTH Earth Science Resources for.

Remote Visualization of Large Datasets with MIDAS & ParaViewWeb Web3D – Paris 2011 Julien Jomier, Kitware

Sergey Belov, Tatiana Goloskokova, Vladimir Korenkov, Nikolay Kutovskiy, Danila Oleynik, Artem Petrosyan, Roman Semenov, Alexander Uzhinskiy LIT JINR The.

GEON: The User Perspective Choonhan Youn Dogan Seber, Chaitan Baru, Ashraf Memon San Diego Supercomputer Center, University of California at San Diego.

Best Practices: Integration of OpenTopography DEM data with UIUC Viewshed tool SDSC OT team.

OpenTopography 2: A Cyberinfrastructure-Enabled Facility for High-Resolution Topographic Data and Tools PI: Chaitan Baru (SDSC) Co-PIs: J Ramon Arrowsmith.

Developing Reusable Software Infrastructure – Middleware – for Multiscale Modeling Wilfred W. Li, Ph.D. National Biomedical Computation Resource Center.

Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.

WPS Application Patterns at the Workshop “Models For Scientific Exploitation Of EO Data” ESRIN, October 2012 Albert Remke & Daniel Nüst 52°North Initiative.

Integrating digital atlases of the brain: atlas services with WPS Ilya Zaslavsky San Diego Supercomputer Center, UCSD Lead of the INCF Digital Atlasing.

TeraGrid Science Gateways: Scaling TeraGrid Access Aaron Shelmire¹, Jim Basney², Jim Marsteller¹, Von Welch²,

Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES High Performance Computing applications in GEON: From Design to Production Dogan Seber.

SAN DIEGO SUPERCOMPUTER CENTER NUCRI Advisory Board Meeting November 9, 2006 Science Gateways on the TeraGrid Nancy Wilkins-Diehr TeraGrid Area Director.

material assembled from the web pages at

National Earth Science Infrastructure Program AuScope Limited Headquarters School of Earth Sciences University of Melbourne Victoria 3010 Tel

October 2008, Nice Using ProActive to bridge Grid and SOA The AGOS project Frédéric Linder Program Director, Service Oriented Architecture.

Enabling Access to High-Resolution LiDAR Topography through Cyberinfrastructure-Based Data Distribution and Processing Christopher J. Crosby, J Ramón Arrowsmith.

1PeopleDocumentsData Catalog Generation Tools Analysis and Visualization Tools Data Services Discovery and Publication Tools Discovery and Publication.

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Michael L. Norman Principal Investigator Interim Director, SDSC Allan Snavely.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.

Data discovery and data processing for environmental research infrastructures Roberto Cossu ENVRI WP4 leader ESA.

1 Ilkay ALTINTAS - July 24th, 2007 Ilkay ALTINTAS Director, Scientific Workflow Automation Technologies Laboratory San Diego Supercomputer Center, UCSD.

SoCal Infrastructure OptIPuter Southern California Network Infrastructure Philip Papadopoulos OptIPuter Co-PI University of California, San Diego Program.

Apache Airavata (Incubating) Gateway to Grids & Clouds Suresh Marru Nov 10 th 2011.

Service - Oriented Middleware for Distributed Data Mining on the Grid ，劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.

Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.

1 Interoperability and a Spatial Web Portal April 20, 2007 Myra Bambacus NASA Applied Sciences Program Geosciences Interoperability Office.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs (SEEK), EAR (GEON), DOE DE-FC02-01ER25486.

© 2006 STEP Consortium ICT Infrastructure Strand.

GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.

GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.

1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.

Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.

1 CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August Web Services – The Motivation.

GEOSCIENCE NEEDS & CHALLENGES Dogan Seber San Diego Supercomputer Center University of California, San Diego, USA.

Enabling e-Research in Combustion Research Community T.V Pham 1, P.M. Dew 1, L.M.S. Lau 1 and M.J. Pilling 2 1 School of Computing 2 School of Chemistry.

Center for Computational Visualization University of Texas, Austin Visualization and Graphics Research Group University of California, Davis Molecular.

AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Virtual Geophysics Laboratory (VGL): Scientific workflows Exploiting the Cloud Josh.

Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.

2005 GRIDS Community Workshop1 Learning From Cyberinfrastructure Initiatives Grid Research Integration Development & Support

CUAHSI HIS: Science Challenges Linking small integrated research sites (

1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.

Managing deployment and activation of Web Applications in a distributed e-Infrastructure EGI Technical Forum September 2011 Lyon

The Storage Resource Broker and.

Tackling I/O Issues 1 David Race 16 March 2010.

PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.

GEOSPATIAL CYBERINFRASTRUCTURE. WHAT IS CYBERINFRASTRUCTURE(CI)?  A combination of data resources, network protocols, computing platforms, and computational.

A Science Collaboration Environment for the Network for Earthquake Engineering Simulation (NEES) Choonhan Youn Chaitan Baru, Ahmed Elgamal,

EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu

Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.

Clouds , Grids and Clusters

Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5

XSEDE’s Campus Bridging Project

Choonhan Youn, Viswanath Nandigam, Minh Phan

OGCE Portal Applications for Grid Computing

Presentation transcript:

SAN DIEGO SUPERCOMPUTER CENTER Choonhan Youn Viswanath Nandigam, Nancy Wilkins-Diehr, Chaitan Baru San Diego Supercomputer Center, University of California, San Diego Development of OGC WPS services on Gordon I/O node for Data-Intensive Applications

SAN DIEGO SUPERCOMPUTER CENTER 2 Introduction  OpenTopography Project Service Registry OGC WPS service Gordon: Computing Facility System Architecture Outline

SAN DIEGO SUPERCOMPUTER CENTER OpenTopography As an NSF data facility, OpenTopography (OT, provides community access to high-resolution Earth science- oriented, topography data, and related tools and resources. OT provides several spatial data access functions and geoprocessing applications packaged as Web services across multiple backend servers. OPAL toolkit ( OPAL is an open-source toolkit developed by the National Biomedical Computation Resource (NBCR) and the SDSC that enables users to wrap scientific applications running on cluster and Grid resources as Web services. All Web services are built and deployed by leveraging OPAL toolkit. 3

SAN DIEGO SUPERCOMPUTER CENTER Service Registry An SOA based pluggable service infrastructure has been prototyped to enable scientists to contribute processing tools and algorithms for operating on OT LIDAR datasets, for use by the larger community. Service registry is a key piece for enhancing and achieving reuse of services that allows service providers/consumers to organize information about services and allow facilities to publish their services. 4

SAN DIEGO SUPERCOMPUTER CENTER OGC WPS (Web Process Service) Services It defines a standardized interface that facilitates the publishing of geospatial processes, and the discovery of and binding to those processes by clients. TauDEM (Terrain Analysis Using Digital Elevation Models) services for the hydrology science Adapted as science driver and community service to connect OT and CyberGIS projects. TauDEM functions are wrapped as OGC WPS Web services. A single data access service which invokes a set of OT data and application services. WPS repository can be suitable for the service registry potentially and these service registry can be used for the service integration and composition. 5

SAN DIEGO SUPERCOMPUTER CENTER Gordon: Computing Facility Data-intensive applications that involve “very large data-sets or very large input-output requirements”. A “data-intensive” supercomputer based on SSD flash memory A system designed to accelerate access to massive data bases being generated in all fields of science, engineering, medicine, and social science. TauDEM services, including full OT software stack, has been deployed to a dedicated Gordon’s I/O node. 6

SAN DIEGO SUPERCOMPUTER CENTER System Architecture LIDAR Data Management System (Data Oasis) Gordon Computing Cluster OGC WPS Web Services Gordon I/O Node Local SSD (4.8TB) External Authenticated OPAL Web Services Science Applications Gordon Compute Nodes SOAP/HTTP Future Work: Local SSD Cache Science Applications Compute Servers Service Consumers, Science Gateways ( Web Apps, Model Builders, etc. ) 7

SAN DIEGO SUPERCOMPUTER CENTER