Open Grid Computing Environments

Slides:



Advertisements
Similar presentations
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Advertisements

Open Grid Computing Environments Marlon Pierce (IU) & Gopi Kandaswamy (RENCI)
Developing Grid User Interface Components Portlets, gadgets, etc.
User Introduction to the TeraGrid 2007 SDSC NCAR TACC UC/ANL NCSA ORNL PU IU PSC.
Building and Testing OGCE Software on the NMI Build and Test Facility Marlon Pierce Indiana University.
Wrapping Scientific Applications as Web Services Gopi Kandaswamy (RENCI) Marlon Pierce (IU)
OGCE Overview: Portals, Services, Workflows, Gadgets, and Tags Marlon Pierce (IU), Suresh Marru (IU), Gregor von Laszewski (RIT), Mary Thomas (SDSU), Nancy.
OGCE OVERVIEW: PORTALS, SERVICES, WORKFLOWS, GADGETS, AND TAGS Marlon Pierce (IU), Suresh Marru (IU), Raminder Singh (IU), Chathura Herath (IU), Gregor.
Open Grid Computing Environments Marlon Pierce, Suresh Marru, Gregor von Laszewski, Mary Thomas, Maytal Dahan, Gopi Kandaswamy, and Wenjun Wu.
Grid Computing for Real World Applications Suresh Marru Indiana University 5th October 2005 OSCER OU.
TeraGrid Information Services John-Paul “JP” Navarro TeraGrid Grid Infrastructure Group “GIG” Area Co-Director for Software Integration and Information.
Future Grid Future Grid User Portal Marlon Pierce Indiana University.
HPC club presentation A proposal for a campus-wide research grid Barry Wilkinson Department of Computer Science UNC-Charlotte Dec. 2, 2005.
Towards a Javascript CoG Kit Gregor von Laszewski Fugang Wang Marlon Pierce Gerald Guo
CloudCom Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University.
Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University
OGCE Workflow Suite GopiKandaswamy Suresh Marru SrinathPerera ChathuraHerath Marlon Pierce TeraGrid 2008.
CoG Kit Overview Gregor von Laszewski Keith Jackson.
ANSTO E-Science workshop Romain Quilici University of Sydney CIMA CIMA Instrument Remote Control Instrument Remote Control Integration with GridSphere.
OGCE Overview: Services, Gadgets, and Tags Marlon Pierce, Suresh Marru, Gregor von Laszewski, Mary Thomas, Maytal Dahan, Gopi Kandaswamy, Rion Dooley,
Grid Computing, B. Wilkinson, b.1 National Science Foundation Middleware Initiative (NMI) Started in 2001 initially over 3 years “to create and deploy.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
23:48:11Service Oriented Cyberinfrastructure Lab, Grid Portals Fugang Wang April 29
Open Grid Computing Environments: Advanced Gateway Support Activities RT Project Review October 7 th, 2010.
L inked E nvironments for A tmospheric D iscovery leadproject.org Using the LEAD Portal for Customized Weather Forecasts on the TeraGrid Keith Brewster.
UltraScan Gateway Advanced Support GIG Team: Suresh Marru, Raminder Singh, Marlon Pierce Pervasive Technology Institute Indiana University Gateway Personal:
Experiment Management with Microsoft Project Gregor von Laszewski Leor E. Dilmanian Acknowledgement: NSF NMI, CMMI, DDDAS
December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide User Interfaces to Grids Patrick Hurley Texas.
TeraGrid CTSS Plans and Status Dane Skow for Lee Liming and JP Navarro OSG Consortium Meeting 22 August, 2006.
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
Using Cyberaide JavaScript to develop Ajax based Grid Apps – A Tutorial for Grid App Developers Gregor von Laszewski Fugang Wang Jun 22, 2009.
1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Grappa Grid Access Portal for Physics Applications CHEP 2003 UCSD March 24-28,2003 Daniel Engh (UC), Shava Smallen (IU), Liang Fang (IU), Jerry Gieraltowski.
1 The Portal Expedition Beth Plale, Dennis Gannon Indiana University – Project Leads Jay Alameda NCSA – Project Coordinator The Alliance Portals Expedition.
WALSAIP Portal Automated Composition of Signal Processing Operators Mariana Mendoza Botero.
Evolving Interfaces to Impacting Technology: The Mobile TeraGrid User Portal Rion Dooley, Stephen Mock, Maytal Dahan, Praveen Nuthulapati, Patrick Hurley.
LEAD – WRF How to package for the Community? Tom Baltzer.
OGCE Components for Enhancing UltraScan Job Management. Suresh Marru,Raminder Singh, Marlon Pierce.
NCSA Alliance Portal Expedition Demo Marlon Pierce, Greg Daues, Gopi Kandaswamy, and Liang Fang Supercomputing 2004 Pittsburg, PA.
OGCE Overview: Services, Gadgets, and Tags Marlon Pierce, Suresh Marru, Gregor von Laszewski, Mary Thomas, Maytal Dahan, Gopi Kandaswamy, Rion Dooley,
The Open Grid Computing Environments Project Marlon Pierce Community Grids Laboratory Indiana University.
Biomedical and Bioscience Gateway to National Cyberinfrastructure John McGee Renaissance Computing Institute
Building Grid Portals with OGCE: Big Red Portal and GTLAB Mehmet A. Nacar, Jong Youl Choi, Marlon Pierce, Geoffrey Fox Community Grids Lab Indiana University.
Open Grid Computing Environments Tutorial Marlon Pierce, Suresh Marru, Gopi Kandaswamy, Gregor von Laszewski, and Tom Scavo.
Boulder, CO25 June 2004WRF/MM5 Users’ Workshop The WRF Portal Effort Brian Jewett, Robert Wilhelmson, & Matt Gilmore U. Illinois Atmospheric Sciences /
BioVLAB-Microarray: Microarray Data Analysis in Virtual Environment Youngik Yang, Jong Youl Choi, Kwangmin Choi, Marlon Pierce, Dennis Gannon, and Sun.
The Gateway Computational Web Portal Marlon Pierce Indiana University March 15, 2002.
Globus, CoG Kit, Web portals, and Road to Grid Fugang Wang Grid Seminar II, Fall 2008 Oct
OGCE Workflow and LEAD Overview Suresh Marru, Marlon Pierce September 2009.
Using the LEAD Portal to submit a Regional WRF run to the Teragrid July 13, 2006.
LEAD Project Discussion Presented by: Emma Buneci for CPS 296.2: Self-Managing Systems Source for many slides: Kelvin Droegemeier, Year 2 site visit presentation.
GCE07 Workshop Introduction Marlon Pierce Community Grids Lab Indiana University.
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
A Quick tour of LEAD for the VGrADS
Open Grid Computing Environment Summary
OGCE Short Summary Marlon Pierce Community Grids Lab
LEAD-VGrADS Day 1 Notes.
Writing Grid Portlets.
Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5
Marlon Pierce Indiana University February 14, 2012
Building Science Gateways and Managing Workflows with the Open Grid Computing Environment Toolkit Marlon Pierce, Suresh Marru, Zhenhua Guo, Fugang Wang,
Standard Portlet Architecture Supports Reusable Components
OGCE Portal Applications for Grid Computing
Middleware for Grid Portal Development
Database Connectivity and Web Development
OGCE Portal Software for Big Red and the TeraGrid
Open Grid Computing Environments
OGCE Architecture: Portlets and Services for Science Gateways
Grid Computing Software Interface
Presentation transcript:

Open Grid Computing Environments Marlon Pierce, Suresh Marru, Gregor von Laszewski

OGCE Principals IU: Marlon Pierce, Dennis Gannon, Suresh Marru RENCI: Gopi Kandaswamy RIT: Gregor von Laszewski SDSC: Nancy Wilkins-Diehr SDSU: Mary Thomas, Rob Edwards TACC: Maytal Dahan

OGCE Present and Future Work Sections Project organization: code, build, demo. Workflow suite overview and demo. JavaScript COG demo Other good stuff Interactions Feel free to distract us.

What Does the OGCE Do? Build and package Grid portal software. Portlets for GRAM, GridFTP, etc Provide programming libraries for building Grid clients. Java COG, GTLAB, JavaScript COG Build and package portal services GPIR Provide workflow tools: XRegistry, GFAC, XBaya

Browser Time…

Future Work, Part 1 We have several substantial components to support, extend. Portal software Improvements to existing interfaces Sakai container integration GFAC, Workflow Suite Add eventing system for monitoring workflows, tracking provenance. Support for asynchronous workflows. Use TeraGrid community credentials Java COG abstractions Upgrades to the Condor and SRB support Information service providers (see next) Need new providers: Amazon S3, EC2

Future Work, Part 2 Focused support for TeraGrid gateways. Logging, auditing, accounting services. Support, integration with TG information services See JP Navarro’s talk at GCE07 Engage other communities Web 2.0 tools for mashup gateway building Leverage social networking, bookmarking, start page tools JavaScript CoG Support for non-Java environments through the JS COG. Testing framework with NMI test bed, Jmeter.

OGCE Workflow Suite Development Team: Srinath Perera, Chathura Herath, Gopi Kandaswamy, Satoshi Shirasuna Generic Service Toolkit (Gfac) allows users to wrap any command line applications as web service. XRegistry is an application service registry which allows users to register web service descriptions using GFAC portlet interface and access and invoke the services from XBaya toolkit and Gfac Portlet. XBaya is an Java webstart application that can be used for composition, running and monitoring of workflows.

Few Examples LEAD: Linked Environment for Atmospheric Discovery MotifNetwork: Genome-Wide Domain Analysis

Dynamic Workflow in LEAD Terrain data files NAM, RUC, GFS data 9 3D Model Data Interpolator (lateral Boundary Conditions) 1 3 3D Model Data Interpolator (Initial Boundary Conditions) Terrain Preprocessor Surface data, upper air mesonet data, wind profiler 2 15 WRF Static Preprocessor 11 ARPS to WRF Data Interpolator IDV Bundle 4 Surface, Terrestrial data files 88D Radar Remapper 7 WRF ADAS WRF Run Once per forecast Region 10 12 WRF WRF Radar data (level II) ARPS Ensemble Generator Radar data (level III) 5 NIDS Radar Remapper 13 8 WRF to ARPS Data Interpolator ADAM Satellite data 6 Satellite Data Remapper Visualization on users request Repeated for periodically for new data 14 ARPS Plotting Program Data mining: looking for storm signature Triggered if a storm is detected Static data Real time data Initialization Analysis Data Mining Forecast Visualization

WRF Forecast with ADAS Initialization

Contact Us Web site: http://www.collab-ogce.org Contact information is there. Email: discuss@ogce.org