OGCE OVERVIEW: PORTALS, SERVICES, WORKFLOWS, GADGETS, AND TAGS Marlon Pierce (IU), Suresh Marru (IU), Raminder Singh (IU), Chathura Herath (IU), Gregor.

Slides:



Advertisements
Similar presentations
Open Grid Computing Environments Marlon Pierce (IU) & Gopi Kandaswamy (RENCI)
Advertisements

Building and using REST information services Rion Dooley.
Using the Collaborative Tools in NEESgrid Charles Severance University of Michigan.
Developing Grid User Interface Components Portlets, gadgets, etc.
Foundation API: Today and Tomorrow Rion Dooley. Today v1 is in production 192 apps Creeping up on 200,000 requests/month About to hit 10,000th job Blowing.
Web Services Darshan R. Kapadia Gregor von Laszewski 1http://grid.rit.edu.
Building and Testing OGCE Software on the NMI Build and Test Facility Marlon Pierce Indiana University.
Wrapping Scientific Applications as Web Services Gopi Kandaswamy (RENCI) Marlon Pierce (IU)
OGCE Overview: Portals, Services, Workflows, Gadgets, and Tags Marlon Pierce (IU), Suresh Marru (IU), Gregor von Laszewski (RIT), Mary Thomas (SDSU), Nancy.
Building Science Gateways Marlon Pierce Community Grids Laboratory Indiana University.
Open Grid Computing Environments Marlon Pierce, Suresh Marru, Gregor von Laszewski, Mary Thomas, Maytal Dahan, Gopi Kandaswamy, and Wenjun Wu.
GridSphere for GridLab A Grid Application Server Development Framework By Michael Paul Russell Dept Computer Science University.
1 Multicore and Cloud Futures CCGSC September Geoffrey Fox Community Grids Laboratory, School of informatics Indiana University
Toward an OpenSocial Life Science Gateway Wenjun Wu, Michael E. Papka, Rick Stevens.
Building Science Gateways Using Gadgets and OpenSocial Zhenhua Guo, Raminder Singh, Marlon Pierce Pervasive Technology Institute at Indiana University.
The Open Gateway Computing Environment: Experiences Developing Tools for Scientific Communities in the Apache Software Foundation Marlon Pierce Indiana.
Grid Computing, B. Wilkinson, a.1 Grid Portals.
E-Science Workflow Support with Grid-Enabled Microsoft Project Gregor von Laszewski and Leor E. Dilmanian, Rochester Institute of Technology Abstract von.
CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:
TeraGrid Information Services December 1, 2006 JP Navarro GIG Software Integration.
Ajax-based startpage Web top Personal web portal Page aggregator –Netvibes, My Yahoo!, iGoogle, Page Flakes, Wakooz, and Microsoft Live. –Personalize.
Distributed Web Security for Science Gateways Jim Basney In collaboration with: Rion Dooley Jeff Gaynor
A Web 2.0 Portal for Teragrid Fugang Wang Gregor von Laszewski May 2009.
Future Grid Future Grid User Portal Marlon Pierce Indiana University.
Installing and Building GTLAB Marlon Pierce Indiana Univeristy.
Towards a Javascript CoG Kit Gregor von Laszewski Fugang Wang Marlon Pierce Gerald Guo
Building the Portal. Choosing a Host Computer Select your host computer. o You will need a real IP address for some COG-based portlets o VPN also OK (?)
CloudCom Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University.
Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University
OGCE Workflow Suite GopiKandaswamy Suresh Marru SrinathPerera ChathuraHerath Marlon Pierce TeraGrid 2008.
CoG Kit Overview Gregor von Laszewski Keith Jackson.
OGCE Overview: Services, Gadgets, and Tags Marlon Pierce, Suresh Marru, Gregor von Laszewski, Mary Thomas, Maytal Dahan, Gopi Kandaswamy, Rion Dooley,
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
23:48:11Service Oriented Cyberinfrastructure Lab, Grid Portals Fugang Wang April 29
07/06/11 New Features of WS-PGRADE (and gUSE) 2010 Q Q2 Miklós Kozlovszky MTA SZTAKI LPDS.
Open Grid Computing Environments: Advanced Gateway Support Activities RT Project Review October 7 th, 2010.
UltraScan Gateway Advanced Support GIG Team: Suresh Marru, Raminder Singh, Marlon Pierce Pervasive Technology Institute Indiana University Gateway Personal:
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Experiment Management with Microsoft Project Gregor von Laszewski Leor E. Dilmanian Acknowledgement: NSF NMI, CMMI, DDDAS
Using Cyberaide JavaScript to develop Ajax based Grid Apps – A Tutorial for Grid App Developers Gregor von Laszewski Fugang Wang Jun 22, 2009.
1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Grid Security: Authentication Most Grids rely on a Public Key Infrastructure system for issuing credentials. Users are issued long term public and private.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University
Evolving Interfaces to Impacting Technology: The Mobile TeraGrid User Portal Rion Dooley, Stephen Mock, Maytal Dahan, Praveen Nuthulapati, Patrick Hurley.
OGCE Components for Enhancing UltraScan Job Management. Suresh Marru,Raminder Singh, Marlon Pierce.
OGCE Overview: Services, Gadgets, and Tags Marlon Pierce, Suresh Marru, Gregor von Laszewski, Mary Thomas, Maytal Dahan, Gopi Kandaswamy, Rion Dooley,
The Open Grid Computing Environments Project Marlon Pierce Community Grids Laboratory Indiana University.
QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University
Biomedical and Bioscience Gateway to National Cyberinfrastructure John McGee Renaissance Computing Institute
Building Grid Portals with OGCE: Big Red Portal and GTLAB Mehmet A. Nacar, Jong Youl Choi, Marlon Pierce, Geoffrey Fox Community Grids Lab Indiana University.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Open Grid Computing Environments Tutorial Marlon Pierce, Suresh Marru, Gopi Kandaswamy, Gregor von Laszewski, and Tom Scavo.
Building Science Gateways Marlon Pierce Community Grids Laboratory Indiana University.
GridChem Architecture Overview Rion Dooley. Presentation Outline Computational Chemistry Grid (CCG) Current Architectural Overview CCG Future Architectural.
OGCE Workflow and LEAD Overview Suresh Marru, Marlon Pierce September 2009.
Clarens Toolkit Building Blocks for a Simple TeraGrid Gateway Tutorial Conrad Steenberg Julian Bunn, Matthew Graham, Joseph Jacob, Craig Miller, Roy Williams.
Lightweight OGCE Gadget Portal for Science Gateways Zhenhua Guo, Marlon Pierce Community Grids Laboratory, Pervasive Technology Institute, Indiana University,
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
Open Grid Computing Environment Summary
OGCE Short Summary Marlon Pierce Community Grids Lab
Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5
Marlon Pierce Indiana University February 14, 2012
Open Grid Computing Environments
Building Science Gateways and Managing Workflows with the Open Grid Computing Environment Toolkit Marlon Pierce, Suresh Marru, Zhenhua Guo, Fugang Wang,
Middleware for Grid Portal Development
OGCE Portal Software for Big Red and the TeraGrid
Open Grid Computing Environments
Presentation transcript:

OGCE OVERVIEW: PORTALS, SERVICES, WORKFLOWS, GADGETS, AND TAGS Marlon Pierce (IU), Suresh Marru (IU), Raminder Singh (IU), Chathura Herath (IU), Gregor von Laszewski (RIT), Fungang Wang (RIT), Mary Thomas (SDSU), Nancy Wilkins-Diehr (SDSC), Jeff Sale (SDSC), Maytal Dahan (TACC), Rion Dooley (TACC), and Wenjun Wu (UC) Funding: NSF SDCI, TeraGrid RP and GIG (synergistic)

Links for More Information Website: News/RSS/Blog: ogce.blogspot.comhttp://collab- ogce.blogspot.com SVN Code Repository: – And get tar.gz’s Source Forge:

ProjectDescriptionStatus Grid PortalPackaged, one step installation of Grid portlets into Tomcat+Gridsphere Stable, V2.5 for TG09 Axis ServicesOne step install of Resource Discovery and Prediction Services. More services to come. Stable, V1.0 for TG09. Workflow SuiteSupport for scientific workflows, based on LEAD tools. Suresh will describe next. Dev. Release for TG09 GTLABJSF Tag Libraries for building Grid portlets and gadgets Dev. Release for TG09 JavaScript COG (Cyberaide) JavaScript libraries for building Grid gateways. Dev. Preview for TG09 Gadgets, Open Social Portals Open Social containers, gadgets, OAuth, OpenID SVN, will build Incubator projects Pylons portals, metascheduling services, bio-gadgets, etc. SVN if you dare

OGCE and Gateways We develop and package software for use by TeraGrid Science Gateways and other resources BioVLAB use OGCE tools to run on Amazon A lot of this comes from active Gateways. Information Services (GPIR, QBETS): TeraGrid User Portal Workflow tools: LEAD Resource Discovery Service, File Browser Applet: TGUP, GridChem Gadgets, Open Social Containers: SIDGrid, OLSG We contribute codes back to these projects. Gateways OGCE Software

Grid Portal Software – Java-based Code managed by Source Forge SVN. Get it by anonymous SVN checkout Download the Tar: net/viewvc/ogce/tags/ogce- portal-only-2.5-release.tar.gz net/viewvc/ogce/tags/ogce- portal-only-2.5-release.tar.gz One-line build: mvn clean install. Download has everything you need except Java.

File browser front end from OGCE portal download

Workflow: GFAC and XBaya

WRF-Static running on Tungsten LEAD: A Weather Forecasting Workflow OGCE Workflow Tutorial

Nightly builds on 14 linux, Mac PPC, and Mac X86

JMeter test suite

SOME OGCE SERVICES Information Web Services and build framework

Resource Discovery Service Extracted from the TeraGrid User Portal – Contributed by Rion Dooley, TACC Axis2 Web service Integrates information from INCA, GPIR services. – What machines are in my Grid – Which ones are actually running? Works with TeraGrid deployed services, but you can use it with your own information service installations.

Resource Prediction Service (RPS) Predicts an optimal set of resources for running scientific applications – Predicts a set of resources on which the sum of data transfer time, queue wait time and compute time for the application will be minimum – Data transfer time: Uses input data size and NWS info – Queue wait time: Uses QBETS info – Compute time: Uses application performance info Axis2 web service with a MySQL backend RPS is a subset of the Fault Tolerance and Recovery service used in LEAD and VGrADS

Packaging Services Everything builds with one command – mvn clean install We use Apache Maven 2 for builds. – Structured, modular builds and consistent layouts Build a single module: – mvn clean install –f somemod/pom.xml We include Apache Tomcat in the download, so all you need is Java and MySQL. Suitable also for the NMI build and test system. Want the Javadoc? mvn javadoc:javadoc

Upcoming Services XMC-CAT metadata cataloging service with JSDL sample implementation. Swarm Web Service for mass job submission and management. – ml ml GPIR Web Service for information on your Grid. This is being repackaged; older packaged version (but same code) is already available. GFAC and XRegistry services – Available now using XSUL Web service engine

OGCE and Web 2.0

Enterprise ApproachWeb 2.0 Approach JSR 168 PortletsGoogle Gadgets, Widgets, badges Server-side integration and processingAJAX, client-side integration and processing, JavaScript SOAPRSS, Atom, JSON WSDLREST (GET, PUT, DELETE, POST) Portlet ContainersOpen Social Containers (Orkut, LinkedIn, Shindig); Facebook; StartPages User Centric GatewaysSocial Networking Portals Workflow managers (Taverna, Kepler, XBaya, etc) Mash-ups WS-Eventing, WS-Notification, Enterprise Messaging Blogging and Micro-blogging with REST, RSS/Atom, and JSON messages (Blogger, Twitter) Semantic Web: RDF, OWL, ontologiesMicroformats, folksonomies

OGCE Strategies for Web 2.0 Java COG --> JavaScript COG (Cyberaide) – JavaScript can be integrated with many different frameworks: PHP, JSP, JSF, RoR, etc – Integration with JSON-REST style services. – Enable mashups, integrate with Jquery, etc. Portlets--> Google and Open Social Gadgets JSR 168 Containers-->Open Social Containers – Orkut, LinkedIn, MySpace, etc – Apache Shindig, Sakai 3, other open source Web Services --> REST Services

Authentication How to authenticate through the Cyberaide JavaScript API? // construct an authenticator object for authentication // using myproxy // make sure to use the attributes keys specified here. var auth = org.cyberaide.js.jsAuthenticator(url); auth.setAttribute("host", "myproxy.teragrid.org"); auth.setAttribute("port", 7512); auth.setAttribute("user", ’YOURTGUSERNAME'); auth.setAttribute("password", ’YOURPASSWORD'); // currently only 'myproxy' is supported auth.setProvider("myproxy"); at Rochester Institute of Technology

Cyberaide JavaScript API Summary Authentication Job and Workflow Submission Job Monitoring File management – Listing, upload, download, third party transfer, etc. Graphical components

Example OGCE Google Gadgets: MOAB dashboard, remote directory browser, and proxy management. Built with GTLAB.

TeraGrid Gadgets using the OpenSocial APIs Six teragrid gadgets have been published Slide courtesy of Wenjun Wu and Thomas Uram

TeraGrid Gadgets on iGoogle Search for “TeraGrid” in iGoogle Gadget Directory Add two TeraGrid gadgets here Open Life Sciences Gateway gadgets Slide courtesy of Wenjun Wu and Thomas Uram

Pilot Open Social Project: SIDGrid Gadget Container Integration (W.Wu) Built on top of Shindig OAuth Security Container-Gadget JSON-RPC Communication

TeraGrid REST Information Services /profiles GET – list all user profiles PUT – unused POST – add a new user profile DELETE – unused /profiles/id GET – get user profile details PUT – update user profile POST – unused DELETE – delete user profile /resources GET – list all resources PUT – unused POST – add resource DELETE – unused /resources/id GET – get resource details PUT – update resource information POST - unused DELETE – delete resource /accounts GET – list all accounts PUT – unused POST – add account DELETE - unused /accounts/id GET – get account details PUT – update account details POST - unused DELETE – delete account Slide courtesy of Rion Dooley

Putting It All Back Together Time to put it all together again. – Working Grid gadgets and mash-up examples. – Running in an open social container – Coupled with Axis and REST information services – Continued support for workflows Expect this at SC09