E-Science Centre, CCLRC Daresbury Laboratory

Slides:



Advertisements
Similar presentations
OMV Ontology Metadata Vocabulary April 10, 2008 Peter Haase.
Advertisements

Rob Allan Daresbury Laboratory A Web Portal for the National Grid Service Xiaobo Yang, Dharmesh Chohan, Xiao Dong Wang and Rob Allan CCLRC e-Science Centre,
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
May 21, A Developers Viewpoint Prof Mark Baker School of Systems Engineering University of Reading Tel:
A Virtual Research Environment (Extending the Grid to the Desktop)
A Prototype Implementation of a Framework for Organising Virtual Exhibitions over the Web Ali Elbekai, Nick Rossiter School of Computing, Engineering and.
Web Services Nasrullah. Motivation about web service There are number of programms over the internet that need to communicate with other programms over.
Daresbury Laboratory Enabling Science with Grid Technology Jamie Rintelman, Kerstin Kleese-Van Dam, Rik Tyer STFC-Daresbury Laboratory; Daresbury, Cheshire,
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
R.J. Allan Portals and User Interfaces for Data Management and Grid Computing Rob Allan Leader of the Grid Technology Group 9 th.
R e D R e S S Case Study in e-Social Science Building Collaborative e-Research Environments JISC Consultation Workshops, 23/2/04 and 5/3/04 Rob Allan (CCLRC.
Building New SOA and AJAX- Based Business Applications Mark Barnard R&D Manager – Natural Business Services Software AG (Canada) Inc.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Integrating SOA and the Application Development Framework Shaun O’Brien Principal Product Manager – Oracle JDeveloper / ADF.
John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley
Grid Programming Environment (GPE) Grid Summer School, July 28, 2004 Ralf Ratering Intel - Parallel and Distributed Solutions Division (PDSD)
UNIT-V The MVC architecture and Struts Framework.
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
Environment from the Molecular Level: An e-science project for modelling the atomistic processes involved in environmental issues (funded by NERC)
User requirements for and concerns about a European e-Infrastructure Steven Newhouse, Director.
Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.
© Geodise Project, University of Southampton, Data Management in Geodise Zhuoan Jiao, Jasmin Wason and Marc Molinari
Lecturer: Prof. Piero Fraternali, Teaching Assistant: Alessandro Bozzon, Advanced Web Technologies: Struts–
Why do we need PGI? Shahbaz Memon Jülich Supercomputing Centre (JSC)
1 All-Hands Meeting 2-4 th Sept 2003 e-Science Centre The Data Portal Glen Drinkwater.
Cracow Grid Workshop, October 27 – 29, 2003 Institute of Computer Science AGH Design of Distributed Grid Workflow Composition System Marian Bubak, Tomasz.
© DATAMAT S.p.A. – Giuseppe Avellino, Stefano Beco, Barbara Cantalupo, Andrea Cavallini A Semantic Workflow Authoring Tool for Programming Grids.
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
Shannon Hastings Multiscale Computing Laboratory Department of Biomedical Informatics.
1 Geospatial and Business Intelligence Jean-Sébastien Turcotte Executive VP San Francisco - April 2007 Streamlining web mapping applications.
Rob Allan Daresbury Laboratory A Web Portal for the National Grid Service Xiaobo Yang, Dharmesh Chohan, Xiao Dong Wang and Rob Allan CCLRC e-Science Centre,
Grid Computing & Semantic Web. Grid Computing Proposed with the idea of electric power grid; Aims at integrating large-scale (global scale) computing.
17 th October 2005CCP4 Database Meeting (York) CCP4(i)/BIOXHIT Database Project: Scope, Aims, Plans, Status and all that jazz Peter Briggs, Wanjuan Yang.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Building the e-Minerals Minigrid Rik Tyer, Lisa Blanshard, Kerstin Kleese (Data Management Group) Rob Allan, Andrew Richards (Grid Technology Group)
EGEE is a project funded by the European Union under contract IST R-GMA: Production Services for Information and Monitoring in the Grid John.
The EDGeS project receives Community research funding 1 Porting Applications to the EDGeS Infrastructure A comparison of the available methods, APIs, and.
Project Database Handler The Project Database Handler is a brokering application that mediates interactions between the project database and the external.
AstroGrid How to make your data famous OR One-click PhD creation.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
NeuroLOG ANR-06-TLOG-024 Software technologies for integration of process and data in medical imaging A transitional.
Easy Access to Grid infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) Dr. Mathias Stuempert (KIT-SCC, Karlsruhe) EGEE User Forum 2008 Clermont-Ferrand,
Some comments on Portals and Grid Computing Environments PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics,
WP3 Information and Monitoring Rob Byrom / WP3
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Using the ARCS Grid and Compute Cloud Jim McGovern.
1 Distributed System using J2EE. 2 What is J2EE?  J2EE (Java2 Enterprise Edition) offers a suite of software specification to design, develop, assemble.
John Kewley e-Science Centre All Hands Meeting st September, Nottingham GROWL: A Lightweight Grid Services Toolkit and Applications John Kewley.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
INFSO-RI Enabling Grids for E-sciencE Web Services Mike Mineter National e-Science Centre, Edinburgh.
Rob Allan Daresbury Laboratory NW-GRID Training Event 26 th January 2007 Next Steps R.J. Allan CCLRC Daresbury Laboratory.
EGEE is a project funded by the European Union under contract IST Introduction to Web Services 3 – 4 June
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
Data Bridge Solving diverse data access in scientific applications
WEB SERVICES.
June 1, 2008 Michael Erdmann, Peter Haase, Holger Lewen, Rudi Studer
Collaborations and Interactions with other Projects
Some Basics of Globus Web Services
AMGA Web Interface Salvatore Scifo INFN sez. Catania
Grid Portal Services IeSE (the Integrated e-Science Environment)
Viet Tran Institute of Informatics Slovakia
Project tracking system for the structure solution software pipeline
Knowledge Based Workflow Building Architecture
ApplinX Rod Carlson Senior Technical Lead.
Distributed System Using Java 2 Enterprise Edition (J2EE)
AMGA Web Interface Vincenzo Milazzo
Large Scale Distributed Computing
SDMX IT Tools SDMX Registry
Presentation transcript:

E-Science Centre, CCLRC Daresbury Laboratory The GROWL Project Rob Allan E-Science Centre, CCLRC Daresbury Laboratory r.j.allan@dl.ac.uk

Institutions need Autonomy and Security Host – client relationship Example solution suggested by Web server - browser Communication must be initiated by client because of firewall around client’s institution. Can use a proxy or gateway.

The Grid “Client Problem” Many clients want to access a few Grid-enabled resources Grid Core Consumer clients: PC, TV, video, AG Middleware e.g. Globus Workplace: desktop clients Portable clients: phones, laptop, pda, data entry… Grid Core

This was presented in the JISC VRE Roadmap Summary of Options Provide a Grid with heavyweight functionality (Globus?) - Grid-enabled compute and data servers analogous to Web servers; Implied need for client-server software architecture, e.g. using Web services: Web-based portal with familiar browser Client programming library - API in C, C++ Java, Perl, Python, R etc. Ability to link to existing applications/ GUIs Command-based shell interface Drag and Drop desktop interface Need a published set of services on Grid hosts – OGSA model, registry, semantics; Need easy development and deployment framework for applications and client tools - encourage community contribution via an open process. This was presented in the JISC VRE Roadmap

GROWL, potted History GROWL: Grid Resources on Workstation Library http://www.growl.org.uk Discussion started on underground with Peter Coveney, 18/12/03 after attending the GOSC meeting convened by Tony Hey in London. Prototype developed by RJA to expose the Globus services provided in HPCPortal as C-client Web services Proposal to and funding by JISC under the VRE Progamme £150k for 18 months (developers at Cambridge, Daresbury, Lancaster) SABRE-R, ESRC pilot project Follow-on projects, GROWL will be used in CQeSS, ESRC e-Infrastructure, e-CCP, NW-GRID, etc. Strix Nebulosa, the Great Grey Owl

GROWL Modules and Server GROWL is designed to allow “heritage” applications to be Grid enabled. Written in C/ C++ with wrappers (e.g. Fortran, R, Python…) 100% non-Java!!! John and Dan will explain technical details in other talks. I will quickly mention additional work on AgentX RCommands Future interest: Work with others to standardise technology and functionality Other funding opportunities? Standarise API (SAGA, DRMAA, etc?) Additional modules, e.g. OGSA-DAI WSRF?

AgentX Framework - Example DL_POLY3 (CCP5) integrated with CCP1 GUI Mappings DL_POLY3 CONTROL REVCON.xml CCP1 GUI Mappings AgentX Core library written in C Wrappers for Python, Perl and Fortran Hides the complexities of dealing with XML Simple API Enables straightforward exchange of information AgentX core AgentX core CONFIG.xml Fortran wrapper Python wrapper Standard Ontology Standard Mappings

“Grand Challenge” science and the e-Minerals VO Beginning to use AgentX to link together many applications, DL_POLY, Siesta, GULP etc. Level of theory Adsorbing surface Contaminant Quantum Monte Carlo Large empirical models Linear-scaling quantum mechanics Organic molecules Halogens Metallic elements Clays, micas Aluminosilicates Natural organic matter Phosphates Carbonates Oxides/hydroxides Sulphides

RCommands (1) RCommands are shell tools and associated Web services for meta-data manipulation RCommands primary use case is within e-Minerals workflow, i.e. to allow automatic insertion of meta-data as a post processing action

RCommands (2) Link into workflows Client Side Server Side gSOAP BPEL Engine Link into workflows SOAP Server Side RCommand Server Code JDBC Axis Relational Database

Architecture RCommand Server Code RPC Endpoints MDE JSP, Servlets & Beans RCommand Server Code Relational Database Expose same functionality/ code base via a variety of interfaces

Subset of Schema Title Description Notes Start / End Dates Originator Name Value Pairs Title Description Notes Start / End Dates Originator Name URI

Authentication / Session RCommand Clients Function Domain RCommand Authentication / Session Rinit Rexit Rpasswd Entity Operations Rls Rcreate Rrm Parameter Operations Rannotate Rsearch Permissions Rchmod