©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture 20081009 1 Workflow on the GRIDs surface GRIDs ‘surface’ provides.

Slides:



Advertisements
Similar presentations
X-SIGMA (An XML based Simple data Integration system for Gathering, Managing and Accessing scientific experimental data in grid environments) Karpjoo
Advertisements

©STFC/Keith G JefferyThe Future of GRIDs: A European Perspective The Future of GRIDs: A European Perspective Keith G Jeffery Science and Technology.
© Keith G Jeffery, Anne G S Asserson GL7: Nancy: December Grey in the R&D Process Keith G Jeffery Director, IT CCLRC
Keith G Jeffery Director, IT Research Workflow Process on the GRIDs Surface Keith G Jeffery President euroCRIS.
©CLRC/ITD/Keith G JefferyGRIDsN+N:San Francisco The Information and Knowledge Layers of the GRIDs Architecture Keith G Jeffery Director, IT.
1 CRIS: Research Organisation View of the e-Infrastructure Keith G Jeffery STFC Anne Asserson UiB.
©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture CRIS Stakeholders, Benefits, History, Process, Architecture.
1 Richard White Design decisions: architecture 1 July 2005 BiodiversityWorld Grid Workshop NeSC, Edinburgh, 30 June - 1 July 2005 Design decisions: architecture.
©STFC/Keith G JefferyELPUB 2007 Keynote Technical Infrastructure and PolicyFramework for Maximising the Benefits from Research Output Keith.
EPOS e-Infrastructure Keith G Jeffery Natural Environment Research Council (with Jean-Pierre Vilotte and Alberto Michelini)
Grid Programming Environment (GPE) Grid Summer School, July 28, 2004 Ralf Ratering Intel - Parallel and Distributed Solutions Division (PDSD)
Support for Automatic Workflow Composition in Semantic Grid Environemnt Tomasz Gubała, Marian Bubak, Maciej Malawski Institute of Computer Science and.
UMIACS PAWN, LPE, and GRASP data grids Mike Smorul.
Semantic Web and Web Mining: Networking with Industry and Academia İsmail Hakkı Toroslu IST EVENT 2006.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Computer Science and Engineering A Middleware for Developing and Deploying Scalable Remote Mining Services P. 1DataGrid Lab A Middleware for Developing.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
Advances in Technology and CRIS Nikos Houssos National Documentation Centre / National Hellenic Research Foundation, Greece euroCRIS Task Group Leader.
GCC 2006 Panel: Grid Research and Engineering Vs Standards Dr. Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer.
©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture The Problem the traditional divide between –the individual.
An Answer to the EC Expert Group on CLOUD Computing Keith G Jeffery Scientific Coordinator.
NAREGI WP4 (Data Grid Environment) Hideo Matsuda Osaka University.
Chapter 1: Computing with Services Service-Oriented Computing: Semantics, Processes, Agents – Munindar P. Singh and Michael N. Huhns, Wiley, 2005.
Integrated e-Infrastructure for Scientific Facilities Kerstin Kleese van Dam STFC- e-Science Centre Daresbury Laboratory
© euroCRIS/Keith G Jeffery 1 Achievements & Experience of euroCRIS Achievements and Experience of the euroCRIS Organisation Keith G Jeffery President,
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Position Paper for Data Fabric IG Interoperability, Infrastructures and Virtuality Gary Berg-Cross, Keith.
Miguel Branco CERN/University of Southampton Enabling provenance on large-scale e-Science applications.
ICTP, April 2007 CIMA in Australia Ian Atkinson HPRC Manager, ITR School of Maths, Physics and IT James Cook University.
©Keith G Jeffery/ Anne AssersonSupporting the Research Process with a CRIS CRIS Supporting the Research Process with a CRIS Keith G Jeffery Director.
The Grid: What Next? Karim Djemame Web Science Research Group School of Computing.
INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,
Design and run-time bandwidth contracts for pervasive computing middleware Peter Rigole K.U.Leuven – Belgium
PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Middleware for Grid Computing and the relationship to Middleware at large ECE 1770 : Middleware Systems By: Sepehr (Sep) Seyedi Date: Thurs. January 23,
Keith G Jeffery Director, IT & International Strategy ARCHITECTURE Utilising IT Research to Meet the Requirement for a CRIS.
Grids - the near future Mark Hayes NIEeS Summer School 2003.
SEEK Welcome Malcolm Atkinson Director 12 th May 2004.
Cracow Grid Workshop ‘06 17 October 2006 Execution Management and SLA Enforcement in Akogrimo Antonios Litke Antonios Litke, Kleopatra Konstanteli, Vassiliki.
© euroCRIS/Keith G Jeffery 1 euroCRIS and e-Infrastructure Keith G Jeffery President, euroCRIS Premium Members.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
Keith G Jeffery Director, IT What does a CRIS add to Open Access Publications ?
Enabling e-Research in Combustion Research Community T.V Pham 1, P.M. Dew 1, L.M.S. Lau 1 and M.J. Pilling 2 1 School of Computing 2 School of Chemistry.
©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture CRIS “a Current Research Information System, commonly.
1 The EDIT System, Overview European Commission – Eurostat.
Using DAML+OIL Ontologies for Service Discovery in myGrid Chris Wroe, Robert Stevens, Carole Goble, Angus Roberts, Mark Greenwood
A centre of expertise in digital information management Shaping the e-future? Grids, Web Services and Digital Libraries Professor Tony.
Resource Brokering on Complex Grids EUROGRID and GRIP Presented by John Brooke ESNW October 3/4 UK/Japan N+N.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Chapter 1: Computing with Services Service-Oriented Computing: Semantics, Processes, Agents – Munindar P. Singh and Michael N. Huhns, Wiley, 2005.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
OWL-S: As a Semantic Mark-up Language for Grid Services By Narendranadh.J.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
© Copyright AARNet Pty Ltd PRAGMA Update & some personal observations James Sankar Network Engineer - Middleware.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
Data Grid Research Group Dept. of Computer Science and Engineering The Ohio State University Columbus, Ohio 43210, USA David Chiu and Gagan Agrawal Enabling.
+ Support multiple virtual environment for Grid computing Dr. Lizhe Wang.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
MSF and MAGE: e-Science Middleware for BT Applications Sep 21, 2006 Jaeyoung Choi Soongsil University, Seoul Korea
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
©CLRC/ITD/Keith G JefferyEuroCRIS May 2001: Introduction to GRIDs May Introduction to GRIDs Keith G Jeffery Director, IT & Head, ITD
Data Grids, Digital Libraries and Persistent Archives: An Integrated Approach to Publishing, Sharing and Archiving Data. Written By: R. Moore, A. Rajasekar,
Clouds , Grids and Clusters
Globus —— Toolkits for Grid Computing
Tools for Composing and Deploying Grid Middleware Web Services
NextGRID: From Compute Grids to Grid SOAs and beyond
Presentation transcript:

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Workflow on the GRIDs surface GRIDs ‘surface’ provides –Computational capabilities of GRID –Information presentation capabilities of WWW –Information management capabilities But not yet environment for workflow

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture The GRIDs Architecture Knowledge Layer Information LayerComputation / Data Layer Data to Knowledge Control

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture The GRIDs Architecture Data to Knowledge Control Particle Physics ApplicationGenomics Application Environmental ApplicationE-Business Application

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture A POSSIBLE ARCHITECTURE U:USER S:SOURCE R:RESOURCE Rm:Resource Metadata Ra:Resource Agent Ua:User Agent Um:User Metadata Sm:Source Metadata Sa:Source Agent brokers The GRIDs Environment

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture A Brief History of GRIDs 1G: custom-made architecture machines to user –Pioneering metacomputing 2G: proprietary standards and interfaces –I-WAY  GLOBUS, UNICORE, CONDOR, LEGION  AVAKI 2.5G: added in FTP, SRB, LDAP, AccessGRID 3G: adopted W3C concepts for open interfaces – OGSA / OGSI: note especially OGSA/DAI –But built on 2.G foundations e-Science Apps e-Science R&D

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture But….. This comes nowhere near the requirements as originally defined for GRIDs Too low-level (programmer not end-user level) –Insufficient representativity –Insufficient expressivity –Insufficient resilience –Insufficient dynamic flexibility

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Services: Challenges 1  Description  Location  Requirements matching  Composing  Utilising  metadata Functional Program Code (to deliver the service) Service description (descriptive metadata) Input Parameter definitions Output Parameter definitions Restrictions on use of service (restrictive metadata)

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Services: Challenges 2  Composition  End-to-end FR satisfaction  End-to-end NFRs satisfaction  Avoiding emergent properties  Conditions of use of services  Processes  wrapped with data  wrapped with processing, storage etc  wrapped with real estate  wrapped with staff Multiple Instances Parallel execution

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture e-,i-,k-infrastructure server detectors e- i- k- Deduction & induction – human or machine Physical Information Systems server

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Middleware – and as SOKUs e- i- k- Lower middleware (hides physical heterogeneity) Upper middleware (hides syntactic heterogeneity) K- upper middleware (resolves semantic heterogeneity) K- lower middleware (presents declared semantics)

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Workflow on the GRIDs Surface Nirvana is –GRIDs ‘surface’ Providing computation, information presentation and information management –Plus Self* resilience –Plus capabilities to support workflow

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Overall : The Way Forward SCIENTIFIC DATASETS Data Information Knowledge PUBLICATIONS Data Information Knowledge CRIS Management of Research

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture PUBLICATIONS Data Information Knowledge Overall : The Way Forward Digital Curation Facility SCIENTIFIC DATASETS Data Information Knowledge CRIS Management of Research CDR (CERIF) Portal with knowledge-assisted user interface

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Overall : The Way Forward Digital Curation Facility SCIENTIFIC DATASETS Data Information Knowledge PUBLICATIONS Data Information Knowledge metadata Portal with knowledge-assisted user interface

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Overall : The Way Forward Digital Curation Facility SCIENTIFIC DATASETS Data Information Knowledge PUBLICATIONS Data Information Knowledge metadata publish validate Portal with knowledge-assisted user interface

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Overall : The Way Forward Digital Curation Facility SCIENTIFIC DATASETS Data Information Knowledge PUBLICATIONS Data Information Knowledge metadata publish validate GRIDs Portal with knowledge-assisted user interface Ambient, Pervasive Access

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Overall : The Way Forward Portal with knowledge-assisted user interface Digital Curation Facility SCIENTIFIC DATASETS Data Information Knowledge PUBLICATIONS Data Information Knowledge metadata publish validate GRIDs Ambient, Pervasive Access

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Overall : The Way Forward Portal with knowledge-assisted user interface Digital Curation Facility SCIENTIFIC DATASETS Data Information Knowledge PUBLICATIONS Data Information Knowledge metadata publish validate GRIDs Ambient, Pervasive Access

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Overall : The Way Forward Portal with knowledge-assisted user interface Digital Curation Facility SCIENTIFIC DATASETS Data Information Knowledge PUBLICATIONS Data Information Knowledge metadata publish validate GRIDs Ambient, Pervasive Access

©euroCRIS/Keith G JefferyCRIS: Stakeholders, Benefits, History, Process, Architecture Three Steps to Nirvana Complete Process ICT Support Metadata and Data Exchange Standards Workflow on the GRIDs Surface The Perfect CRIS