1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong

Slides:



Advertisements
Similar presentations
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
Advertisements

© 2007 Open Grid Forum Data Management Challenge - The View from OGF OGF22 – February 28, 2008 Cambridge, MA, USA Erwin Laure David E. Martin Data Area.
GT 4 Security Goals & Plans Sam Meder
Data Management Expert Panel - WP2. WP2 Overview.
The Anatomy of the Grid: An Integrated View of Grid Architecture Carl Kesselman USC/Information Sciences Institute Ian Foster, Steve Tuecke Argonne National.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
Database Architectures and the Web
Distributed Systems basics
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE SAN DIEGO SUPERCOMPUTER CENTER Particle Physics Data Grid PPDG Data Handling System Reagan.
High Performance Computing Course Notes Grid Computing.
Seminar Grid Computing ‘05 Hui Li Sep 19, Overview Brief Introduction Presentations Projects Remarks.
GGF Toronto Spitfire A Relational DB Service for the Grid Peter Z. Kunszt European DataGrid Data Management CERN Database Group.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Grids and Grid Technologies for Wide-Area Distributed Computing Mark Baker, Rajkumar Buyya and Domenico Laforenza.
4b.1 Grid Computing Software Components of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b.
UMIACS PAWN, LPE, and GRASP data grids Mike Smorul.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
Grid Toolkits Globus, Condor, BOINC, Xgrid Young Suk Moon.
Technology Overview. Agenda What’s New and Better in Windows Server 2003? Why Upgrade to Windows Server 2003 ?  From Windows NT 4.0  From Windows 2000.
Presenter: Dipesh Gautam.  Introduction  Why Data Grid?  High Level View  Design Considerations  Data Grid Services  Topology  Grids and Cloud.
SeLeNe - Architecture George Samaras Kyriakos Karenos Larnaca – April 2003 THE UNIVERSITY OF CYPRUS.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Dataset Caitlin Minteer & Kelly Clynes.
ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.
San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center National Partnership for Advanced.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
File and Object Replication in Data Grids Chin-Yi Tsai.
Production Data Grids SRB - iRODS Storage Resource Broker Reagan W. Moore
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
1 4/23/2007 Introduction to Grid computing Sunil Avutu Graduate Student Dept.of Computer Science.
Tools for collaboration How to share your duck tales…
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Scientific Data Grid & China-VO Kai Nan Computer Network Information Center Chinese Academy of Sciences November 27, 2003.
Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Internet2 AdvCollab Apps 1 Access Grid Vision To create virtual spaces where distributed people can work together. Challenges:
Replica Management Kelly Clynes. Agenda Grid Computing Globus Toolkit What is Replica Management Replica Management in Globus Replica Management Catalog.
1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,
Introduction to The Storage Resource.
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Biomedical Informatics Research Network The Storage Resource Broker & Integration with NMI Middleware Arcot Rajasekar, BIRN-CC SDSC October 9th 2002 BIRN.
Features Of SQL Server 2000: 1. Internet Integration: SQL Server 2000 works with other products to form a stable and secure data store for internet and.
Globus: A Report. Introduction What is Globus? Need for Globus. Goal of Globus Approach used by Globus: –Develop High level tools and basic technologies.
EGI-Engage Data Services and Solutions Part 1: Data in the Grid Vincenzo Spinoso EGI.eu/INFN Data Services.
© Oxford University Press 2011 DISTRIBUTED COMPUTING Sunita Mahajan Sunita Mahajan, Principal, Institute of Computer Science, MET League of Colleges, Mumbai.
1 Data Management for Internet Backplane Protocol by Tang Ming Assoc/Prof. Francis Lee School of Computer Engineering, Nanyang Technological University,
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
Vincenzo Spinoso EGI.eu/INFN
Data services on the NGS
Introduction to Data Management in EGI
University of Technology
Public Key Infrastructure from the Most Trusted Name in e-Security
The Anatomy and The Physiology of the Grid
The Anatomy and The Physiology of the Grid
Presentation transcript:

1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong

2 School of Computer, National University of Defense Technology GridDaEn Focus  Integration  Integrate heterogeneous mass storage resources located in multiple domains  Effective and secure data operations  Access, storage, dispatch, replication, and movement  Transparent Federated services  Name transparence  Location transparence  Protocol transparence  Uniform access

3 School of Computer, National University of Defense Technology Data Request Integrated Access and Processing GridDaEn Overview Environment Environment NFSCINF Data Center 1 OracleFTP Data Center 2 NFSXML Data Center n NFS Providing Data Publishing Data Response Deployment and Management

4 School of Computer, National University of Defense Technology GridDaEn Architecture  Access interface layer :  Data service interfaces for grid users  System service layer :  Metadata service  Data service  Monitor service  Security service  …  Data operation layer :  Access interfaces to fabric storage

5 School of Computer, National University of Defense Technology GridDaEn Architecture

6 School of Computer, National University of Defense Technology GridDaEn Components  DRB:Data Request Broker  MDIS:MetaData Information Server  GridDaEnSI:Security Infrastructure  GridEye:Monitor System  GridDaEnSM: System Management

7 School of Computer, National University of Defense Technology Distributed Data Access and Management Local MDIS MDIS Data Center A Data Center B Data Center C Client Optimization and Scheduling DRB High-level MDIS Local MDIS Data Service

8 School of Computer, National University of Defense Technology Data Service DRB: Data Request Broker  Access dispatch  System status and location of data  Data management  Uniform view : global logical view of data resources  Data replicating and moving  Data operation  Posix like APIs: create, open, read, write, close, etc.

9 School of Computer, National University of Defense Technology Data Service Federated DRB Service  Distributed collaborated service  Remote data access  Distributed data storage  Collaborate management  Distributed cache and replica  Management of cache and copies  On-demand storage and access  High performance data transport

10 School of Computer, National University of Defense Technology Metadata Information Service  Global MDIS server  System information  Index information  …  Local MDIS server  Domain information  File information  …

11 School of Computer, National University of Defense Technology Metadata Information Service  Metadata access and management  Uniform data namespace  Data locating, registration, and publishing  System information management  Data discovery  Replication policy and management  Nearest replica access  Control of replica privileges  Management of replica lifetime

12 School of Computer, National University of Defense Technology GridDaEn Security  GSI Compliance  Only use Proxy function of GSI  Separate GSI from Globus Toolkit  GridDaen Security Functionality :  Secure authentication  Communication encryption  Single sign on  Role-based authentication management  Multi-level user mapping

13 School of Computer, National University of Defense Technology GridEye: Monitor System  Based on GMA  Producer/consumer model  Web Service Interface  Multi-layer structure  Local monitor--LM  Global monitor--GM Global domain GM manager Local domain 1 ….. LM Sensor1 up-level system Local domain 1 ….. LM Sensor1 Local domain 1 ….. LM Sensor1

14 School of Computer, National University of Defense Technology GridDaEn Tools  User administrative client  User data operation client  UIs supported:  Graphic user interface  Command line  APIs and SDKs

15 School of Computer, National University of Defense Technology GridDaEn v 1.0 Features  Virtualized resources  Uniform operation and management  Coordination of autonomic system  High usability and security  Scalability  Multi-level authorization  Performance optimization

16 School of Computer, National University of Defense Technology Our Future Works  GridDaEn v1.0  Now available in our website    GridDaEn v1.1  web service Based  Available on  GridDaEn v2.0 beta  Structured data and semi- structured data supported  Related database,XML database  More native file system and access protocol supported  Performance optimization  Available on