ATLAS Grid Requirements A First Draft Rich Baker Brookhaven National Laboratory.

Slides:



Advertisements
Similar presentations
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
Advertisements

BARNALI CHAKRABARTY. What is an Operating System ?
High Performance Computing Course Notes Grid Computing.
1 Module 1 The Windows NT 4.0 Environment. 2  Overview The Microsoft Operating System Family Windows NT Architecture Overview Workgroups and Domains.
Distributed Databases John Ortiz. Lecture 24Distributed Databases2  Distributed Database (DDB) is a collection of interrelated databases interconnected.
Condor-G: A Computation Management Agent for Multi-Institutional Grids James Frey, Todd Tannenbaum, Miron Livny, Ian Foster, Steven Tuecke Reporter: Fu-Jiun.
A Computation Management Agent for Multi-Institutional Grids
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
3.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 3: Introducing Active Directory.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 1: Introduction to Windows Server 2003.
Replication Monitoring University of Maryland Institute for Advanced Computer Studies.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Grids and Grid Technologies for Wide-Area Distributed Computing Mark Baker, Rajkumar Buyya and Domenico Laforenza.
Chapter 5: Configuring Users and Groups. Windows Vista User Accounts User accounts are the primary means of authentication Built-in Accounts –Administrator:
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 1: Introduction to Windows Server 2003.
Operating Systems Concepts 1. A Computer Model An operating system has to deal with the fact that a computer is made up of a CPU, random access memory.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 1: Introduction to Windows Server 2003.
A centralized system.  Active Directory is Microsoft's trademarked directory service, an integral part of the Windows architecture. Like other directory.
H-1 Network Management Network management is the process of controlling a complex data network to maximize its efficiency and productivity The overall.
GRID COMPUTING: REPLICATION CONCEPTS Presented By: Payal Patel.
Overview of Active Directory Domain Services Lesson 1.
Directory services Unit objectives
11 REVIEWING MICROSOFT ACTIVE DIRECTORY CONCEPTS Chapter 1.
Chapter 3.1:Operating Systems Concepts 1. A Computer Model An operating system has to deal with the fact that a computer is made up of a CPU, random access.
Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.
Grid Data Management A network of computers forming prototype grids currently operate across Britain and the rest of the world, working on the data challenges.
Designing Active Directory for Security
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Dataset Caitlin Minteer & Kelly Clynes.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 1: Introduction to Windows Server 2003.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
Processes and OS basics. RHS – SOC 2 OS Basics An Operating System (OS) is essentially an abstraction of a computer As a user or programmer, I do not.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
© Wiley Inc All Rights Reserved. MCSE: Windows Server 2003 Active Directory Planning, Implementation, and Maintenance Study Guide, Second Edition.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
1 Windows 2008 Configuring Server Roles and Services.
Introduction to dCache Zhenping (Jane) Liu ATLAS Computing Facility, Physics Department Brookhaven National Lab 09/12 – 09/13, 2005 USATLAS Tier-1 & Tier-2.
1 4/23/2007 Introduction to Grid computing Sunil Avutu Graduate Student Dept.of Computer Science.
Operating System What is an Operating System? A program that acts as an intermediary between a user of a computer and the computer hardware. An operating.
 Identify Active Directory functions and Benefits.  Identify the major components that make up an Active Directory structure.  Identify how DNS relates.
Chapter 5 McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved.
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
Client Server Network Model:
Distributed System Concepts and Architectures 2.3 Services Fall 2011 Student: Fan Bai
Virtual Batch Queues A Service Oriented View of “The Fabric” Rich Baker Brookhaven National Laboratory April 4, 2002.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Chapter 2 Introduction to Systems Architecture. Chapter goals Discuss the development of automated computing Describe the general capabilities of a computer.
Operating System Principles And Multitasking
Hands-On Microsoft Windows Server 2008 Chapter 4-Part 1 Introduction to Active Directory and Account Manager.
Virtual Private Grid (VPG) : A Command Shell for Utilizing Remote Machines Efficiently Kenji Kaneda, Kenjiro Taura, Akinori Yonezawa Department of Computer.
Module 3: Planning Administrative Access. Overview Determining the Appropriate Administrative Model Designing Administrative Group Strategies Planning.
Introduction to Grid Computing and its components.
Introduction to Active Directory
1 Chapter 13: RADIUS in Remote Access Designs Designs That Include RADIUS Essential RADIUS Design Concepts Data Protection in RADIUS Designs RADIUS Design.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore
HNC COMPUTING - Network Concepts 1 Network Concepts Network Concepts Network Operating Systems Network Operating Systems.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Overview of Active Directory Domain Services Lesson 1.
Chapter 1 Introducing Windows Server 2012/R2
GGF OGSA-WG, Data Use Cases Peter Kunszt Middleware Activity, Data Management Cluster EGEE is a project funded by the European.
Overview of Active Directory Domain Services
Objectives Differentiate between the different editions of Windows Server 2003 Explain Windows Server 2003 network models and server roles Identify concepts.
University of Technology
Unit 3 NT1330 Client-Server Networking II Date: 1/6/2016
湖南大学-信息科学与工程学院-计算机与科学系
Introduction to Operating Systems
Wide Area Workload Management Work Package DATAGRID project
Presentation transcript:

ATLAS Grid Requirements A First Draft Rich Baker Brookhaven National Laboratory

What Will the Grid do for ATLAS? Manage Data Manage Resources –CPU- Storage –Network- Other? Manage Security/Authentication Track Resource Utilization Control Task Execution

Manage Data Abstraction of Data from Physical Storage Global Name Space for Named Data Objects –i.e. /gds/atlas/myusername/myanalysis/myntuple –User and Group Level Access Control Allow Various Levels of User Control –Move, Copy, Replicate commands –“Smart” Features Should be Responsibility of Task Manager Perhaps

Manage Data (2) Replica Management –Most Data Will Be Read Only After Creation –Some Data Will Require Active Management –Replica Manager Should Understand Difference “Virtual Data” Not a Primary Concern (?) Compatible with Multiple File Systems, Databases, Storage Managers, … Local Control & Fault Tolerance

Manage Resources Keep Track of All Available Computing Resources Local Registration - Global Discovery Fault Tolerant Dynamic

Manage Security & Authentication User Credentials Created at Logon Allow Task Execution and Resource Use Across Administrative Domains Compatible with Various Local Security Implementations Must Scale Reasonably –Can We Manage Millions of User Accounts? –Will All Sites Allow “Generic” Users? A Thorny Issue!

Track Resource Utilization User & Group Accounting Sufficient to Serve as Input to Resource Allocation Algorithms Absolutely Essential if Resources are to be Shared “Fairly”

Control Task Execution Automagic? Perhaps Eventually Initial Focus –Allow Submission, Monitoring & Control –Fault Tolerance - Retry Options –Allow Specification of Input/Output Options –Output Collection / Merging

Commentary Requirements Will Evolve Good General Concept of What is Needed Specifics Needed, but Difficult to Define Without Experience Important to Start Using Grid Services in “Production” Environments ASAP To Be Continued…