Download presentation
Presentation is loading. Please wait.
Published byEugenia Crawford Modified over 9 years ago
1
ARGONNE CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader scope u E.g., international collaboration u E.g., GriPhyN in the large (GriPhyN-2) u E.g., Terascale l Creating a national cyberinfrastructure u What is our appropriate role
2
ARGONNE CHICAGO Ian Foster Discussion Points l Outreach to other disciplines u Biology, NEES, … l Virtual data toolkit u Inclusive or focused? u Resource issue, again l Achieving critical mass of resources to deliver on the complete promise
3
ARGONNE CHICAGO Ian Foster Planning l Review of Year 1 milestones l Top 10 research challenges l Demonstration projects l Research projects + goals l Workshops
4
ARGONNE CHICAGO Ian Foster Year 1 Milestones: Virtual Data l Develop basic information model to represent data elements, relationships between different data types, characteristics of data elements l Develop protocols for storing, discovering, and retrieving these models l Design and develop tools for creating, accessing and manipulating these models by interactive tools, & planning and scheduling tools l Deploy centralized metadata and replica catalog services. Develop tools for managing catalogs
5
ARGONNE CHICAGO Ian Foster Year 1 Milestones: Request Planning Develop generic models for representing execution plans. Define API and tools for constructing, traversing, and manipulating plan data structures. Develop protocols and formats for storing and exchanging execution plans. Develop uniform policy representation for code, data, and resource access. Develop a set of global and local policy scenarios that reflect the requirements of the user communities of the four physics experiments. l Develop simple optimization heuristics. Initial thrust will be on data movement only and focus on the use of alternative, or branching plans to compensate for both resource failure and changes in resource performance. Implement planning heuristics in prototype planning module. Evaluate performance of alternatives with simulation and model based studies, as well as execution on GriPhyN testbed.
6
ARGONNE CHICAGO Ian Foster Year 1 Milestones: Request Execution l Develop and evaluate a task control language capable of capturing the requirements, preferences and dependencies of a PVDG request. Implement prototype of an interpreter to a basic subset of the language l Enhance the "Gang Matching" capabilities of the ClassAd language and add these enhancements to the run-time support library l Explore ways to enhance the ClassAd language to support events and triggers l Develop a protocol for information exchange between the execution and planning agents
7
ARGONNE CHICAGO Ian Foster Year 1 Milestones: Virtual Data Toolkit l VDT-1 (Basic Grid Services) provides an initial set of grid enabling services and tools, including security, information, metadata, CPU scheduling, and data transport. VDT-1 will support efficient operation on O(10 TB) datasets, O(100) CPUs, and O(100 MB/s) wide area networks and will build extensively on existing technology.
8
ARGONNE CHICAGO Ian Foster Year 1 Milestones: CMS & LIGO l CMS u Build basic services and 1-2 prototype Tier 2 centers u Complete High Level Trigger milestones and perform studies with ORCA, the CMS object- oriented reconstruction & analysis software l LIGO u Develop a cataloging approach for data access methods & data location (metadata definition, design) u Develop an access and use model for LIGO data across the GriPhyN system
9
ARGONNE CHICAGO Ian Foster Year 1 Milestones: ATLAS and SDSS l SDSS u Build a prototype distributed analysis system l ATLAS u Connect the Athena analysis framework to a set of prototype virtual data services l Start with Globus replica catalog service l Athena EventSelector service to a replica catalog (reading) l Athena Replica catalog update service u Testing of basic file replication and transport using 500 GB testbeam data sets. u Develop Condor interface to the ATLAS testbed u Build basic services and 1-2 prototype Tier 2 centers
10
ARGONNE CHICAGO Ian Foster Schedule FebDoc: Data grid reference architecture v1 Doc: Virtual data architecture v1 Doc: LIGO application summary and virtual data requirements v1 Doc: CMS application summary and virtual data requirements v1 MarDoc: CAS policy architecture v0 AprVDT: GSI, GRAM, GridFTP, replica catalog, Condor-G Doc: SDSS application summary and virtual data requirements v1 App: CMS data analysis v1 [tests GSI, GRAM, Condor-G] MayDocs: Architecture, virtual data, appln requirements v2 JuneDoc: Data grid failure models and fault management research plan Doc: GriPhyN simulation architecture and integrated simulation R&D plan Doc: Proto: CAS policy architecture prototype App: LIGO data analysis v1 [tests replica catalog]
11
ARGONNE CHICAGO Ian Foster Schedule JulyProto: Virtual data catalog Proto: Request scheduler App: ATLAS data analysis AugTbed: Initial joint testbed with EDG SeptTbed: Joint testbed with EDG established with UC, ISI, CIT resources App: CMS data analysis over EDG-GriPhyN[-PPDG?] testbed
12
ARGONNE CHICAGO Ian Foster Breakouts/Workshops? l Virtual data representations u Naming, etc. l Simulation strategies and tools u UC, CIT, UCB, others? l Architecture u What are the essential (and missing) pieces l Failure models
13
ARGONNE CHICAGO Ian Foster Workloads l Three types: queries, objects, files l Koen Holtman’s modeling work l LIGO workloads (says Valerie)
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.