1. 1 The LDCM Grid Prototype Infrastructure Demonstration Jeff Lubelczyk X45225 Jeffrey.T.Lubelczyk@nasa.gov June 24, 2004

2. 2 Prototype Introduction The objective of the LDCM Grid Prototype (LGP) is to assess the applicability and effectiveness of a data grid to serve as the infrastructure for research scientists to generate virtual Landsat-like data products Grid technology serves as a key enabler in the creation of scientific Virtual Organizations, promotes a flexible and scalable infrastructure, facilitates the exchange of data, and maximizes the use of available resources A Grid infrastructure allows scientists at resource-poor sites access to remote resource-rich sites Enables greater scientific research Maximizes existing resources Limits the expense of building new facilities

3. 3 LGP Grid Key POCs LDCM Sponsors LDCM - Bill Ochs, Matt Schwaller, Harper Pryor Code 580 - Peter Hughes LGP Team members Jeff Lubelczyk (Lead) Gail McConaughy (Branch Principal) Beth Weinstein (Software Lead) Ben Kobler (Hardware, Networks) Eunice Eng (Software Dev, Data) Valerie Ward (Software Dev, Apps) Ananth Rao ([SGT] Software Arch/Dev, Grid Expertise) Brooks Davis ([Aero] Globus/Grid Admin Expert) Glenn Zenker ([QSS] System Admin) IPG Judith Utley (ARC IPG) USGS Chris Doescher (POC) Mike Neiers (Systems Support) Science Input Robert Wolfe (Blender, Data) Ed Masuoka (MODIS, Grid)

4. 4 Let’s look at what Grid can do for you PI Science User Land Data (Storage) Subset.exe MOD09_1.dat MOD09_2.dat Commodity Resources (Clusters, Data Storage) Science Team Facility (CPU w/ storage) ALI_1.dat Landsat_1.dat Blend.exe GSI (Globus Security Inf) Authentication - PKI Authorization Storage Request Broker Metadata Catalog Replica Location Service Storage Resource Management Resource Discovery Monitor & Discover Service (MDS) Storage Management Remote Job Execution GRAM Subset.exe ALI_1.dat Landsat_1.dat MODISSub.dat Blend.exe SimLandsat.dat MODISSub.dat SimLandsat.dat

5. 5 What the current data grid provides Security Authentication (PKI) Authorization Resource Discovery Monitoring and Discovery Service (MDS) [LDAP like] Storage Management and Brokering Metadata catalogs Replica Location Service Allows use of logical file names Physical locations are hidden Storage Resource Management –Retrieve data using physical file names –GridFTP –Data formats and subsetting Job Scheduling and Resource Allocation GRAM (Globus Resource Allocation Manager) -- Provides a single common API for requesting and using remote system resources

6. 6 High Level Schedule Major Milestones 12/03 - Prototype start 6/04 - Demo of Capability 1 grid infrastructure Demonstrate simple file transfers and remote application execution at multiple GSFC labs and USGS EDC Ready to build application on top of basic infrastructure 12/04 - Demo of Capability 1 Provide and demonstrate a grid infrastructure that enables a user program to access and process remote heterogeneous instrument data at multiple GSFC labs and USGS EDC 3/05 - Demo of Capability 2 grid infrastructure Demonstrate file transfers and remote application execution at multiple GSFC labs, USGS EDC, and ARC IPG 6/05 - Demo of Capability 2 Enable the data fusion (blender) algorithm to obtain datasets, execute, and store the results on any resource within the Virtual Organization (GSFC labs, USGS EDC, ARC IPG)

7. 7 Next Steps -- C1 Data and Tools Obtain and evaluate C1 data sets MOD09 -- MODIS Surface Reflectance ALI, LandSat Investigate Sample Applications MRT -- MODIS Reprojection Tool Provides subsetting, reformatting and reprojection of MODIS products UAH Subsetter Visualization Tools -- Demonstrate Results WebWinds HDFLook

8. 8 Some Early Observations With Grid Infrastructure Without Grid Infrastructure End User One login policy Multiple userid/pswd Multiple security policies Project Mgmt & Dev Community hardened Grid Infrastructure Resources focused on Application Interfaces already defined -- reduced risk Develop from scratch High security dev -- no audit of code needed Maint & Ops Security Peer reviewed code Expert community investment Security Multiple site Ad hoc Home grown