Building Shared Collections Using the Storage Resource Broker Storage Resource Broker Reagan W. Moore

Storage Resource Broker Data grid middleware Organize distributed data into shared collections. Support access through C library calls Java class libraries and GridSphere portal Python/Perl load libraries Interactive browsers (Web, Perl, PHP, Windows) Digital libraries (DSpace, Fedora). Manage properties of the shared collection needed by Preservation environments Digital libraries Real-time sensor systems Secure data management environments. Used in production SDSC collections Internationally shared collections

Data Grid Using a Data Grid – in Abstract Ask for data User asks for data from the data grid Data delivered The data is found and returned Where & how details are hidden

Using a Data Grid - Details Storage Resource Broker Data request goes to SRB Server Storage Resource Broker Metadata Catalog DB Server looks up data in catalog Catalog tells which SRB server has data 1 st server asks 2 nd for data The data is found and returned User asks for data

Using a Data Grid - Details SRB MCAT DB SRB Data Grid has arbitrary number of servers Complexity is hidden from users

Shared Collections Purpose of SRB data grid is to enable the creation of a collection that is shared between academic institutions Register digital entity into the shared collection Assign owner, access controls Assign descriptive, provenance metadata Manage state information Audit trails, versions, replicas, backups, locks Size, checksum, validation date, synchronization date, … Manage interactions with storage systems Unix file systems, Windows file systems, tape archives, … Manage interactions with preferred access mechanisms Web browser, Java, WSDL, C library, …

Shared Collections Data grids support the creation of shared collections that may be distributed across multiple institutions, sites, and storage systems. Digital libraries publish data, and provide services for discovery and display Persistent archives preserve data, managing the migration to new technology Real-time sensor systems federate name spaces across independent environments

Mark Ellisman Biomedical Informatics Research Network BIRN Data Grid

Mark Ellisman

National Science Digital Library URLs for educational material for all grade levels registered into repository at Cornell SDSC crawls the URLs, registers the web pages into a SRB data grid, builds a persistent archive 750,000 URLs 13 million web pages About 3 TBs of data

Southern California Earthquake Center SCEC Community Library Select Receiver (Lat/Lon) Output Time History Seismograms Select Scenario Fault Model Source Model Intuitive User Interface – –Pull-Down Query Menus – –Graphical Selection of Source Model – –Clickable LA Basin Map (Olsen) – –Seismogram/History extraction (Olsen) Access SCEC Digital Library – –Data stored in a data grid – –Annotated by modelers – –Standard naming convention – –Automated extraction of selected data and metadata – –Management of visualizations SCEC Digital Library

Terashake Data Handling Simulate 7.7 magnitude earthquake on San Andreas fault 50 Terabytes in a simulation Move 10 Terabytes per day Post-Processing of wave field Movies of seismic wave propagation Seismogram formatting for interactive on-line analysis Velocity magnitude Displacement vector field Cumulative peak maps Statistics used in visualizations Register derived data products into SCEC digital library

Humidity Climate Ecological Wireless Oceanography Wind Speed Climate Ecological Wireless Oceanography Seismic Geophysics ROADNet Sensor Network Data Integration Fire start Rain start Frank Vernon - UCSD/SIO

NARA Persistent Archive NARAU MdSDSC MCAT Original data at NARA, data replicated to U Md & SDSC Replicated copy at U Md for improved access, load balancing and disaster recovery Active archive at SDSC, user access Demonstrate preservation environment Authenticity Integrity Management of technology evolution Mitigation of risk of data loss Replication of data Federation of catalogs Management of preservation metadata Scalability Types of data collections Size of data collections Federation of Three Independent Data Grids

Logical Name Spaces Storage Repository Storage location User name File name File context (creation date,…) Access constraints Data Grid Logical resource name space Logical user name space Logical file name space Logical context (metadata) Control/consistency constraints Data Collection Data Access Methods (C library, Unix, Web Browser) Data is organized as a shared collection

Federation Between Data Grids Data Grid Logical resource name space Logical user name space Logical file name space Logical context (metadata) Control/consistency constraints Data Collection B Data Access Methods (Web Browser, DSpace, OAI-PMH) Data Grid Logical resource name space Logical user name space Logical file name space Logical context (metadata) Control/consistency constraints Data Collection A Access controls and consistency constraints on cross registration of digital entities

NOAO Astronomy Data Grid Chile Tucson, Arizona NCSA, Illinois A functioning international Data Grid for Astronomy Manchester-SDSC mirror Moved over 400,000 images

Irene Barg

Worldwide University Network Data Grid SDSC Manchester Southampton White Rose NCSA U. Bergen A functioning, general purpose international Data Grid for academic collaborations Manchester-SDSC mirror

WUNGrid Collections BioSimGrid Molecular structure collaborations White Rose Grid Distributed Aircraft Maintenance Environment Medieval Studies Music Grid e-Print collections DSpace Astronomy

BaBar High-energy Physics Stanford Linear Accelerator Lyon, France Rome, Italy San Diego RAL, UK A functioning international Data Grid for high-energy physics Manchester-SDSC mirror Moved over 170 TBs of data

SRB Objectives Automate all aspects of data discovery, access, management, analysis, preservation Security paramount Distributed data Provide distributed data support for Data sharing - data grids Data publication - digital libraries Data preservation - persistent archives Data collections - Real time sensor data

Unix Shell NT Browser, Kepler Actors http, Portlet, WSDL, OAI-PMH) DSpace, OpenDAP, GridFTP, Fedora Archives - Tape, Sam-QFS, DMF, HPSS, ADSM, UniTree, ADS Databases - DB2, Oracle, Sybase, Postgres, mySQL, Informix File Systems Unix, NT, Mac OSX Application ORB Storage Repository Abstraction Database Abstraction Databases - DB2, Oracle, Sybase, Postgres, mySQL, Informix C Library, Java Logical Name Space Latency Management Data Transport Metadata Transport Consistency & Metadata Management / Authorization, Authentication, Audit Linux I/O C++ DLL / Python, Perl, Windows Federation Management Storage Resource Broker 3.3.1

Data Grid Operations File access Open, close, read, write, seek, stat, synch, … Audit, versions, pinning, checksums, synchronize, … Parallel I/O and firewall interactions Versions, backups, replicas Latency management Bulk operations Register, load, unload, delete, … Remote procedures HDFv5, data filtering, file parsing, replicate, aggregate Metadata management SQL generation, schema extension, XML import and export, browsing, queries, GGF, Operations for Access, Management, and Transport at Remote Sites

Types of Risk Media failure Replicate data onto multiple media Vendor specific systemic errors Replicate data onto multiple vendor products Operational error Replicate data onto a second administrative domain Natural disaster Replicate data to a geographically remote site Malicious user Replicate data to a deep archive

How Many Replicas Three sites minimize risk Primary site Supports interactive user access to data Secondary site Supports interactive user access when first site is down Provides 2nd media copy, located at a remote site, uses different vendor product, independent administrative procedures Deep archive Provides 3rd media copy, staging environment for data ingestion, no user access

Deep Archive Z2Z1 Z3 Z2:D2:U2 Register Z3:D3:U3 Register Pull Pull Firewall Server initiated I/O DeepArchive StagingZone Remote Zone No access by Remote zones PVN

SRB Developers Reagan Moore - PI Michael Wan - SRB Architect Arcot Rajasekar - SRB Manager Wayne Schroeder - SRB Productization Charlie Cowart- inQ Lucas Gilbert - Jargon Bing Zhu - Perl, Python, Windows Antoine de Torcy - mySRB web browser Sheau-Yen Chen - SRB Administration George Kremenek- SRB Collections Arun Jagatheesan - Matrix workflow Marcio Faerman - SCEC Application Sifang Lu - ROADnet Application Richard Marciano - SALT persistent archives Contributors from UK e-Science, Academia Sinica, Ohio State University, Aerospace Corporation, … 75 FTE-years of support About 300,000 lines of C

Development SRB December 15, 2000 Basic distributed data management system Metadata Catalog SRB February 18, 2003 Parallel I/O support Bulk operations SRB August 30, 2003 Federation of data grids SRB April 30, 2006 Feature requests (quotas)

For More Information Reagan W. Moore San Diego Supercomputer Center