1 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com 1 Sunshine State Education & Research Computing Alliance (SSERCA) Erik Deumens, PhD. Director, University of Florida Research

2 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com 2 Collaborative Research Storage SSERCA - DDN - Oct 22, 2014 DDN webinar - Oct 22,

3 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Sunshine State Education & Research Computing Alliance (SSERCA) Members include: Florida Atlantic University Florida International University Florida State University University of Central Florida University of Florida University of Miami University of South Florida Overview Create a distributed Storage Ecosystem Continuum of storage requirements, e.g. one size will not fit all Give researchers easy way to share small to very large data sets Smaller data sets (<10 GB) can be supported by other available services, e.g., Google Drive, Dropbox, etc. Keep cost very competitive Challenges & Vision

4 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Collaborative Research Storage Not a shared file system, no file locking Robust replication of data in hours or overnight Multiple administrative domains Mapping of user and group identities Manage permissions by users and groups Easy access to view High-performance access to process Functionality Needed

5 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com SSERCA DDN Partnership SSERCA – Sunshine State Education and Research Computing Alliance FAU, FIU, FSU, UCF, UF, UM, USF + UNF, UWF DDN – DataDirect Networks Architecture and design started Jan 2013 FSU, UF, and USF created test system for pilot project Proof of concept July 2014

6 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Distributed Storage Solution

7 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com USF FSU UFUF WOS Replication Between All 3 Sites Using FLR WA Namespace Synchronization End User Creates a File and Stores it to NoleStor File is Replicated Based upon WOS Policy Metadata is Synchronized Between WA Servers

8 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Architecture (1 of 4) WOS = Web Object Storage Provides object storage and replication WOS nodes hold data WOS nodes are grouped into zones WOS zones are grouped into clusters WOS Core

9 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Architecture (2 of 4) WOS policies are collections of data with a rule Data protection by shredding or replication Data can be replicated across zones in a cluster Data that is not local can be accessed too WOS Policies

10 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Architecture (3 of 4) Provide access to data in WOS Core using other protocols than the native WOS REST protocol NFS and CIFS GPFS and Lustre*future S3 WOS Access Gateways

11 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Architecture (4 of 4) Mount NFS, GPFS, or Lustre file system Map a CIFS share Use ownCloud server web interface or Sync client for Windows, MacOS, Linux, Android, etc User Access to Data

12 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Results: Collaborative Use Cases Dropbox-like interface for research data Archival/backup copy for high performance storage Storage for Virtual Machine configurations (OpenStack compatible Local Seamless collaboration, e.g., data replication over a WAN Disaster Recovery, e.g., reciprocal hosting of critical data Regional

13 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com FSU, UF and USF Test System One WOS cluster across Florida LambdaRail WAN 3 WOS Core zones Synchronization of data as WOS objects 3 WOS Access servers, one at each site Synchronization of pathnames and permissions Identity mapping

14 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Solution Enables WOS Access at site A Maps local user with local ID MaryA To global federation ID Sends data to site WOS Access at B WOS Access at site B Receives data from site A Maps global ID to local ID Enters pathname with the correct local ID ID Mapper

15 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com THANK YOU Will take any questions at the end of the Webinar Please come see SSERCA and DDN in Booth #507

16 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com 16 Academic Research Highlights George Jones Director Strategic Sales, DDN Higher Education Research Computing