“Indiana University should continue to execute and accelerate an incremental and extensible strategy that enhances its overall storage infrastructure from online storage to long-term archival storage. Dependable archival storage must include a commitment to ongoing and periodic data validation and maintenance for reading and migrating the data to newer formats.” - The Final Report of the Indiana University Cyberinfrastructure Research Task Force May 2005
Research Computing Storage Conceptual View Massive Data Storage System “Big Red” Supercomputer RFS Data Capacitor GPFS & Home Directories RDBMS Storage
Data Capacitor
Data Capacitor Architecture Force-10 Switch clients metadata servers twenty-four object storage servers attached to shared storage
Data Capacitor Research Examples Dr. Caty Pilachowski, Astronomer at IU Investigating the evolution of stars Project scientist for design of WIYN telescope ODI promises 1 billion pixels/image by 2009 IU Physicist, Chuck Horowitz – Nuclear Pasta Studying the behavior of nuclear matter near saturation density IU Analytical Chemist, David Clemmer Biomolecular sequencing Builds his own instruments IU Chemist, John Huffman X-ray Crystallography
Shared RDBMS Storage Support for Oracle Databases Leverage enterprise Oracle license Pilot using MySQL 50 TB 2 IBM p575s w/ 64 GB RAM/each
Research File System File based storage system Designed for shared and personal research storage Connect with AFS Client, Web Browser, SFTP, or Windows Share 50 TB total storage Researcher and grad student use
Massive Data Storage System
State, National and International Research Collaboration
Research Examples Emad Tajkhorshid, from Illinois, who's work is Simulation of Membrane Channels and Transporters. Koichiro Umemoto from the University of Minnesota has also been a James Cook University in Brisbane Instrument Representative machines at Purdue ANL
Integration with IU Enterprise Storage