1. Automated File Server Disk Quota Management May 13 th, 2008 Bill Claycomb Computer Systems Analyst Infrastructure Computing Systems Department Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy’s National Nuclear Security Administration under contract DE-AC04-94AL85000.

2. Introduction History Challenges faced Solutions Additional capabilities Future work Questions Agenda

3. Introduction Sandia Data Storage Service (SDSS) –Location Independence –Platform Independence –Data Protection –Collaboration Corporate users provided free disk space –1 GB quota –Optional space increases to 10 GB and beyond Quotas automatically managed

4. History of SDSS Deployed in 1998 –400 MB default user quota Available to paying customers only –1.2 TB of data storage 6 Servers, 5 disk arrays each Later increased to 1.75 TB –Backed up daily Upgraded three times since then –Reduced to 3 servers –Increased space to 2.5 TB, 5.5 TB, 11 TB

5. History of SDSS Last Major upgrade in 2008 –3 clustered servers –~20 TB disk storage space allocated –SAN-connected –1 GB default user quota Available to all users –Volume Shadow Copy used to supplement standard backup schedule

6. Quota Management Disk quota types –Per User –Per Folder Quota information stored in corporate database Quota management software –Various applications used over the years Originally, additional disk space was not widely requested –Handled individually by system administrators –GUI available for managing disk quotas

7. Challenges Faced As used disk quota increases became more common, the strain on administrators increased –Often 30 minutes per day spent modifying user quotas –GUI became slower as more user quotas were added –Quotas were only modified once daily We needed an automated solution

8. Additional Challenges Quota management software did not provide an API –Command-line interface only

9. Solution Automated disk quota management solution was developed –No longer required manual administration –Changes reflected within 30 minutes of approval –Web interface developed for temporary changes –User notification incorporated into service Some policy was needed –Disk space increases are automatic –Disk space decreases are automatic, too, but nice about it.

10. Improvements Windows Server 2003 R2 –File Server Resource Manager (FSRM) User-based to Folder-based quotas Increased performance time Administrator web interface User web interface Custom reporting and notification

11. Collaboration for Collaboratives SDSS hosts collaborative shares as well –These have always been managed manually by system administrators An automated solution was needed –No central authority existed to define collaborative quota space requested/authorized/paid for

12. Collaboration for Collaboratives SNL contracted with the SIS Lab at New Mexico Tech University to develop a solution –Real-time quota management application was developed –Monitors SDSS and source file to maintain consistency of quotas

13. Future Work Large Quota support –10 GB+ quotas requested Soft quotas? Larger maximum quota? FSRM API –Increased performance –Greater flexibility to expand the service

14. Questions