© Copyright , Cambridge Computer Services, Inc. – All Rights Reserved – Lightning Talks Automated Fixity Checker for Disparate Hardware Jacob Farmer, CTO Cambridge Computer

2 Lightning Talk – Fixity Checker PASIG 2013 Our Project – Defining Best Practices for File Management Inspiration for our project comes from SRB/IRODS Bring parts of the SRB/IRODS vision to reality –Define a general purpose feature set –Intuitive user interface –Simplified API Inspiration also comes from numerous home grown solutions in our client base. The paradigm: Stat() your file systems Make database records for each file and/or directory Relate metadata to the file and directory records Report and/or take action

3 Lightning Talk – Fixity Checker PASIG 2013 In-Band and Out-of-Band

4 Lightning Talk – Fixity Checker PASIG 2013 Building a Fixity Checker Into Starfish Out of the box, Starfish has most of the key components of a fixity checker Hash calculations and comparisons are fundamental to the system: deduplication, integrity checking, versioning, content addressing Walking file systems and object stores is fundamental. –Super fast, parallelized crawler and file processor Starfish holds any kind of metadata Position of files on tape Logging of our activity Starfish takes metadata from other systems through API If another system does a fixity check, we can store the history and results Starfish rules engine works on a schedule and uses metadata as a trigger for activity We query the metadata catalog and then “do stuff” The “stuff” could be a hash compare