Big Data Symposium: Analytics and Applications for Federal Big Data – Bureau of Justice Statistics Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community AOL Government Blogger March 5-6,
Begin With the End in Mind Ms. Jo Strang, Associate Administrator, Safety, Federal Railroad Administration, Department of Transportation “Open Gov 2.0 and Safety.Data.Gov” – New safety data sources and challenge from the National Institute of Justice and new data from Open FEMA Open FEMA – Could not find with Google search – Start with See Safety.Data.Gov – Could not find at that Web site – Start with Bureau of Justice Statistics 2
My Process Found New Releases and Female Victims of Sexual Violence, at BJS.gov Built a Knowledge Base of the Web Site, Metadata, and Data Sources for: – Press Release Press Release – PDF (1.4M) PDF – ASCII file (34K) ASCII file – Comma-delimited format (CSV) (Zip format 26K) Comma-delimited format (CSV) – Help for using BJS products Help for using BJS products – About the Source Data: National Crime Victimization Survey (NCVS)National Crime Victimization Survey (NCVS) Did Extensive Pre-Conditioning of the CSV Spreadsheets for Use and Display of the Data Sets Imported the Data Sets Into Spotfire and Created a Guided Analysis Documented My Data Science Work in a Story and PowerPoint Slides Provided Conclusions and Recommendations 3
Bureau of Justice Statistics 4 Female Victims of Sexual Violence,
5 Build a Knowledge Base: Press Release Report (PDF and ASCII) Help About the Source Data
Knowledge Base*: MindTouch 6 *Well-defined URLs for everything: PDF Text CSV Images See next slide!
Knowledge Base*: MindTouch 7 *Well-defined URLs for everything: PDF Text CSV Images
Knowledge Base in Spreadsheet: Excel 8 This is Linked Open Data! My 5 Steps to Getting to 5 Stars!
Spreadsheet in Dashboard: Spotfire 9 Readme.txt to Master Data Management and Unified Data Architecture : Figures: 3; Tables: 11; and Appendix Tables 16
Spreadsheet in Dashboard: Spotfire 10 From 1995 to 2005, the total rate of sexual violence committed against U.S. female residents age 12 or older declined 64% from a peak of 5.0 per 1,000 females in 1995 to 1.8 per 1,000 females in It then remained unchanged from 2005 to Sexual violence against females includes completed, attempted, or threatened rape or sexual assault. In 2010, females nationwide experienced about 270,000 rape or sexual assault victimizations, compared to about 556,000 in 1995.
Spreadsheet in Dashboard: Spotfire 11 Males had lower rates of rape or sexual assault than females from1995 to 2010 Due to the relatively small number of sample cases, coupled with a low rate of victimization, estimates of male sexual violence from the NCVS cannot be used reliably for further disaggregation by victim and incident characteristics. Therefore, this report focuses exclusively on females.
Spreadsheet in Dashboard: Spotfire 12 The percentage of sexual violence reported to police increased to a high of 56% in 2003 before dropping to 35% in 2010, a level last seen in 1995 The percentage of victimizations known to police because they were reported by another household member declined from 26% in to 10% in , while the percentage reported by an official other than the police increased from 4% to 14%.
Spreadsheet in Dashboard: Spotfire 13 All the tables were carefully formatted in the spreadsheet for display on Spotfire. This is what Data Science does!
Conclusions and Recommendations Built a Knowledge Base of the Web Site, Metadata, and Data Sources with Well-Defined URLs for Everything Did Extensive Pre-Conditioning of the 30 CSV Spreadsheets for Use and Display of the Data Sets Made the Reame.txt File a Master Data Management, a Unified Data Architecture, and Linked Open Data: My 5 Steps to Getting to 5 Stars Imported the Data Sets Into Spotfire and Created a Guided Analysis That Augments the Original Report Documented My Data Science Work in a Story and PowerPoint Slides The Fairfax County Domestic Violence Fatality Review Team 2012 Annual Report is next 14