1 Build Your Own Data.gov/semantic with Spotfire in the Cloud: The White House Visitor Database Brand Niemann US EPA May 22, 2010 (Updated June 1, 2010) Disclaimer: These slides do not reflect the views of the U.S. Environmental Protection Agency and does not constitute endorsement by the EPA of the standards or products mentioned.

2 Overview The Challenge The Data.gov Program The Expert and His Advice The Cloud Tools The Inspiration The Data Sources Other Sources of Data The Process The Results Comments Acknowledgements References Footnote

3 The Challenge Trudy Walsh: Pass the mom’s test. Vivek Kundra: Link data from one agency to another or one country to another (see next slide). Dominic DiFranzo: Link concepts—ideas inside these data sets—to other data sets in a very easy, intuitive fashion. John Sowa: What the SemWeb lacks is somebody like Steve Jobs. Brand Niemann: Goal is to simplify and amplify what’s been done.

4 The Data.gov Program Data.gov: Pretty Advanced for a One-Year-Old, Vivek Kundra, White House Blog, May 21, 2010:White House Blog –As we look to the next year, we recognize that the Web itself is evolving into a data platform and how important it is to link data from one agency to another or one country to another. True value lies at the intersection of multiple datasets and what we are witnessing is a continued movement across the world to democratize data, but more importantly the explosion of applications created by the emergence of a community of innovators. So all you innovators out there – what data sets can we try to get out there to help you go further? Tweet your ideas for data we should try to put out with hashtag #datagov, and we’ll see what we can do in year 2.

5 The Expert and His Advice Edward Tufte Presidential appointment announced by White House, March 5, announced by White House Tufte Comment on iPhone interface design: Better to have users looking over material adjacent in space within our eyespan rather than stacked in time. This is especially the case for statistical data, where the fundamental analytical task is to make comparisons. Also see page 159 in the above book reference.Comment on iPhone interface design

6 The Cloud Tools

7 The Cloud Tools

8 The Cloud Tools

9 The Cloud Tools

10 The Inspiration H1N1 Spread Courtesy of TIBCO Spotfire. See Web Player.Web Player

11 The Data Sources

12 The Data Sources

13 Other Sources of Data In process.

14 The Process Document the Steps at Data.gov Semantic Web (see Footnote section) The Basic Steps: –Inventory Data Sources and Plan Application –Prepare and Import Data and Metadata –Implement Layout and Analytics –Add Bookmarks and Create Data Stories –Publish and Test in Web Player –Get Feedback and Improve First create visualizations, faceted search (filters), and analytics for each individual data source and then look for relationships between the data sources.

15 The Results First there was Put Your Desktop in the Cloud to Support the Open Government Directive and Data.gov/semantic, April 19, Second there was Build Your Own Data.gov and EPA Microsite with Semantics and Statistics in the Cloud, May 15, Third was Build Your Community Health Information "Design for America" Using Mindtouch and Spotfire Analytics, May 17, Fourth was Build EPA's CASTNET in the Cloud, May 21, 2010, and completed May 30, See References. The author followed Edward Tufte's advice on interface design: "Better to have users looking over material adjacent in space within our eyespan rather than stacked in time. This is especially the case for statistical data, where the fundamental analytical task is to make comparisons" (see page 159, of his book entitled Beautiful Evidence, 2006) and noting that one can do Tufte's "sparklines" (writing with data graphics) with Tibco Spotfire Bookmarks.

16 The Results The White House Visitor database was organized in 4 adjacent panels in Spotfire Analytics: Navigation, Data Dictionary, Database, and Interactive Graphics. Spotfire Analytics uses “linked data”, but not with the Semantic Web's RDF at present. It is “open” in the sense that the Spotfire file (.dxp) can be downloaded from the Web and a 30-day free trial client can be used to perform additional analyses including exporting the data back to Excel, etc. for use in your own applications. The results can be exported to PowerPoint slides, Web pages (static), and the Spotfire Silver Analytics Beta in the Cloud (Web Player) where almost all of the functionality of the desktop client (e.g. sliders, filters, zooming for maps, etc.) is retained except for the ability of the Web user to change the analyses. The author followed a six step process: Inventory Data Sources and Plan Application, Prepare and Import Data and Metadata, Implement Layout and Analytics, Add Bookmarks and Create Data Stories (in process), Publish and Test in Web Player, and Get Feedback and Improve. results are shown in the slides and many more are possible with the open, interactive, and creative environment offered by Mindtouch and Spotfire.

17 The Results Spotfire on the Desktop Query by Last Name and First Name (e.g. Vivek Kundra) Click on links

18 The Results Spotfire Silver Analytics Beta in the Cloud (Web Player)Web Player Query by Last Name and First Name (e.g. Vivek Kundra) Click on links

19 Comments Two examples in the Data.gov Apps Showcase have been reworked "to simplify and amplify what’s been done". See Clean Air Status and Trends (CASTNET) and Community Health Information "Design for America". One example from the Data.gov Semantic Web has been reworked (The White House Visitor Database - this wiki). Additional examples from the Data.gov Community and Semantic Web are in process.Data.gov Apps ShowcaseClean Air Status and TrendsCommunity Health Information "Design for America" CommunitySemantic Web Please use the Add Comment feature at the bottom of this wiki page to provide feedback and suggest additional analyses you would like to see. To use the Add Comment feature you first need to register by providing your address. Your privacy will be respected and your addressed will not be available to others or used for any other purpose. You can also download the Spotfire File (16 MB) from this Wiki and a 30-day free evaluation copy from and reuse these analyses, add your own data to this file or new Spotfire files that you create. Have fun and give us your feedback!Spotfirehttp://spotfire.tibco.com/

20 Acknowledgements The author acknowledges gratefully Dean Allemang, Cory Casanave, Sean Connors, Mills Davis, Li Ding, David Eng, Lee Feigenbaum, Aaron Fulkerson, Jim Hendler, Ralph Hodgson, Kevin Kirby, Kevin Jackson, Bob Marcus, John McMahon, Richard Murphy, Brand Niemann, Jr., Barry Nussbaum, Matthew Phoenix, Tony Shaw, Jeff Stein, George Strawn, George Thomas, Pete Tseronis, and Edward Tufte.

21 References Brand L. Niemann, Put Your Desktop in the Cloud to Support the Open Government Directive and Data.gov/semantic, April 19, 2010, Semantic Universe.Semantic Universe Brand L. Niemann, Build Your Own Data.gov (Spotfire) and EPA Microsite (Spotfire) with Semantics and Statistics in the Cloud, May 15, Slides.Own Data.govSpotfireEPA MicrositeSpotfireSlides Brand L. Niemann, Build Your Community Health Information "Design for America" Using Mindtouch and Spotfire, May 17, Slides.MindtouchSpotfireSlides Brand L. Niemann, Build EPA’s CASTNET In the Cloud, May 29, Slides, Mindtouch, and Spotfire.SlidesMindtouchSpotfire

22 Footnote Select See:

23 Footnote Scroll Down To Bottom Of Page

24 Footnote Select

25 Footnote Select: Vivek Kundra

26 Footnote See next slide

27 Footnote RPI The Data-gov Wiki (see next slides): – Search (see previous slide): – visitor/search.phphttp://data-gov.tw.rpi.edu/demo/stable/white-house- visitor/search.php Facts about this Demonstration (see next slides): – gov.tw.rpi.edu/wiki/Demo:_White_House_Visitor_Sea rchhttp://data- gov.tw.rpi.edu/wiki/Demo:_White_House_Visitor_Sea rch

28 Footnote

29 Footnote

30 Footnote Scroll Down To Link dataset: White House visitee to DBpedia link file Expand this to get Google Web and News Search Results

31 Footnote Scroll Down To Vivek Kundra. See next slide.

32 Footnote