1. Mash-up of Linked Government Data from http://data.gov Li Ding, Jim Hendler and Deborah L. McGuinness Tetherless World Constellation, Rensselaer Polytechnic Institute June 24, 2010

2. 2 Raw Government Data Now January 1, 2009 “Openness will strengthen our democracy and promote efficiency and effectiveness in Government.” --- President Obama Putting Government Data online May 21, 2009 January 19, 2010 data.gov.uk online May 21, 2010 data.gov online data.gov relaunch with semantic web featured June30,2009 December 8, 2009 “Open Government Directive” released 2009 2010 …

3. 3 Semantic Web featured at data.gov leveraged contributions from the Tetherless World Constellation at RPI published 6.4 billions of triples (almost doubled LOD cloud – 13 billion triple in total) hosted triple store (virtuoso) and open source RDF mashups http://www.data.gov/semantic/http://www.data.gov/semantic/data/alpha

4. 4 The Data-gov Wiki: Innovations at RPI The Data-gov Wiki explores and educates the use of semantic web technologies, esp. linked data, in producing, processing and utilizing government data from data.gov. DataDemo Tutorial Video The Data-gov Wiki is run by the Tetherless World Constellation at RPI, headed by Professor Jim Hendler and Deborah McGuinness and led by Li Ding. Other student team members include: Dominic DiFranzo, Sarah Magidson,James Michaelis, Alvaro Graves, Adam Bell, Jin Guang Zheng, Xian Li, Tim Lebo, Gregory Todd Williams, Peter Coons, Zhenning Shangguan, Devin Gaffney, William Cooper, Brian Zaik, and Johanna Flores.

5. 5 The Data-gov Wiki - Architecture Data Web Linked Data Linked Data LGD in RDF Enhancement Conversion Knowledge Provenance … Usage LGD: Linked government data

6. 6 Open Data => Visualization => More Open Data: available for public use Visualization: easy to understand Mashups: make it more meaningful Provenance: make it accountable Table (raw data)Map (books per state)Map (books per capita per state) Created by Xian Li, PhD student at RPI, http://data-gov.tw.rpi.edu/wiki/Demo:_Library_Books_Per_Capita,_by_Statehttp://data-gov.tw.rpi.edu/wiki/Demo:_Library_Books_Per_Capita,_by_State Source: Dataset 353 (State Library Agency Survey: Fiscal Year 2006, Institute of Museum and Library Services)

7. 7 Example Mashup Exhibit Visualization API Data.gov CASTNET Ozone (CSV) epa.gov CASTNET Site (CSV) Convert raw dataset into linkable RDF Data Mashup Web Application Mashup Visualization Mashup query multiple RDF dataset via SPARQL end point surf to EPA applications 1 2 drill down for details 3 4 Created by Dominic DiFranzo, PhD student at RPI, http://www.data.gov/semantic/Castnet/html/exhibithttp://www.data.gov/semantic/Castnet/html/exhibit

8. 8 Mashup US UK Foreign aid Sources –http://data.govhttp://data.gov –http://data.gov.ukhttp://data.gov.uk AIDMajor aids from USMajor aids from UK PakistanUS >UKEconomic/Security Assistance, Development Assistance, … Health, Gov and Civil Society,.. IndiaUK > USChild Survival and Health, … Health, Economic, … Discovery and Explanation Created by James Michaelis, PhD student at RPI, http://data-gov.tw.rpi.edu/demo/linked/aidviz-1554-10030.htmlhttp://data-gov.tw.rpi.edu/demo/linked/aidviz-1554-10030.html

9. 9 Adding Social Factor to Mashups RDF Publish* Enhance* User Raw Data consume* feedback Import socially contributed data, e.g. DBpedia Let users contribute –links –feedbacks Other Social Web Apps Import/export

10. 10 Social Mashup: Gov Data + DBpedia Wildland fire (NIFC) Budget on wildfire “DOI” and “USDA” (OMB) Category:Wildfires In The United States Created by Li Ding, researcher at RPI, http://data-gov.tw.rpi.edu/demo/stable/demo-1187-40x-wildfire-budget.htmlhttp://data-gov.tw.rpi.edu/demo/stable/demo-1187-40x-wildfire-budget.html

11. 11 Social Mashup: Web 3.0 Linking (a) White house visitor search for President Obama (b) Web 3.0 site linking white house record to dbpedia *[[skos:altLabel::POTUS]] *[[foaf:firstName::Barack]] [[foaf:lastName::Obama]] *[[owl:sameAs::http://dbpedia.org/resource/Barack_Obama]] *[[owl:sameAs::http://rdf.freebase.com/ns/en.barack_obama]] *[[owl:sameAs::http://data.nytimes.com/47452218948077706853]] Wiki Text RDF data DBpedia White House Visitor Record whitehouse DBpedia Data-gov Wiki “POTUS” dbpedia:Barack_Obama Created by Dominic DiFranzo, http://data-gov.tw.rpi.edu/demo/stable/white-house-visitor/top100-visitees.phphttp://data-gov.tw.rpi.edu/demo/stable/white-house-visitor/top100-visitees.php

12. 12 Social Mashup: User Feedback Mashup multiple time series Support users to feedback (contributing News) Created by Sarah Magidson, http://data-gov.tw.rpi.edu/demo/linked/demo-401-usps-news.htmlhttp://data-gov.tw.rpi.edu/demo/linked/demo-401-usps-news.html

13. 13 More Mashups: Using Web Tools SPARQL results (XML) can be converted into other formats (e.g. JSON, CSV) as input of other Web tools: Yahoo Pipes, IBM Many Eyes, Microsoft Web n-gram Service, …

14. 14 More Mashups: Provenance Critical to accountability Demo => Dataset => Agency –Where data come from? Agency =>Dataset => Comments –Support users’ feedback Dataset Demo Agency

15. 15 Even More … Applications –More raw data, data catalog, links, hub datasets –More tools, esp. visualization Web APIs –Friendly UI Research –Data Integration: smart and scalable –Data access: search, social interaction,… –Provenance: source, versions, changes,… –Reliability: trust, persistency, quality…

16. 16 Conclusion 6.4 billions of triples from data.gov “data + visualization + mashup” is powerful Low-cost prototypes, not difficult, undergraduates and Webmasters can do it Open source tools, data, demos and tutorials are available for education Raw Data Now!