TWC LOGD: A Portal for Linking Open Government Data Dominic DiFranzo, Li Ding, John S. Erickson, Xian Li, Tim Lebo, James Michaelis, Alvaro Graves, Gregory Todd Williams, Jin Guang Zheng, Johanna Flores, Zhenning Shangguan, Gino Gervasio, Deborah L. McGuinness, Jim Hendler Tetherless World Constellation Rensselaer Polytechnic Institute Semantic Web Challenge 2010 Nov 10, 2010

2 The TWC LOGD Portal for SWC2010 Real World Data  US, UK, China,…  Health, energy, economy End User Applications  Community Portal  Fast, Low-cost Mashups Semantic Web in Gov Domain  Major partner of Data.gov  8.5 billion triples in LOD

3 “Semantic Web” and RDF logo showed up on the frontpage of the US Data.gov website

4 RPI brought Semantic Web to US government

5 Major Partner of US Data.gov Project  Semantic Web Tech deployed in Data.gov  RDF data, SPARQL endpoint, semantic mashups

6 Government Adoption Process Data-gov online May 21, 2009 May, 2010 data.gov online SPARQL End Point & RDF data & Demos Replicated at Data.gov July, … Demos Tutorials Videos SPARQL Endpoint Oct, 2010 New Application published by a team at DOE Two-day Mashathon in Washington DC Aug, 2010 May 21, 2010 data.gov relaunch with semantic web featured TWC LOGD Drupal Site announced Oct, 2010

7 The Largest Real World LOD Dataset  8.5+ billion triples from real world  LOD links  Accessible via Data Browser, e.g. Tabulator

8 Trends in Smoking Prevalence, Tobacco Policy Coverage and Tobacco Prices ( ) Smoking Prevalence vs. Tax, Policy … Extensible and accountable Mashups for NIH project Extensible Mashups via Linked Data  Diverse datasets from NIH  Potentially linking to “unemployment rate” Accountable Mashups via Provenance  Annotate datasets used in demos  Feedback users’ comment to gov contact

9 White House Visitor Search Leveraging linked data (DBpedia & New York Times) “POTUS” dbpedia:Barack_Obama Created by Dominic DiFranzo, Evan Patton, RPI,  [Person Mashup] Data.gov (statistics) + DBpedia (personal profiles)+ NYTimes (news)  [Technologies] Semantic MediaWiki, Google Visualization, IPad Apps available in Apple Store The White House Semantic Wiki Wikipedia NYTimes

10 Linking GDP of the US and China Linking international government data meaningfully GDP of China (Billion Chinese Yuan ) GDP of the US (Billion Dollar) [Temporal Mashup] bea.gov + federalreserve.gov +stats.gov.cn

11 Reaching Open Source Communities Linking semantic web with web developers Social Semantic Web extensions/modules to popular CMS, e.g. Semantic Wiki, Drupal Process/consume integrated gov data in a number of different ways: social networks, natural language technologies, workflows, search…

12 TWC LOGD Status: Website Statistics 378,128 page hits 28,481 visits 16,041 visitors 4126 cities 34 countries Note: the above statistics are about Dataset access not counted.

13 Summary of the TWC LOGD Portal Real World Data  8.5+ billion triples  400+ datasets  10+ sources  Many domains Semantic Web Technology  completely open source  Demos/tutorials/videos Community and Users  partner of US government  open source community  education in university Linking Open Government Data Now!

14 The Team and Sponsors Jim Hendler Deborah L. McGuinness Li Ding Dominic DiFranzo Sarah Magidson James Michaelis Alvaro Graves Jin Guang Zheng Xian Li Gregory Todd Williams Tim Lebo Zhenning Shangguan Devin Gaffney Peter Coons Adam Bell William Cooper Brian Zaik Johanna Flores Government Sponsors DARPA NSF NASA IARPA NIH/NCI …

15 Backups

16 Data.gov and World-Wide Open Government Data Activities January 1, 2009 “Openness will strengthen our democracy and promote efficiency and effectiveness in Government.” --- President Obama Putting Government Data online May 21, 2009 January 19, 2010 data.gov.uk online May 21, 2010 data.gov online data.gov relaunch with semantic web featured June30, … Many countries US UK Australia New Zealand …

17 Data-gov Wiki: Innovations at RPI The Data-gov Wiki explores and educates the use of semantic web technologies, esp. linked data, in producing, processing and utilizing government data from data.gov. The Data-gov Wiki is run by the Tetherless World Constellation at RPI, headed by Professors Jim Hendler and Deborah McGuinness and led by Li Ding. Other student team members include: Dominic DiFranzo, Sarah Magidson,James Michaelis, Alvaro Graves, Adam Bell, Jin Guang Zheng, Xian Li, Tim Lebo, Gregory Todd Williams, Peter Coons, Zhenning Shangguan, Devin Gaffney, William Cooper, Brian Zaik, and Johanna Flores. 40+ Demos 400+ Datasets Tutorials & Videos

18 Dataset Version Table Source Record Conversion Layer OGD (part1) Snapshot LOGD (raw) LOGD (e1) highLevels of structural data granularity low Data publishing stages OGD (part2) Snapshot … … … Tech: Abstraction and Versioning

19 Tech: Provenance in LOGD data Convert derive create derive revision Access Enhance Version SemDiff

20 XHTML+RDFa ARC2 Data-gov Semantic Search HTML RDFa Web Search Results RDF Annotation Consume LOGD data in Semantic Search