광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) Friday Seminar “Big Data for Policy, Development and Official Statistics” 22 February 2013, New York Ki-Jong Woo Commissioner Statistics Korea (KOSTAT)

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) Contents 1.Global Responses to Big Data 2.Big Data Use in Public Sector of Korea 3.KOSTAT’s preparation in response to Big Data 4.KOSTAT’s pilot project on applicability of Big Data 5.Treats or Opportunities? What should we prepare?

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) 1 / 15 US: ‘Big Data R&D Initiative’ - invest in R&D on big data technology (Mar 2012) Japan : ‘Basic Strategy on Using Big Data’ as a major task for ‘Active Japan’ initiative (May 2012) Public-Private-Academic Partnerships - “Big Data Strategy Forum” for market analysis and future strategy (Mar 2012) - “Korea Big Data Forum” for market growth and industrial transformation (Sep 2012) National Master Plan on Big Data - established by 5 concerned ministries including National Science & Technology Commission and Ministry of Education, Science and Technology (Dec 2012) - Identifying national agenda for big data use and its relevant infrastructure to ensure applicability and benefits to the public “The Future Belongs to the One who Rules the Data”

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) First Step is… - to develop a system that can cross-link huge amount of administrative data kept by different government agencies 3 Priority Tasks in 2013 are… - Prevention of criminal incidents by predicting the location and time of crimes - Early detection and prediction of natural disasters - A traffic accident reduction scheme with a bottom-up method (Citizen Participation) Using big data means handling ‘LARGE-SCALE’ & ‘REAL-TIME’ data only? - For example, what if ‘administrative data’ in public sector ? Could be… → Could be… because it can provide greater INSIGHTS for reproduction of data 2 / 15

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) Youth at Risk Policy has been insufficient in fighting serious/life-threatening youth problems Analyzing social data – buzz patterns related to suicide among youth – allows formulation of policies to effectively prevent suicide by better understanding the circumstances and psychological states of the youth (Source) National Information Society Agency Pilot Project (Jul-Sept, 2012) 3 / 15 e.g.) Suicide Context Poole.g) Online spread of harmful content e.g.) Influence by Major Players Online Suicide risk factor Harmful Contents

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) “Will the Data Deluge Makes the Scientific Methods Obsolete? - Chris Anderson, 『 The End of Theory 』 “All Models are Wrong, but Some are Useful” – George Box 4 / 15 Challenge! On the basis of mathematical theories Represent target population Timely Quantity creates quality Statistics can be also biased MORE timely Survey environment is challenging

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) Since October 2012 Aims to raise awareness on big data among KOSTAT staffs Organizes monthly seminars to share up-to-date information and trend of big data at global and national level 5/ 15 A pilot project on the use of big data in the process of editing existing national statistics Using media data for examining outliers when producing the Index of Industrial Production(IIP) Completing the system set-up by this February for a pilot trial run in March and April 2013

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) 6 / Industrial Types (Division level) 633 Products 8,300 Establishments C21 (Pharmaceuticals) C24 (Primary Metals) C26 (Electronic Components, …) C28 (Electric Equipment) 162 Products 1,438 Establishments 4 Industrial Types

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) 7 / 15 Work Flow Volume by product and establishment Index by industry and product Visualization of Surveyed Data Comprehensive internet information on products and establishments Analysis of Unstructured Data from Media Check related information on Internet Telephone Inquiries Data Edit

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) 8 / 15 Crawling of related articles and web documents online from 1 st of previous month to the present - Collect internet data on products or establishments indicating increases and decreases in trends - Crawl internet news on real-time basis - Download materials (i.e. PDF, DOC) on website and upload to the server for analysis Consolidate documents downloaded from websites and internet news for comprehensive analysis - Enhance search accuracy by registering similar product names in advance - Provide website and internet news in order of search accuracy Analysis of unstructured data IBM’ VIVISIMO

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) IndustrySourceContents C21 (Pharmaceuticals) Korea Pharma. Assoc. / pharmaceutical news Jongkeundang and others Major production, pharmaceutical products Internet NewspaperRelated articles C24 (Primary Metals) Korea Metal Journalnew.kmj.co.kr / news on products Korea Iron & Steel Assoc. / metal info / reports on survey data, steel news Internet NewspaperRelated articles C26 (Electronic Components, media & communication) Ministry of Knowledge & Economy homepage / press release, announcement, policies Korea Customs ServiceHomepage / breaking policy news, press release Korea Semicon. Ind. Assoc.Live semiconductor news Semiconductor NetworkSN news Korea Display Indus. Assoc. Industry news Internet NewspaperRelated articles C28(Electric equipment) Internet NewspaperRelated articles 9 / 15 (Media Data) Information posted on websites and internet news articles

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) 10 / 15 Direct access to the Industrial Production System (IPS) database Visualize data into graphs by industry, establishment and product for time series analysis on IIP and output volume - Graph of output by product/establishment (volume/ Comparison with previous month/ comparison with same month of previous year) - Graph of index by industry/product (volume/ Comparison with previous month/ comparison with same month of previous year) Visualization of structured data Index Data Volume Data By Industry/Product By Product/Establishment

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) 11 / 15

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) 12 / 15 NSOs will have to decide on whether to produce official statistics based on big data. Someday! What would users prefer?

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) Encourage the research on the comparison of the statistics produced on the basis of big data and the existing statistics. i.e. 2-year pilot project on using big data for price index in Europe 13 / 15

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) Openness.vs. Privacy Legal framework and system to facilitate data sharing and access should be established in order to ensure effective use of big data among agencies. - KOSTAT provides 540 subjects of statistics for free and plans to develop OpenAPI this year There is a growing request for Microdata in the advent of big data. - Clever solutions are needed to the issue pertaining to microdata, mainly the conflict between the need for data sharing vs ensuring privacy protection 14 / 15

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) 14,000 data scientists will be needed by 2017 while there are currently about 100 in Korea. Data Scientists should be cultivated in public and private sector. - have to come up with strategies to train big data specialists to cooperate with private, academic and research sectors - need to develop a curriculum to foster data scientists by concentrating on business analysis, statistics and IT studies 15 / 15

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) The future belongs to those who rule the data

광업제조업 동향지수 빅데이터 활용 Pilot Project 제 44차 UN 통계위원회( , 뉴욕) 44 th UNSC (22 Feb. 2013, New York) Thank You 감사합니다