Big Data and Open Data What's in it for the archives? Yvo Volman Publications Office of the European Union Athens, 6 June 2014
Role of the EU Publications Office The production, the dissemination, the reuse and the long term preservation of EU public information Production Dissemination Reuse Preservation
Some megatrends in the digital arena Administrations go digital Internet and the way in which information is consumed Big Data
Big Data: What the reports say ‘Data, the lifeblood of the knowledge economy’ ‘London's 200 traffic surveillance cameras send 64 trillion bits a day to the data command center’ ‘Every day, people send 10 billion text messages' ‘In 2020 the size of the Internet will be 44 times the size of the 2009 Internet. Storage capacity will grow by a factor of 30’ ‘The current ecosystem around Big Data creates a new kind of digital divide: the Big Data rich vs the Big Data poor’
Privacy needs to be respected Big Data: Why does it matter? Will fundamentally alter the way in which we tackle societal challenges Example: health New economic activity Annual growth Big Data activities is 40% Efficiency gains Data based decision-making increases the productivity of companies by 5-6% Privacy needs to be respected
How are the archives concerned? Potential users of the new tools (analytics, visualisation, etc.) Data holders Rich source of information resources that can be used How can this be linked to the role of archives in the digital age? Focus on the basic mandate or on generating income?
Open Data: A New Paradigm From information owned by a limited group To information owned by ALL Why Open Government Data? Enhance openness and transparency of public bodies Foster economic activity: raw data as a basic resource for innovative applications, new products and services Create new knowledge by linking data from different sources and pattern Enhance evidence-based decision-making and civic participation
Open Data: The link between Big Data, Open Data and Open Government Data Public Data OPEN DATA
European Council Conclusions, 24-25 October 2013 EU Legal Framework for open data and other initiatives European Council Conclusions, 24-25 October 2013 "Open data is an untapped resource with a huge potential for building stronger, more interconnected societies that better meet the needs of the citizens and allow innovation and prosperity to flourish. Interoperability and the re-use of public sector information shall be promoted actively."
Deadline for transposition for the Member States, 18 July 2015 Basic rules of the PSI-Directive for archives Transparency of procedures and of conditions for re-use Non-discrimination + non-exclusivity Ceiling on charging Deadline for transposition for the Member States, 18 July 2015
Application of the PSI-Directive to the archives: some myths… 'No longer possible to generate income' 'No possibility for public private partnerships for digitisation' 'Administrative burden' 'It's all so complicated for smaller institutions'
Conclusion Big Data will affect all of us Open Data: growing in importance PSI-Directive has a limited impact on the archives Deeper question around the role of archives in the digital age