1. >> Dissemination databases and PC-Axis in Statistics Denmark Lars Knudsen lak@dst.dk Statistics Denmark

2. >> What will be presented…  Demo of www.statbank.dkwww.statbank.dk  Ingredients in the PX-family  Input and editing software  Questions and discussion

3. >> General info about the StatBank  About 3500 tables/cubes/matrices  Billions of time series (many zeros)  + 200 GB raw data (excl. zero-values)  though)  4-5 news releases a day  Large multidimensional tables (up to 16 variables, recommend max. 8)

4. >> Common functionality… Similar  Documentation (Declaration of contents for statistics)  Related publications  Search  Contextual Help function  Etc…

5. >> Demo www.statbank.dk www.dst.dk

6. >> Selected features of the StatBank (1)  User profile and saved queries stored on server  DataShooting and batch  Dynamic XML access (incl. graphs) and Excel Web Queries  Web Services

7. >> Selected features of the StatBank (2)  User and pre-defined aggregations and pick- lists (goes with saved queries)  Month/quarter to year aggregation on the fly  Advanced selection (search by code/text etc.)  Elimination of variables

8. >> Selected features of the StatBank (3)  SmartTableView (automatic pivot)  Time series output  Graphs and maps for "all" tables  Many output formats (from pc-axis)  Print and Sort data  Sorting function  Eliminate zero-rows

9. >> Selected features of the StatBank (4)  Search results sorted by most used  Search includes synomyms, mis-spellings, search within result etc.  Search by "alias" in URL  Access subjects, tables and queries by "alias"

10. PC-Axis software family overview… PC-Axis main modul PX-Batch macro & micro PX-iMap PX-Publ PC-Axis sql macro & micro PX-Map PX-Make PX-Edit PX-Web PX-Tool PX-Check … PX-iGraph PC-AXIS file format

11. >> Features of PC-Axis system  Easy to re-arrange table  Make calculations in a simple way  Exporting to other file formats  Making graphics very fast  Link to PX-Map  Use standard aggregation lists  Multiple language support  Etc … etc …

12. PX-MAP Create maps from PX-files or csv-files Changing map appearance Eksport map to reports etc. Good for data overview

13. >> Features of PX-Web  Powerfull statistical dissemination system  Easy to implement and getting started  Minimal system requirements  Example Example

14. >>

15. >> Database- vs. Fileserver system  What database structure?  Redundant metadata with many files single source system  PX-Web 2012 can handle both

16. >> File server system

17. >> Data model

18. >> CPR BBR  Loader Software SumDataBase (Oracle) PX-Publ PC-AXIS SQL StatBank Denmark www.statbank.dk PDF (www) Paper *.xls *.dbf *.csv etc... Users (DataShoot) TimeSeries PX / PXS files Word Excel Visual Basic / ASP and Oracle Forms Registers Production System Overview... www dst dk  SAS MainFrame SuperStar etc...

19. >> SumDataBase (Oracle) FireWall Internet Database 1 Internet Database 2 Internet Server 1 Internet Server 2 User Adm. Database Web Switch SumDataBase / StatBank Denmark Overview One Internet Database is active, while the other is inactive They shift every day at 9.30, releasing new figures. Internet Server 3

20. >> Consistency with publications  One source serving multiple needs  Prepare publications using PX-Publ with data from dissemination system (unreleased version)  Easy updating  Error checking

21. >> Input and editing tools…

22. Public and private metadata Divisions and databanks have devided access to metadata depending on the nature Public metadata: SumTimes SumTimes Private metadata: SumTools

23. >> SumTools

31. >> Features to make it easier  Record Layout  Batch function for SumTools  PC-Axis and Web interface to ’not-released-data’  Automatic release ’on time’  Validation and log-files

32. >> Our implementation  The common datamodel + a few extra tables for ”user control”  Oracle, ASP (VB-Script) and JavaScript  Developed in-house, using common PC-Axis components (PX-Web)  Lithuania and Ireland

33. >> Organizing metadata work Jacob Chr. Solander jcs@dst.dk 2013

34. >> Who do what?  Dissemination Centre and the subject matter divisions work very closely together  Yearly meetings 34  5 contact person in Dissemination Centre  13 Subject matter divisions  12 Subject areas  3000 tables in the statbank.dk

35. >> Centralized Vs. Decentralized  Decentralized updating of data, table headlines and contact information  Centralized updating of metadata and codes  To ensure consistency throughout the statbank and www.dst.dkwww.dst.dk  Reuse of metadata 35  Municipalities  Country names and codes  NACE - Industry codes  Other standard codes

36. >> Creating value pooles (VP)  Few value pooles (VP)  From where a lot of value sets (VM) are made. 36 Value poole for Regions, municipalities and country parts (VPxxx) Value set for regions (VMxxx) Value set for regions and municipalities (VMxxy) Value set (VMx)

37. >> From the idea to the final table  By e-mail or phone  or a meeting 37  Disseminations centre  Request from the subject matter divisions  Subject matter divisions  By e-mail or phone  or a meeting Reuse of metadata ? Sorting code ? English metadata ? Spreadsheet with info: English metadata ! Contact person ! Release date ! A new table Editing of a table Renaming an existing table

38. >> The final result as a table Using the metadata tool Presentations from Subject matter division From the idea to the final table 38

39. >> The metadata tool 39

40. >> Use of metadata in dst.dk  Metadata from the statbank are widely used in www.dst.dkwww.dst.dk  E.g. Subject pages Key figures  Newsletter NYT 40 Metadata from statbank.dk

41. >> 41