1. DLI Training April 2004 Kingston Ontario

2. DDI What, Why, How?

3. Data Documentation Initiative The Data Documentation Initiative is an international effort to establish a standard for technical documentation describing social science data http://www.icpsr.umich.edu/DDI/index.ht ml http://www.icpsr.umich.edu/DDI/index.ht ml http://www.icpsr.umich.edu/DDI/index.ht ml http://www.icpsr.umich.edu/DDI/index.ht ml

4. Getting Used to Acronyms You’ll see….. You’ll see…..

5. DTD - Document Type Definition Consists of a Tag Library Consists of a Tag Library Tags have been developed by DDI Tags have been developed by DDI A set of tags, when filled, are known as a codebook A set of tags, when filled, are known as a codebook DDI – intends to comply to Dublin Core DDI – intends to comply to Dublin Core

6. Tags Tags present English language descriptions of XML (eXtensible Markup Language) Tags present English language descriptions of XML (eXtensible Markup Language) Each tag can be optional or mandatory, repeatable or non-repeatable Each tag can be optional or mandatory, repeatable or non-repeatable Set of tags for each section of DTD Set of tags for each section of DTD

7. 5 Sections of DTD ( Document Type Definition ) 1.0 Document Description 1.0 Document Description 2.0 Study Description 2.0 Study Description 3.0 Data File Description 3.0 Data File Description 4.0 Variables Description 4.0 Variables Description 5.0 Other Study Materials 5.0 Other Study Materials

8. Document Description Bibliographic description of the DDI document itself, otherwise known as a marked-up codebook Bibliographic description of the DDI document itself, otherwise known as a marked-up codebook

9. Study Description Describes Study or Survey Describes Study or Survey Includes title, abstract, keywords, author, publisher, collection methods, etc. Includes title, abstract, keywords, author, publisher, collection methods, etc.

10. Data File Description Contains information describing the data file Contains information describing the data file Includes file name, file type, case quantity, logical record length, total number of records, etc. Includes file name, file type, case quantity, logical record length, total number of records, etc.

11. Variables Description Describes each variable Describes each variable Includes variable label, values, value label, question, summary statistics, etc. Includes variable label, values, value label, question, summary statistics, etc.

12. Other Study Materials Includes documentation files in a variety of formats: pdf, excel, word, etc. Includes documentation files in a variety of formats: pdf, excel, word, etc. Includes codebooks, questionnaires, user guides, variability tables, etc. Includes codebooks, questionnaires, user guides, variability tables, etc.

13. Choosing Tags http://www.icpsr.umich.edu/DDI/users/dt d/codedtd.html http://www.icpsr.umich.edu/DDI/users/dt d/codedtd.html http://www.icpsr.umich.edu/DDI/users/dt d/codedtd.html http://www.icpsr.umich.edu/DDI/users/dt d/codedtd.html Select tags from each DTD section for template Select tags from each DTD section for template Each tag represents a searchable element Each tag represents a searchable element Choose carefully – definitions are provided on-line Choose carefully – definitions are provided on-line

14. Codebook Template Over 300 tags to choose from Over 300 tags to choose from DDI suggests starting with set of Recommended Elements DDI suggests starting with set of Recommended Elements

15. Making Templates Pre-fill tags which are common to each dataset and save as template Pre-fill tags which are common to each dataset and save as template One template for Stats Canada surveys One template for Stats Canada surveys One template for ICPSR Surveys One template for ICPSR Surveys One generic to cover other sources One generic to cover other sources

16. Making Templates - example

17. Marking up document Tags can be filled by a variety of methods: Cut and paste or type in information Cut and paste or type in information Extract information using custom scripts, xml editors or custom software Extract information using custom scripts, xml editors or custom software Follow tag descriptions carefully Follow tag descriptions carefully Establish guidelines Establish guidelines

18. Completed Codebook

19. Displaying codebook XML is not a visual display language on the web XML is not a visual display language on the web Transform codebook using XSL/XSLT (extensible stylesheet language) Transform codebook using XSL/XSLT (extensible stylesheet language) Stylesheets control the output display Stylesheets control the output display Software required to read stylesheets, eg. Cocoon, Saxon Software required to read stylesheets, eg. Cocoon, Saxon

20. Stylesheets – what they look like

21. Stylesheets Create your own Create your own Borrow from others – examples available on DDI site Borrow from others – examples available on DDI site Purchase proprietary software to do it for you –example NESSTAR Purchase proprietary software to do it for you –example NESSTAR

22. Final product...........................

26. Where to go from here….. Borrow Borrow Share Share Collaborate Collaborate Discuss Discuss Become involved..... Become involved.....

27. Appendix – Acronyms DDI – Data Documentation Initiative DDI – Data Documentation Initiative DTD – Document Type Definition DTD – Document Type Definition XML – eXtensible markup language XML – eXtensible markup language XSL/XSLT – extensible stylesheet language XSL/XSLT – extensible stylesheet language Template – file containing a set of chosen tags to be used for each dataset Template – file containing a set of chosen tags to be used for each dataset Marked-up codebook – all chosen tags are filled with survey information Marked-up codebook – all chosen tags are filled with survey information

28. The end Carol Perry & Ernie Boyko