1. Texas Digital Newspaper Program Data What we gather, and how we use it. By Ana Krahmer & Mark Phillips University of North Texas Libraries 4 February 2014 Start Spreading the News!

2. Overview I.Target Audiences II.Data Collection III.Data Use IV.Questions

3. Target Audiences Of the Texas Digital Newspaper Program

4. Target Audiences K-12 Students & Educators Higher Education Researchers, including undergraduate, graduate, and faculty researchers Librarians Genealogists Lay-Historians Lifelong-Learners

5. Current Classroom Use Teaching with Primary Sources: National History Day; Texas Junior Historians; Texas History, grades 4 & 7. Texas Tech University, Dr. Ann Hawkins’ Texas Manuscript Cultures Online, undergraduate and graduate Book History and Research Methods courses. University of North Texas, Dr. Andrew Torget’s courses, History of Texas and American History courses. Austin College, Dr. Light Cummins’ Research Methods.

6. Library Use Texas Digital Newspaper Program Feedback utility Partner institution pages Newspaper Program Traveling Banner Links to share on social networking feeds

8. Genealogists Full-text searchability Search content highlighting Full metadata records Faceted links

9. Lay-Historians Annual Digital Frontiers Conference Free and open access to newspaper content Zoomable views Permissions to use in research, with citations

10. Lifelong-Learners Emeritus College students Partner public library patrons Local civic interest groups

11. Data Collection Where did it all come from?

12. Data Collection Qualitative: Surveys, Feedback responses, grant report comments, partner communications Quantitative: Analysis of collection usage, geographic origin, contributing partners, annual additions to collection

13. Data Collection (Qualitative) Grant-funded projects require final reports from TDNP partner institutions. In 2012, Kathleen Murray and Dreanna Belden launched an impact survey for Portal to Texas History users. The Portal feedback database offers years of user questions.

14. Data Collection (Qualitative) “The newspaper digitization project places our library in position to reach out toward the future. By taking a piece of the past and bringing it with us, we are sure to grow and learn, appreciate and respect what was, what is and what will be.” - Whitaker, L. (2013). Richard S. & Leah Morris Memorial Library Final Grant Project Report to the Tocker Foundation.

15. Data Collection (Qualitative) The Portal to Texas History Impact Survey was launched in 2012 by Murray and Belden. Of 573 respondents, 36% self-identified as genealogists, 19% as lifelong-learners, 19% as historians, 6% as librarians, 5% as students, and 15% as “other.” 93 individual comments within this survey cited the newspapers as being of especial value.

16. Data Collection (Quantitative) Descriptive metadata for the Texas Digital Newspaper Program collection is available via OAI-PMH in multiple formats. Utilized a Python-based harvester, pyoaiharvester, to collect metadata from the TDNP OAI Repository endpoint. All years combined total 165,298 metadata records. Phillips then prepared a Python script to parse records and extract relevant information. This script uses the output of the pyoaiharvester tool as input, to return a tab-delimited file displaying one newspaper issue per row.

17. FieldField DescriptionExample Data ARKARK Identifier for issueark:/67531/metapth16320 PartnerContributing Partner CodeBDPL Year OnlineYear issue went online (prefixed with “od:”) od:2006 YearYear of newspaper issue1934 DecadeDecade of newspaper issue1930 CountyCounty of newspaper issuePalo Pinto County CommunityCommunity of newspaper issueMineral Wells TitleTitle of newspaper issueThe Tattler *All values in the Partner field can be resolved from the controlled vocabulary: http://digital2.library.unt.edu/vocabularies/institutions/ http://digital2.library.unt.edu/vocabularies/institutions/ The fields* in the tab-delimited file are:

18. Year# of IssuesCumulative% of IssuesCummulative % 200654 0.03% 2007000%0.03% 200844980.03%0.06% 20097,2637,3614.40%4.46% 201044,78852,14927.10%31.56% 201132,62684,77519.74%51.30% 201230,836115,61118.65%69.95% 201349,538165,14929.97%99.92% Number of issues added per year (n=165,149)

19. Year# of Titles Added # of New Titles Added Cummulative # of Titles 2006222 2007002 2008224 2009262529 2010121114143 2011269252395 2012163145540 20139879619 Number of counties added per year (n=109)

20. Year# of Communities Added# of New Communities Added Cummulative # of Communities 2006222 2007002 2008224 2009171620 2010352242 2011624284 20126637121 20134721142 Number of communities added per year (n=142)

24. Counties currently represented in the TDNP Collection

25. Year# of Partners Added# of New Partners Added Cummulative # of Partners 2006222 2007002 2008224 2009659 201010615 2011161227 2012201037 2013241047 20143148 Number of partners added per year (n=48)

26. Partner Type# of Partners by Type# of Issues Public Libraries2766,320 Academic Libraries & Archives* 1341,308 Genealogical/Historical Societies 45,065 Museums22,544 * “UNT Archives” and “UNT Libraries” are two partner institutions, thus actually totaling to 48 partners. This table indicates content whose digitization was funded by external partners. Content funded internally by UNT totals to 49,805 and has been removed from this table. TDNP Partner Institutions

27. Google Fusion Tables map, derived from TDNP Newspaper Locations: https://www.google.com/fus iontables/embedviz?q=select +col1+from+17utAXOiLgXhaE XlHgsIfE2DJ_2OlQyD-XIR- LZU&viz=MAP&h=false&lat= 28.271046172964198&lng=- 103.64894140625&t=1&z=6 &l=col1&y=2&tmplt=2&hml= GEOCODABLE

28. External References Python Metadata Extraction Script: https://github.com/vphill/untl_metadata_extraction/blob/master/tdnp_dataset.py https://github.com/vphill/untl_metadata_extraction/blob/master/tdnp_dataset.py Texas Digital Newspaper Program OAI API: http://texashistory.unt.edu/explore/collections/TDNP/oai/ http://texashistory.unt.edu/explore/collections/TDNP/oai/ PYOAIHarvester Script: https://github.com/vphill/pyoaiharvesterhttps://github.com/vphill/pyoaiharvester Belden, Dreanna & Murray, Kathleen R. Where do users find value?. UNT Digital Library. http://digital.library.unt.edu/ark:/67531/metadc185793/. Accessed January 27, 2014.http://digital.library.unt.edu/ark:/67531/metadc185793/

29. Questions? Ana Krahmer Ana.Krahmer@unt.edu Mark Phillips Mark.Phillips@unt.edu