The Phylogeny of a Dataset Andrea K Thomer & Nicholas M. Weber Center for Informatics Research in Science and Scholarship Graduate School of Library and Information Science University of Illinois at Urbana-Champaign

Time

How do we understand the evolution of digital objects? Time

How do we understand the evolution of digital objects when they are complexly interrelated? c/o Steve Worley, NCAR

Evolution as a tree From

tl;dr

1)Biologists construct evolutionary trees by comparing animals’ traits and inferring how they may have evolved

tl;dr 1)Biologists construct evolutionary trees by comparing animals’ traits and inferring how they may have evolved 2)And there’s lots of free, open source software available for this work.

Why not datasets? (which, like organisms, also often lack explicit documentation…) Cornets (Tëmkin & Eldredge, 2007) “Little Red Riding Hood” (Tehrani, 2013) Non-biological evolution

A phylogenetic approach helps us: Study evolution of digital objects more rigorously Model how digital objects are reworked into new “species” Understand what properties of a digital object must be preserved or expressed to facilitate modeling We ask: In a digital object, what properties lead to evolutionary fitness?

Dataset of datasets: COADS, ICOADS and its derivatives (I)COADS= (International) Comprehensive Ocean and Atmosphere Dataset Community project bringing together 1000s of marine surface measurements from buoys, ship’s logs, more – First release: 1987 – New releases as new datasets are added; now at 2.5 Enormously modified & reused by others in climate science

Towards a more rigorous view of the evolutionary process: anagenesis and phylogenesis ICOADS documentation largely describes anagenesis (versioning) GCMD* = 1 of many potential sources of data on phylogenesis (branching) – Found 99 metadata records versions/derivatives of ICOADS (“specimens”) through keyword search – Metadata includes scientific paramaters, geographic scope, instruments used, more *known problems in metadata quality, but value in GCMD is breadth rather than depth

Workflow Download records Create character matrix Create a NEXUS file Assess the tree!

Workflow Download records Create character matrix Create a NEXUS file Assess the tree!

Identifying “characters” In phylogenetics: characters are morphological features, DNA, other measurable qualities In ICOADS datasets: we treated each metadata field as a character, and each term as a character state

Dates, times, resolution are “binned” into categories Parameters are split into individual categories, and presence/absence are noted in binary

Method: * Software: PAUP* (Phylogenetic Analysis Using Parsimony *and other methods) Maximum Likelihood algorithm (we can talk about that more if people are interested). Result:

Phylogeny of ICOADS datasets Each fork = a “speciation event” Each group joined at a node = a “clade” – We annotated primary clades

Related datasets cluster; some clades show up as derived from “ancestral” forms – Clade 1 – original COADS datasets – Clade 2 – ICOADS input datasets – Clade 3 – Sea surface flux calculations – Clade 4 – later COADS data products – Clade 5 – COADS derivatives

Why does it matter that digital objects evolve? Or how? Digital preservation implications – A way to understand the history and contents of a collection – Could be used to browse repositories? – Could be used to complement citation analysis? Offers a lens into cooperative processes that create objects – A way to “read” interplay of different scientific cultures

Challenges and areas for future work What existing statistical models of evolution are most appropriate for this? Or do we need to develop a new one? How can existing software be modified for this work? How do we show reticulating relationships?

Future work: Phylogenies showing hybridization & ‘spontaneous generation’

Future work: what makes a dataset “fit”? Part of ICOADS success and proliferation is surely due to low levels of “competition” – But is some of it due to its open availability? – How do we test the effects of openness on a dataset’s fitness-for-purpose?

Acknowledgements Thanks to Julie Allen, Peter Fox and Steve Worley for feedback, and our reviewers for excellent comments. Thanks to CIRSS and the DCERC program for funding

References & Additional Reading Datasets mentioned in this talk: Howe, C. J., & Windram, H. F. (2011). Phylomemetics-- evolutionary analysis beyond the gene. PLoS Biology, 9(5), e doi: /journal.pbio O’Brien, M. J., Darwent, J., & Lyman, R. L. (2001). Cladistics Is Useful for Reconstructing Archaeological Phylogenies: Palaeoindian Points from the Southeastern United States. Journal of Archaeological Science, 28(10), 1115–1136. doi: /jasc Tehrani JJ (2013) The Phylogeny of Little Red Riding Hood. PLoS ONE 8(11): e doi: /journal.pone Tëmkin, I., & Eldredge, N. (2007). Phylogenetics and Material Cultural Evolution. Current Anthropology, 48(1), 146–154.

Homology

Future work: Phylogenies showing hybridization & ‘spontaneous generation’