Presentation is loading. Please wait.

Presentation is loading. Please wait.

Mannheim Open Social Science Conference, January 2019

Published byDamian Atkins Modified over 5 years ago

Similar presentations

Presentation on theme: "Mannheim Open Social Science Conference, January 2019"— Presentation transcript:

1 Annotation for Transparent Inquiry (ATI) Transparency for Qualitative Social Science Research
Mannheim Open Social Science Conference, January 2019 Sebastian Karcher Qualitative Data Repository

2 How Do We Make Qualitative Research Transparent?

3 Quantitative Research: Matrix Data
Open Science Toby Bolsen, Thomas J. Leeper, and Matthew Shapiro “Doing What Others Do: Norms, Science, and Collective Action on Global Warming.” American Politics Research 42(1): 65–89.

4 Qualitative Research: Granular Data

5 The Traditional Way

6 Annotation for Transparent Inquiry (ATI)

7 ATI: Data repository

8 ATI: Annotations

9 ATI examples: Historical research
Source document Annotation Publication Link:

10 ATI Example: Excerpt, translation, and analysis
Source excerpt Translation Analysis Publication

11 Example: audio in linguistics
Documentation (list of excerpts) Data source (audio) Direct link to snippet video: Direct link to raw sound file: Link to annotation: Publication table Link:

12 Evaluating ATI: The ATI Initiative
2 Phases; currently beginning of 2nd 1st phase: Annotating recently published articles Collaborated closely with Cambridge University Press to test technology, workflows, and solicit articles Projects available at qdr.org/ati/ati-models 2nd phase: Annotating during writing process Every paper paired with reviewer, pre- and post review Authors keep logbook & fill out survey Very preliminary results

13 Evaluating ATI Average time spent per project: ~20hs

14 Evaluating ATI Relatively poor match between reviewer expectation and annotations Widely differing number of annotations (6-80/article) Widely differing usage of annotations, some disagreement Concern about incentives Interest in clearer typology of annotations Existing work on annotation/citation ontologies

15 ATI Challenge 2nd Phase of pilots
Solicited proposals for (paid) annotation & workshop 80 submissions across disciplines & continents, though skewed towards political science Selected 19 projects, workshop in November 2018 Will follow articles through peer-review

16 Questions? Comments? Please stay in touch: (QDR)

Download ppt "Mannheim Open Social Science Conference, January 2019"

Similar presentations

OVERVIEW OF FACULTY OF 1000’S SERVICES

OVERVIEW OF FACULTY OF 1000’S SERVICES
The Seven Pillars of Open Language Archiving: Introducing the OLAC Vision Gary Simons SIL International LSA Symposium: The Open Language Archives Community.

The Seven Pillars of Open Language Archiving: Introducing the OLAC Vision Gary Simons SIL International LSA Symposium: The Open Language Archives Community.
Scientific publishing 27.1.2011 Risto Lahdelma Aalto University School of Engineering.

Scientific publishing Risto Lahdelma Aalto University School of Engineering.
OFFICE OF SCHOLARLY COMMUNICATIONS Texas A&M University Libraries Open Access Publishing and Citation Rates: Getting Rewarded by Improving Access to Your.

OFFICE OF SCHOLARLY COMMUNICATIONS Texas A&M University Libraries Open Access Publishing and Citation Rates: Getting Rewarded by Improving Access to Your.
Data Citation for the Social Sciences Mary Vardigan ICPSR CODATA Conference on Data Attribution and Citation August 22-23, 2011.

Data Citation for the Social Sciences Mary Vardigan ICPSR CODATA Conference on Data Attribution and Citation August 22-23, 2011.
Open journal systems open journal systems ICCC 8th International Conference on Elelectronic Publishing.

Open journal systems open journal systems ICCC 8th International Conference on Elelectronic Publishing.
Anna Maria Tammaro Pietro Gozetti Academic staff expectations on DSpace services: results of a survey at the University of Parma's Art and Humanities Faculty.

Anna Maria Tammaro Pietro Gozetti Academic staff expectations on DSpace services: results of a survey at the University of Parma's Art and Humanities Faculty.
Proquest. Digital Commons/Institutional Repository at Pace.

Proquest. Digital Commons/Institutional Repository at Pace.
HELIN DIGITAL COMMONS: A CONSORTIUM OF INSTITUTIONAL REPOSITORIES Martha Rice Sanders HELIN Knowledge Management Librarian.

HELIN DIGITAL COMMONS: A CONSORTIUM OF INSTITUTIONAL REPOSITORIES Martha Rice Sanders HELIN Knowledge Management Librarian.
© 2004 University of Rochester LibrariesSlide 1 Enhancing DSpace Based on a Work-Practice Study DSpace Federation User Group Meeting March 10, 2004 Dave.

© 2004 University of Rochester LibrariesSlide 1 Enhancing DSpace Based on a Work-Practice Study DSpace Federation User Group Meeting March 10, 2004 Dave.
APSA Workshop on Data Access and Research Transparency (DA-RT) in Political Science Hosted by the Inter-university Consortium for Political and Social.

APSA Workshop on Data Access and Research Transparency (DA-RT) in Political Science Hosted by the Inter-university Consortium for Political and Social.
© L.A.C.E. Research Group, 2003 University of Cadiz Eudoxos Project Teaching Science with a Robotic Telescope EVALUATION OF THE EUDOXOS PROJECT The evaluation.

© L.A.C.E. Research Group, 2003 University of Cadiz Eudoxos Project Teaching Science with a Robotic Telescope EVALUATION OF THE EUDOXOS PROJECT The evaluation.
GLOBAL BIODIVERSITY INFORMATION FACILITY Dr Vishwas Chavan Senior Programme Officer for DIGIT Data Citation Mechanism and.

GLOBAL BIODIVERSITY INFORMATION FACILITY Dr Vishwas Chavan Senior Programme Officer for DIGIT Data Citation Mechanism and.
The Role of Abstract and Citation Databases in Supporting Data Repositories DataCite Workshop: Möglichkeiten und neue Lösungen im Forschungsdatenmanagement.

The Role of Abstract and Citation Databases in Supporting Data Repositories DataCite Workshop: Möglichkeiten und neue Lösungen im Forschungsdatenmanagement.
Authors of manuscripts stemming from either platform and poster presentations are invited to submit an article for publication in the CAC Supplement that.

Authors of manuscripts stemming from either platform and poster presentations are invited to submit an article for publication in the CAC Supplement that.
Digital Commons & Open Access Repositories Johanna Bristow, Strategic Marketing Manager APBSLG Libraries: September 2006.

Digital Commons & Open Access Repositories Johanna Bristow, Strategic Marketing Manager APBSLG Libraries: September 2006.
DA-RT What publishing houses can and can’t do Patrick McCartan Publishing Director, Social Science and Humanities Journals Cambridge University Press.

DA-RT What publishing houses can and can’t do Patrick McCartan Publishing Director, Social Science and Humanities Journals Cambridge University Press.
Journal of Earth System Science Education Earth system and global change science for formal and informal education Martin Ruzek, Donald R. Johnson Universities.

Journal of Earth System Science Education Earth system and global change science for formal and informal education Martin Ruzek, Donald R. Johnson Universities.
Template for PowerPoint File Author(s) Affiliation(s) Email of Corresponding Author (Notes: Keep the heading above on the first slide. PACKCON has three.

Template for PowerPoint File Author(s) Affiliation(s) of Corresponding Author (Notes: Keep the heading above on the first slide. PACKCON has three.
What is this “thing”?  Basically it is a website where you would be able to collaborate with the group in a safe and private environment through a powerful.

What is this “thing”?  Basically it is a website where you would be able to collaborate with the group in a safe and private environment through a powerful.

Similar presentations

Ads by Google