Mannheim Open Social Science Conference, January 2019

Slides:



Advertisements
Similar presentations
OVERVIEW OF FACULTY OF 1000’S SERVICES
Advertisements

The Seven Pillars of Open Language Archiving: Introducing the OLAC Vision Gary Simons SIL International LSA Symposium: The Open Language Archives Community.
Scientific publishing Risto Lahdelma Aalto University School of Engineering.
OFFICE OF SCHOLARLY COMMUNICATIONS Texas A&M University Libraries Open Access Publishing and Citation Rates: Getting Rewarded by Improving Access to Your.
Data Citation for the Social Sciences Mary Vardigan ICPSR CODATA Conference on Data Attribution and Citation August 22-23, 2011.
Open journal systems open journal systems ICCC 8th International Conference on Elelectronic Publishing.
Anna Maria Tammaro Pietro Gozetti Academic staff expectations on DSpace services: results of a survey at the University of Parma's Art and Humanities Faculty.
Proquest. Digital Commons/Institutional Repository at Pace.
HELIN DIGITAL COMMONS: A CONSORTIUM OF INSTITUTIONAL REPOSITORIES Martha Rice Sanders HELIN Knowledge Management Librarian.
© 2004 University of Rochester LibrariesSlide 1 Enhancing DSpace Based on a Work-Practice Study DSpace Federation User Group Meeting March 10, 2004 Dave.
APSA Workshop on Data Access and Research Transparency (DA-RT) in Political Science Hosted by the Inter-university Consortium for Political and Social.
© L.A.C.E. Research Group, 2003 University of Cadiz Eudoxos Project Teaching Science with a Robotic Telescope EVALUATION OF THE EUDOXOS PROJECT The evaluation.
GLOBAL BIODIVERSITY INFORMATION FACILITY Dr Vishwas Chavan Senior Programme Officer for DIGIT Data Citation Mechanism and.
The Role of Abstract and Citation Databases in Supporting Data Repositories DataCite Workshop: Möglichkeiten und neue Lösungen im Forschungsdatenmanagement.
Authors of manuscripts stemming from either platform and poster presentations are invited to submit an article for publication in the CAC Supplement that.
Digital Commons & Open Access Repositories Johanna Bristow, Strategic Marketing Manager APBSLG Libraries: September 2006.
DA-RT What publishing houses can and can’t do Patrick McCartan Publishing Director, Social Science and Humanities Journals Cambridge University Press.
Journal of Earth System Science Education Earth system and global change science for formal and informal education Martin Ruzek, Donald R. Johnson Universities.
Template for PowerPoint File Author(s) Affiliation(s) of Corresponding Author (Notes: Keep the heading above on the first slide. PACKCON has three.
What is this “thing”?  Basically it is a website where you would be able to collaborate with the group in a safe and private environment through a powerful.
National Library of Finland Strategic, Systematic and Holistic Approach in Digitisation Cultural unity and diversity of the Baltic Sea Region – common.
INTRODUCTION TO A NEW KIND OF RESORCE – F1000 Georg Reimer October 2011.
OMICS international Contact us at: OMICS International through its Open Access Initiative is committed to make genuine and.
OMICS Group Contact us at: OMICS Group International through its Open Access Initiative is committed to make genuine and.
How do you know your product “works”? And what does it mean for a product to “work”?
Sara Bowman Center for Open Science | Promoting, Supporting, and Incentivizing Openness in Scientific Research.
Presenting and Preserving Your Scholarship with Digital SPU November 13, 2013 Kristen Hoffman and Michael Paulus.
Vision: Increase regional sharing and collaboration in order to expedite the delivery and adoption of energy efficiency. Conduit is brought to you by NEEA.
Copyright © Springer Publishing Company, LLC. All Rights Reserved. BECOMING A SCHOLAR IN NURSING EDUCATION – Chapter 16 –
Improvement In Broadband Technology Rapid improvement in broadband technology, online security, etc. audio and video conferencing software have gained.
Rob van der Bliek Mark Robertson
1st Steering Committee Meeting activities from WP3 –
How to Use Google Scholar An Educator’s Guide
Prevention and Detection
Usage scenarios, User Interface & tools
OMICS international OMICS International through its Open Access Initiative is committed to make genuine and reliable contributions to the scientific community.
The Undergraduate Research in Natural and Clinical Science and Technology (URNCST) Journal Learn more at URNCST.com | Find us
Why We Need a Transparency Revolution in Business History
Follow-up & Reflections Webinar
Petr Knoth & Nancy Pontika CORE The Open
Tim Smith CERN Geneva, Switzerland
Emerging Adulthood Measured Across Multiple Institutions 2 (EAMMi2):
Google Apps in Classrooms and Schools
Changing Practices… Changing Values
1st Steering Committee Meeting activities from WP3 –
Adopting Dataverse at the Qualitative Data Repository
Teaching Critical Thinking Skills in Science with sInvestigator
Building a GER Toolbox As you return from break, please reassemble into your working groups: Surveys and Instruments Analytical Tools Getting Published.
What Are Institutional Repositories?
OMICS International OMICS International through its Open Access Initiative is committed to make genuine and reliable contributions to the scientific community.
Scientific Publishing in the Digital Age
OMICS international OMICS International through its Open Access Initiative is committed to make genuine and reliable contributions to the scientific community.
2003 LFS ad hoc module on lifelong learning
OMICS international OMICS International through its Open Access Initiative is committed to make genuine and reliable contributions to the scientific community.
OMICS international OMICS International through its Open Access Initiative is committed to make genuine and reliable contributions to the scientific community.
Repository Platforms for Research Data Interest Group: Requirements, Gaps, Capabilities, and Progress Robert R. Downs1, 1 NASA.
Toward an Open Monograph Ecosystem (TOME) Peter Berkery Executive Director Association of University Presses Katie Steen Policy Associate Association.
You will need the following:
4-6 Declaration of Independence Analysis
OMICS Group OMICS Group International through its Open Access Initiative is committed to make genuine and reliable contributions to the scientific community.
OMICS international OMICS International through its Open Access Initiative is committed to make genuine and reliable contributions to the scientific community.
Do abstracts represent the article?
Metrics and national evaluation cultures
Happy New Year! January 2017 Newsletter Project News Need Assessment
The Impact of Metrics on Scholarly Libraries
Open access in REF – Planning Workshop
OMICS Journals are welcoming Submissions
Encyclopaedia of informality ‘Invisible Words, Invisible Worlds’
OMICS Group OMICS Group International through its Open Access Initiative is committed to make genuine and reliable contributions to the scientific community.
Reviewing Features in Word
Presentation transcript:

Annotation for Transparent Inquiry (ATI) Transparency for Qualitative Social Science Research Mannheim Open Social Science Conference, January 2019 Sebastian Karcher Qualitative Data Repository

How Do We Make Qualitative Research Transparent?

Quantitative Research: Matrix Data Open Science Toby Bolsen, Thomas J. Leeper, and Matthew Shapiro. 2014. “Doing What Others Do: Norms, Science, and Collective Action on Global Warming.” American Politics Research 42(1): 65–89.

Qualitative Research: Granular Data

The Traditional Way

Annotation for Transparent Inquiry (ATI)

ATI: Data repository

ATI: Annotations

ATI examples: Historical research Source document Annotation Publication Link: http://bit.do/ati-historical

ATI Example: Excerpt, translation, and analysis Source excerpt Translation Analysis Publication

Example: audio in linguistics Documentation (list of excerpts) Data source (audio) Direct link to snippet video: https://drive.google.com/open?id=1gjAdy0BSgqHJ_eQ1s6FwPNf_frnF-OZX Direct link to raw sound file: https://drive.google.com/file/d/1uYwDxQmV24ERBBBktSy8nnrhnWQvCjJa/view?usp=sharing Link to annotation: https://hyp.is/UvONqAaYEeibFZ8epLi12g/www.cambridge.org/core/journals/english-language-and-linguistics/article/unstoppable-glottal-tracking-rapid-change-in-an-iconic-british-variable-1/B466B1578FAC33B1B4E1FFD0A538513D/core-reader Publication table Link: http://bit.do/ati-audio

Evaluating ATI: The ATI Initiative 2 Phases; currently beginning of 2nd 1st phase: Annotating recently published articles Collaborated closely with Cambridge University Press to test technology, workflows, and solicit articles Projects available at qdr.org/ati/ati-models 2nd phase: Annotating during writing process Every paper paired with reviewer, pre- and post review Authors keep logbook & fill out survey Very preliminary results

Evaluating ATI Average time spent per project: ~20hs

Evaluating ATI Relatively poor match between reviewer expectation and annotations Widely differing number of annotations (6-80/article) Widely differing usage of annotations, some disagreement Concern about incentives Interest in clearer typology of annotations Existing work on annotation/citation ontologies

ATI Challenge 2nd Phase of pilots Solicited proposals for (paid) annotation & workshop 80 submissions across disciplines & continents, though skewed towards political science Selected 19 projects, workshop in November 2018 Will follow articles through peer-review

Questions? Comments? Please stay in touch: https://qdr.syr.edu @adam42smith (Sebastian) @qdrepository (QDR) Email: skarcher@syr.edu qdr@syr.edu