Harbor Herons Citizen Science Surveys: Issues, Constraints, and Future Directions. Nellie Tsipoura, Kristin Munafo, Tom Smith, Kate Ruskin, Kim Mendillo,

Slides:



Advertisements
Similar presentations
1 Champlain Valley Head Start Child Outcomes Assessment in Champlain Valley Head Start.
Advertisements

Key Steps to running a survey. Aims and Objectives Have clear aims and objectives for the project. Ensure you know what you want to get out of the survey.
Animal, Plant & Soil Science
Monarch Larva Monitoring Project Goals and Roles.
CREDIT RECOVERY AND COLLECTION. CHALLENGERS 1.Longer repayment period 2.Higher loan limits 3.Higher monthly installments 4.Many cases handling cash in.
Anita M. Baker, Ed.D. Jamie Bassell Evaluation Services Program Evaluation Essentials Evaluation Support 2.0 Session 2 Bruner Foundation Rochester, New.
Accuracy Assessment of Thematic Maps
Chapter 3 Producing Data 1. During most of this semester we go about statistics as if we already have data to work with. This is okay, but a little misleading.
National Commission for Academic Accreditation & Assessment Preparation for Developmental Reviews.
QBM117 Business Statistics Statistical Inference Sampling 1.
© Tefko Saracevic, Rutgers University1 digital libraries and human information behavior Tefko Saracevic, Ph.D. School of Communication, Information and.
Copyright © 2014 by McGraw-Hill Higher Education. All rights reserved. Essentials of Business Statistics: Communicating with Numbers By Sanjiv Jaggia and.
Sampling Methods.
Sampling Methods.
1a Job Descriptions for Personnel Involved in PAT Implementation Materials Developed by The IRIS Center, University of Maryland.
Quality Assurance in the clinical laboratory
Evaluating survey methods for the Yellow Rail: comparison of human surveys and autonomous recording units Kiel Drake and Danica Hogan.
Lecture 30 sampling and field work
Data and Data Collection Quantitative – Numbers, tests, counting, measuring Fundamentally--2 types of data Qualitative – Words, images, observations, conversations,
Chapter 17 Ethnographic Research Gay, Mills, and Airasian
Wisconsin Bird Conservation Initiative (WBCI) Citizen Science: Past, Present, and Future Efforts in Wisconsin Bill Mueller and Andy Paulios.
1 of 27 PSYC 4310/6310 Advanced Experimental Methods and Statistics © 2013, Michael Kalsher Michael J. Kalsher Department of Cognitive Science Adv. Experimental.
South Carolina Oyster Restoration and Enhancement Water Quality Monitoring: Evaluation of a Digital Training Product for South Carolina Oyster Restoration.
Use of OCAN in Crisis Intervention Webinar October, 2014.
RELIABILITY AND VALIDITY OF DATA COLLECTION. RELIABILITY OF MEASUREMENT Measurement is reliable when it yields the same values across repeated measures.
 Involves testing a hypothesis.  There is no single parameter to estimate.  Considers all categories to give an overall idea of whether the observed.
Standardization and Test Development Nisrin Alqatarneh MSc. Occupational therapy.
A Biodiversity Monitoring Framework for Devon Work Programmes for BIRG discussion 31/07/08 Ray Perrins.
Chap 20-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 20 Sampling: Additional Topics in Sampling Statistics for Business.
+ Biology… It Begins! Chp 1, pg Why is biology important? Questions you’ve asked yourself? Why can birds fly? How do I work? What makes me who.
Comp 20 - Training & Instructional Design Unit 6 - Assessment This material was developed by Columbia University, funded by the Department of Health and.
Chapter 11: Qualitative and Mixed-Method Research Design
The Scientific Method. The Scientific Method The Scientific Method is a problem solving-strategy. *It is just a series of steps that can be used to solve.
Results of the 2009 Survey for Inland Heron Colonies in New Jersey & Survey Plans for 2011 Christina Kisiel NJ Division of Fish and Wildlife Endangered.
Observation & Analysis. Observation Field Research In the fields of social science, psychology and medicine, amongst others, observational study is an.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Market Research The key to the customers wallet …..
National Commission for Academic Accreditation & Assessment Developmental Reviews at King Saud University and King Faisal University.
Slide Slide 1 Copyright © 2007 Pearson Education, Inc Publishing as Pearson Addison-Wesley. Lecture Slides Elementary Statistics Tenth Edition and the.
What Species? We assume this workshop is primarily focused on secretive marshbirds, as defined in the 1998 workshop. But in some (many?) areas, implementation.
DTC Quantitative Methods Survey Research Design/Sampling (Mostly a hangover from Week 1…) Thursday 17 th January 2013.
PCB 3043L - General Ecology Data Analysis. OUTLINE Organizing an ecological study Basic sampling terminology Statistical analysis of data –Why use statistics?
Unit 1 Lesson 3 Scientific Investigations Copyright © Houghton Mifflin Harcourt Publishing Company.
Accuracy of Land Cover Products Why is it important and what does it all mean Note: The figures and tables in this presentation were derived from work.
BPS - 5th Ed. Chapter 221 Two Categorical Variables: The Chi-Square Test.
Chapter 2 Doing Sociological Research Key Terms. scientific method Involves several steps in research process, including observation, hypothesis testing,
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Using Nonexperimental Research.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
PCB 3043L - General Ecology Data Analysis.
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation Planning your evaluation This presentation provides.
What the data can tell us: Evidence, Inference, Action! 1 Early Childhood Outcomes Center.
12/7/2005Annetta L. Cheek FDA Web-based Drug Information Dr. Annetta L. Cheek Plain Language Action and Information Network.
Qualitative and Quantitative Approaches to Comparative Research Anthony Sealey University of Toronto This material is distributed under an Attribution-NonCommercial-ShareAlike.
Quality Control  Statistical Process Control (SPC)
ACTION RESEARCH By Toni McConnell Rachel Milliken Sarah Montefiore Biljana Milovanovic.
Session 6: Data Flow, Data Management, and Data Quality.
Slide 7.1 Saunders, Lewis and Thornhill, Research Methods for Business Students, 5 th Edition, © Mark Saunders, Philip Lewis and Adrian Thornhill 2009.
COLLECTING DATA: SURVEYS AND ADMINISTRATIVE DATA PBAF 526 Rachel Garshick Kleit, PhD Class 8, Nov 21, 2011.
Biostatistics Dr. Amjad El-Shanti MD, PMH,Dr PH University of Palestine 2016.
Chapter 9 Estimation and Confidence Intervals. Our Objectives Define a point estimate. Define level of confidence. Construct a confidence interval for.
Examining difference: chi-squared (x 2 ). When to use Chi-Squared? Chi-squared is used to examine differences between what you actually find in your study.
Single Season Study Design. 2 Points for consideration Don’t forget; why, what and how. A well designed study will:  highlight gaps in current knowledge.
Lecture 5.  It is done to ensure the questions asked would generate the data that would answer the research questions n research objectives  The respondents.
Research Design
MSA / Gage Capability (GR&R)
Quality Assurance in the clinical laboratory
PCB 3043L - General Ecology Data Analysis.
Puget Sound Seabird Survey and Early On-Scene Oil Reconnaissance
Using outcomes data for program improvement
Presentation transcript:

Harbor Herons Citizen Science Surveys: Issues, Constraints, and Future Directions. Nellie Tsipoura, Kristin Munafo, Tom Smith, Kate Ruskin, Kim Mendillo, New Jersey Audubon; Susan Elbin, New York City Audubon

Why do these Citizen Science surveys work? Dedicated citizen scientists Trainings Volunteer input welcome “Participatory” project Online data entry Carefully crafted protocols Maintaining contact with volunteers

What are the issues Habitat AssessmentHabitat Assessment Effects of TidesEffects of Tides DistanceDistance Data entry and program administrationData entry and program administration

Habitat Issues Reported percentages may change drastically from one survey to the next.Reported percentages may change drastically from one survey to the next. – In some cases, this may represent actual habitat changes that occurred at the site. In other cases, it may be due to variation in visual estimates from one visit to the next.

Habitat Issues Volunteers may have different approaches for estimating habitat percentages.Volunteers may have different approaches for estimating habitat percentages. –Some volunteers have done this by deciding on percentages during the first survey, and then change only those percentages that really change (e.g. mudflat vs. open water). –Other volunteers estimate percentages independently during every survey.

Habitat Issues Possible solutions: Possible solutions: Use only the dominant habitat class for analysis.Use only the dominant habitat class for analysis.

Habitat – NJ and NY Data Average total counts per point visit, for each dominant habitat type (as selected by volunteer)Average total counts per point visit, for each dominant habitat type (as selected by volunteer)

Habitat Issues There are discrepancies within the same survey, between the overall site habitat percentages recorded and the individual bird habitat entered under the behavioral observations.There are discrepancies within the same survey, between the overall site habitat percentages recorded and the individual bird habitat entered under the behavioral observations.

Habitat – Preliminary Data Specific habitats used by birds volunteers selected for behavioral observationsSpecific habitats used by birds volunteers selected for behavioral observations

Habitat – What does it mean? Bird distribution may be related to dominant habitat type even if when they selectively use a different habitat type within the siteBird distribution may be related to dominant habitat type even if when they selectively use a different habitat type within the site –Mudflat/open water changes with tide Volunteers are selecting birds in a biased way for their behavioral observations.Volunteers are selecting birds in a biased way for their behavioral observations. –Volunteers may be selecting open water habitat preferentially over other habitats Sampling bias?Sampling bias? –More data from open water sites More information is needed!

Habitat Issues Possible solutions: Explore habitat characteristics of sites where no birds were seen?Explore habitat characteristics of sites where no birds were seen?

Dominant Habitat for Points with no birds observed (on any survey)Dominant Habitat for Points with no birds observed (on any survey) Habitat – NY and NJ Data

Dominant habitat for points with no birds observed was open waterDominant habitat for points with no birds observed was open water Not different from the predominant habitat for the individual bird observations.Not different from the predominant habitat for the individual bird observations.However, Is open water without associated mudflat a reflection of hardened shorelines and water levels that may be too deep for egrets?Is open water without associated mudflat a reflection of hardened shorelines and water levels that may be too deep for egrets? Habitat – NY and NJ Data More information is needed!

Habitat Issues Possible solutions: Possible solutions: Can we analyze a subset of the data to look at habitat use patterns?Can we analyze a subset of the data to look at habitat use patterns?

Water depth for Great Egrets and Snowy EgretsWater depth for Great Egrets and Snowy Egrets Habitat – NJ Data

Water depth for Great Egrets and Snowy EgretsWater depth for Great Egrets and Snowy Egrets Habitat – NY Data

Habitat Issues Can we make management recommendations for specific habitats based on these data? Can we make management recommendations for specific habitats based on these data? ??? Maybe not ??? Maybe not We can analyze a subset of the data to look at habitat use patterns. More complex data becomes more difficult to interpret.

Habitat Issues Solutions: Solutions: Standardize collection of habitat informationStandardize collection of habitat information –estimate percentages at the beginning of the season and then change only the ones that vary, while keeping the others constant. Give volunteers aerial photos to ground truthGive volunteers aerial photos to ground truth –Problematic. Use staff to record habitat and other relevant site informationUse staff to record habitat and other relevant site information –Funding constraints

Tide Issues Tide information is crucial; however, the data collection and entry can be confusing.Tide information is crucial; however, the data collection and entry can be confusing. Many sites (in both the Meadowlands and Raritan) have a tide delay, relative to the available tide tables.Many sites (in both the Meadowlands and Raritan) have a tide delay, relative to the available tide tables. –Some volunteers have adjusted tides using the appropriate delay, while others do not. Therefore, tide information needs to be proofed and adjusted before data analysis.

Tide Issues Management changes at some sites can cause unexpected tide fluctuationsManagement changes at some sites can cause unexpected tide fluctuations –Sites controlled by tide gates, sites subject to restoration that alters tidal regimes At some sites it may not be tidal cycle, but the proportion of mudflat and open water that determines use by waterbirds.At some sites it may not be tidal cycle, but the proportion of mudflat and open water that determines use by waterbirds. –This may also relate to rainfall, site management and lunar cycles.

Tide Issues Possible solutions: Possible solutions: Collect tide information carefullyCollect tide information carefully –In 2010 we used time of survey and the time of the low to and calculated the stage in the tidal cycle. Proof tide information carefullyProof tide information carefully –Incorporate the time needed to enter and correct tidal information before the data can be analyzed in project budgets.

Tide – Preliminary Data A subset of sites were selected for analysisA subset of sites were selected for analysis Focus on sites that we know have no tidal delay, or for which delay corrections were made.Focus on sites that we know have no tidal delay, or for which delay corrections were made. MeadowlandsRaritan Mill CreekSandy Hook Marsh ResourcesEdmund’s Avenue Secaucus HS MarshRaritan Center

Tide – Preliminary Data Chi-Square = 7.96; P = 0.04

Tide – Preliminary Data Chi-Square = 38.1; P < 0.001

Tide – What does it mean? There is a slight effect of tide for GREGs, with lower numbers at low relative to all other tides.There is a slight effect of tide for GREGs, with lower numbers at low relative to all other tides. There is a large effect of tide for SNEGs, with preferences for low and incoming over high and outgoing.There is a large effect of tide for SNEGs, with preferences for low and incoming over high and outgoing. This is in agreement to the results of the habitat/water depth data for SNEGs.This is in agreement to the results of the habitat/water depth data for SNEGs. Our Citizen Science data are reasonably good or can be edited and corrected to give us the information we need.Our Citizen Science data are reasonably good or can be edited and corrected to give us the information we need.

Distance Issues There are no distance categories for the bird observations.There are no distance categories for the bird observations. It would be useful to know which birds are seen relatively close to the point and which are seen at a great distance (e.g. 500m or more).It would be useful to know which birds are seen relatively close to the point and which are seen at a great distance (e.g. 500m or more). –This might eliminate biases in the habitat data –Distance categories may also allow us to undertake some type of detection probability analysis

Distance Issues Possible solutions: Possible solutions: Have volunteers record birds in distance classes (less than 100m, m, >500m).Have volunteers record birds in distance classes (less than 100m, m, >500m). –There may be problems related to distance estimation in the field. Have volunteers record bird locations on a site map during every survey. This would allow us to identify which portions/habitat within the site the birds are using.Have volunteers record bird locations on a site map during every survey. This would allow us to identify which portions/habitat within the site the birds are using. –However this would result in very time intensive data entry and proofing post-data collection.

Program Administration Issues Decline in volunteer participation without a staff coordinator.Decline in volunteer participation without a staff coordinator. Data are useful, but a certain amount of post- data collection data proofing and manipulation is essential before any meaningful analysis.Data are useful, but a certain amount of post- data collection data proofing and manipulation is essential before any meaningful analysis. Unpredictable site changes (e.g. habitat, tide) need to be tracked through communication with site managers.Unpredictable site changes (e.g. habitat, tide) need to be tracked through communication with site managers.

Conclusions Where do we go from here? Citizen Science data can be used in at least some types of analyses after being corrected and processedCitizen Science data can be used in at least some types of analyses after being corrected and processed Continue volunteer effort – this allows us to survey many more sites and much more often that we would be able to do with staff.Continue volunteer effort – this allows us to survey many more sites and much more often that we would be able to do with staff. Develop and obtain funding for a hybrid volunteer/staff program to address specific concerns such as habitat use.Develop and obtain funding for a hybrid volunteer/staff program to address specific concerns such as habitat use.