1 What is Representativeness, and why are we confused? Revital Katznelson State Water Resources Control Board NWQMC 2006 San Jose, CA.

Slides:



Advertisements
Similar presentations
Please sit by level. Welcome! Quality Liaisons Leaders of Continuous Improvement.
Advertisements

Team Leads Orientation to the Activity Tracker. Thank you for becoming an Active U Team Lead This presentation has been developed to orient you to the.
Considerations for Data Series for Current Practices Scenario November 2006 Update 17 January 2007 B. Contor (New stuff will be in green boxes or on green.
SIMS 213: User Interface Design & Development Marti Hearst Tues, Feb 25, 2003.
1 The Basics of Regression Regression is a statistical technique that can ultimately be used for forecasting.
Statistical Concepts (continued) Concepts to cover or review today: –Population parameter –Sample statistics –Mean –Standard deviation –Coefficient of.
SIMS 213: User Interface Design & Development Marti Hearst Tues Feb 13, 2001.
On Scoring Guides everything you were afraid to ask PART TWO.
Psych 231: Research Methods in Psychology
Animal Behavior Lab Instructions
Statistically-Based Quality Improvement
Assessment, Data collection methods Baseline Survey Module 3 – Session 1 Assessment – Time line Data collection methods Baseline survey.
Minnesota Manual of Accommodations for Students with Disabilities Training Guide
Water Quality Completing Lab 8. Reminder - What’s Due for Lab 8 Full Lab Report (One per Group) (a)Title & Abstract start with catchy title and list of.
Chapter 9 Flashcards. measurement method that uses uniform procedures to collect, score, interpret, and report numerical results; usually has norms and.
Lecture II.  Using the example from Birenens Chapter 1: Assume we are interested in the game Texas lotto (similar to Florida lotto).  In this game,
Evaluating the transfer-promoting potential of ESOL materials Mark Andrew James Arizona State University / Sunshine.
Why Johnny Can’t Apply: Using Cognitive Psychology to Redesign a Business Statistics Class Ronald Bruce Associate Professor Gwynedd Mercy University
© 2007 Pearson Education Managing Quality Integrating the Supply Chain S. Thomas Foster Chapter 12 Statistically-Based Quality Improvement for Variables.
1 of 39 DQO Implementation Process: Flow Chart and Wall Charts 30 minutes DQO Training Course Day 2 Module 8 Presenter: Sebastian Tindall.
Assessing the Curriculum Gary L. Cates, Ph.D., N.C.S.P.
Understanding and Implementing SWAMP Comparability: Quality Assurance SWAMP Quality Assurance Help Desk Quality Assurance Research.
Successful SAT Implementation (SSI Series) 1. Kick-off to the SAT
California Rapid Assessment Method for Wetlands (CRAM) Project and Ambient Assessments.
ISLLC Standard #2 Implementation
Science, consensus, and monitoring strategies : the art of revising a long-term benthic monitoring program Heather Peterson California Department of Water.
Monitoring through Walk-Throughs Participants are expected to purpose the book: The Three-Minute Classroom Walk-Through: Changing School Supervisory.
NR 422 Quality Control Jim Graham Spring Staircase of Knowledge Increasing Subjectivity Human value added Observation And Measurement Data Information.
Developing Monitoring Programs to Detect NPS Load Reductions.
Teaching Students to Prove Theorems Session for Project NExT Fellows Presenter: Carol S. Schumacher Kenyon College and.
School Leadership Module Preview This PowerPoint provides a sample of School Leadership Module PowerPoint. The actual Overview PowerPoint is 73 slides.
Usability Evaluation June 8, Why do we need to do usability evaluation?
Evaluator Workshop for Personnel Evaluating Teachers Rhode Island Model The contents of this training were developed under a Race to the Top grant from.
1 of 21 Introduction to the EPA 7-Step DQO Process DQO Training Course Day 1 Module 7 (30 minutes) Steps Presenter: Sebastian Tindall.
Part 4 – Be a Citizen - Scientist Electronic Tools Side Event UNECE Aarhus Convention 1 st Meeting of the Parties Lucca, Italy October 21-23, 2002 Frances.
School of Health Systems and Public Health Monitoring & Evaluation of HIV and AIDS Programs Data Quality Wednesday March 2, 2011 Win Brown USAID/South.
Peer coaching is a strategy where one or more teachers form a partnership with one another for the purpose of observing, recording, and providing feedback.
Tier I: Implementing Learning Walks & Instructional Rounds OrRTI Conference Tara M. Black, M.Ed. May 9,
Biostatistics: Sampling strategies Data collection for fisheries assessment: Monitoring and sampling strategies.
Coupling Cohesion Chandan R. Rupakheti Steve Chenoweth (Chapter 18)
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
What’s golden? DAY 4. Agenda Norms Morning Jumpstart Discourse Investigating statistical variability Designing lesson #1 Lunch Launch after Lunch Migraines.
Copyright © 2008 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of.
FORS 8450 Advanced Forest Planning Lecture 5 Relatively Straightforward Stochastic Approach.
Chapter 2 Doing Sociological Research Key Terms. scientific method Involves several steps in research process, including observation, hypothesis testing,
Planning your Project Managing your 333T project is like managing any professional project.
Precision Agriculture in Small Scale Farm System Yumiko Kanke.
Asking for Assistance conveying a tone in your writing conveying a tone in your writing.
Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part II.
ISLLC Standard #1 Implementing a Shared Vision Name Workshop Facilitator.
WISKI for Hydrologic Assessment Michael Seneka Water Policy Branch Alberta Environment and Sustainable Resource Development.
Just Culture Implementation – Phase 2 Using the Just Culture Algorithm
District Leadership Module Preview This PowerPoint provides a sample of the District Leadership Module PowerPoint. The actual Overview PowerPoint is 73.
LECTURE 09: INTERACTION PT. 2: COST October 19, 2015 SDS235: Visual Analytics Note: slide deck adapted from R. Chang.
1 Module One: Measurements and Uncertainties No measurement can perfectly determine the value of the quantity being measured. The uncertainty of a measurement.
Moderation and Validation of Teacher Judgements in School.
Watershed Monitoring and Modeling in Switzer, Chollas, and Paleta Creek Watersheds Kenneth Schiff Southern California Coastal Water Research Project
ENVE 201 Environmental Engineering Chemistry 1 Sampling – Sampling Types Dr. Aslıhan Kerç.
Welcome! Seminar – Monday 6:00 EST HS Seminar Unit 1 Prof. Jocelyn Ramos.
Instructional Leadership: Monitoring Insights, Patterns, & Trends.
Lead Teach Learn PLC Fundamental IV: Multi-Tiered System of Supports.
Statistical Concepts Basic Principles An Overview of Today’s Class What: Inductive inference on characterizing a population Why : How will doing this allow.
Outcomes By the end of our sessions, participants will have…  an understanding of how VAL-ED is used as a data point in developing professional development.
Walking the Fine Line between Training and Coaching
3.5 General feeling that knowledge of hydrology has improved … but more is needed.
Senior Instructional Technology Consultant
CS 139 – Programming Fundamentals
Two Halves to Statistics
Think about your view of QA
Presentation transcript:

1 What is Representativeness, and why are we confused? Revital Katznelson State Water Resources Control Board NWQMC 2006 San Jose, CA

2 Why am I talking about it? Speaker’s biosketch Grew up in Hebrew Teenager in CA in English University days in Scientese …..hard time with Agentese! (Tri-Lingual and happy)

3 Today’s objectives: Make some distinctions Suggest words to communicate Try to do some confusion abatement Why am I talking about it?

4 Googled it 4/20/06 The hypothesis that people evaluate probabilities by representativeness … by intuitive statistical heuristic.. similar effect of the gambler's fallacy… The question of the representativeness of the organizations is fundamental …to hold a Representative town meeting Representativeness refers to judgments based on stereotypes The legal concept of union representativeness implies a process of selection… Behavioral finance, representativeness bias, overreaction, earnings announcements And finally…..sites that have a 'typical' species composition for the considered ecosystem Found 2,410,000 hits

5 Different meanings Environmental Monitoring Gambling Politics Meeting Delegates Finance

6 Focus: Environmental Environmental Monitoring Many Grabs One Grab Statistical meaning non-representative ‘sample’ = statistically biased Sample properties Different meanings for ‘Representative sample’ Confusion Item # 1: One sample or many?

7 Environmental Monitoring Many Grabs One Grab The Environment Representative sample and what it represents in the environment [next 7 slides] ‘Analytical Quality’: Sample integrity Lack of contamination Lack of deterioration Sample homogeneity Uniformity of aliquots Confusion Item # 2: How the sample represents itself, versus the environment

8 ‘The Environment’: an example Alameda Creek, April 2006

9 What the sample represents in the environment in the context of inherent environmental variability [next slide and later] The Environment Representative sample and what it represents in the environment Confusion Item # 3: A representative sample versus what it represents How the sample is collected – e.g., bottle dipped in the centroid of the flow rather than at the edge, so it is representative of the bulk of the flow Centroid

10 Temporal Variability What time of day is more representative? Or - does each time represent something else? What is YOUR intent? What the sample represents in the environment in the context of inherent environmental variability 1 234

11 How will you select monitoring location and timing? In other words, which sampling design principle will you apply?

12 Spatial descriptors Station Type : Creek, Outfall, Ditch Station Selection Intent: Impact assessment, Source ID Reach Selection Design: Systematic, Directed, Random, or Non-Deliberate (Anecdotal) Station Selection Design: (same options) Temporal descriptors Flow Conditions: Storm runoff flows (wet) or base flow (dry) weather Sample Timing Intent: Worst case, Snapshot, Routine Monitoring Seasonal Sampling Design: Systematic, Directed, Random, etc. Diurnal Sampling Design: (same options) Season of interest: Summer, Fall Useful Words

13 - Training tool to teach the basic concepts of variability; - Planning tool to hone in on the intent and the design of the study; - Dialogue tool to solicit feedback from experts; - Instruction tool to guide Project operators; and - Communication tool to inform data users what each result represents in the environment. Applications of these words

14 I am the worst case scenario I have been collected in a stagnant ditch at 14:00 DO =5.6 pH =8.7 Let Monitoring Results Speak for Themselves!

15 Enhancing Representativeness Composite Collect Many Confusion Item # 4: How composited? Integrated collection versus pooled grabs Back to Representativeness…

16 Bonus Confusion Item!

17 RunRifflePoolStep PoolRifflePool Spatial Variability What the sample represents in the environment in the context of inherent environmental variability

18 Value e.g., Distance, or Time Inherent Variability (Field Variability) Value Sequence of Repeated Measurements (of same thing) Measurement Precision Error (Lab Variability) = Environment = One Grab Sample = Error Range, e.g., Lab Control Chart = Repeated Measurement (Rep, Dup)

19 Do…. Collect as many individual samples as you can, and analyze separately! Collect paired samples often (at the same time and place), and calculate measurement precision. You will know both: + the measurement error + and the inherent variability Value e.g., Distance, or Time Do… (w field measurement or Sample) Or… (w Sample only, if less $$) Value e.g., Distance, or Time But Please Don’t Lump Inherent Variability with Measurement Error If your individual samples are used as repeated measurements to calculate measurement precision, you will NOT know either: -- the measurement error -- Or the inherent variability Value e.g., Distance, or Time Composite Or…. Create a composite sample and analyze it (preferably in two lab reps). Calculate or apply lab measurement precision. You will know: + the measurement error -- But not the inherent variability

20 Environmental Monitoring Collection Protocol: How a Sample represents The bulk of flow Gambling Politics Meeting Delegates Finance ‘Non-Env.: ‘Environmental’: What a Sample or a Measurement Represents (Intent, Design, Conditions, Station type) Statistical: How multiple Samples represent average conditions Measurement Error: Accuracy&Precision of the Measurement System Inherent Variability: How values change over space and time ‘Analytical’: Sample Integrity, Homogeneity, Uniform aliquots (Not about this) Summary

21 Knew it already? I hope it was good to meet a kin spirit. Learned something useful? Welcome! Feel like I have just opened… Thanks for Listening! You…

22 A can of worms? My apologies… But there is help! SWAMP Field Modules, (check out Common Element C) DLC/demos/swampFT/index.html Clean Water Team Guidance (check out DQM-IP-8.2.4) ps/cwtguidance.html My