1 Question on vision Results of the cognitive test Jeremiah Banda and Maria Martinho United Nations Statistics Division.

Slides:



Advertisements
Similar presentations
Session 3 “In-depth review of cognitive and field test results and experiences” QUESTION ON VISION Country results: Argentina Gladys Massé
Advertisements

1 ESCAP/WHO Pilot Study Overview Wei Liu Statistics Division, ESCAP Sixth Meeting of the Washington Group on Disability Statistics, Kampala,
UNESCAP Project on Disability Statistics Field testing protocol.
 I consistently calculate confidence intervals and test statistics correctly, showing formula, substitutions, correct critical values, and correct margins.
Data collection and information management RAABs: How frequently should these be done at national or sub-national level? Hans Limburg, MD PhD, DCEH.
Learning from Across the Border. Learning from across the border Organisations are at different stages in relation to using and analysing equality information.
Analysis. Start with describing the features you see in the data.
VISION Results of the Cognitive and Field Tests 10 th Washington Group Meeting Luxembourg, 3-5 November 2010.
CHAPTER 7 Sampling Distributions
Chapter 3 Producing Data 1. During most of this semester we go about statistics as if we already have data to work with. This is okay, but a little misleading.
INTERPRET MARKETING INFORMATION TO TEST HYPOTHESES AND/OR TO RESOLVE ISSUES. INDICATOR 3.05.
Exploring the Washington Group Data from the 2011 U.S. National Health Interview Survey Julie D. Weeks, Ph.D. National Center for Health Statistics, USA.
Summary of Annual Activities Related to Disability Statistics Cordell Golden National Center for Health Statistics United States Thirteenth Meeting of.
Country Report on the Pre Test to Improve Disability Measurement Statistics Sri Lanka 2009 (UNESCAP /WG supported)
Standard Grade Modern Studies Enquiry Skills - Investigating Questions -
Research Methods and Design
The BI-Mark Vision 1. 1.Do you wear glasses or contact lenses? 2. 2.How much difficulty do you have in clearly seeing someone ’ s face across.
The harmonized Joint Pilot Tests for 2010 Census Round in Latin American Countries: an integration experience Alicia Bercovich Population Census Committee.
NCPEDP Study on Disability Question in Population Census of India 2011 Prepared by DEOC.
Cognitive Interviewing for Question Evaluation Kristen Miller, Ph.D. National Center for Health Statistics
SPECA Workshop on Disability Statistics, Dec 13-15, 2006 The Definition and Measurement of Disability: The Work of the Washington Group Jennifer Madans.
HEARING DOMAIN 10th Washington Group meeting Luxembourg 3-5 November 2010 B.Tserenkhand National Statistical Office of Mongolia.
SCIENCE FAIR 2009.
SPECA Regional Wrokshop on Disability Statistics, Dec 13-15, 2006 Issues Related to Disability Measurement: Cognitive testing and mode Jennifer Madans.
Fifth Annual Meeting of the WG: Objectives and Agenda Jennifer H. Madans U.S.A.
1 United Nations collection of national disability statistics from population and housing censuses and related national surveys and administrative registers.
Sixth Meeting of the Washington Group on Disability Statistics Session 3: In-depth review of cognitive and field test results and experiences Cognition.
Report on the Budapest Initiative* *Joint UNECE/WHO/Eurostat Task Force on Measurement of Health Status Jennifer H. Madans National Center for Health Statistics,
Rapid Assessment of Avoidable Blindness in England Hannah Kuper Robert Lindfield.
Measuring Disability Prevalence Daniel Mont, HDNSP Disability and Development Team June 6, 2007.
The Definition and Measurement of Disability: The Work of the Washington Group (continued) Daniel Mont Disability and Development Group The World Bank.
Washington Group Cognitive Test Kristen Miller Questionnaire Design Research Lab National Center for Health Statistics, USA 1) Purpose of cognitive test.
Presentation on Field tests Margie Schneider Dan Mont 6 th Meeting of the Washington Group Kampala, Uganda 10 – 13 th October 2006.
Cognition domain Cognition domain 10th Washington Group meeting Luxembourg 3-5 November 2010 Andres Montes ESCAP Statistics Division.
FATIGUE Results of ESCAP Testing Barbara M. Altman Disability Statistics Consultant Washington Group, November 3-5, 2010, Luxembourg.
6 th Washington Group Meeting on Disability Statistics COGNITIVE TESTING EXERCISE Question 1: VISION Presented by Helen Laetitia Nviiri Principal Statistician,
Examination of Disparities Between Reponses to Short Set Questions and Extended Questions: With Emphasis on Those Reporting Unable Barbara M. Altman.
Why is Research Important?. Basic Research Pure science or research Research for the sake of finding new information and expanding the knowledge base.
PAIN. Pain Questions Do you have frequent pain? Do you use medication for pain? If yes: In the past 3 months, how often did you have pain? Some days,
Cornelia Taylor, ECO at SRI Kathy Hebbeler, ECO at SRI National Picture –Child Outcomes for Early Intervention and Preschool Special Education October,
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
SPECA Meeting, Paris, June 16, 2006 Activities Related to Health and Disability Statistics in the UNECE Region and Globally Jennifer H. Madans for the.
Scientific Method Vocabulary Review Compiled By Robert Strawn.
SCIENCE FAIR 2010.
Journalism 614: Public Opinion & Research Design.
Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part II.
Cognitive test Results Mobility Question By LYDIA MOTHIBELI 6 th Annual meeting of WG Uganda Lesotho Cognitive test Lesotho Cognitive test.
Proceedings and outcomes of WG workshops Jennifer H. Madans U.S.A.
SELF – REPORT TECHNIQUES
… the work of the Washington Group on Disability Statistics Jennifer H. Madans National Center for Health Statistics, USA for the Washington Group on Disability.
Country pre-test results: Vietnam VietnamBy Nguyen Phong Nguyen Dinh Chung General Statistics Office 6th Annual Meeting of the Washington Group in Kampala,
Sixth Annual Meeting of the WG: Objectives and Agenda Jennifer H. Madans U.S.A.
TANZANIA- COGNITIVE TEST RESULTS QUESTIONS ON HEARING By. Ms. Albina Chuwa October, 2006.
Washington Group Meeting, Kampala, Uganda, Oct Mobility Barbara M. Altman Disability Statistics Consultant.
Plan for Today: Chapter 1: Where Do Data Come From? Chapter 2: Samples, Good and Bad Chapter 3: What Do Samples Tell US? Chapter 4: Sample Surveys in the.
Comments on vision domain 10th Washington Group meeting Luxembourg 3-5 November 2010 Andres Montes ESCAP Statistics Division.
M ARKET R ESEARCH Topic 3.1. W HAT IS MARKET RESEARCH ? The process of gaining information about customers, products, competitors etc through the collection.
SCIENCE TEST 35 Minutes; 40 Questions; 7 Passages 5 – 7 questions per passage 5 minutes per passage Evaluates your ability to reason scientifically 3 Question.
Understanding the Washington Group Measures: Distinguishing disability status from response error.
UNICEF/WG MODULE ON INCLUSIVE EDUCATION
Washington Group on Disability Statistics (WG16)
Cognitive Interview Obstacles
Towards improved measures of disability for development indicators
Comparing Estimates from the ACS and WG Question Sets
ESCAP/WHO Field Results on
Interpreting and analysing data
Barbara M. Altman Disability Statistics Consultant
THE NATURE OF SCIENCE.
Interpreting and analysing data
Countries with Discrepancies Between National and International Data
Presentation transcript:

1 Question on vision Results of the cognitive test Jeremiah Banda and Maria Martinho United Nations Statistics Division

2 Analysis of cognitive data The cognitive test included: The WG question Do you have difficulty seeing even if wearing glasses? Other questions on vision and seeing difficulties Without/With your glasses, how often do you have difficulty seeing well? … Without/With your glasses, do you have difficulty seeing and recognizing a person from 7 meters (20 feet) away? A question on the use of glasses Do you wear glasses all of the time, only for certain activities or none of the time?

3 Analysis of cognitive data (cont.) Response patterns Aim: compare replies to WG question with those to other questions Interpretation of results Purposive sample: % of cases in each pattern is not and estimate of the % in the general population. Replies to open question can suggest explanations for inconsistencies between the WG question and the other questions International comparability: do respondents in different countries interpret the question in a similar way? Wears glasses? Reported seeing difficulties? WG questionOther questions Yes/No

4 Response patterns PatternWG questionOther questionsWears glasses A No B Yes C No DYes E No Yes F No G Yes H No Yes No

5 Response patterns WG question and near/far vision questions Do you have difficulty Near vision: seeing the print in a map, newspaper or book? Far vision: seeing/recognizing a person you know from 7 meters away? ABCDEFGHTotal Gambia Philippines Paraguay … Total Inconsistency between the WG and near/far vision questions

6 Response patterns WG question, near/far vision and diff/effort questions Without/ With your glasses, Diff: how often do you have difficulty seeing well? Effort: seeing/recognizing a person you know from 7 meters away? Inconsistency between the WG and near/far vision questions ABCDEFGHTotal

7 Response patterns WG question, near/far vision and diff/effort questions ABCDEFGHTotal Near/far vision Near/far vision and diff/effort More consistent replies when the diff/effort questions are taking into account

8 Some thoughts on the glasses clause The difficulties and location of the glasses clause only explains a part of the discrepancies between the WG question and the near/far vision question then inconsistencies between diff/effort questions and WG questions should be equally high. They are not! Near/far vision & diff/effort questions WG question At the beginning Difficult to understand At the end Easier to understand If the difficulties and location of the glasses clause were the only reason for inconsistencies between near/far vision and WG questions,

9 Response patterns in detail WG question, near/far vision and diff/effort questions Replies to WG Question Highest reply among other vision questions N= = No difficulty/Never

10 Inconsistent respondents: Replies to the open question WG question, near/far vision and diff/effort questions Pattern E - wears glasses, yes to WG question Glasses clause misunderstood in WG question: 33 respondents (e.g. “ because I wear glasses ”, “ I am short-sighted ”) Near/far vision questions not able to capture respondent’s seeing problems: 11 respondents (e.g. cataracts, problem with one eye only) No clear explanation: 26 respondents Pattern F - no glasses, yes to WG question 2 respondents (both from Vietnam) reported some difficulty in the WG question: because they can see well!!!

11 Inconsistent respondents: Replies to the open question WG question, near/far vision and diff/effort questions Pattern G - wears glasses, no to WG question 15 respondents understood the glasses clause and reported no difficulty to WG question (e.g. “ I see well with glasses ”). Why do they report difficulties to the near/far vision?) No clear explanation: 4 respondents Pattern H - no glasses, no to WG question 11 respondents claim to see well (why do they report difficulties to the near/far question?) 1 does not report difficulties to WG question because he is not blind 2 wear glasses!!! (we can not use near/far question) No clear explanation: 12 respondents

12 Comparability of the WG question across countries Interpretations found in several countries: Glasses clause missed in the WG question: Kenya, Egypt, Vietnam, Argentina, Paraguay, Brazil, Mexico Glasses clause understood in the WG question: Argentina, Paraguay, Brazil and Mexico Inconsistency between WG and near/far questions for persons with problem in one eye only, cataracts, irregular blurred vision: Paraguay, Argentina, Brazil, Philippines All replies consistent: all countries

13 Comparability of the WG question across countries Interpretations found in several countries (cont.): Respondents claim to see well with glasses but report difficulties in the near/far question: Argentina, India, Paraguay, Brazil and Mexico Respondents do not wear glasses, claim to see well but report difficulties in the near/far question: Uganda, Kenya, Argentina, India, Philippines, Paraguay, Brazil and Mexico Country-specific interpretations: Report some difficulty in seeing because they see well (Vietnam)

14 Conclusions and issues to discuss ‘Even if wearing glasses’: in or out? Sometimes respondents (or interviewers?) miss it WG question interpreted in a comparable way across countries? Most response patterns and interpretations were found in several countries Inconsistencies between WG questions and near/far vision were often due to: The glasses clause can be missed in any of those questions Some disabilities not captured by the near/far vision question (such as blind of one eye)

15 Conclusions and issues to discuss Other explanations suggested for inconsistencies: A respondent that needs glasses may reply to the WG question in a hypothetical way ( If I had glasses, I would see well ) Some persons anticipate financial assistance by reporting a difficulty Ageing respondents may believe their vision is weakening Blind people do not report difficulties in near/far vision questions Illiterate people report difficulties in near vision question Only field tests can tell us if the % of people falling in the inconsistent patterns is large enough to be worrying

16 Further analyses Analyse the effect of interview difficulties Study patterns of other questions on vision issues Study open questions in relation with other questions Repeat analysis for proxy data Investigate association with socio-economic variables