COUNTRY: KENYA NAME OF PRESENTER: FRANCIS M. MUNENE TITLE: CHIEF ECONOMIST, MINISTRY OF JUSTICE AND CONSTITUIONAL AFFAIRS. QUESTION: SELF CARE QUESTIONS.

Slides:



Advertisements
Similar presentations
2/8/2014 Measuring Disability and Monitoring the UN Convention on the Rights of Persons with Disabilities… … the work of the Washington Group on Disability.
Advertisements

Innovation data collection: Advice from the Oslo Manual South East Asian Regional Workshop on Science, Technology and Innovation Statistics.
Module 2 Sessions 10 & 11 Report Writing.
SADC Course in Statistics Assessing data critically Module B1 Session 17.
SADC Course in Statistics Session 4 & 5 Producing Good Tables.
1 The Social Survey ICBS Nurit Dobrin December 2010.
To Halton Youth Service 
Health and Functional Status of Working Age People with Disabilities in the United States Gerry E. Hendershot Consultant on Disability and Health Statistics.
Maintaining data quality: fundamental steps
Multiple Indicator Cluster Surveys Data Interpretation, Further Analysis and Dissemination Workshop Basic Concepts of Further Analysis.
Chapter Thirteen Fieldwork 13-1 © 2007 Prentice Hall.
Copyright 2010, The World Bank Group. All Rights Reserved. Statistical organization Principles and models Part 1 Strengthening Statistics Produced in Collaboration.
LIST QUESTIONS – COMPARISONS BETWEEN MODES AND WAVES Making Connections is a study of ten disadvantaged US urban communities, funded by the Annie E. Casey.
Self-Care Question: Cognitive Testing Results 6 th Annual Mtg UN Washington Group on Disability Statistics Kampala, Uganda October 10-13, 2006.
1 How High Interest Card Debts Affects Debtors’ Quality of Life Survey Report Dr. Robert Ting-Yiu Chung Director of The Public Opinion Programme, University.
Combining the strengths of UMIST and The Victoria University of Manchester An analysis of the relationship between time spent on active leisure and educational.
The Effort to Develop Disability Questions for the Current Population Survey Terence M. McMenamin U.S. Bureau of Labor Statistics October 5, 2006.
Data Analysis, Interpretation, and Reporting
Evaluation of SEED in Romania and England Angela Sorsby Joanna Shapland University of Sheffield Funded by National Offender Management Service (England)
Chapter 7 Correlational Research Gay, Mills, and Airasian
Exploring the Washington Group Data from the 2011 U.S. National Health Interview Survey Julie D. Weeks, Ph.D. National Center for Health Statistics, USA.
Student views about homework Toby Leonard Eleanor Scott Jessica Hollis Nima Habibzadeh Lauren Danbury Alice Ward.
How to Assess Student Learning in Arts Partnerships Part II: Survey Research Revised April 2, 2012 Mary Campbell-Zopf, Ohio Arts Council
Client Satisfaction Survey what’s possible Belgrade, July 2010 Report on the findings of the CSAI Success Grants Applicants’ Satisfaction with the Grant.
BSBIMN501A QUEENSLAND INTERNATIONAL BUSINESS ACADEMY.
Cognitive Interviewing for Question Evaluation Kristen Miller, Ph.D. National Center for Health Statistics
Summary of our research project What is the bilingual project? The bilingual project in Madrid is called AICOLE and began in 2004 The project began with.
Identifying the gaps in state assessment systems CCSSO Large-Scale Assessment Conference Nashville June 19, 2007 Sue Bechard Office of Inclusive Educational.
Modeling Possibilities
Technical Adequacy Session One Part Three.
SPECA Regional Wrokshop on Disability Statistics, Dec 13-15, 2006 Issues Related to Disability Measurement: Cognitive testing and mode Jennifer Madans.
Employment, unemployment and economic activity Coventry working age population by disability status Source: Annual Population Survey, Office for National.
Research Methodology. Refers to search for knowledge. Research is an academic activity.
A unique database to provide evidence for solution development David Heaney.
TEMPLATE DESIGN © The Homework Effect: Does Homework Help or Harm Students? Katherine Field EdD Candidate, Department.
September 151 Screening for Disability Washington Group on Disability Statistics.
How can teachers be supported to provide quality learning in emergency and conflict situations? Voices of teachers in South Sudan By John Lujang Wani Deputy.
Sixth Meeting of the Washington Group on Disability Statistics Session 3: In-depth review of cognitive and field test results and experiences Cognition.
 Closing the loop: Providing test developers with performance level descriptors so standard setters can do their job Amanda A. Wolkowitz Alpine Testing.
Chapter Thirteen Validation & Editing Coding Machine Cleaning of Data Tabulation & Statistical Analysis Data Entry Overview of the Data Analysis.
Washington Group Cognitive Test Kristen Miller Questionnaire Design Research Lab National Center for Health Statistics, USA 1) Purpose of cognitive test.
FATIGUE Results of ESCAP Testing Barbara M. Altman Disability Statistics Consultant Washington Group, November 3-5, 2010, Luxembourg.
WHAT IS THE NATURE OF SCIENCE?. SCIENTIFIC WORLD VIEW 1.The Universe Is Understandable. 2.The Universe Is a Vast Single System In Which the Basic Rules.
Control Measures for Non Sampling Errors 1. Sampling Errors arise due to: POPULATION SPECIFICATION ERROR—when the researcher does not understand who (s)he.
PROCESSING OF DATA The collected data in research is processed and analyzed to come to some conclusions or to verify the hypothesis made. Processing of.
Trends in Functional Status and Disability among the Elderly Ellen Kramarow Jennifer Akerblom NCHS Data Users Conference July 2004 U.S. DEPARTMENT OF HEALTH.
0 1 1.Key Performance Indicator Results ( ) KPI Survey Statistics Student Distribution by Year in Program KPI Overall Results Student Satisfaction.
Research Strategies. Why is Research Important? Answer in complete sentences in your bell work spiral. Discuss the consequences of good or poor research.
Employment, unemployment and economic activity Coventry working age population by ethnicity Source: Annual Population Survey, Office for National Statistics.
Cognitive test Results Mobility Question By LYDIA MOTHIBELI 6 th Annual meeting of WG Uganda Lesotho Cognitive test Lesotho Cognitive test.
Criteria for selection of a data collection instrument. 1.Practicality of the instrument: -Concerns its cost and appropriateness for the study population.
Analysis of the characteristics of internet respondents to the 2011 Census to inform 2021 Census questionnaire design Orlaith Fraser & Cal Ghee.
United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Asunción,
The Effect of Facial Paralysis on Career Success: A Preliminary Investigation Cramer Kallem and Kathleen Bogart PhD Oregon State University Introduction.
Surveillance and Population-based Prevention Department for Prevention of Noncommunicable Diseases Displaying data and interpreting results.
N ational Q ualifications F ramework N Q F Quality Center National Accreditation Committee.
The Cognitive Survey for Mauritius – test and results Presented by: Mr Chettun Kumar ARIANAICK Statistician.
Democratic Republic of the Congo Cognitive Test Results Question 6 Communication 6th Washington Group on Disability Statistics 10th-13th October 2006 Jean.
TANZANIA- COGNITIVE TEST RESULTS QUESTIONS ON HEARING By. Ms. Albina Chuwa October, 2006.
Washington Group Meeting, Kampala, Uganda, Oct Mobility Barbara M. Altman Disability Statistics Consultant.
MOROCCAN EXPERIENCE ON DISABILITY STATISTICS THE KINGDOM OF MOROCCO HIGH COMMISSION OF PLANNING BY ZINEB EL OUAZZANI TOUAHAMI Statistician Engineer Directorate.
Survey Training Pack Session 3 – Questionnaire Design.
Week 2: Interviews. Definition and Types  What is an interview? Conversation with a purpose  Types of interviews 1. Unstructured 2. Structured 3. Focus.
WG/UNICEF Child functioning module: Preliminary results from Samoa & Supporting documentation Mitchell Loeb National Center for Health Statistics/ Washington.
Washington Group on Disability Statistics (WG16)
UNICEF/WG MODULE ON CHILD FUNCTIONING: TESTING and ANALYSIS
Angelika H. Claussen, PhD,
The sample under analysis at the end of the scoring was made up of 99 participants as follows:
Concept of Test Validity
Cognitive Interview Obstacles
Presentation transcript:

COUNTRY: KENYA NAME OF PRESENTER: FRANCIS M. MUNENE TITLE: CHIEF ECONOMIST, MINISTRY OF JUSTICE AND CONSTITUIONAL AFFAIRS. QUESTION: SELF CARE QUESTIONS DOMAIN

2. METHODOLOGY 2.1 The sampling design: The sampling design for the pre-test was purposive implying that the selection of respondents was not based on any authoritative method. Interviewers had full freedom to select their respondents from households, disability institutions, through friends and even relatives. Consequently, no inferences can be made from the results. Data collection, processing and submittal of the results strictly followed the general guidelines issued by the Secretariat. Kish Grid method was used to select the proxy respondents

Recruitment criteria of the Interviewers: Selection of interviewers was strictly based on: Ones educational qualification (at least with a minimum of graduate level university education), professional inclination and working experience in research related assignments; Fluency (oral and written) in both English and their respective local language; Availability though out the entire period of the survey;

Ethnic representation; Good understanding of general principles of data collection; Ability to translate the pretest from English (source language) to their local ethnic language); Ability to take interview notes (These two criteria were considered crucial in view of maintaining the original meaning of the English translation and debriefing session that was to follow after the interviews); and Quick grasp of the instruments (this was key for two reasons: the limited time given for the exercise and two, respondents had to occasionally explain to respondents some of the hard- to-comprehend questions.

All interviewers had: Extensive training and experience in statistical surveys and research work. Good understanding of general principles of data collections, processing and analysis. Participated in diverse research assignments, mainly in CBS; Acquired a minimum of graduate level education, with diverse educational specialization ranging from Economics, law, sociology to Applied Statistics.

2.3Translation and duration of the Interviews: Forward and reverse translation was performed from English (source language) to the four main languages that are mainly spoken. These are Kiswahili, Kikuyu, Kamba and Luhya). No major problems identified with language translation except that most of our local languages are not so rich in words that occasionally failed to get their equivalence of English words.

On average, the interviews lasted between one and a half to 2 hours. This was by all standards a long duration and occasionally, interviewers had difficult time maintaining the respondents patience. This however depended on the respondents level of education, their relationship and the amount of interruptions during the interviews. Six interviewers, 2 Editors/ data processing and 1supervisor were recruited for the exercise. They were drawn from the National Statistics Office, some of the reputable research institutions and the local universities.

RESULTS: 2.1 Definition of Self Care Disability: Been defined by the Facilitator 2.2 Key Disability and Functioning Self Care Questions: Given by the facilitator 2.3Explanation of the Patterns: been discussed by the facilitator 2.4Results of the Response Patterns for Kenya

TABLE 2: COMBINED RESPONSE PATTERNS FOR SELF AND PROXY BY BROAD CATEGORIES RESULTS BY RESPONSE PATTERNS: The results are tabulated in three categories. The first set of results give 5 specific response categories (A,B,C, F, G) for both self and proxy as tabulated from the data, the second set shows the 3 broader pattern categories of disability (non problematic – constituted by A and E, borderline – by B,C, F, and G; and Problematic - formed by D and H); while the third set presents cross tabulations of the broader response patterns by key demographic variables

PATTERN RESPONSE PATTERN No. of Cases (%) SELFPROXY A No disability reported, no functioning problem(1,2,3)Perfect agreement or close to perfect). 87%(47 cases) E Disability reported, 3 functioning problem reported, 1 and 2 functioning problems reported. 0%(0 cases) B No disability reported;1 functioning problem reported, at least 2-3 problems not reported 5.6% (2 cases) C No disability reported,2 functioning problem reported,1 and 3 functioning problems not reported 1.9%(1 case) F Disability reported, 2 functioning problems reported and 1 and 3 functioning problems not reported. 5.6%(3 cases) G Disability reported,1 functioning problem reported,2 and 3 functioning problems not reported total disagreement) 0%(0 case)

CONT… D 3 functioning problems reported, no disability reported and 2 functioning problems not reported. 0%(0 case) H Disability reported,1 to 3 functioning problems not reported 1.9%(1 case)0%(0 case) MISS0%(0 case)

CHART 2 RESPONSE PATTERNSRESPONSESELF REPORTING Non problematic response patterns Total agreement between core and extended set of questions 47 cases)87% Borderline response patterns Partial, marginal agreement (6 cases)13.1% Problematic response patterns (1 case)1.9%

2.4.2 Non-Problematic Pattern - Category A and E: Pattern A and B are clearly non-problematic. A reports no disability and negative responses to all the follow-up functioning questions, which is perfectly consistent. E reports difficulty with self care and then at least three positive responses to the follow-up functioning questions. Again, perfectly consistent.

Borderline Category – Pattern F and G; and B and C: F and G are labeled as non-problematic but report at least one functioning problem (one functioning problem for G and two functioning problem under F). At first, it was a bit difficult to decide where to place it. If both of the categories had reported one functioning problem, then, it would have been easier to place them in the non-problematic domain. But F has two functioning problems which was somewhat mild and therefore placing it in the borderline seemed to me perfectly okay.

Categories B and C reported no self care disability but at least one functioning problem, quite similar to categories F and G. The two classes of patterns show perfect agreement up that level. The only difference between the two is that category B and C did not report disability whereas F and G did. Category C had nil responses, while the other three categories had each registered only one response.

2.4.4 OTHER SUPPORTING FINDINGS: Majority (85%) of responses give perfect agreement i.e. fall within the non-problematic category, 15% are in the borderline and about less than 1 percent in the problematic category. That response patterns A, G and G for self and C, D, and H for proxy had nil responses. There were no missing cases in both classes of categories. Categories F and G had one case each under proxy. Such a skewed distribution limits ability to explain some of the hard-to-explain patterns as in the case of B and C category and F and G categories.

Tabulations were run by key demographic variables (namely; age, education, work status, marital status) for each response category. This was in an effort to get some more insights on their effects with a view to explaining some of the hard-to-explain patterns. The results of the tabulations are shown in the following slides.

2.5 Other Findings from further Tabulations by Key Demographic Variables and by Category Category A: No difficult was reported for self across all ages but the proxy data revealed that about 98 % had some difficulties using hands and fingers while about 3% of the respondents felt too tired to dress. For the education variable, about 3% of the proxy university level respondents reported feeling too tired to dress. Analysis by work status and marital status did not show any significant differences in percentage terms for category A. Category B: A large proportion of proxy respondents (25% to 50%) reported difficulties ranging from using fingers to button shirts to tying of shoe laces.

Category E: There were no respondents for self care on this category, but about 7 for proxy. The 7 proxy respondents revealed difficulties ranging from mild to severe in virtually all the 8 parts of question 5, with severity difficulties levelling around 50%(71% difficult putting on socks, 86% combing hair and needing someone to help on daily activities). Category F: 16% of the self care respondents aged 50 years and above had difficult using hands, while 33% of the university level graduates had difficult putting on shoes against 33% for post secondary. For the proxy, 100% reported some difficulty reaching over their heads, and same % too tired to bathe-no direct relationship seen.

Category G: This category registered nil case for self and only 1 case for proxy. The proxy respondent was aged years, had university education, worked for pay, was not married but needed someone to help in daily activities.

3. Explanations for some of the Observed Response Patterns Based on field Experiences and further Tabulations: 3.1 Interpretation of WG Question and Extended Set: The core and extended set of questions were interpreted most consistently among most respondents, whether through proxy or self. This point is collaborated by the overwhelming and perfect agreement of response patterns observed. From the interview observations and follow-up debriefing, It was quite evident that the extended WG and the extended set were well understood by the respondents. Almost all of the self-reporting respondents and at least 11 out of a sample of 12 proxy respondents sampled from the data: Did not require any part of the question repeated;

Never sought for clarification nor demonstrated any difficulties in using the response options. However, on enquiring further why they answered that way, it emerged that majority of the respondents did not take this question kindly. Majority took offence. The impression created was that they were being doubted on. The following examples demonstrate this point: She does not have to ask for help to dress; She knows her well; and

If she has a problem, she would know. Part of these impressive results are attributed to elaborate training, close supervision during field work and engagement experience and qualified staff. Two, compared to other domains, the self care questions were relatively straight forward and easy to understand.

3.2 Question-response problems: There was some evidence of question-response problems but these were quite minimal and mainly conditioned on the physical aspects such as shaking ones hands, putting on socks/stockings etc. and to a large extend, the question was interpreted as asking about relatively serious limitations. They could have contributed to the larger cases falling under borderline. Many of the problems were centred on the respondents ability to conceptualize the level of limitation and to decide whether or not to respond in the affirmative. Such difficulties apparently were more common among respondents who had secondary and lower level of education, reported inferior work status and the aged.

There were relatively more question-response problems with the proxy than self reporting. 3.3 Inclusion of Any Difficulty: The inclusion of the word any difficulty raised some interpretation problems about the scope of difficulties. Respondents with mild self care difficulties tended to ignore the question and only those respondents who considered their impairment to be serious responded affirmatively to the question. Further, respondents tended to concentrate only on the long term conditions that are serious but omitted the short term mild conditions.

5. CONCLUSION: In conclusion, many of the difficulties were largely due to design limitations of the instrument but not content-based. Compared to other domains, the self care questions were relatively easy, straight forwarded, well understood and correctly interpreted by majority of respondents except those with low education, had inferior occupations, and aged (above 50 years of age). We see direct relationship between age and difficult in reporting but no direct relationship with the level of education. That the various response patterns are consist across key demographic variables except for age and to some extent work status. Overall, we saw significant difference in error reporting between self and proxy responses. THANK YOU