UNICEF/WG MODULE ON CHILD FUNCTIONING: TESTING and ANALYSIS

Slides:



Advertisements
Similar presentations
2/8/2014 Measuring Disability and Monitoring the UN Convention on the Rights of Persons with Disabilities… … the work of the Washington Group on Disability.
Advertisements

GETTING STARTING! USING THE BDI-2 IN MA EI A General Overview to Administration.
1 ESCAP/WHO Pilot Study Overview Wei Liu Statistics Division, ESCAP Sixth Meeting of the Washington Group on Disability Statistics, Kampala,
UNESCAP Project on Disability Statistics Field testing protocol.
10 th Meeting of the Washington Group Results from the UNESCAP and the Granada Group testing Luxembourg November 3 – 5, 2010.
5/5/2015 Module on child functioning and disability: questions proposed (1) Roberta Crialesi*, Elena De Palma*, Mitchell Loeb** National Center for Health.
Disability Statistics at NCHS: An Update
TRANSLATION PROTOCOL PREPARED BY ETHEL JN. BAPTISTE ADAPTED FROM EURO-REVES, NOV 2003.
Exploring the Washington Group Data from the 2011 U.S. National Health Interview Survey Julie D. Weeks, Ph.D. National Center for Health Statistics, USA.
Jennifer Madans Associate Director for Science
Cognitive test results and Finalization of the Module on Child Functioning and Disability Mitchell Loeb / Kristen Miller / Meredith Massey NCHS Washington,
8/16/2015 Comparison of Short Set Disability Measures: Mitchell Loeb National Center for Health Statistics/ Washington Group on Disability Statistics 1WG-11.
GENERAL REPORT OF THE COGNITIVE TESTING MÉXICO INSTITUTO NACIONAL DE ESTADISTICA, GEOGRAFÍA E INFORMÁTICA (INEGI) Sixth meeting of the Washington Group.
Disability measurement and statistics - the state of the notion Marguerite Schneider UNECA/LCD conference on UNCRDP, May Addis Ababa Marguerite Schneider.
NCPEDP Study on Disability Question in Population Census of India 2011 Prepared by DEOC.
September 19-20, 2005 Rio de Janeiro, Brazil Internationally Comparable General Disability Measures Barbara M. Altman National Center for Health Statistics.
September 151 Screening for Disability Washington Group on Disability Statistics.
Sixth Meeting of the Washington Group on Disability Statistics Session 3: In-depth review of cognitive and field test results and experiences Cognition.
Report on the Budapest Initiative* *Joint UNECE/WHO/Eurostat Task Force on Measurement of Health Status Jennifer H. Madans National Center for Health Statistics,
The WG Workgroup on Child Functioning and Disability Elena De Palma *, Roberta Crialesi *, Mitchell Loeb** Washington Group on Disability Statistics *Italian.
10/13/2015 Monitoring the UN Convention on the Rights of Persons with Disabilities… … and the work of the Washington Group on Disability Statistics Mitchell.
UNICEF’s work and planned activities for the production of data on children with disabilities Claudia Cappa, Data and Analytics Section, UNICEF, NY.
Measuring Disability in school-aged children: Findings from the National Health Interview Survey PH Pastor, CA Reuben, ME Loeb NCHS Washington,
The Definition and Measurement of Disability: The Work of the Washington Group (continued) Daniel Mont Disability and Development Group The World Bank.
Presentation on Field tests Margie Schneider Dan Mont 6 th Meeting of the Washington Group Kampala, Uganda 10 – 13 th October 2006.
Cognition domain Cognition domain 10th Washington Group meeting Luxembourg 3-5 November 2010 Andres Montes ESCAP Statistics Division.
SPECA Meeting, Paris, June 16, 2006 Activities Related to Health and Disability Statistics in the UNECE Region and Globally Jennifer H. Madans for the.
UNICEF/WG’s work and planned activities for the production of data on children with disabilities Claudia Cappa, Data and Analytics Section, UNICEF, NY.
Field-testing an earlier draft of the WG/UNICEF Question Set in Cameroon and India Islay Mactaggart Research Fellow in Disability International Centre.
1 Task Force on Health Expectancies National Disability Survey and Sport and Physical Exercise Module Gerry Brady Central Statistics Office, Ireland Luxembourg.
The WG Workgroup on Child Functioning and Disability Elena De Palma *, Roberta Crialesi *, Mitchell Loeb** Washington Group on Disability Statistics *Italian.
The DHS Program Pilot of a Household Survey Disability Module 6 OCTOBER 2015.
REPORT ON UGANDA PILOT STUDY by Ms. Pamela Kakande Senior Statistician Uganda Bureau of Statistics (UBOS)
Cognitive test results and Finalization of the Module on Child Functioning and Disability Mitchell Loeb (with Kristen Miller & Meredith Massey) NCHS Washington,
Digital Family Portraits: Supporting Peace of Mind for Extended Family Members Elizabeth et. al Ubicomp class reading Presented by BURT.
MOROCCAN EXPERIENCE ON DISABILITY STATISTICS THE KINGDOM OF MOROCCO HIGH COMMISSION OF PLANNING BY ZINEB EL OUAZZANI TOUAHAMI Statistician Engineer Directorate.
WG/UNICEF Child functioning module: Preliminary results from Samoa & Supporting documentation Mitchell Loeb National Center for Health Statistics/ Washington.
EDU 564 MODULE 5(CHAPTERS 10, 11 AND 12). Chapter 10  Self Determination - many definitions and models to teach this skill -essential characteristics.
Measuring the Disability Continuum in a Policy Context Barbara M. Altman, PhD Disability Statistics Consultant Stephen P. Gulley, PhD Brandeis University.
Measuring disability in South Africa: Data gaps & challenges Population Statistics Division Statistics South Africa 7 December 2016.
UNICEF/WG MODULE ON CHILD FUNCTIONING
UNICEF/WG MODULE ON INCLUSIVE EDUCATION
Washington Group on Disability Statistics (WG16)
UNICEF/WG Module on Child Functioning
Mainstreaming Disability Data Collection and Reporting:
Introduction to Evaluation IDEA 2004.
Introduction to Evaluation in IDEA Produced by NICHCY, 2007.
Measuring Disability in Population and Housing Censuses
PREDICTORS IN DEVELOPMENT OF LEARING DISABILITIES INTRODUCTION-PURPOSE
WG Mental Health Work Group Examination of Anxiety and Depression in Cameroon, Canada, India and the United States Islay Mactaggart Research Fellow in.
Mexico's experience in collecting data on disability
Disability Statistics at NCHS: A Changing Landscape
Session 5: More Information About Determining a Rating
Mental Health and Substance Use among Students with Disabilities
2018 Census content development Disability
Special Educational Needs
Towards improved measures of disability for development indicators
Comparing Estimates from the ACS and WG Question Sets
Internationally Comparable General Disability Measures
DISCUSSION ON MEASURING DISABILITY IN POPULATION AND HOUSING CENSUS
for disability data collection in Viet Nam
Xingyan Wen Ros Madden Australian Institute of Health and Welfare
Understanding the Outcomes and the COSF: A Quick Review
Child Outcome Summary Form
Psychological Principles (LCP)
Introduction to Evaluation IDEA 2004.
NYC Family Meeting; Updates for Self-Direction
Interreg-IPA Cross-border Cooperation Programme Romania-Serbia
Context and Methodology
LEARNER-CENTERED PSYCHOLOGICAL PRINCIPLES. The American Psychological Association put together the Leaner-Centered Psychological Principles. These psychological.
Presentation transcript:

UNICEF/WG MODULE ON CHILD FUNCTIONING: TESTING and ANALYSIS

Content and structure Questions ask about difficulties the child may have in doing certain activities Questionnaires for children 2-4 and 5-17 Response categories (with the exception of behavior (2-4) and emotions (5-17) are: No difficulty Some difficulty A lot of difficulty Cannot do at all

Domains of Functioning Seeing 2-17 years Hearing 5-17 years Mobility 2- 4 years Self-care Fine motor Communication/Comprehension Learning Remembering Emotions: anxiety and depression Controlling behaviour Focusing attention and concentrating Coping with change Relationships Playing

Cognitive Testing Cognitive testing January 2013, Belize April 2013, Oman July 2013, Montenegro 2012/13/14/15/16, USA March 2016, India April 2016, Jamaica Comparative report completed and decisions made on final set of questions included in field testing

Cognitive testing of the child functioning module Child disability questions perform differently than adult disability questions due to: Parent proxy Parent’s knowledge of “what is normal” for children of the same age Relationship between parent and child Parental frustration with child Potential for false positives. Domains most sensitive to false positives : those that generate parent frustration (learning/remembering, communication, attention/completing a task)

Cognitive testing of the child functioning module Relevance of comparison with other children of the same age: respondents do not always make this comparison/such comparison is not always possible. Domains most likely to be effected: Self-care, Emotions, Attention Responses “some difficulty” may lead to false positives Questions were modified to reduce risks of bias, clarify concepts and facilitate interview process

Example Hearing Domain: Round #1 Does [name] have difficulty hearing? This question is intended to focus on auditory hearing. Many respondents, however, focused on listening. Round #2 Does [name] have difficulty hearing sounds like peoples’ voices or music?

Example of possible constructs Compared with children of the same age, does [name] have difficulty with self-care such as feeding or dressing him/herself? Activities Considered by Respondent General Conceptualization Physical capability of child to do an array of complex activities including feeding, dressing, bathing, combing hair, getting in and out of bed Only Feeding Physical capability of child to feed themselves Willingness of child to eat what he/she is given; whether child is a “fussy” eater Only Dressing Physical capability of child to put on clothes Willingness of child to wear appropriate clothing Both Feeding and Dressing Physical capability of child to feed and dress themselves Willingness of child to eat what he/she is given coupled with the willingness of child to wear appropriate clothing Visual Representation of Thematic Schema

Field Testing Independent field testing on earlier version of the module completed in Haiti (Brown University, 2013), Cameroon & India (London School of Hygiene and Tropical Medicine, 2013), and Italy (NSO, 2013) Field testing of complete version of the module in Samoa (NSO, 2014) and El Salvador (NSO, 2015) with technical assistance from UNICEF/WG Module also used in surveys in Zambia (National Disability Survey, 2014) and Mexico (MICS, 2016) Dedicated methodological work in Serbia (NSO, 2016)

Field test in Serbia Primary goal of the field test was to assess the performance of the Child Functioning module in the field Secondary goal was to compare: the 2-4 year old questionnaire of the Child Functioning module with the 2-4 year old questionnaire of the Ten Questions (TQ) module the 5-17 year old questionnaire of the Child Functioning module with the 5-17 year old questionnaire of the Washington Group short set of questions.

Feedback from interviewers Questions to be filled out by interviewers at the time of the survey, right after the corresponding questions asked whether the interviewer had to repeat the question whether the respondent asked for clarifications of words or concepts whether the respondent had difficulties with response categories

Findings Questionnaire administered without any major problems Reactions of the respondents were mostly neutral to positive Repetitive to read out loud response categories Developed recommendations on implementation: one randomly selected child per household in countries with high levels of fertility No need to repeat responses categories after first set of questions unless needed

Cut-offs (recommended for international comparisons) For questions that use the standard WG response options: no difficulty, some difficulty, a lot of difficulty and cannot do at all – cut-off for inclusion is set at a lot of difficulty or cannot do at all For controlling behavior (2-4) cut-off for inclusion is set at a lot more For emotions (5-17) the most severe cut-off (daily) is used Overall measure: % of children with functional difficulties in at least one domain

Analysis of findings from testing Within range disability prevalence obtained across the different settings Similar patterns in terms of characteristics of the population of children with functional disability Most common functional difficulties across contexts: controlling behavior, managing emotions, learning

Prevalence rates by different cut-offs Cut-offs - at least one domain coded as: Age Prevalence Samoa Serbia Some difficulty, A lot of difficulty, or Cannot do at all Weekly or Daily (anxiety and depression: 5-17) More or A lot more (controlling behavior) MILD - SEVERE 2-4 15.5 9.4 5-17 9.0 25.0 2-17 10.4 22.7 A lot of difficulty or Cannot do at all Daily (anxiety and depression: 5-17) MODERATE - SEVERE 2.9 3.8 4.3 4.5 4.0 Samoa, 2015 / Serbia, 2016

Disability by School attendance Ever attended school Prevalence Without disability With disability YES 96.4 90.8 NO 3.6 9.2 Samoa, 2015

Child Functioning Module Results across modules   Children aged 2-4 Children aged 5-17 Child Functioning Module TQSI WG Short Set Seeing 0.5 0.6 0.3 Hearing 0.0 0.2 Walking 0.8 Learning/Cognition 9.1 0.9 Self-Care NA Understanding 2.1 Being understood/ Communicating 4.4 0.4 TOTAL PREVALENCE (using all the questions in the modules) 3.8 18.4 3.5 1.3 Serbia, 2016

Conclusions Questions carefully drafted to reflect multitude of domains and reduce risk of missing out children with different functional difficulties Domains are not meant to be looked at in isolation Questions carefully tested and cut-offs selected to reduce risk of false positives Not recommended to reduce number of questions, change response categories, modify content or change cut-offs