Explaining variation in CCE outcomes (Chapters 7 & 8) National Research Coordinators Meeting Madrid, February 2010.

Slides:



Advertisements
Similar presentations
Individual, Home, and Community Factors PISA/PIRLS Task Force International Reading Association January 2005.
Advertisements

Enhance the Attractiveness of Studies in Science and Technology WP 6: Formal Hinders Kevin Kelly Trinity College Dublin WP 6 Co-ordinator.
Home and pre-school influences on early language and reading Evidence from the Effective Pre-school, Primary and Secondary Education (EPPSE) project.
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
According to the Statistical Yearbook for 2010, in 2008/09 year, only 41% of the total number of children in Serbia, aged between 0 and 7 years, were enrolled.
24 July 2014 PISA 2012 Financial Literacy results – New Zealand in an international context.
Cross-national Variations in Educational Achievement and Child Well-being Dominic Richardson International Society for Child Indicators Inaugural Conference.
Chapter 6 (p153) Predicting Future Performance Criterion-Related Validation – Kind of relation between X and Y (regression) – Degree of relation (validity.
Quantitative Techniques
Overview of Main Survey Data Analysis and Scaling National Research Coordinators Meeting Madrid, February 2010.
Multiple Regression Fenster Today we start on the last part of the course: multivariate analysis. Up to now we have been concerned with testing the significance.
Measuring socio-economic background and its influence on school education outcomes South Australian Institute for Education Research Spring Seminar Series.
Deborah Cobb-Clark (U Melbourne) Mathias Sinning (ANU) Steven Stillman (U Otago)
Education 793 Class Notes Joint Distributions and Correlation 1 October 2003.
Regression With Categorical Variables. Overview Regression with Categorical Predictors Logistic Regression.
Overview of field trial analysis procedures National Research Coordinators Meeting Windsor, June 2008.
Table 1 Socio-demographic Characteristics of Immigrant Parents and their Children in Spain, 2010 Characteristic Parents Children MadridBarcelona Total.
Simple Correlation Scatterplots & r Interpreting r Outcomes vs. RH:
Elaboration Elaboration extends our knowledge about an association to see if it continues or changes under different situations, that is, when you introduce.
Ch 2 and 9.1 Relationships Between 2 Variables
Brown, Suter, and Churchill Basic Marketing Research (8 th Edition) © 2014 CENGAGE Learning Basic Marketing Research Customer Insights and Managerial Action.
Chapter 7 Correlational Research Gay, Mills, and Airasian
Understanding and Supporting Gender Equality in Schools
SPSS Session 4: Association and Prediction Using Correlation and Regression.
Correlational Research Strategy. Recall 5 basic Research Strategies Experimental Nonexperimental Quasi-experimental Correlational Descriptive.
Correlation Nabaz N. Jabbar Near East University 25 Oct 2011.
McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. Correlational Research Chapter Fifteen.
ICCS European Regional Report National Coordinators Meeting Madrid February 2010.
Outline of International Report on ICCS National Research Coordinators Meeting Madrid, February 2010.
Understanding Research Results
Chapter 12 Correlation and Regression Part III: Additional Hypothesis Tests Renee R. Ha, Ph.D. James C. Ha, Ph.D Integrative Statistics for the Social.
Introduction to plausible values National Research Coordinators Meeting Madrid, February 2010.
CHAPTER NINE Correlational Research Designs. Copyright © Houghton Mifflin Company. All rights reserved.Chapter 9 | 2 Study Questions What are correlational.
Understanding Statistics
Chapter 11 Descriptive Statistics Gay, Mills, and Airasian
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Multivariate Data Analysis CHAPTER seventeen.
Introduction Multilevel Analysis
Descriptive Statistics
Assessing assessment: the role of student effort in comparative studies Ray Adams Jayne Butler.
John AndersonTodd Rogers Don Klinger University of VictoriaUniversity of Alberta Queen’s University Charles UngerleiderBarry Anderson Victor Glickman University.
Affective-Behavioural Domains and Contextual Framework National Research Coordinators Meeting Amsterdam, October
UNDERSTANDING RESEARCH RESULTS: DESCRIPTION AND CORRELATION © 2012 The McGraw-Hill Companies, Inc.
METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY Copyright © 2007 The McGraw-Hill Companies, Inc.
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
The reporting of student questionnaire data (Chapters 4&5) National Research Coordinators Meeting Madrid, February 2010.
Chapter 16 Data Analysis: Testing for Associations.
Proposed student questionnaire for the main survey National Research Coordinators Meeting Windsor, June 2008.
Chapter 4 Summary Scatter diagrams of data pairs (x, y) are useful in helping us determine visually if there is any relation between x and y values and,
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
UNDERSTANDING DESCRIPTION AND CORRELATION. CORRELATION COEFFICIENTS: DESCRIBING THE STRENGTH OF RELATIONSHIPS Pearson r Correlation Coefficient Strength.
Student Background Questionnaire National Research Coordinators Meeting Amsterdam, October 2006.
The Correlational Research Strategy Chapter 12. Correlational Research The goal of correlational research is to describe the relationship between variables.
Chapter 16: Correlation. So far… We’ve focused on hypothesis testing Is the relationship we observe between x and y in our sample true generally (i.e.
Chapter 8 Relationships Among Variables. Outline What correlational research investigates Understanding the nature of correlation What the coefficient.
Chapter Seventeen Copyright © 2004 John Wiley & Sons, Inc. Multivariate Data Analysis.
Teacher Questionnaire National Research Coordinators Meeting Windsor, June 2008.
LESSON 5 - STATISTICS & RESEARCH STATISTICS – USE OF MATH TO ORGANIZE, SUMMARIZE, AND INTERPRET DATA.
Educational Research Descriptive Statistics Chapter th edition Chapter th edition Gay and Airasian.
Parent’s Guide to Individual Profile Report
Factors associated with achievement in PISA 2006 Why? Why? –Establishing links –Identifying things we can change –Valuable data in its own right E.g. bullying,
Gender differences in reading from a cross-cultural perspective- the contribution of gender equality David Reilly, School of Applied Psychology, Griffith.
Gwyther Rees & Jonathan Bradshaw
Chapter 12 Understanding Research Results: Description and Correlation
Statistics for the Social Sciences
Between-school Variance in Achievement
Correlation and Regression
Figures adapted from the TIEDI Analytical Report #4:
An Introduction to Correlational Research
15.1 The Role of Statistics in the Research Process
Regression and Categorical Predictors
Presentation transcript:

Explaining variation in CCE outcomes (Chapters 7 & 8) National Research Coordinators Meeting Madrid, February 2010

NRC Meeting Madrid February 2010 Content of presentation Student background measures Statistics included in tables Data presentation Chapter 7 and 8 outline

NRC Meeting Madrid February 2010 BACKGROUND VARIABLES AND MEASURES

NRC Meeting Madrid February 2010 Variables Cultural/ethnic family background Immigrant background Language use at home Social background Parental socioeconomic status (occupations) Parental educational attainment Home literacy resources (books) Parental interest in political & social issues

NRC Meeting Madrid February 2010 Measures Coded MeasureTransformations ImmigrantCategorical (3)Categorical (2) Native/non-native Language useCategorical (2)As is Socioeconomic (HISEI) Continuous (16-90) ISCO → ISEI scale Categorical (6) Defined as ranges Parental Education Categorical (5) (ISCED-based levels) Years of education Home literacyCategorical (5)No of books (unit =100) Parental interest (politics & social) Categorical (4)As is

NRC Meeting Madrid February 2010 STATISTICS

NRC Meeting Madrid February 2010 Statistical representations Group means of scale scores Country and international averages for groups Percentages of students in each group Country and international averages for groups Regression coefficients Unstandardised prediction of outcome Represent strength of relationship Percentage variance explained

NRC Meeting Madrid February 2010 Immigrant Status

NRC Meeting Madrid February 2010 Socioeconomic status (SEI)

NRC Meeting Madrid February 2010 Parent Education

NRC Meeting Madrid February 2010 Home literacy (NBOOKS)

NRC Meeting Madrid February 2010 Parental Interest

NRC Meeting Madrid February 2010 REGRESSION CK

NRC Meeting Madrid February 2010 REGRESSION CK % VARIANCE

NRC Meeting Madrid February 2010 REGRESSION INTEREST IN POLITICS

NRC Meeting Madrid February 2010 REGRESSION INTPOL % Variance UNIQUE VARIANCE COMM VAR TOT VAR HLANGIMMIGPAREDSEINBOOKSPARINT A B C D

NRC Meeting Madrid February 2010 REGRESSION Expected Electoral Participation

NRC Meeting Madrid February 2010 REGRESSION ELECTORAL PARTICIPATION

NRC Meeting Madrid February 2010 CHAPTER 7 OUTLINE

NRC Meeting Madrid February 2010 Chapter 7 Outline Research question 6 influence of background on outcomes civic knowledge expected electoral participation student interest in political and social issues Cultural/ethnic family background –Immigrant background native students, students with parents born abroad and students born abroad) and effects –Language use at home

NRC Meeting Madrid February 2010 Chapter 7 Outline (Cont) Socio-economic family background –Parental occupation –Parental education and effects –Home literacy Parental interest Combined influences Regression models

NRC Meeting Madrid February 2010 Chapter 8: Model Hierarchical Linear Models Students nested within classroom (in most countries equivalent to schools) So far unweighted analysis and listwise exclusion of missing values Criterion variables: –Civic knowledge –Expected electoral participation

NRC Meeting Madrid February 2010 Chapter 8: Explanatory variables Student characteristics –Gender (female=1, male=0) –Test language at home (yes=1, no=0) –Expected educational level (in approximate years of further education) –Students’ interest in political and social issues

NRC Meeting Madrid February 2010 Chapter 8: Explanatory variables (cont.) Home background variables –Index of socio-cultural background” derived from highest parental occupation, education and home literacy Factor scores from principal component analysis Mean of 0 and SD of 1 for equally weighted countries –Highest parental interest

NRC Meeting Madrid February 2010 Chapter 8: Explanatory variables (cont.) Indicators of students’ activities –Reading for enjoyment (5-point scale) –Watching TV news (4-point scale) –Time spent with friends (5-point scale)

NRC Meeting Madrid February 2010 Chapter 8: Explanatory variables (cont.) School-related variables at the individual level –Student participation at school (scale) –Perception of openness in classroom discussions

NRC Meeting Madrid February 2010 Chapter 8: Explanatory variables (cont.) Classroom level variables –Average scores of the students’ index of socio-cultural background –Average of scale scores on perception of openness in classroom discussions

NRC Meeting Madrid February 2010 Modelling results in general Need for summarising results across country (not yet in draft tables) In many cases results similar to finding from CIVED Effects of variables AFTER controlling for all other variables –Sometimes results may be different for factors presented in earlier tables

NRC Meeting Madrid February 2010 Example of table with results

NRC Meeting Madrid February 2010 Modelling results: Civic knowledge Female gender generally positive effect Test language only in countries with higher percentages of students speaking another language Expected education consistent positive predictor Student interest only in few countries positive (weak) predictor

NRC Meeting Madrid February 2010 Modelling results: Civic knowledge (cont.) Both reading for enjoyment and watching TV news tend to be positive predictors of civic knowledge Spending time with friends negative predictor of civic knowledge Both school-based civic participation and individual perceptions of openness in classroom discussion positive predictors

NRC Meeting Madrid February 2010 Modelling results: Civic knowledge (cont.) Context level variables: –Average socio-cultural background index scores positive predictor in most countries –Average scores of perceptions of openness in classroom discussions also tends to be positive predictor Model explanation –62 percent at classroom level –23 percent at student level

NRC Meeting Madrid February 2010 Modelling results: Expected electoral participation Gender and test language not consistent predictors Expected education only weak to moderate effects Higher levels of civic knowledge have consistently positive effects Hardly any influence of index of socio- cultural background Parental interest important predictor

NRC Meeting Madrid February 2010 Modelling results: Expected electoral participation (cont.) Watching TV news positive predictor Both civic participation at school and perceptions of openness in classroom discussions tend to have positive effects Few countries with significant effects for the average socio-cultural background and average perceptions of openness in classroom discussions

NRC Meeting Madrid February 2010 Modelling results: Expected electoral participation (cont.) Model explanation –64 percent of the class-level –23 percent of the student level variance

NRC Meeting Madrid February 2010 NRC feedback on: Appropriateness of –Presented statistics –Included items and scales –Tables and figures Coverage of report –Aspects that are missing –Content that may be omitted from report

NRC Meeting Madrid February 2010

NRC Meeting Madrid February 2010 Questions or comments?