Foundations of Institutional Research 2018 Data quality improvement   Foundations of Institutional Research 2018   Data quality improvement Presented by Liz Archer

Demands on IR I R 1,351 tasks

How to be an IR superhero

Institutional Need Hierarchy Archer 2017 SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

Communication matrix exemplar (Learner Analytics) Stakeholder   Information type Consolidated individual student profile Summary of student risk profile per module Summary of Student risk profile per qualification Intervention uptake per module Student support staff X College management School Director Chair of Department Module team Tutors Student  X

Group Activity Data quality improvement assignment Individually identify three data quality issues that your institution are struggling with (5 min) Discuss these issues in your group. Choose two to three of the most relevant issues to carry forward in your assignment (10 min) Discuss the chosen issues in your group (10 min) Feedback based on the questions provided (each group will be allowed 10 min) Consolidation (5 min) SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

Introduction to statistics for institutional research   Foundations of Institutional Research 2018   Introduction to statistics for institutional research Presented by Liz Archer

Introduction to statistics for Institutional Research Purpose of using statistics in IR and HE administration The tip of the iceberg What is statistics? Doing the groundwork Types of statistics Types of data Statistical software Treat data with respect SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH The tip of the iceberg Technique Method Design Paradigm SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH What is statistics The science of collectiong, organizing, presenting, analyzing, and interpreting data to assist in making more effective decisions Statistical analysis – used to manipulate summarize, and investigate data, so that useful decision-making information results. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

Statistical Superhero Basics Southern African Association for Institutional Research

Understanding your Nemesis Southern African Association for Institutional Research

Southern African Association for Institutional Research Villain weakness Southern African Association for Institutional Research

Southern African Association for Institutional Research Know your superpowers Data manipulation with cleaning go hand in hand Using Inclusion / exclusion criteria Visualizing Outliers Cleaning character variables Dealing with missing data Southern African Association for Institutional Research

Southern African Association for Institutional Research Types of Statistics Southern African Association for Institutional Research

Southern African Association for Institutional Research Sampling Funnel Southern African Association for Institutional Research

Southern African Association for Institutional Research Levels of Measurement Southern African Association for Institutional Research

Southern African Association for Institutional Research Levels of Measurement Southern African Association for Institutional Research

Southern African Association for Institutional Research Levels of Measurement Southern African Association for Institutional Research

What type of statistics Southern African Association for Institutional Research

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH Parametric or Non SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH Statistical software SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH Most used? SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH The biggest? SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

The collective delusion SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

False sense of security SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

Important considerations Parametric tests are more likely than their nonparametric counterparts to detect a statistically significant difference between two or more treatments of a significant relationship between two variables The choice between parametric tests and nonparametric tests is dictated by the characteristics of the data When the data allow you to choose between the two types then parametric tests is recommended SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

Institutional Research Context In some cases, data reflect one or more of the following: Small sample size Data summarised in categories Non-normal or unknown distribution Nominal or ordinal measurement scales Examples: Data organised by discipline, department, college/faculty, rank, etc SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

Institutional Research Context Typically situations involving large number of observations such as student population or personnel/staff population In these case use of parametric approaches are appropriate as underlying distributions are usually “close enough” to a normal distribution to provide reliable information SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

Treat data with respect Data has a story to tell. Therefore: Do not fudge the data Be objective in analyzing the data Use the best tools to analyze the data Do not exhaust the data beyond its capacity Accuracy in dealing with data is of the utmost importance Recognize your power and responsibility as story teller SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH Discussion SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH