16th September 2014 Loughborough University The role of preparation in psychometric test performance or Practice ≠ Preparation 16th September 2014 Loughborough University

Overview Purpose of testing – the employer Purpose of testing – the job seeker Research on test preparation Tips for effective preparation Reflections

Purpose of testing - employers Efficiency Managing risk Creating a ‘level playing field’ Fairness Understanding potential Finding the right fit

Purpose of testing – job seekers To ‘show myself off’ – it’s an opportunity Do I have the right knowledge / skills / abilities? Will I fit in? Do I want this job enough?

Purpose of testing It’s a two-way thing… …though loaded in favour of the employer It helps if it is seen as an opportunity, not a threat

Research on test preparation Almost exclusively on cognitive tests and ‘exams’ Partial and incomplete Assumptions and ambiguities

What the research tells us - ability ‘Familiarisation’ vs ‘coaching’ Re-test effect, c0.5 standard deviations Research during the 1980s by ETS Test-specific familiarisation – modest effect Coaching – variable, not as big as claimed Numerical more susceptible than verbal Effect of test complexity Well designed prep, c4 hours, as effective as coaching courses

What the research tells us – personality & motivation Less coachable than ability – job specific Natural changes under assessment conditions ‘Gaming’ the assessment Fit Validation through interview

What the research tells us - SJTs Very little good research available Re-test effects similar to cognitive tests Familiarity is likely to important – variation in question formats Know the company – what do they want? Typical behaviour and fit

Helping students prepare Action Exploration Reflection Creation

Action What do I know about tests? What tests am I being asked to take? Get some practice

Reflection Key questions to ask: How did I do? Did I understand the instructions properly? How did I feel – confidence vs anxiety? Did I manage speed vs accurately well? What skills do I need to develop?

Reflection Optimum performance Accuracy Speed

Creation Use Reflection points to set targets: Know the test and its requirements Confident and positive Develop speed and accuracy Brush-up on knowledge / skills assessed by test Identify gaps in current knowledge

Exploration Put it into practice Practice tests Information

Action Get some practice… … and apply what I now know / can do

Test-taking skills Test performance Test-taking skills Ability Low High Test-taking skills Weak Strong Ability

Issues of equity As motivation for testing From test taker’s perspective Access to preparation

Reflections (in pictures)

Any questions? www.realisepotential.com www.bpstesttraining.co.uk