1. Using e-assessments Dublin – 13 October, 2005 Suzana Lopes – Director, Sales and Marketing Assessment Tomorrow

2. Promissor Background >Over 20 years experience in the assessment industry >More than 200 customers in 45 countries >2.5 million tests a year >68 million revenue per year >Over 3,000 test Centres in the UK

3. Before e-assessment : P&P >Assessing has always been a key part of learning >e-learning increases the need for assessments >Technology brings new tools for assessments

4. Paper and pencil testing : still used ! >Universities, schools, companies, vocational training … >Drawbacks associated with paper and pencil testing :  Labour intensive  Complex maintenance  Difficult localization  Heavy logistics  Low availability  Long processing time  Difficult data collection / demographics

5. Move to e-assessments ? >Reinvent the wheel … Excel, Flash, Word >Buy the tools, manage the infrastructure … Niche software vendors  Integration with content / LMS / … >Use a complete solution at your fingertips … Test delivery providers like Promissor  Complete solution  Infrastructure availability  Service level agreement

6. Keep it Simple Approach >Maintain most of the current program as possible, item types, presentation style, navigation, scoring and report. Advantages of this approach:  Familiarity with the process often eases candidate anxiety  Leveraging existing tests minimizes conversion costs  Historical results can be readily analyzed and compared  Stakeholder acceptance is often more easily achieved

7. Completely New Program >Usually done with other initiatives such as geographic expansion, use of innovation. Advantages:  Concentrated effort yields greater program stability and reduced overall cost  Provides a “clean break” between the old and new methodologies  Stakeholder excitement can stimulate candidate interest and drive testing demand  Enhanced value justifies potential increase in testing fees

8. From the need to the test Analysis of the business need Development of training program Development of assessment blueprint Development of item bank Development of assessment Assessment administration Evaluation of training effectiveness

9. Why use e-assessments ?

10. Benefits for all the stakeholders Candidates / learners Test designers Organisations

11. E-assessment advantages Flexibility Consistency Security Engaging Presentation Scoring Availability Streamlined Logistics Advanced Item Types Data Rich Test Results

12. Benefits to candidates / learners  On-demand  Immediate score reporting  Prevention of transcription errors (no answer sheet)  Answers are easy to change or mark for review

13. Benefits to test designers >Assessment design :  Item creation Item banking design time reduction : from 50 to 80% Reusability and management of items Ease of correction/updates  On line testing allows better quality of assessment >Ease of creation  Diversity of available questions  Innovative item types  Localization (easy to go global) >Quality of psychometric design  Increased accuracy of measurement  Innovative item types  Results data & trends with no data entry

14. Benefits to test centres  Scheduling on demand  No scoring costs  Standardised administration

15. Benefits to organizations >Easy access to tests : on demand 24*7 >Content security : encryption >Standardized administration >On line registration >Cost reduction >Assessment analysis  Automatic collection of demographic data database  Results data

16. Customer example : City and Guilds >Over 3,000 testing locations in the UK >Over 600,000 e-assessment in the past 18 months >Over 500 different test – vocational areas >Benefits  On demand testing  Results are delivered in immediately instead of 2 weeks  Lower cost of test administration

17. Customer example : >Teacher and Development Agency for Schools - TDA >Qualified Teacher Status  Literacy  Numeracy  Introduction of Computer Technology >Over 155,000 tests per year >Benefits  On demand testing  Testing close to home  Results are delivered immediately instead of 6 weeks  More teachers available in the classrooms

18. Questions & Discussion