11 Emerging Adoption of E-Assessment in the Professions Garrett Sherry Country Manager - Ireland

22 Emerging Adoption of E-Assessment in the Professions Thomson Prometric – Body of Experience External Factors Driving Adoption Changing Business Needs Emerging Developments A Few Cases In Point Review & ‘Our’ View

33 Thomson Prometric – A Body of Experience st Computer Based Exam for Novell Global Leader in Technology Enabled Assessment Services 600 Clients, 132 Countries, 8 Million Exams every year Practical, Paper & Pencil, Internet & Computer Based Solutions Test Development, Delivery and Data Management Professional, Academic, Government, Corporate & IT Ireland - 60 Test Locations, 200,000 Exams - Customers; Department of Transport, Medical Council of Ireland, CITB NI, Microsoft, Cisco, Dell, Oracle…

44 External Factors Changes in Regulatory & Legal Environment Rapidly Evolving Curriculum Candidate ‘Test-on-Demand’ – The ‘Now’ Generation Globalisation of Programmes Competition for Candidates

55 Changing Business Needs Develop / Change Programmes Quickly Increased Availability & Test Windows– Quicker Results Improved Security, Integrity & Easier Administration More Relevant Exam Experience Improve ROI – Develop New Revenue Streams

66 Independent Research on UK Attitudes to e-Assessment Drivers & Barriers to Adoption of e-Assessment Attitudes to QCA Proposals for e-Assessment Acritas Research Commissioned to Independently Research 116 UK Awarding Bodies Qualitative - Face to Face Interviews Quantitative Study – Confidential Telephone Interviews

77 Qualitative Findings A Highly Receptive Environment – Innovative Working Examples A need to Develop Sophisticated, Robust and More Scalable e-Assessment Examples The Needs and Wants of Learners Should be Central to Implementation Business Continuity is vital to e-Assessment E-Assessment should include Vocational and Professional Qualifications – Not Just Schools

88 Quantitative Findings 26% Currently Deliver e-Assessment Of the 74% not delivering e-Assessment, 46% are developing / piloting 83% Believe e-Assessment More or Equally Robust as P&P 60% Believe e-Assessment More Cost Effective than P&P Client Satisfaction and On-Demand Testing are Most Important Factors 78% Would Prefer Multiple Technologies Conform to Agreed Standards

99 What are the three main advantages of using e-Assessment, in your opinion, overall? (unprompted)

10 What drives uptake of e-Assessment?

11 Case Studies

12 Securities and Investment Institute Customer Issues & Needs UK Awarding Body, 40,000 Exams Per Year & Rising Paper & Pencil Delivery Complex & Costly Administration Weeks to Get Results Candidate frustration - On-Demand Needs Increasing International Focus Revenue Growth

13 Securities and Investment Institute Conversion to CBT Expanded delivery – 60 Locations, 30 Countries On-Demand Continuous Testing Immediate Results – Re-Test in 3 days Administration Efficiencies On-line Self Service Booking Enhanced Candidate Experience Flexibility to Change and Add Programs Quickly Expanded Revenue Opportunities

14 Medical Council of Ireland Temporary Registration Assessment Scheme (TRAS) - Customer Issues & Needs Paper & Pencil Fixed Exam Delivery Dates Limited Overseas Delivery Increasingly Complex Administration Difficult & Costly to Expand Delivery (especially overseas) Cumbersome to Change & Update Exam

15 Medical Council of Ireland Temporary Registration Assessment Scheme (TRAS) - Conversion to CBT Available On-Demand - Test When Ready Flexible Global Delivery – 4 Countries, 15 Locations Simplified Scheduling & Registration Control of Eligibility Criteria Robust High Specification MCQ Exam Consistency of Exam Experience High Level of Security and Integrity Ability to Change & Update Exam Easily

16 American Institute of Certified Public Accountants (AICPA) The Uniform CPA Examination - Customer Issues & Needs Paper & Pencil – Twice a Year Limited Locations – Large and Costly Auditoriums First Time Candidates – Two Day Exam Very Stressful Environment for Candidates and Invigilators Limited Ability to Simulate Real-World Skills Need for a More Flexible, Seamless Candidate Experience to Help Attract New Talent A 21 st Century Exam for 21 st Century Practices & Demands

17 American Institute of Certified Public Accountants (AICPA) The Uniform CPA Examination - Conversion to CBT Partnership Approach to Conversion (Steering Group) Flexible Candidate Options – Whole Exam or Sections Year Round Delivery – Test When Ready Locations Fit for Purpose Test Centre Network – Secure, Comfortable Innovative Test Items, Simulations and Tools Greater Public Confidence in Competency and Ethical Proficiency of CPA’s A 21 st Century Exam

18

19

20

21

22

23

24 Emerging Adoption of E-Assessment in the Professions Increased Availability & Test Windows– Quicker Results – The ‘Now’ Generation Improved Security, Integrity & Easier Administration Increasing Competition for Candidates More Relevant Exam Experience Consistent Global Administration Improved ROI / New revenue streams / Expansion of programs Outsourcing Test Delivery & Administration Concentrate on Developing Core Programmes Improved Security & Integrity of Testing Process

25 Emerging Adoption of E-Assessment in the Professions Thomson Prometric ‘Our View’ Professional bodies and other responsible organisations in Ireland should embrace the advantages offered by technology enabled learning and assessment to ensure: That those who look after our sick are properly qualified Those who look after our money have an appropriate to licence to practice and, That education for the professions better reflects the realities of today’s business and regulatory environment