2. FACTA 6th Annual Conference "Changes in Attitude, Latitude, and Testing" Changes in Testing Opportunities and Risks Dr. Lou Woodruff

3.  Emerging Directions for Higher Education  Technology Challenging the “Testing Box”  The Future Impact of Off-Line CBT  New Directions in Data Forensics  The Next Big Technology Thing Changes in Testing – Opportunities and Risks

6. Expand/Impart Knowledge – Develop Skills Credential Accomplishments Mission of Higher Education Institutions Validate Targeted Learning and Abilities

7. Expand/Impart Knowledge – Develop Skills Mission of Higher Education Institutions There is an increasing recognition that the knowledge and skills students have developed outside the college need to be integrated into their college education

8. Prior Learning Assessment Programs (PLA) Credit by Examination Programs Structures are in place now to validate some knowledge and skills gained outside the college Digital-Credentials replacing of seat time/credits Portfolio Evaluation Programs Placement Testing Programs

9. Opportunities are expanding to gain knowledge and skills outside the college environment  Massive Open On-Line Courses (MOOCS)  Content focused video modules  On-demand on-line expertise  Social networks as learning tools  Professional Learning Networks (PLN)

10. Expand/Impart Knowledge – Develop Skills Credential Accomplishments Mission of Higher Education Institutions Validate Targeted Learning and Abilities

11. Credential Accomplishments Mission for Selected Higher Ed Institutions Validate Learning and Abilities “ New”

12. The College as a Credentialing Institution No Faculty – Low Overhead – Reduced Service Costs Charge $ for “credits” awarded Transfer accomplishments as academic equivalencies The College provides guidance and resources Validate broad-based knowledge and skills

13. Risks for College Testing Programs  Reduced need for traditional testing services  The end of College testing as we know it The College as a Credentialing Institution Opportunities for College Testing Professionals  Specialized testing of targeted knowledge/skills  Expertise in portfolio evaluations  Expertise in non-traditional assessments

14. Another Emerging Higher Education Model

15. If Higher Education went to Shark Tank For what Idea might it seek funding?

16. The College as an Entrepreneurship Institution

17. In place of degrees, the College would credential professional portfolios supporting student career paths Venture capital firms invest in the College in return for an equity stake in new ventures developed by students and faculty The campus offers high-immersion work spaces, networking, mentorship and business plan development... individualized and self-paced The College as an Entrepreneurship Institution

18. Risks for College Testing Programs  No placement testing - No course testing  Massive staffing and budget cuts Opportunities for College Testing Professionals  Assessment consultant in a business context  Staff with expertise in business evaluation  Integral part of the validation process The College as an Entrepreneurship Institution

19. Staying Inside the Testing Box Commandeering Control Higher Stakes Lower Stakes Exams How Much Control... The What The How The When The Where

20. Staying Inside the Testing Box Commandeering Control High stakes standards were set with P&P in the 1950’s The What The How The When The Where

21. Staying Inside the Testing Box with the Advances in Electronic Delivery  Stand Alone PCs  Telecom Data (T-1, dial-up)  Server-Based (LAN)  Internet Connected  Internet Delivered Computer Based Testing

22. Staying Inside the Testing Box with the Advances in Electronic Delivery  Encryption  FTP Standards  Data Forensics  Firewalls/Security  Lock-Down Functions Computer Based Testing

23.  Laptops  Tablets  I-Phones  New Devices Staying Inside the Testing Box with Device-Based Testing

24. On-Line Testing Solution Secure the device Secure the testing environment Secure the data transmission Delivery system compatibility Staying Inside the Testing Box with Device-Based Testing

25. “Off-Line” Testing Solution Secure the device Secure the testing environment Secure the data transmission Delivery system compatibility Staying Inside the Testing Box with Device-Based Testing

26. “Off-Line” Testing Solution Secure the device Secure the testing environment Staying Inside the Testing Box with Device-Based Testing Over 2,000,000 high stakes Off–Line tests in 2014 An Encryption Solution

27. ① Advanced encryption of exams integrated with the delivery software ② The secured file, exam and test delivery software, is hosted on dedicated web site ④ At an authorized test center, the exam file is unlocked and the examinee’s device is fully secured to test without the internet ③ Before the test day, encrypted exam files and delivery software are downloaded to test taker’s personal device ⑤ Questions and delivery software are erased after testing. Answers are uploaded when device connects to the internet ⑥ Scoring data sent for score reporting ⑦ Scores reported to exam takers Off-Line DBT Model Web

28. Campus administrators and faculty will become more aware of and more concerned with cheating Course level data forensics will become an expectation on most campuses Most course examinations will be delivered on campus using student-owned electronic devices The role of college testing professionals will be expanded as a result of these changes Off-Line Testing Predictions

29. Data Forensics D.F. Before the Test ! D.F. During the Test ! After Test Analyses Evidence that test fraud occurred

30. Data Forensics Before the Test Imbedded Verification Models Populating a test with compromised questions, disguised to lead the perpetrators to reveal themselves and devalue their brain dump content

31. Data Forensics During the Test RT Data Forensic Analyses Identifying anomalous data patterns during testing, either locally or across a network, with the option in “real time” (RT) to alert the proctor to intervene or to have the test delivery system interrupt that test

32. Increased Test Security Threats

37. Contact Lens with Camera Increased Test Security Threats

38. become the campus test security expert maintain security focused procedures promote national security standards expand test security expertise employ security technology implement data forensics Implications for College Testing Professionals

39. The Fool-Proof Solution for All Test Security Concerns Ban Testing ! Happening Selectively Already

40. Big Technology Thing The next “Big Technology Thing” to change the way we compute and communicate and eventually even the way we test Projection Technology

41. 2-D Cell Phone Spatial Display

42. Projection Technology 2-D Interactive Cell Phone Display Projected Keyboard

43. Wearable Projected Cell Phone Display Projection Technology

44. Cell Phone 3-D Projection Projection Technology

45. Holographic 3-D Projection

46. Cell Phone Holographic Display Projection Technology

47. 2D Spatial Computing Projection Technology

48.  Master the Testing Basics  Learn and Re-Learn the Field  Sustain Continuous Improvement  Pursue Professional Growth  Understand the Implications of Change  Always Exceed Expectations  Collaborate with Colleagues Today’s Top Seven Take-Aways

49. It’s always better with a friend ! Lou Woodruff woodruff@bucks.edu 609-947-4040