1. Technology Enhanced Education: Opportunities and Challenges Chuck Dziuban Patsy Moskal University of Central Florida

2. The University of Central Florida

3. A value-added model of technology- enhanced learning Technology Augmented (E) Faculty Initiative Institutional Initiative Blended (M) Fully Online (W) Access and Transformation Enhancement Engagement Learning Management Systems Web 2.0 Lecture Capture

4. Technology Enhanced Learning as a Boundary Object TEL Vice Provosts Librarians CIOs Deans Faculty Students Journalists Provosts Department Chairs Instructional Designers Evaluators Presidents

5. Shirky, C. (2009)

6. An Evaluation Plan

7. Distributed Learning Impact Evaluation Students Faculty Reactive behavior patterns Success Satisfaction Demographic profiles Retention Strategies for success Online programs Writing project model Large online classes Higher order evaluation models Student evaluation of instruction Theater Information fluency Generational comparisons

8. Student Success

9. Online and Blended Registrations Fully Online Courses Blended Learning Courses

10. Learning Return on Investment 67% more efficient classroom use Saved $6.2 million in construction costs Saved $316,000 in space maintenance costs Joel Hartman, 2010

11. Success rates by modality Spring 01 through Spring 03 F2F Blended Total N= 139,444 students Fully Online Percent

12. A Decision Tree for Success 85.9% n=11,286 85.8% n=6,460 91.5% n=2,079 72.7% n=378 86.7% n=2,369 86.5% n=5,639 74.8% n=821 94.1% n=1,036 89.1% n=1,043 64.7% n=148 79.6% n=230 88.4% n=3,263 84.1% n=2,376 68.9% n=298 78.5% n=526 Arts & Sciences, Business Admin., Hospitality Mgmt. Education Engineering Health & Pub. Affairs F2F, E, MW femalesmalesA&SBA & Hosp. mgmt F2FE, M, WE, MF2F Overall E=Enhanced M=Blended W=Online

13. Where have all the face-to-face courses gone?

14. Overall success rates by modality Blended (N=49,434) Percent Online (N=102,755)

15. Success rates by modality for Sciences Percent Blended Online (N= 6,731) (N= 22,301)

16. Success rates by modality for Health & Public Affairs Percent (N= 7,716) (N= 42,366) Blended Online

17. Success rates by modality for Education Percent (N= 7,479) (N=10,078) Blended Online

18. Predictors

19. Prediction Domains DomainsDependent Demographics Ability Academic Performance Success & Withdrawal

20. Relationship of online success and withdrawal with demographics Success (r 2 =.02) Withdrawal (r 2 =.01) N range = 69,000 – 133,000 r r Age.04Age-.01 Class Size-.03Class Size-.01 Adult Status.01Adult Status.03 Ethnicity.03Ethnicity.03 Gender.04Gender.04 Generation.00Generation.00 Term.04Term.04

21. Relationship of online success and withdrawal with SAT and ACT scores r r SAT Total-.01SAT Total.02 SAT Verbal-.01SAT Verbal.02 SAT Math.00SAT Math.01 ACT Total.02ACT Total.00 ACT Math.01ACT Math.00 ACT English.02ACT English.00 ACT SCR.01ACT SCR.01 N range = 69,000 – 133,000 Success (r 2 =.01) Withdrawal (r 2 =.01)

22. Relationship of Online Success and Withdrawal with GPA N range = 69,000 – 133,000 r r HS GPA.10HS GPA-.03 Current GPA.49Current GPA-.10 Cum. GPA.31Cum. GPA-.09 UCF GPA.39UCF GPA-.11 Success (r 2 = 0.37) Withdrawal (r 2 =.04)

23. Student Satisfaction

24. Student satisfaction in fully online and blended courses 39% Fully online (N = 1,526) Blended (N = 485) 41% 11% 9% Very Satisfied UnsatisfiedSatisfied Neutral 38% 44% 9% Very Unsatisfied 3% 5% 1% Percent

25. Student satisfaction with online learning Convenience Reduced Logistic Demands Increased Learning Flexibility Technology Enhanced Learning Reduced Opportunity Costs for Education

26. Students’ problems with online learning Reduced Face-to-Face Time Technology Problems Reduced Instructor Assistance Overwhelming Increased Workload Increased Opportunity Costs for Education

27. The Ambivalence Dimension SatisfactionDissatisfaction Ambivalence

28. Sources of Ambivalence Change Ambiguity Incompleteness Complexity Uncertainty Pluralism ?

29. Derived Model Yields 8 Dimensions of Student Perception of ALN Ambiguity Ambivalence Engagement Responsiveness Expectations Commitment Information Fluency

30. Web 2.0

31. Disruptive Innovation! There’s one in YOUR future!! And another one right behind it! Wayne Hodgins, 2007

32. Web 2.0 Wikis Blogs Social Networking RSS XHTML Semantic Web Podcasting Audio Video tagging Digg Zude Del.ico.us Technorati Flickr Wikipedia YouTube MySpace Facebook SlideShare Pandora Skype Folksonomy Ajax

33. The Generations

34. Some characteristics of the generations Matures (prior to 1946) Dedicated to a job they take on Respectful of authority Place duty before pleasure Baby boomers (1946- 1964) Live to work Generally optimistic Influence on policy & products Generation X (1965-1980) Work to live Clear & consistent expectations Value contributing to the whole Millennials (1981-1994) Live in the moment Expect immediacy of technology Earn money for immediate consumption

35. Net Generation: Marc Prensky – Learning Preferences Gaming and Fantasy Twitch Speed Connections Graphics Multitasking Active Learning Technology is my Friend

36. Net Generation: Howe and Strauss – Lifestyle Pressure Conventional Team Oriented Special Sheltered Confident Achievement

37. Tabscott: Net Generation Norms freedom customize speed personalize play integrity collaborate scrutinize

38. Net Generation: Twenge (Generation Me) – Lifestyle Self Focused Artificial Self Esteem Life by Lottery Cynical Anything is Possible (unrealistic) Yeah Right

39. Students who were satisfied by generation (non ambivalent) 55% 38% 26% Boomer 1946-1964 n=328 Generation X 1965-1980 n=815 Millennial 1981-1994 n=346 Percent

40. Because of the web I changed my approach to learning (non ambivalent) Percent 51% 37% 23% Boomer 1946-1964 n=328 Generation X 1965-1980 n=815 Millennial 1981-1994 n=346

41. Classroom modality preferred by generations Baby Boomer Gen X Millennial n= 1,149 p =.000 26% 24% 39% 15% 11% 22% 59% 65% 40%

42. Students’ description of whether they learn better alone or with others Baby Boomer Gen-X Millennial p=.000 n= 1,149

43. Student and faculty generations in blended and online learning FacultyStudent Mature 11% Millennial 1% N=689N=26,823 Gen X 33% Baby Boomer 55% Mature 1% Baby Boomer 6% Gen X 11% Millennial 84%

44. Student Ratings

45. Facilitation of learning Communication of ideas Excellent Very Good Good Fair Poor Then... The probability of an overall rating of Excellent =.97 & The probability of an overall rating of Fair or Poor =.00 If... A decision rule for the probability of faculty member receiving an overall rating of Excellent (n=1,280,890) Respect and concern for students

46. Then... The probability of an overall rating of Poor =.90 & The probability of an overall rating of Very Good or Excellent =.00 If... A decision rule for the probability of faculty member receiving an overall rating of Poor (n=1,280,890) Facilitation of learning Communication of ideas Excellent Very Good Good Fair Poor Respect and concern for students

47. A comparison of excellent ratings by college unadjusted and adjusted for instructors satisfying Rule 1 (n=1,280,890) OverallIf Rule 1 College% Excellent% Excellent Education58.697.9 Molecular & Microbiology49.997.6 Health & Public Affairs49.897.6 Arts & Humanities49.196.7 Arts & Sciences45.197.0 Sciences44.596.8 Hospitality Management44.196.6 Business Administration39.596.9 Engineering39.096.8

48. A comparison of excellent ratings by course modality--unadjusted and adjusted for instructors satisfying Rule 1 (n=1,171,664) Blended48.997.2 Online47.697.3 Enhanced46.897.5 F2F45.797.2 ITV34.296.6 CourseOverallIf Rule 1 Modality % Excellent % Excellent

49. Technology Enhanced Education, Ghost Maps and Black Swans

50. London 1853 Bone PickersSewer Hunters Rag-GatherersNight Soil Men Pure FindersDustmen DredgermenBunters Mud-LarksToshers

51. John Snow Water borne theory Incidence mapping Henry Whitehead Miasmic Theory Interviewed patients Found index case William Farr Introduced the value of archival data Crossover data mining in a cholera epidemic: 1854

52. The Pump!

53. The Broad Street pump

54. What could this be???.0000000000000000000001049

55. Taleb: The Black Swan Unpredicted 9/11 Google Harry Potter Y2K Undetectable Outliers Back-Filled Narrative Monumental Impact Retrospective Prediction Market crash Technology Enhanced Learning

56. Research Initiative for Teaching Effectiveness For more information contact: Dr. Chuck Dziuban (407) 823-5478 dziuban@mail.ucf.edu Dr. Patsy Moskal (407) 823-0283 pdmoskal@mail.ucf.edu http://rite.ucf.edu http://www.if.ucf.edu/