1. Journal 2010 The Trend toward Online Project- Oriented Capstone Courses Charles Tappert and Allen Stix Pace University, New York

2. Journal 2010 Integrates Five Conference Papers on Real-World Student Projects 1. Integrating Real-World Projects for Actual Customers into Capstone Courses (E-Learn 2002) 2. Security-Related Real-World Projects (ISECON 2004) 3. Interplay of Student Projects and Student-Faculty Research (E-Learn 2007) 4. Pedagogical Issues in Managing Information Technology Projects Conducted by Geographically Distributed Student Teams (SITE 2009) 5. Assessment of Student Work on Geographically Distributed Information Technology Project Teams (E-Learn 2009)

3. Journal 2010 Real-World Student Projects Conducted in capstone courses for 10 years Student teams build real-world computer information systems for actual customers Project systems serve the community internal university community at Pace greater university community external non-profit local community

4. Journal 2010 Real-World Student Projects (cont) Real-world projects are a stellar learning experience for students Win-win situation for all Students Customers Instructors and other involved faculty School of CSIS University

5. Journal 2010 Migrate to Online Format Migrated from traditional face-to-face format to online format in Fall 2006 To be progressive Technology for online courses adequate Online preferred by employed students – no scheduling conflicts & no commuting To expand the population of students beyond the greater NYC area

6. Journal 2010 Challenges of Online Format Uncertainties of how traditional course methods port to the online environment and what new methods might be required Teams lacking co-presence require higher level of organizational and process skills No weekly classroom meetings as safety net for teams’ interaction and functioning

7. Journal 2010 Team Projects – Categories

8. Journal 2010 Team Projects – Sources

9. Journal 2010 Team Projects – Publication Types

10. Journal 2010 Team Projects – Examples Course website “Projects” page Fall 2009

11. Journal 2010 Team Website Project title and description Project members and customers All deliverables posted Weekly status reports Midterm & final presentation slides User manual Technical paper

12. Journal 2010 Team Project – Example Website Personality Assessment from Handwriting Project

13. Journal 2010 Team Project – Example Website

14. Team Projects – Example Systems Handwriting Forgery Quiz System Rare Coin Grading System Keystroke Biometric Experimental System

15. Biometric Authentication A robot identifies a suspect, from the movie “Minority Report.”

16. Man Wo man Train Test Train Test Left Right Iris Authentication: Data

17. Iris Authentication: Image Processing

18. Fingerprint Verification

19. Each person has a unique face? Face Recognition

20. ? Query Face DB Face Recognition: System

21. Inspirational Portrait of Individuality

22. Face Recognition: National Security

23. Speaker Individuality: “My name is …”

24. “My name is” from Two Different Speakers Speaker Individuality

25. “My name is” divided into seven sound units. Speaker Individuality

26. biomouse Fingerprint scanner Digital Camera LCD Pen tablet Microphone Multi-modality Biometric Authentication Embeded & Hybrid User Verification system System that requires user verification

27. Journal 2010 Issues/Solutions Stemming from Scattered Teams Project stakeholder communication Issue – communication gets difficult For example, scattered team members more likely to feel isolated and want to communicate directly with instructor or customer Solution Communication between team and instructor/customer must be through team leader Email distribution lists for whole class and for each team Project team leaders must be local to facilitate communication/meetings with instructor and customers Course website provides central source of course information Blackboard discussion forum for each project (see below)

28. Journal 2010 Issues/Solutions Stemming from Scattered Teams (cont) How to handle quizzes, deliverables, etc. Issue – classroom meetings not available Solution – use Blackboard educational software Quizzes Collecting digital deliverables Discussion forums Forum for archiving instructor email Forum for student introductions Forum for textbook and other course material Forum for each team project

29. Journal 2010 Issues/Solutions Stemming from Scattered Teams (cont) Provide some face-to-face interaction Issue – no weekly classroom meetings Solution – three classroom meetings for local students/customers 1. Near beginning of course 1. Face-to-face introductions, nature of course, specifics of course, student team project meetings 2. Midterm 1. Project status presentations 3. End of semester 1. Final project presentations

30. Journal 2010 Current Assessment of Online Students Individual quizzes (20%) Blackboard educational software system Team initial assignment (10%) Students learn to function as a team Team project midterm checkpoint (20%) Team project final checkpoint (20%) Team technical paper (30%) Strong emphasis on projects No midterm/final exams (used in two-semester course)

31. Journal 2010 Team Member Self and Peer Evaluations Issue – lack of classroom meetings makes it difficult to determine individual team members’ contribution to the project work Peer evaluations critical for distributed teams Some minimal team member/customer contact Some minimal team member/instructor contact Literature indicates Various granularity levels in peer evaluations Some automated systems reported

32. Journal 2010 Team Member Self and Peer Evaluations Three times during the semester After initial assignment to learn the process At the midterm checkpoint At the final end-of-semester checkpoint Process for a graded team event First assign a team grade Adjust individual grades up/down based on self/peer, customer, and instructor evaluations

33. Journal 2010 Example Team Peer Evaluation and Grade Chart (4 member team) Team Member Eval 1Eval 2Eval 3Eval 4SummaryGrade 1+=+++ 93 2==–– – – –79 3–=+––83 4==–+=85 Average=====85 +/- 2% for each summary +/- sign, showing only peer evaluations.

34. Journal 2010 Pedagogical Course Evaluations Issue – lack of classroom meetings makes it difficult for instructor to determine relative value of the course methodologies Solution – semester-end survey (Survey Monkey) Procedures/methods that worked well, or did not work well, and why

35. Journal 2010 Pedagogical Customer Evaluations Issue – instructor is often not aware of the quality of team-customers interactions Solution – semester-end survey Obtain student feedback on customer interaction Were customer requirements clear? Was amount of contact/interaction adequate? Was help on the project work appropriate?

36. Journal 2010 Case Study - Agile Methodology Extreme Programming (XP) First rigorous test of XP method Instructor posted deliverables on that project’s page on the course website Deliverables intended as ~2-week duration Results Instructor overestimated ability of team Often had to provide pseudo code However, first deliverable caused team frustration Re-running experiment of previous team Not possible because not documented properly

37. Journal 2010 Conclusions  Over five year’s experience in face-to- face mode  Over four year’s experience in online mode  Techniques for managing and assessing distributed teams have been successful and they continue to evolve