1. Computer Science Course Assessment Feb 15, 2012 / Dan Duchamp

2. Purpose To improve the quality of education To improve instructors ABET requires it (for BS-CS program) Middle States requires it (for MS programs) Why do assessment?

3. Program Outcomes Each program (i.e., BS major or MS degree) has PROGRAM OUTCOMES Example program outcome: a program graduate has the “ability to apply knowledge of computing and mathematics appropriate to the discipline.” (BS-CS outcome A)

4. Program Outcomes Outcomes for all CS programs listed at http://www.stevens.edu/compsci/ accreditation/prog_out.html

5. Course Outcomes Each course has COURSE OUTCOMES Example course outcome: “Explain how memory is allocated among multiple resources.” (CS 520 outcome #1)

6. Course Outcomes Outcomes for all CS courses listed at http://www.stevens.edu/compsci/ undergrad/ugrad_courses.php and http://www.stevens.edu/compsci/ graduate/masters/ grad_courses.php

7. Outcome Mapping Each program outcome is supported by one or more course outcomes Course 1Course 2Course 3 Program 1 Program 2

8. Course Outcomes Mapping of program outcomes to course outcomes listed with program’s outcomes at http://www.stevens.edu/compsci/ accreditation/prog_out.html

9. Example Mapping

10. Course Assessment Direct: measured student performance Indirect: student opinions about their performance (ACE survey) Two kinds of data:

11. Measuring Student Performance For each course outcome there is an “assessment instrument” (i.e., graded piece of work) Example: homework assignment, exam question, project

12. Course Assessment 1. Compute average performance on each instrument (0-4 scale) 2. Enter average onto SPAD form inside ACE system 3. Instructor also writes his/her opinions on ICE form inside ACE system 4. Produce PDF versions of SPAD & ICE 5. Post PDFs at http://www.stevens.edu/compsci/accre ditation/forms.php

13. SPAD Form

14. ICE Form

15. Course Improvement 1. Before semester, instructor reads SPAD and ICE forms from previous semesters 2. From this data, instructor determines how to improve the course; instructor documents his/her plans on PCR form 3. After semester, instructor produces and posts SPAD & ICE forms – for use by future instructors

16. PCR Form

17. Important Web Sites ACE system (to produce SPAD and ICE forms): https://www.stevens/assess CS forms page (to get PCR form, save PCR, SPAD, ICE): http://www.stevens.edu/accreditat ion/forms.php

18. ACE

19. CS Forms Page

20. Mid-semester Survey Also … around mid-semester, during class time students fill out very simple “mid-term survey” form Instructor reads surveys and immediately makes any needed improvements Mid-term survey forms are not saved

21. Mid-term Survey

22. What You Can Do To Help 1. Learn course outcomes 2. Discuss with instructor: which instrument will measure each outcome? 3. Create grade item in Moodle for each instrument 4. For each instrument, compute average, convert to 0-4 scale (e.g., 79% = 3.16/4) 5. Report instrument averages to instructor for entry onto SPAD