1. This Morning’s Discussion Topics Program accreditation Assessment as an aid in accreditation Model curriculum in computer science Certification

2. Where We’re From Terry Linkletter Seattle John Whitehouse Cleveland ICCP Chicago

3. Interlocking Governance Prior names: ● Computer Sciences Accreditation Board ● Accreditation Board for Engineering and Technology * *

4. ABET accredits 3,278 programs in applied science, computing, engineering, and engineering technology at 671 institutions in 24 nations. CSAB is ABET’s lead society for Computer Science, Information Systems, Information Technology, and Software Engineering.

6. ABET Options for Assessment

7. CS2013 Assessment Exams Available to Colleges Institute for Certification of Computing Professionals was founded 40 years ago by ACM, IEEE-CS, AITP (then DPMA), CIPS, and several smaller professional associations. It is governed by a board of the representatives from its member associations. ACM’s reps are Don Gotterbarn and Joyce Little.

8. ICCP Professional Certifications Certified Computing Professional Certified Data Management Professional Certified Business Intelligence Professional Certified IT Consultant CITCP - Certified IT Compliance Professional CITGP - Certified IT Governance Professional

9. ICCP Certification Council Current Members John Whitehouse Jr., PhD Director of Certification (Cleveland, OH) – Rick Seaman, VP Financial systems (Virginia) – Terry Linkletter, MS, Lecturer (Seattle) – David Horvath, MS, Lecturer, Author (Philadelphia) – Lynn McKell, PhD, Professor (Provo) – Pat Cupoli, MBA, MLS, DAMA International, (Philadelphia) – Jim Woolen, CIO, PhD, Professor (Michigan) – Bob Grenier, PhD, Professor (Illowa, IA) – Tom Hilton, PhD, Professor (Eau Claire, WI) – Bruce White, PhD, Professor (Hamden, CT) – Kewal Dhariwal, PhD, Professor (Albany, NY) – Ken Bainey, CIO, Author (Edmonton, AB) – Michael Nelson, PhD, Professor (Fort Myers, FL) X

10. CS2013 Steering Committee

11. CS2013 Themes The “Big Tent” view of Computer Science – Computational biology, computational engineering... Managing curriculum size – The field grows. The course load can’t. Actual course examplars – Existing successful courses and curricula Institutional needs – Applicable in a range of educational/cultural contexts

12. CS2013 Strategy 18 Knowledge Areas – 171 Knowledge Units 1008 Learning Outcomes 3 Tiers 3 Levels – Familiarity – Usage – Assessment http://cs2013.org

13. Principles Computer Science curricula should be designed to – provide students with the flexibility to work across many disciplines – prepare graduates for a variety of professions, attracting the full range of talent to the field – provide guidance for the expected level of mastery of topics by graduates – permit innovation and track recent developments in the field

14. Guidance Appropriate for 2-, 3-, and 4-year programs Liberal arts, technological, and research institutions Institutions of every size Individual programs will evaluate their own constraints and environments as they adapt the CS2013 model curriculum.

16. CS2013 18 KAs 159 KUs Algorithms and Complexity Architecture and Organization Computational Science

17. 18 KAs 159 KUs

18. 18 KAs 159 KUs

19. 18 KAs 159 KUs 3 Tiers3 Depth Levels1008 Learning Outcomes

20. LO Count by Tier 1110 Total Learning Outcomes 253Core (Tier 1)Required 307Tier 280% is sufficient 550ElectivesProgram’s option

21. Exam Strategy 1110 Total Learning OutcomesHow To Be Measured 253Core (Tier 1)RequiredStandard core exam 307Tier 280% is sufficientTestlets incorporated 550ElectivesProgram’s optionNo standard test planned

22. Knowledge Areas in the Core (Tier 1) LOsKAKnowledge Area 25 ALAlgorithms and Complexity 6 CNComputational Science 32 DSDiscrete Structures 5 GVGraphics and Visual Computing 5 HCIHuman-Computer Interaction 17 IASInformation Assurance and Security 6 IMInformation Management 7 NCNetworking and Communications 12 OSOperating Systems 6 PDParallel and Distributed Computing 12 PLProgramming Languages 39 SDFSoftware Development Fundamentals 12 SESoftware Engineering 29 SFSystems Fundamentals 40 SPSocial Issues and Professional Practice 25315

23. Familiarity Level

24. Usage Level

25. Assessment Level

26. College Maps Courses to CS2013

27. How ICCP Delivers IS2010 Exams

28. How ICCP Plans To Deliver CS2013 Exams

30. Next Steps 1Form cadre of volunteers for CS2013 Council 2As a team, develop standards for tests and items 3Recruit initial 15 item writers, begin building out pool 4Recruit more item writers, as specific KU needs known 5Find 3 alpha test groups, with known but distinct knowledge level ranges

31. Meeting Places Chicago Seattle Cleveland

32. Glossary correlationstatistical correlation between correctly answering an item and overall exam score difficultythe item’s pass rate as a fraction distractorone of an item’s incorrect responses distractor correlation correlation between overall exam pass rate and answering that the given distractor is the correct response examtest itemtest question KAKnowledge Area from CS2013 KUKnowledge Unit from CS2013, associated with a single KA LOLearning Outcome from CS2013, associated with a single KU pass ratethe fraction of examinees who correctly answered an item performance statistics difficulty, correlation, and distractor correlations of an item qualityAn item is a quality item if it has performance statistics that show its correct response has a sufficiently high correlation with success on the exam, its incorrect responses have sufficiently negative correlation with success on the exam, and its level of difficulty is in the appropriate range.

33. Glossary (continued) scorethe number of items answered correctly on an exam sparse A KU is sparse if not enough quality items exist to test all of its Learning Outcomes of the appropriate tier in the desired number of distinct forms. (If we want three forms, then the KU is sparse if there is any LO that is not tested by three distinct quality items.) stemthe part of an item that precedes the responses student’s exam a tier-1 form and a collection of testlets such that all the tier-1 and tier-2 LOs in the KUs studied by the given student are tested tested A LO is tested by an item if knowing that the correct response is true and that the distractors are false implies that the learning outcome is met at the proper level of depth. testleta collection of quality items which together test all of the tier-2 LOs in one given KU tier-1 forma collection of quality items which together test all of the tier-1 LOs in all KUs tier-1 testtier-1 form tweakchange the wording of an item’s stem, correct response, or distractor, with the objective of improving the item’s performance

34. Questions? What is the college’s cost of assessment by examination? – $50 per student to a max of $2,500 How many colleges are assessing so far with the IS exam? – 85 colleges have used these assessment exams, and growing What must a student who passes the exam do to become ISA certified? – Present evidence of degree graduation within one year of taking the exam – Sign code of ethics – Pay $250 certification fee – Enter recertification program and begin collecting PD hours