1. Unit Assessment System Teacher Education at Purdue March 4, 2012

2. What is our assessment philosophy ?

3. CONTINUOUS IMPROVEMENT 3 All components of teacher education at Purdue engage in continuous improvement by gathering and analyzing relevant data and making decisions based on data.

4. BALANCE 4 The unit balances central coordination of the overall assessment system with encouraging individual offices and programs to develop flexible, creative, assessment system components that fit their mission and foster continuous improvement.

5. What have we done since the last visit to improve our UAS?

6. THE FIRST THREE YEARS CI Focus: Initial licensure program candidate assessment system –Reviewed the literature and state systems to identify clear criteria for instructional performance –Created the Gate C & D rubrics to measure those performances using the identified criteria –Worked with program faculty to align program key assessments with the unit rubrics 6

7. THE GATE D RUBRIC FOUR SECTIONS PLUS A HOLISTIC SUMMATIVE ASSESSMENT I.PLANNING INSTRUCTION (also used for Gate C) II.TEACHING AND LEARNING EXPERIENCES III.ASSESSING LEARNERS IV.REFLECTING ON LEARNING AND TEACHING EACH SECTION HAS… –3-5 unit items –Items to assess impact on P-12 student learning –Encouragement to programs to add discipline-specific programs FOUR POINT SCALE FOR PERFORMANCE RATINGS –Clear descriptions of target behaviors in the cells PROGRAMS ALIGN TO THE UNIT RUBRIC IN VARIOUS WAYS 7

8. THE GATE D RUBRIC Engineering/Technology Education Rubric Criteria#1#2#3#4 Subject Matter Focus (I.3) 03101 Sound Instructional Strategies (I.4, II.1) 0680 Student Communication Opportunities (II.3) 0680 Communicating Performance Expectations and Assessment Criteria (III.1) 0860 Focus of Student Assessments (I.5) 03101 Summative Assessment of Student Performance (III.1) 03101 Rubric Criteria Beginning Developing Proficient Expert I.1 Knowledge of Students’ Learning Needs and Interests 041734 I.2 Knowledge of Community, School, and Classroom Factors NCTE Standards 1 (1.3), 3.0 (3.1.3) 061434 I.3 Subject Matter Focus of the Unit/Lesson(s) NCTE Standards 3.0 (3.1.4, 3.1.5, and/or 3.1.7), 3.5 (3.5.1, 3.5.2, 3.5.3, and/or 3.5.4) 041334 I.4 Strategies and Resources, Including Technology, to Support Student Learning NCTE Standards 2.0 (2.4, 2.5, and/or 2.6), 3.3 (3.3.1, 3.3.2, and/or 3.3.3) 4.0 (4.2, 4.3, and/or 4.6) 031934 I.5 Focus of Student Assessments NCTE Standards 4.0 (4.10) 012034 8 English Education

9. ACCURACY, FAIRNESS, & CONSISTENCY CI Focus: Initial licensure program candidate assessment system –Use the Gate C&D rubrics for all initial programs –Define and use key assessments for all programs –Audit transition points –Coordination Programs– Program convener Multiple Section Courses – Course coordinator 9

10. THE PAST FOUR YEARS CI Focus: The operational assessment/decision system –Created to specify the decision system –Created a UAS annual report template –Implemented TEC change decisions CI Focus: Advanced programs for teachers –Reviewed and categorized all graduate programs (TEC) –Created task force to design a unit framework, providing clear criteria for performance (TEC) –Currently, advanced programs for teachers are being redesigned to the new unit framework (Programs) 10

11. CURRENT CI Focus: Program Assessment Systems (Standard 2) –March 2011: First SPA program reports in 20 years Results comparable to national averages Most concerns related to the assessment systems –December 2011: First state program reports in 20 years Two approved, one approved with conditions Most concerns related to the assessment systems –Fall 2011: TEC established Standard 2 at the program level as the continuous improvement focus (2011-12) Assessment Coordinator met with all TE Program Conveners Program faculty are currently working to improve their assessment systems 11

12. What are the features of our current unit assessment system?

13. OPERATIONAL DECISION SYSTEM 13

14. CANDIDATE ASSESSMENT SYSTEM 14 Unit and Program Levels Unit Level includes the conceptual framework and related standards, systems for assessing and managing critical transitions, and aggregated performance data from unit wide rubrics Program Level (a) applicable program standards; (b) program assessment systems based on program and unit guidelines for transitions and key assessments; (c) national or state program review

18. CANDIDATE ASSESSMENT SYSTEM OnePurdue Transition to Banner –Facilitated grade reports for content assessment –Facilitated some aspects of Gate audits –DegreeWorks… coming soon… Performance-based Assessment Technology –P3T3 grant (before 2005) –TaskStream, an outsourced solution (2006-present) –We are currently researching alternatives Inexpensive Integrated with Banner, DegreeWorks, and BlackBoard Excellent capabilities 18

19. Questions?