Commission on Teacher Credentialing Ensuring Educator Excellence 1 Program Assessment Technical Assistance Meetings December 2009

Commission on Teacher Credentialing Ensuring Educator Excellence 2 Agenda  Agency Overview  Review Accreditation Cycle  Program Assessment Document  Guidelines for Submission  Review, Feedback and Dialogue  Relationship to the Site Visit

Commission on Teacher Credentialing Ensuring Educator Excellence 3 Committee on Accreditation COA Tasks i n accordance with the Accreditation Framework... (1) Make decisions about the accreditation of educators’ preparation (2) Make decisions about the initial accreditation of new programs of educator preparation (3) Determine the comparability of standards submitted by applicants with those adopted by the Commission

Commission on Teacher Credentialing Ensuring Educator Excellence 4 COA Tasks (continued) (4) Adopt guidelines for accreditation reviews, and monitor the performance of accreditation teams and other aspects of the accreditation system (5) Report annually to the Commission

Commission on Teacher Credentialing Ensuring Educator Excellence 5 Accreditation Cycle Program Assessment (Yr 4) Biennial Report (Yr 1) Follow-up to Site Visit (Yr 7) Biennial Report (Yr 5) Biennial Report (Yr 3) Site Visit (Yr 6)

Commission on Teacher Credentialing Ensuring Educator Excellence 6 Program Assessment  Year 4 of accreditation cycle  Purposes: –To determine if and how programs are aligned with program standards –To aid in focusing the Site Visit that will follow in Year 6.

Commission on Teacher Credentialing Ensuring Educator Excellence 7 Program Assessment Documentation in 3 Parts  Part I –institutional response to Program Standards  Part II –course syllabi or other evidence that supports Part I  Part III –assessments reported on in Biennial Report

Commission on Teacher Credentialing Ensuring Educator Excellence 8 Program Assessment Program Assessment Part I  Initial Program Approval document –the dream  Program Assessment document –the reality

Commission on Teacher Credentialing Ensuring Educator Excellence 9 Program Assessment In Depth Program Assessment Part I - In Depth  The Program Assessment document describes HOW the program meets each of the adopted program standards.

Commission on Teacher Credentialing Ensuring Educator Excellence 10 Program Assessment In Depth Program Assessment Part I - In Depth Begin by understanding the entire standard Take the standard apart sentence by sentence Respond to each part of the standard Provide appropriate evidence

Commission on Teacher Credentialing Ensuring Educator Excellence 11 Program Assessment In Depth Program Assessment Part I - In Depth   Respond to key verbs or phrases from each sentence of the standard – –The program provides… – –The program prepares candidates to… – –Candidates have multiple, systematic opportunities to… – –Candidates are required to demonstrate …

Commission on Teacher Credentialing Ensuring Educator Excellence 12 Program Assessment In Depth Program Assessment Part I - In Depth  Practice by reviewing some current program standards

Commission on Teacher Credentialing Ensuring Educator Excellence 13 Program Assessment In Depth Program Assessment Part I - In Depth  The program provides...  Candidates have opportunities to...  Candidates demonstrate...

Commission on Teacher Credentialing Ensuring Educator Excellence 14 Program Assessment In Depth Program Assessment Part I - In Depth  The program response to each portion of the standard is the HOW the program meets the standard  One idea for consideration  Additional ideas from participants

Commission on Teacher Credentialing Ensuring Educator Excellence 15 Program Assessment Part I - Review  Any questions about Part I?  Any ideas to share with others?

Commission on Teacher Credentialing Ensuring Educator Excellence 16 Program Assessment Program Assessment Part II - Evidence  Provides the supporting evidence for responses to standards  Ideas: * Copy and paste examples * Indicate in the narrative of Part I specifically where to find the evidence specifically where to find the evidence in Part II— tab, page number in Part II— tab, page number * Hyperlink to the syllabus

Commission on Teacher Credentialing Ensuring Educator Excellence 17 Program Assessment Program Assessment Part II - Evidence   If your institution uses a particular form as a template or course outline that is required as the core of each course, – –you may submit that one course outline in your Program Assessment document.   If each instructor designs their section of the course on their own, – –include each course syllabi for all courses taught in the two years prior to Program Assessment.

Commission on Teacher Credentialing Ensuring Educator Excellence 18 Program Assessment Part II - Review  Any questions about Part II?  Any ideas to share with others?

Commission on Teacher Credentialing Ensuring Educator Excellence 19 Program Assessment Assessment Information Program Assessment Part III - Assessment Information   Provide the actual assessments reported in Biennial Report – –Rubrics – –Observation forms – –Portfolio guidelines   Provide detailed information on the assessments   Readers will have copies of the Biennial Report

Commission on Teacher Credentialing Ensuring Educator Excellence 20 Program Assessment Assessment Information Program Assessment Part III - Assessment Information   How good is good enough? What does it look like?   Describe how you ensure that assessment measures are used in the same manner regardless of location, number of faculty, etc.

Commission on Teacher Credentialing Ensuring Educator Excellence 21 Program Assessment Assessment Information Program Assessment Part III - Assessment Information   MS/SS Programs do not need to include background information on the TPA model.   MS/SS Programs do need to include information on... – –assessor training, – –rescoring procedures, and – –information that connect with Standards 17, 18 and 19 (formerly )

Commission on Teacher Credentialing Ensuring Educator Excellence 22 Program Assessment Program Assessment Part III - Review   Any questions about Part III?   Any ideas to share with others?

Commission on Teacher Credentialing Ensuring Educator Excellence 23 NEW Program Standards NEW Program Standards During Transition...   Institutions have options for responding to Program Assessment. These options will be noted as new standards are approved.

Commission on Teacher Credentialing Ensuring Educator Excellence 24 Transitioning Standards  Education Specialist ( )  Multiple and Single Subject (2009)  Preliminary Admin Services (2009)  Career Technical Education (2008)  School Nurse (2008)  Bilingual Authorization (2008)

Commission on Teacher Credentialing Ensuring Educator Excellence 25 Program Assessment Ongoing 7 year Accreditation Cycle   Develop a process to continually update program documents.   Continuous review and update of the document will save programs from having to write it all in preparation for Year 4 of the cycle.

Commission on Teacher Credentialing Ensuring Educator Excellence 26 Program Assessment Guidelines for Submission   Options – –1 CD/flash drive with all parts – –Posted on a website with on-line review – – submissions. Attachments larger than 10MB must be broken into multiple s and zipped files cannot be accepted through the CTC mail server. – –Due dates - the 15 th of... October, November, or December

Commission on Teacher Credentialing Ensuring Educator Excellence 27 Program Assessment Guidelines for Submission   Each program selects the 15 th of October, November, or December.   Deans/Directors will get a letter by the end of January asking for the date of submission each program has selected.

Commission on Teacher Credentialing Ensuring Educator Excellence 28 Program Assessment Guidelines for Submission  Mail to: Commission on Teacher Credentialing 1900 Capitol Avenue Sacramento, CA ATTN: PSD Program Assessment

Commission on Teacher Credentialing Ensuring Educator Excellence 29 Program Assessment Formatting Suggestions  MS Word or PDF document  12pt Times New Roman or Arial font  Hyperlinks from narrative to attachments (syllabi, assessments) and back to the specified point in the narrative.  Bookmarks (available in PDFs only) are very useful to readers.

Commission on Teacher Credentialing Ensuring Educator Excellence 30 Program Assessment Review Process   Two trained readers per document   Calibration of readers prior to reading first document   Each document is initially read during the meeting   Readers review – –Is the HOW described? – –Does the HOW meet the standard? – –Is there adequate supporting evidence?

Commission on Teacher Credentialing Ensuring Educator Excellence 31 Program Assessment Feedback and Dialogue   Feedback will be either – –Preliminarily Aligned OR – –More Information is Needed   First reading opens dialogue with program that could last for months

Commission on Teacher Credentialing Ensuring Educator Excellence 32 Program Assessment Examples of Feedback Possible Comments   Specifics of HOW the standard is addressed are needed   The narrative response needs to reflect the standard   The evidence does not support the narrative

Commission on Teacher Credentialing Ensuring Educator Excellence 33 Preliminary Report of Findings A minimum of 3 months prior to the scheduled site visit the process comes to closure… – –All standards are Preliminarily Aligned or – –Standards not aligned focus the site visit team’s work Or – –A program specific team member is added to the site visit team to fully review the program on site.

Commission on Teacher Credentialing Ensuring Educator Excellence 34 Preliminary Report of Findings   Report provided to – –Program Contact and Dean/Director – –COA – –Commission Consultant assigned to Site Visit – –Site Visit Team   Final report issued three months to a year before the site visit.

Commission on Teacher Credentialing Ensuring Educator Excellence 35 Accreditation Cycle are Common Standards and Program Standards implemented in an integrated, effective manner? Biennial Reports are programs effective in preparing competent educators? are programs aligned with standards? Site Visit Program Assessment

Commission on Teacher Credentialing Ensuring Educator Excellence 36 Program Assessment Use for Site Visits Prior to Site Visit   Results of Program Assessment guide selection of site visit team members   Preliminary Findings, questions and concerns are reviewed by the team

Commission on Teacher Credentialing Ensuring Educator Excellence 37 Program Assessment Summary  Document compiled from the program narrative describing structure of the program with respect to – –Program Design – –Curriculum – –Field Experience – –Candidate Competence

Commission on Teacher Credentialing Ensuring Educator Excellence 38 Use During Site Visits   Results are confirmed, particularly through interviews   Team focuses on – –Program Design – –Curriculum – –Field Experience – –Candidate Competence   Inconsistencies with Preliminary Report of Findings may need additional review

Commission on Teacher Credentialing Ensuring Educator Excellence 39 Resources   prep/accred-implementation.html prep/accred-implementation.html   Sign up for PSD News  

Commission on Teacher Credentialing Ensuring Educator Excellence 40 Program Assessment Questions?