The Common Assessment is Nearly Here: Is Your College Ready? Craig Rutan, CAI Steering Committee Co-Chair Jennifer Coleman, CAI Statewide Program Director 2016 Spring Plenary Session

CAI Overarching Goal Develop a comprehensive, common assessment system that: aligns to state legislation reduces unnecessary remediation provides statewide efficiencies effectively supports faculty and staff to ensure accurate student placement, resulting in more successful student outcomes Spring Plenary Session April 21 – 23, 20162

Key Objectives A test that covers curricular areas of Math English English as a second language (ESL) Adaptive at the Testlet level Multiple (Supplemental) Measures Assessment Preparation Accessibility as a primary consideration Spring Plenary Session April 21 – 23, 20163

Assessment, Not Placement Placement is locally determined Raw data is portable No traditional cut scores. Each student will have a skills assessment report that must be used to place students based upon local mapping of competencies to existing curriculum. Validation steps Statewide Local Spring Plenary Session April 21 – 23,

Current CAI Work Groups Math (includes above college-ready) English (includes Reading) ESL (includes Noncredit) Multiple Measures Professional Development Test Development Process Platform (User Interface, Reporting) Spring Plenary Session April 21 – 23, 20165

Writing Sample Resolution F14 included the following: Resolved, That the Academic Senate for California Community Colleges recommend that the Common Assessment Initiative include writing samples as a required component of the common assessment and that the writing samples are scored by human readers whose participation will inform assessment procedures that promote the growth of students across the composition sequence; and Resolved, That the Academic Senate for California Community Colleges urge the Common Assessment Initiative steering committee to ensure that English and ESL instructors with knowledge and experience as to how integrated assessment programs inform curriculum and pedagogy participate in the design and evaluation of writing samples to ensure that the assessment test is grounded in the latest research on language learning and assessment practices. Spring Plenary Session April 21 – 23, 20166

Writing Sample (2) The writing sample will be a part of the CAI and will serve both English and ESL students The sample can be human scored, but the CAI system will also include a machine scoring algorithm. RFP for this machine scoring system will be out soon The AI must be able to “learn” from writing samples that have been hand scored Colleges will not be required to use the machine score Selection of machine scoring system will come soon. Should human scoring results move with the student? Spring Plenary Session April 21 – 23, 20167

Multiple Measures Overlap with Multiple Measures Assessment Project (MMAP) Currently convening Pilot college overlap Non-cognitive measures Self-Reported GPA Statewide validated model Integration with CCCAssess What should be offered? Use of multiple measures for placement is required. No single placement tool (assessment test or single multiple measure) is sufficient. A “multiple measure” isn’t multiple if you choose to not use the assessment test and then use a single alternative placement tool! Any measure used for placement must be validated. Spring Plenary Session April 21 – 23, 20168

Multiple Measures (2) Please review Resolution S16 – Placement Model for Transfer Statistics Using High School Transcript Data: Resolved, That the Academic Senate for California Community Colleges authorize the distribution of the “MMWG Mathematics Decision Rules Recommendation and Discussion Summary” to Multiple Measures Assessment Project and Common Assessment Initiative pilot colleges; Resolved, That the Academic Senate for California Community Colleges urge local senates to work with their administrations to ensure that the proposed statistics placement model is analyzed using data for their students to ensure that the model works as predicated prior to using it to place students; Resolved, That the Academic Senate for California Community Colleges urge local senates to review the proposed statistics placement model and make any necessary modifications to ensure that there is no negative impact on existing articulation agreements between their college and four year universities; and Resolved, That the Academic Senate for California Community Colleges collect data on the effectiveness of the statistics placement models and report the results by Fall Spring Plenary Session April 21 – 23, 20169

CAI Pilot Colleges Bakersfield CollegeButte College Chaffey CollegeDeAnza College Delta CollegeDiablo Valley College Fresno City CollegeRio Hondo College Sacramento City CollegeSaddleback College Santa Monica CollegeWest Los Angeles College Spring Plenary Session April 21 – 23,

Pilot Phase Piloting began in March of 2016 of test items and the platform. Two components Test Data collection and Validation Technology/Platform Student information system interface Professional Development Iterative process Not a static solution Spring Plenary Session April 21 – 23,

Project Timeline Spring 2016 Field testing and test validation data gathering Summer 2016 Approval by CCCCO ASWG Fall 2016 Release and Implementation begins Ongoing Professional Development Feedback and continuous improvement Success! Spring Plenary Session April 21 – 23,

Now What? We know what is coming. What does that entail locally? How do we get started? Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Timeline Fall 2015 Item Development March-May 2016 Item and Field Testing Adoption Schedule Released June-July 2016Test Validation and Approval Now - October 2016 Preparation for Adoption: Professional Development and Implementation Guidance Fall 2016 Schools begin using CCCAssess for Spring 2017 Placement Spring Plenary Session April 21 – 23,

Local Implementation The implementation of the Common Assessment at your campus will require the collaboration with All Faculty Administrators IT Staff Admissions and Records Assessment Center Staff Research Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

1 st Meeting Watch movie Pass out CCCAsesss Implementation guide Set Deadlines Plan to attend upcoming Professional Development Assign Analyze Current Resources (Step 2) Assign apply for funding Set regular team meetings Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Faculty Role in Implementation Discipline Faculty need to look at the competency maps and determine how they align to existing curriculum The conversations should involve discipline faculty outside of math, English, and ESL because placement decisions affect the entire campus Counselors must be involved in discussion to have accurate information for students Your Academic Senate should take the lead in coordinating the implementation efforts! Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Spring Plenary Session April 21 – 23,

Recency & Retesting How long should the results of the assessment be good for? How long before a student should be allowed to retake the assessment test? Questions like these are a decision to be reached between local academic senates and governing boards, but the answers vary widely across California. Resolution S16 includes the following: Resolved, That the Academic Senate for California Community Colleges work with the Chancellor’s Office to develop guidelines for the development of assessment policies that maintain local control over retesting policies and procedures while maximizing access for students and distribute the guidelines to local senates and curriculum committees prior to the availability of the Common Assessment to all colleges; and Resolved, That the Academic Senate for California Community Colleges urge local senates to delay revision of current policies regarding retesting for placement until after the distribution of assessment retesting guidelines. Spring Plenary Session April 21 – 23,

More Information Visit CCCAssess.org Sign-up for listserv Assess Press via Constant Contact Biweekly newsletters Redesign coming – stakeholder buttons Jennifer Coleman, Statewide Program Director , Craig Rutan, CAI Steering Committee Co-Chair , Spring Plenary Session April 21 – 23,

“ Spring Plenary Session April 21 – 23, QUESTIONS?