Transitional THE Assessment Is Your District Ready? Celebrating 25 Years!

Objectives for the day Participants will – Understand who and what will be tested – Understand differences in KSDE and CETE resources – Find KITE, log in, and create tests – Download KITE Client software – Understand and use new technology Enhanced Resources Celebrating 25 Years!2

Norms for the day Cell Phones on vibrate Consideration of each other’s needs and level of understanding Keep the conversation positive Post all unanswered questions in the Parking Lot Celebrating 25 Years!3

What Color is your Car? Get into groups of like car colored people Introduce your selves What common characteristics do you find in your group? Why do you drive the color car you do? Celebrating 25 Years!4

What your car color says about you Dealing with the “cars” in the lot… Celebrating 25 Years!5

First the Basics Math and Reading 3-8 grades and 11 th graders who do not have a banked score. CETE would appreciate all 10,11,and 12 grades to test for data quality reasons. – Only banked scores will be used for accountability Science Grades 4, 7 and OTL with both sections by their 11 th grade year History / Government – No Test Writing, local recommended but not required Celebrating 25 Years!

Resources KSDE – s/CareerStandardsandAssessmentServices/CSASH ome/Assessments.aspx s/CareerStandardsandAssessmentServices/CSASH ome/Assessments.aspx CETE – SWPRSC – Presentation Handouts Celebrating 25 Years!7

The New CETE Summative College Ready Standards; deliver the test via computer, both desktop/laptop and iPads; include technology-­enhanced items, built using templates similar to those used for SBAC; include only machine-­scorable items; map every item to an SBAC assessment “claim,” which will be the unit for reporting subscores; contain items that have all been written to the SBAC “targets,” which represent the ways in which students may be expected to learn and demonstrate their knowledge—by integrating skills and concepts across standards, rather than by tapping only isolated skills within one standard; use the SBAC blueprint as a guideline for determining which standards to emphasize; include multiple forms; match the SBAC style guide with few exceptions; and merge SBAC allowable accommodations with the Kansas accommodations policy to provide further computer­‐based accommodations to students Celebrating 25 Years!8

Technology Enhanced Items CETE has developed about 40 technology enhanced templates They are used to assess a concept not easily assessed through multiple choice. – Interactive and engaging – Provide a better measure of a construct – Assess existing construct more efficiently Practice TEI assessment can be assessed now for formative use Celebrating 25 Years!9

Technology Enhanced Items Celebrating 25 Years!10

Technology Enhanced Items Celebrating 25 Years!11

Technology Enhanced Items Celebrating 25 Years!12

Reporting Not immediate this year because of cut scores will need to be set after all tests are completed. Students will only receive proficiency category. Scores will be reported on the claims at the school level Celebrating 25 Years!13

English Language Arts Between 52 and 60 items total Two sessions – Reading and writing on each section Item types include: – Selected response – Multiple selected response – Technology response Celebrating 25 Years!14

English Language Arts Claim 1 – Literacy and informational texts – Items are related to texts – All claim 1 targets are included Targets 1-7 Literacy Targets 8-14 Informational Celebrating 25 Years!15

English Language Arts Claim 2 – Writing – Stand alone (not text – based) – Only some targets are included Targets 1/3/6: Write/Revise Brief Texts Target 8: Language and Vocabulary Use Target 9: Edit/Clarify Celebrating 25 Years!16

English Language Arts Not Included on 2013/2014 assessment: – Claim 3 – Speaking / Listening – Claim 4 – Research – Constructed response tasks – Performance tasks Additional coverage of the KCCRS will be included in future assessments Celebrating 25 Years!17

Math Transitional Assessment Around 60 items total Two sections Item types include: – Selected response – Multiple select response – Technology enhanced – Numeric entry

Math Transitional Assessment Smarter Balanced Claims – Claim 1: Concepts and Procedures – Does the student know how to DO the math? – Focus: Mathematical Content Standards

Math Transitional Assessment Grades 3-8 – Targets for claim 1 are the clusters – “Major” or “additional supporting” – Greater focus on ‘major” and less on “additional / supporting” – Students will see at least 1 item from every cluster in their grade level

Math Transitional Assessment High School – Targets only 16 clusters for Claim 1 – “Major” or “additional / supporting” – Greater focus on ‘major” and less on “additional / supporting” – Students will see at least 1 item from every cluster in their grade level

Math Transitional Assessment All Grade Levels – All claim 1 targets – Claim 1 targets from previous grades Special note for HS: SBAC specifies any standard can be assessed in these claims. However CETE has only used the targeted Claim 1 standards or those from the lower grades.

Math Transitional Assessment Calculator Use – 3-5 no calculator – 6-HS Calculator active and inactive subsections On the calculator active subsection, special mathematical tools (e.g., abacus or large button calculators) are permitted for students in their IEP. Not included on assessment: – Constructed response tasks – Performance tasks

Accessibility Tools are available to all students all of the time. Tools include: – Highlighter – Striker – Eraser – Calculator on calculator portions of math tests – Periodic table on high school physical science test – Screen magnification Tools do not change how the content is delivered or how the student responds

Personal Needs and Preferences The PNP allows teachers to identify students special needs and drives the delivery of accommodations The PNP is accessed in the Student Record in Educational Portal The PNP includes: – Display enhancements: how resources are to be presented and structured. – Language Brail: how content is communicated to the learner – Audio Environment Supports: how content is audibly delivered and testing environment adapted to fit the learner’s needs

Available Accommodations Text to speech will be available for students requiring audio presentation of items and directions Braille, large print, and print booklets will be available in electronic files – Brail booklets will be delivered as braille-ready files (BRFs) for download to an embosser; graphics will be delivered as PDFs – Print booklets will be available as PDFs

KITE Kansas Interactive Testing Engine Access at Access to the state summative Access to Kwiet (writing test) Access to Career Pathways (CTE) Access to Dynamic Learning Maps (The old Alternative) Access to Formative Tools Access to old NCLB data Celebrating 25 Years!27

Things that have to happen before you can use KITE First – Superintendent must complete his/her EDCS Report in the authenticated applications at KSDE Second – the district data steward must complete a STCO submission to KIDS Third – KSDE sends the data to CETE every night Assign Roles Celebrating 25 Years!28

Hardwar Issues Works on PC, Mac, and IPad devices. – Download the KITE Client May have it up for Chrome IPad – Go to Safari – Type in tde.cete.us/TDE/login.html Celebrating 25 Years!29

Formative Assessments Hover over “For Educators” Click on Formative Assessment Tools Explore the Language Arts and Mathematics offerings – At your table, ½ commit to ELA research and ½ commit to Math research – Read material – Report to shoulder partner high lights – Share reports with the rest of the table Celebrating 25 Years!30

The Portal Educator.cete.us Sign in using your school address as username. (First Time)Click on forgot password. Check you school account for instructions to reset your account Celebrating 25 Years!31

Navigating KITE Celebrating 25 Years!32

Navigating KITE Test Management Celebrating 25 Years!33

Navigating KITE Adding a new test Celebrating 25 Years!34

Navigating KITE Celebrating 25 Years!35

Navigating KITE Celebrating 25 Years!36

Navigating KITE Celebrating 25 Years!37

Navigating KITE Celebrating 25 Years!38 Select the test you want and then click “Next”

Adding Students Click on the Students Tab Celebrating 25 Years!39

Adding Students Click on the Students Tab Celebrating 25 Years!40

Adding Students Click on the Students Tab Celebrating 25 Years!41

Naming the test Celebrating 25 Years!42

Naming the test Celebrating 25 Years!43

Print your tickets Celebrating 25 Years!44

Celebrating 25 Years!45

KITE Client This is needed for students to access their KITE Portal Go to Hover over “For Educators” and click on KITE Down load the client onto your computer Celebrating 25 Years!46

Warning Tickets – Same ticket information for all tests – Students could take the test at home – Students could take some else’s test – IPad users could pop out of the test to look up information If this should happen there is an SC code for this Celebrating 25 Years!47

Lets Practice Open a web browser Go to educator.cete.us and log in Click on Test management Search for “Practice for Technology-Enhanced Items” Click the radio button and then click next Select some 3 or 4 random students Print your tickets Celebrating 25 Years!48

Lets Practice Launch your KITE Client Log in with the ticket information as a student Experience the joys of Technology Enhanced Items Celebrating 25 Years!49

Celebrating 25 Years!50

Next Generation Assessments in Kansas Marianne Perie CETE January 22, 2014 Presented at KAAC in Topeka And USA in Wichita Celebrating 25 Years!51

Everything is changing Smarter Balanced Assessment Consortium (SBAC) Wiser Harmonious Assessment of Kansas (WHAK) (We (CETE)are taking suggestions on naming this new assessment!) Celebrating 25 Years!52

But how much is changing, really? Transition assessment in Spring 2014 is the same as we have always planned. Spring of 2015, when we would have had SBAC for the first time, we will have an enhanced Kansas assessment. By Spring of 2016, we will be very close to where we would have been with SBAC with difference due to choices made in Kansas Celebrating 25 Years!53

Spring 2014 Transition Assessment – Delivered on KITE – Aligned with Kansas College and Career Ready Standards for math, reading, and writing conversations – Follows similar blueprint to SBAC – Machine-scorable items only – No performance task - No writing prompt - No listening items Celebrating 25 Years!54

New Development in The transitional test will serve as the backbone for the new Kansas College and Career Ready Assessment Enhancements – Listening section – Writing prompt – Math performance tasks Celebrating 25 Years!55

Spring 2015 The core machine-scorable part of the test will be parallel to what was administered in 2014, but we will refresh the item pool. We will field test the enhancements. Accountability for 2015 will be based on the core portion of the test. Schools and districts will receive feedback on the field-test portions to help gauge students readiness on the full set of standards Celebrating 25 Years!56

Summer 2015 After analyzing the field-test items, we will create the best form possible that includes all features of our future assessment. We will set new achievement standards (cut scores and performances level descriptors) based on that form. Using those new cute scores, we will set new AMOs and communicate the new targets to schools and districts Celebrating 25 Years!57

Spring 2016 Now we have a fully enhanced test that covers all of the Kansas College and Career Ready Standards. We should also have sufficient numbers of items to make the test adaptive this year as well Celebrating 25 Years!58

Adaptivity The test will be adaptive to allow students to be measured on items close to their ability level. We are considering stage adaptivity rather than item adaptivity that SBAC uses. Benefits – More reliable estimates – Targets assessment to student level Celebrating 25 Years!59

Special Education Adaptivity should help students who used to take the KAMM. They will be assessed on grade-level, but with easy items. Many tools are available to all students (e.g., highlighter, notes, calculator) Accomodations are available electronically (striker, contrast, auto font) TTS is available in a new and improved voice this year Celebrating 25 Years!60

Kansas Fingerprints We want Kansas educator and stakeholder fingerprints all over these new assessments – Teachers - Design decisions - Item writing - Item reviewing - Rangefinding - Scoring Celebrating 25 Years!61

Kansas Stakeholders Administrators – Support teacher involvement – Voice in report decisions – Cross-content development Kansas Board of Regents – High school-we want to ensure that test truly predict college readiness – Will be involved in design and review of assessments and setting cut scores Celebrating 25 Years!62

Full Kansas Assessment Program Summative assessment O ELA (complete in 2016) – Math (complete in 2016) – History/ government (complete in 2017) – Science (complete in 2017) Formative Tools – Really more like sample items now – Developing capacity for teachers to build test forms using items pool – In 2016, we can start building true formative, instructionally-embedded test. Will include science and H/G Celebrating 25 Years!63

Things to Consider Essay – Covers both ELA and Science or History/Government standards – Students in grades 4,7, and 11 would only need to write one essay aligned to both History/government and literacy standards – Two rubrics provide two scores- one for each test – Same idea for science Celebrating 25 Years!64

HS Example Students watch “I have a dream” and read an essay by Malcolm X. They are then asked to write an essay comparing and contrasting the two approaches to the civil rights movement. They may be asked to define and give examples of civil disobedience and discuss its efficacy Celebrating 25 Years!65

Writing Standards (G11) Write information/explanatory texts, including the narration of historical events, scientific procedures/ experiments, or technical processes. a. Introduce a topic clearly, previewing what is to follow; organize ideas, concepts, and information, using strategies such as definition, classification, comparison/ contrast, and cause/effect; including formatting (e.g., headings), graphics (e.g., charts, tables), and multimedia when useful to aiding comprehension. b. Develop the topic with relevant facts, definitions, concrete details, quotations, or other information and examples. c. Use appropriate transitions to create cohesion and clarify the relationships among ideas and concepts. d. Use precise language and domain-specific vocabulary to inform about or explain the topic. e. Establish and maintain a formal style and objective tone. f. Provide a concluding statement or section that follows from and supports the information and explanation presented Celebrating 25 Years!66

Kansas History/Government Standards High school: Civil rights, social change Standard #3: Societies are shaped by beliefs, ideas, and diversity. – 3.1 The student will recognize and evaluate significant beliefs, contributions, and ideas of the many diverse peoples and groups and their impact on individuals, communities, states, and nations. – 3.2 The student will draw conclusions about significant beliefs, contributions, and ideas, analyzing the origins and context under which these competing ideals were reached and the multiple perspectives from which they came Celebrating 25 Years!67

Things to consider (1) Adaptivity in writing prompt and performance task. – SBAC planned to have writing prompts and performance tasks written to three different levels of difficulty. The first part of the test would determine which writing prompt/performance task the student received. – Should we do the same? Would two levels be sufficient? Celebrating 25 Years!68

Things to consider (2) Scoring – With a writing prompt and math performance task, we will have student responses that need to be scored by hand. – We would like teachers to be involved in scoring. – What is the best model? Celebrating 25 Years!69

Scoring Models Fully distributed scoring – Teachers score on the computer using KITE. An independent activity. School or regional based scoring – Teachers score as a group and enter scores later. Scoring center – Only a few teachers come to Lawrence for several days to score all student papers Celebrating 25 Years!70

Things to consider (3) Weighting the essay and performance task – What are your thoughts as to how much weight the essay should have on the ELA score or the math performance task should have on the math test? MC items are worth one point each. TE items can be worth up to 3 points each. – Math core is worth 60 points. – ELA core is worth points, depending on the grade Celebrating 25 Years!71

Things to consider (4) Listening requires headphones and additional caching Districts and schools will need to purchase headphones for every student or ask students to bring in their own (think ear buds) Streaming audio will put a huge load on the system, so you will need to work with IT to prepare for that in How can KSDE and CETE help you prepare for this load? Celebrating 25 Years!72

Things to consider (5) USED required three: Proficient, one above and one below SBAC has four; PARCC has five Kansas had traditionally used five Considering four: – Academic warning – Approaching standard – Meeting Standard – Exceeding standard Would other levels be useful? Where and Why? Celebrating 25 Years!73

Discussion topics Double counting essays Scoring Weighting the essay and math performance task Streaming audio-bandwidth and caching issues Number of performance levels Celebrating 25 Years!74