UTIPS Core Roll-Out Fall, 2011 Julie Quinn, Data and Delivery Coordinator Assessment and Accountability Utah State Office of Education

Fall, 2011 Utah State Office of Education 2

3 Overview Web-based, using HTML 5 Browsers –Safari, Firefox 4, Google Chrome –Internet Explorer (IE) 9 with Chrome plug-in (not preferred) –IE 10 will be supported 2012 Servers housed at UEN Fall, 2011 Utah State Office of Education

Development Philosophy Maintain UTIPS assessment functionality –If the feature exists in MyUEN, use MyUEN Design intended to reduce training hours –Focus on creating quality assessments and using data to improve student learning Flexibility for standards and item pool Improved reports and data access (coming soon) Fall, 2011 Utah State Office of Education 4

Common Core Common Core State Standards (CCSS) –Math is now in UTIPS Core –ELA (coming soon) Math CCSS item alignment now available New math items written for CCSS (coming soon) Educators may align their own items to CCSS and/or other Utah State Standards Fall, 2011 Utah State Office of Education 5

Support Training issues/requests as well as item quality or alignment issues – s may be forwarded to LEA trainers USOE directly supports LEA trainers Fall, 2011 Utah State Office of Education 6

UTIPS Core Access Each school district has a unique URL – –Examples: All users must have an account –Educators AND students –Enrollment Codes place users into organizations Fall, 2011 Utah State Office of Education 7

User Structure Educators –Unique username and password are selected –CACTUS validation option –After account creation, folders and tests from the old UTIPS system may be imported Students –Username is Student’s LEA ID Chaters use LEA ID + Students’s ID (e.g., 4G123) –Password is selected Fall, 2011 Utah State Office of Education 8

Creating Accounts A user is invited to join an organization by being provided with a Enrollment Code –Examples: schools, classes, groups of teachers –Multiple Enrollment Codes may be used per account Enrollment codes –assign roles and organizations –are created from within an educator’s account –are time limited Fall, 2011 Utah State Office of Education 9

Sharing Assessments Educators may share assessments by adding others as participants –The test owner selects users to be added as participants for individual tests –A sub-organization may be created (e.g., CTE IT, Piute Math Teachers), educators are invited with a passcode Fall, 2011 Utah State Office of Education 10

Fall, 2011 Utah State Office of Education 11 Predict CRT Scores? Blueprint tests and item pool questions are NOT designed to predict a student’s performance on a CRT. UTIPS is a screening tool.

12 Flexibility Educators can build assessments using 1. The USOE item pool, Blueprint tests (CCSS later) Individual items by content standards 2. Their own items, or… A combination of both. Fall, 2011 Utah State Office of Education

UTIPS Flexibility Media can be attached to questions –Images –URLs –Documents (coming soon) –Spreadsheets (coming soon) –Presentations (coming soon) –Audio files (coming soon) Fall, 2011 Utah State Office of Education 13

14 A Formative Tool Formative assessment meta analysis: Black & Wiliam (1998) 1 Information to be used by teachers and students as feedback, to modify teaching and learning activities Fall, 2011 Utah State Office of Education

Elements Of an Assessment Event 1.Is the assessment high-quality? 2.Do teachers have access to the data? 3.Do teachers use the data? 4.Do students have access to the data? 5.Do students use the data? Fall, 2011 Utah State Office of Education 15

16 Fall, 2011 Utah State Office of Education

17 A “Good School” “…a good school is not a collection of good teachers working independently, but a team of skilled educators working together to implement a coherent instructional plan, to identify the learning needs of every student, and to meet those needs” (Boudett, City, & Murnane, 2006).

Ask Questions “Data analysis supports a culture of improvement by building the habit of inquiry in which you constantly ask questions and find answers not in your preconceived judgments of children, but in observable data. Therefore, it is critical to invest the time and effort needed to identify a meaningful problem that becomes the focus of the improvement process” (Boudett, City, & Murnane, 2006). Fall, 2011 Utah State Office of Education 18

UTIPS Core Reports Reports are only as good as the items that are used on the test: Do the items reflect the instruction that was presented? Are there enough questions asked for each objective to have confidence in the report? Are the items accurately aligned to the curriculum? Fall, 2011 Utah State Office of Education 19

20 Student Feedback Fall, 2011 Utah State Office of Education

21 UTIPS Reports Student Summary Score Distribution –% of students reaching performance targets Item Performance –# of students getting each question right Individual student mastery –By standard and/or objective Fall, 2011 Utah State Office of Education

Report: Student Summary Fall, 2011 Utah State Office of Education 22

23 Report: Score Distribution Fall, 2011 Utah State Office of Education

24 Report: Item Performance Fall, 2011 Utah State Office of Education

25 Report: Standards Mastery Fall, 2011 Utah State Office of Education

26 Report: Objectives Mastery Fall, 2011 Utah State Office of Education

Report: Common Core Fall, 2011 Utah State Office of Education 27