Utah Test Item Pool Service UTIPS January 17, 2007 Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 2 Utah Test Item Pool System (UTIPS) TIPS transition to UTIPS –TIPS is no longer maintained by USOE Math, Science, ELA items will be removed UTIPS functional fall of 2004 –

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 3 UTIPS Improvements Reporting features Improved items in the item pools Process in place for item quality control Multiple choice, short answer, matching, and essay Surveys

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 4 UTIPS Improvements Partnership with Curriculum –Professional Development on formative assessment Improves classroom assessment Creates items Teachers also create items –Alignment to standards/objectives provides reports –Opportunity to submit for item pool consideration

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 5 UTIPS Reports Student summary –Can be exported to Excel Pie chart by mastery –Clickable to show individual students in each group Bar graph with percent correct by item –Clickable to show item with response percentages & students who chose each option Individual student mastery –Indicates mastery level by student for standards and objectives

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 6 Report: Student Summary

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 7 Report: Pie Chart

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 8 Report: Bar Graph

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 9 Report: Standards Mastery

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 10 Report: Objectives Mastery

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 11 Improving Instruction Obstacles Summative results of assessment systems Varied definitions of “formative assessment” UTIPS training takes time Availability of local expertise with UTIPS programming language

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 12 Improving Instruction Successes Growing attention to using feedback to improve instruction Increasing number of UTIPS trainers Local technical expertise is growing Professional Development: School and District –Share teaching strategies and resources –Focused on feedback and data Item pools expanding –Better items, more subjects

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 13 Common Assessments Departments or teams can administer common assessments –Administrative rights can be given that view individual and aggregate results of the test Districts are beginning to use UTIPS to administer benchmark tests

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 14 Common Assessments USOE Science pre-tests – Results are most effective when followed up by discussion centered around results

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 15 Non-CRT Subjects Many non-CRT subjects have curriculum entered into UTIPS Teachers can align their questions, and submit for consideration –Questions should be original and non- copyrighted Item pools are being seeded in CTE, Fine Arts, Social Studies, etc

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 16 More than Testing UTIPS provides a public webpage for each account Documents can be uploaded Websites can be linked Media can be imported (sound, video, etc) Calendar feature Blogging tool

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 17 Classroom Access UTIPS assessments can be administered on-line, or paper/pencil –Paper/pencil tests can be scanned, with the results sent to the teacher’s account as if the test was taken on-line

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 18 State-Wide System UTIPS is available regionally, through servers set up locally Information and Training Manuals are available via USOE’s UTIPS website UTIPS is available regionally, through servers set up locally

January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 19 Contact Information Julie Quinn Accountability/UTIPS Specialist Assessment and Accountability Utah State Office of Education (801)