Oklahoma’s Performance Driven Outcomes System Vic Woods, Tech Prep State Coordinator Oklahoma Department of Career and Technology Education We’re Through Tinkering Around Accountability Performance Driven “A Seamless Transition”

Former Times Six isolated consortia were funded in 1991 through individual competitive grants. A few consortia were added between 1991 and As a result of the “New Carl Perkins” and a state funding formula more consortia were added in The Tech Prep Student Definition was approved July, Consortia analysis provided evidence of transition barriers and the need to restructure some consortia in Twenty-five coordinators currently provide leadership for 24 consortia. In 2003 program evaluations supported by a general review process were replaced by the Performance Driven Outcomes System (PDOS), which is supported by data.

Tech Prep 2003

Tech Prep: Delivering On The Promise Accountability Data Collection and Analysis Communication and Outreach

Characteristics of an Effective Accountability System Improve performance, instead of providing compliance to punish failure Establish a few measurable goals that are clear and significant to progress Monitor Progress Publicly Employ fundamental and extreme incentives Utilize every available tool; involve anyone who can help Build capacity Invest in results oriented outcomes

PDOS Pipeline Seamless Transition System The PDOS serves as a year-to-year working plan with deliverable milestones. It has seven program outcome domains and nine student outcome domains, among other areas of performance. It provides a web-based transitional reporting mechanism (longitudinal cohort study) for students from the high school to technical training to higher education to the workforce.

Data Maintenance Menu

Business Partner Form

Program Outcomes Data Form

Student Outcomes Data Form

PDOS Program Outcomes FY03 First Quarter Report (July-Sept.) System—Component 1 Education Partners—Academic and technical learning experiences - Middle School, High School and Technology Center sites = 466 -Higher Education institutions (Colleges and Universities) = 61 Business/Industry Partners—Work-based learning, curriculum, etc. – Active B/I Partners = Job shadowing, mentorships = Student internships = Teacher internships = 115 Articulation—Component 2 State Approved Agreements—# of agreements and credit hours possible that higher education can transcript - Cooperative = 367/ Advanced Standing/Extra-institutional = 15/?

(Continued) Professional Development—Component 3 - Technically related activities/# attending activities - Administrators = 89/422 - Teachers = 69/786 - Counselors = 78/333 Curriculum & Instruction—Component 4 - Plans of Study = Career Clusters = Connecting /Incorporating Content - Curriculum Alignment = 89 - Contextual Coursework = Curriculum Integration = All Aspects of the Industry = 87

PDOS Student Outcomes 5 year Cohort Study—FY01-FY06 for FY01 students Student Opportunities—Component 5 - # of Tech Prep students - FY00=928 - FY01=2,304 - FY02=2,686 - Completing High School - GPA composite = ? - ACT composite = ? - Technical Program Completers = ? - Transitioning to Post-secondary - Higher Education = ? - Technology Centers = ? -Requiring Remediation - # of Students = ? - Courses = ?

(Continued) -Completing Post-secondary - Associate of Applied Science = ? - Associates of Science = ? - Bachelor of Science = ? - Bachelor of Technology = ? - Technical Certification or License = ? - Military, Apprenticeship = ? -Obtaining Employment - Related = ? - Unrelated = ? -Occupational Competency Testing - Completers = ? -Credentials (certifications, license) - State = ? - National = ? -Non-traditional Students - Participants = ? - Completers = ?

PDOS Culture From a culture of compliance to a culture of results. From a document driven system to a performance driven system supported by data. High School Tech Center CollegeUniversity Business/ Industry Middle School

PDOS Database Software The Oklahoma Department of Career and Technology has an integrated mainframe database system in which we store most of our corporate data. The mainframe is an IBM Multiprize 2000 running VM/ESA. The Tech Prep Outcomes System interfaces with this mainframe system in order to obtain school, personnel, and student information and to store the data associated with its consortiums. The interface to the web is accomplished via software marketed by Sirius Software, Inc. ( This software is called Janus and allows us to write programs to access and update data located on our mainframe from web-based environments. It provides a direct, high performance connection between the mainframe and a TCP/IP network. The database for the Tech Prep Outcomes System is structured as a set of tables each containing a different type of data. The tables are normalized to help eliminate duplication. There are tables for Business Partners, Committees, Schools, Training Activities, etc. The Tech Prep Coordinators are assigned ID numbers that serve to link the information concerning their Consortiums to them. Future plans call for our current mainframe databases to be replaced by Oracle databases running on Sun/UNIX machines.

Get Online! To see how this Performance Driven Outcomes System really works go to: Click on Tech Prep button Click on PDOS button Click on Tech Prep Coordinator Menu Enter this information: Last Name = anonymous PID = Password = Testing