Recovering from the Unexpected

Slides:

Advertisements

Similar presentations

How Do We Do It? A Look at DeVry Inc.s Investor Relations Program.

Advertisements

Experts Respond to Your Questions 2006 Annual ConferenceAlexandria, Virginia Council on Licensure, Enforcement and Regulation Expect the Unexpected: Are.

Presented at the 2006 CLEAR Annual Conference September Alexandria, Virginia Disaster Preparedness II: Planning for the Future By Deidre Gish-Panjada.

Presents The Jimmy A Young Memorial Lecture Sunday, July 18, :30 to 9:30 AM Marco Island, FL 1.

Central Valley Flood Protection Board Meeting – Item 6.

Effective Communication of Exam Results: What Should (or Shouldn't) be Included in the Candidate's Score Report Elizabeth A. Witt, Ph.D. American Board.

Leveraging the Internet in Exam Development and Delivery Tony Zara, PhD Ho J. Mun Pearson VUE / Promissor Expect the Unexpected: Are We Clearly Prepared?

“You Can’t Always Get What You Want: Accountability and Limits in Score Reports to Boards” Troy Elliott Association of Social Work Boards 2006 Annual ConferenceAlexandria,

You’ve Been Shown: Now It’s Your Turn to Ask! CLEAR 2004Kansas City, Missouri Responding to Your Questions About Testing.

Raising Private Capital Today  The Private Capital Market Solution for Private Growth Companies Conducting A Private Placement.  Integrating Marketing,

Use the Internet to Find a Job Presented by Highland College Placement Office.

Surgery Management System that Identifies Any Less Invasive, Less Costly Alternatives HR Specialty Products & Services Catalogue Executive Summary A No.

Low Cost, Quick Delivery, 24 X 7 Proprietary Recruiting Team Specialization Model HR Specialty Products & Services Catalogue Executive Summary A No Frills.

BDPA-Information Technology Thought Leaders Bridging the Gap Between Professionals and Students “Boardroom to Classroom concept”

No-Cost-To-Employer, CSR-Supported, SaaS-Based Retirement Assistance System for Moving Employees from Active Status to Retiree Status HR Specialty Products.

Pre-Employment Assessment That Measures Not Only the “Can Do” Skills But Also the “Will Do” Attributes so as to Predict Employee Engagement HR Specialty.

THE HR APPRENTICERICHMOND THE HR APPRENTICE RICHMOND Marvelous Membership Mavericks.

Presented at CLEAR’s 23rd Annual Conference Toronto, Ontario September, 2003 CLEAR 2003 Annual Conference Pushing the Boundaries of Regulation Practice.

Internet Marketing M. Ali Nawaz Adil Web Marketing Consultant

Making an Effective Curriculum Vitae Danielle Gordon, M.S. Senior Research Evaluator.

CLEAR 2003 Annual Conference Toronto, Ontario Technology, Service, and Delivery Stephen Greenfield Product Services Manager.

Sterling Practices in Design & Scoring of Performance-Based Exams #156 F. Jay Breyer Presented at the 2005 CLEAR Annual Conference.

AY 2009 Unit Review Data Delivery Plan Data Description Process – Timeline Rev

Internet Job- Search Process. Changes in the Search In the past, people were able to find jobs in the newspaper, now most are online. You need access.

1 Chapter Nine Engineering Your Career. 2 Engineering Careers  Electrical and computer engineers find employment in: 1.Private industry. 2.Government.

Announcing: Launch of XML Admissions Application 2 nd Annual Conference on Technology & Standards, Washington D.C., March 03, 2005 Graham Tracey, Chair,

Company Name Business Plan. Mission Statement Inspire Web Design is committed to providing high- quality Web design services, full support and maintenance.

Presented at CLEAR’s 23rd Annual Conference Toronto, Ontario September, 2003 Accountability and Effectiveness: Maintaining Security at Test Centers Cynthia.

The Board of Director’s Role in Diversity Implementation Reatha Clark King PhD COLLOQUIUM ON GLOBAL DIVERSITY GLOBAL SUMMIT OF WOMEN THE WORLD BANK February.

REVENUE CYCLE LEARNING PLAN: Bringing it full circle Zoe Wolf Director of Revenue Cycle Sixteenth Street Community Health Centers Milwaukee, WI.

Recovering from the Unexpected 22nd Annual CLEAR Conference Las Vegas, NVSeptember 12, 2002 Ron Rodgers, Ph.D. Director of Measurement Services, Continental.

Office Of Standards, Assessment, & Reporting Update David Abrams Assistant Commissioner For Standards, Assessment and Reporting S/CDN September 23, 2004.

2015 North Carolina State Energy Conference The Transformation of Nuclear Power and its Future Role Moderator: David A. Doctor, President & CEO E4 Carolinas,

Author Instructions How to upload a Session Proposal that will not have any papers -1 Step Process.

Certification in Infection Prevention and Control CIC ® Certification is Commitment.

Adding Luster to a Good (National) Testing Program—Technology Considerations I. Leon Smith, PhD Professional Examination Service 475 Riverside Drive New.

APMG-International Webinar Integrating Agile into PRINCE2® Thursday 19 December 2013 / 13:00 GMT Presented by Melanie Franklin,

2 United States Department of Education, Privacy Technical Assistance Center 1 Western Suffolk BOCES Data Breach Exercise.

Grade Reporting Implications Moving from 6 Week to 9 Week Grading Periods.

Neuroscience Graduate Program Candidacy Exam Process

GM Remarks Fiscal and Management Control Board September 25, 2017.

SCM Customer Service Operations LB 3

PM 512 The Customer In The Project Process April 18,1998

CSS 422 Teaching Effectively-- snaptutorial.com

MHA 628 Education for Service/tutorialrank.com

MGT 415 Education for Service-- tutorialrank.com

What’s New in Small Business

Information Technology

3/12/2013 Middle Management.

MANDATORY PRE-BID MEETING

Middle Management 2012 PLN Conference 11/23/2018.

Institutional Assessment Plans

Meeting Quality Standards when working in collaboration

COMMUNICATION PLAN DESIGN GUIDE

Automated Printed Circuit Board Development

Web archive data and researchers’ needs: how might we meet them?

Family and Consumer Sciences

Program and Staff Development

Recovering from the Unexpected: A Testing Company’s Perspective

Congratulations! One of your employers was selected for a survey

ECSE Advising 10 September /20/2019 Kenneth A. Connor.

Innovative Approaches for Examining Alignment

The Validity of A Website

Beyond Graduate Survey 2015 Summary Analysis

4-H Youth Development 2012 PLN Conference 7/22/2019.

Program and Staff Development

Family and Consumer Sciences

Communications 2012 PLN Conference 8/26/2019.

Balancing Field Experiences and Course Work

Report on CEOS Executive Officer functions

Presentation transcript:

Recovering from the Unexpected Presented at The 22nd Annual CLEAR Conference September 12 – 14, 2002 Moderator I. Leon Smith, PhD President & CEO PES Panel Ronald C. Rodgers, PhD Consulting Psychometrician Continental Testing Services President, Employment Research Institute Randolph P. Reaves, JD Executive Officer and General Counsel Association of State and Provincial Psychology Boards Elizabeth A. Witt, PhD Senior Measurement Analyst Promissor (formally CAT*ASI)

Scenario Summary The “unexpected” arrived in the form of an email to the licensure program sponsor to “look at the website of a test preparation company.” A review of the site revealed a number of pages containing the full text of items presumably recalled from the examination by some candidates. A check of the text of the items revealed that approximately 5% of the items were identical to those on the four current forms of the examination being delivered through the computer delivery vendor. Most of the exposed items also appeared on the four new forms already at the computer delivery vendor to be deployed shortly as replacements for the four current forms. Each form contains operational (scored) items, and several pre-test (unscored) blocks. All forms are pre-equated. To ensure the timely implementation of the four new forms, any replacement of items must be limited to those items already on the compute delivery vendor’s system. Since the test preparation website has been operational for several years, the magnitude of exposure probably went beyond these few items. In addition, approximately 70% of the items on the four new forms overlap with the current forms being administered.

Objective The licensure program sponsor wants to accomplish the following goals: Ensure the continuing validity of examination scores and the public protection function of licensure examination forms Close down the test preparation website that is posting the exposed items Have the Internet host provider terminate the service to the test preparation website What to do? And what are the issues?