Welcome to the Validation Wizard Tutorial - Part 1 - Left click your mouse on the slide or press the right arrow key ( ) to go to the next slide. Press the left arrow key () to go back to a previous slide. Copyright © 2002-20070 Biddle Consulting Group, Inc. All rights reserved.

The following information is offered to CritiCall User’s Group members as part of their membership Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

The CritiCall Validation Wizard The Validation Wizard verifies whether the CritiCall test modules your organization uses for employment purposes are job related and automatically determines appropriate cutoff scores The Validation Wizard is based upon the content validity standards set forth in the federal Uniform Guidelines on Employee Selection Procedures Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

What is “Validation?” Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

What is “Validation?” Validation refers to the investigation and evaluation of the degree to which available evidence supports inferences made from scores on a test In other words, validation supports the inference that someone who passes the test possesses an ability that is required to perform an important job-related task Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Why Should We Validate the Tests We Use? It makes good business sense to make certain the tests you are using are job related and fair Validation is required under the federal Uniform Guidelines on Employee Selection Procedures in some circumstances You can go to www.uniformguidelines.com to see when validation is required Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Three simple steps to using the Validation Wizard Create an AutoTest Code containing the test modules you wish to use for employment purposes (e.g. hiring) - You can also validate linked multiple-hurdle AutoTest Codes if you are using version 3.5 or higher Turn the Validation Wizard “ON” Have 7 to 10 of your experienced employees take the test modules in that AutoTest Code and respond to the Validation Wizard’s questions when they appear Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Based on the information provided by your Job Experts… The Validation Wizard will automatically determine if the test modules you chose are valid for your organization so they might be used for employment purposes The Validation Wizard will also automatically calculate cutoff scores that can be used for employment purposes by your organization Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Using the CritiCall® Validation Wizard Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Who determines which test modules will be validated? You, as the employer, determine which test modules will be included in the AutoTest Code to be validated To do this you must create an AutoTest Code that contains only the test modules you feel are appropriate for the job as it is performed at your agency before you can use the Validation Wizard We recommend using the Test Creation Wizard feature in CritiCall to determine which test modules should be included in the AutoTest Code you will be validating Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Turning the Validation Wizard “ON” Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

This is a “Screen Shot” of the Administrator’s Program opening screen To turn the Validation Wizard “on”, first click on the System Customization link in the CritiCall Administrator Program This is a “Screen Shot” of the Administrator’s Program opening screen Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Then, check the “Run Validation Wizard” box. Finally, select “OK,” and the Validation Wizard is turned “on” This is a “Screen Shot” of the System Customization section of the Administrator’s Program Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

To turn the Validation Wizard “off,” return to the System Customization section of the Administrator Program and uncheck the box that you used to activate the Wizard Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

The next slides show you how! Who determines which AutoTest Code my Job Experts will validate if there is more than one AutoTest Code available in CritiCall? You determine whether you allow your Job Experts to choose the AutoTest Code to be validated or whether you only allow them access the one AutoTest Code you wish to validate The next slides show you how! Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

In the System Customization section of the Administrator’s program you check this box if you wish to allow your Job Experts to choose which AutoTest Code they are going to validate This is a “Screen Shot” of the System Customization section of the Administrator’s Program Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Or, if you decide not to allow the Job Experts to choose from a list of AutoTest Codes, leave this box unchecked. You then must specify which one AutoTest Code (the “default”) will be available to the Job Experts to validate by selecting from the list of available AutoTest Codes here. This is a “Screen Shot” of the System Customization section of the Administrator’s Program Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Who Responds to the the Validation Wizard’s Questions? Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

The Validation Wizard is completed by your own Job Experts Job Experts (also called “Subject Matter Experts” or “SMEs”) are employees who currently hold the job classification you are testing for, and are considered successful job performers, and/or supervisors who have held the targeted job classification, and/or instructors or trainers for the targeted job classification Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

How many of my Job Experts should take the Validation Wizard? The courts have indicated that 7 to 10 Job Experts are sufficient Of course, if the target classification has fewer than 7 to 10 Job Experts available, a smaller number will have to suffice For jobs with more than one-hundred current employees, more than 7 to 10 Job Experts is beneficial Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

How do we choose our Job Experts? We recommend using employees who have at least one year’s experience with the tasks performed on the job, if possible The Job Experts you choose should be considered successful job performers The Job Experts used during the validation process should be representative of the job classification’s employees in terms of gender, race/ethnicity, and functional area of assignment In addition, underrepresented racial/ethnic and gender minorities should be included, if possible Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

Can we practice using the Validation Wizard before we record our actual responses? All entries made into the Validation Wizard are permanently stored and reported by CritiCall. They cannot be deleted or modified. If you wish to practice using the Validation Wizard you should practice using an AutoTest Code title that will never be used for employment purposes Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

This is the end of Part 1 of this tutorial This is the end of Part 1 of this tutorial. Please go to Part 2, which is also located in the User’s Group web pages, when you are ready. Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

We hope this presentation has been helpful! Please call CritiCall at 800-999-0438 with your comments and/or suggestions about this presentation, or write to us at Biddle Consulting Group, Inc. 193 Blue Ravine Road, Suite 270 Folsom, CA 95630 Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.

800-999-0438 Copyright © 2004-2007 Biddle Consulting Group, Inc. All rights reserved.