1. Welcome to the Validation Wizard Tutorial - Part 1 -
Left click your mouse on the slide or press the right arrow key ( ) to go to the next slide. Press the left arrow key () to go back to a previous slide.
Copyright © Biddle Consulting Group, Inc. All rights reserved.

2. The following information is offered to CritiCall User’s Group members as part of their membership
Copyright © Biddle Consulting Group, Inc. All rights reserved.

3. The CritiCall Validation Wizard
The Validation Wizard verifies whether the CritiCall test modules your organization uses for employment purposes are job related and automatically determines appropriate cutoff scores
The Validation Wizard is based upon the content validity standards set forth in the federal Uniform Guidelines on Employee Selection Procedures
Copyright © Biddle Consulting Group, Inc. All rights reserved.

4. What is “Validation?”
Copyright © Biddle Consulting Group, Inc. All rights reserved.

5. What is “Validation?”
Validation refers to the investigation and evaluation of the degree to which available evidence supports inferences made from scores on a test
In other words, validation supports the inference that someone who passes the test possesses an ability that is required to perform an important job-related task
Copyright © Biddle Consulting Group, Inc. All rights reserved.

6. Why Should We Validate the Tests We Use?
It makes good business sense to make certain the tests you are using are job related and fair
Validation is required under the federal Uniform Guidelines on Employee Selection Procedures in some circumstances
You can go to to see when validation is required
Copyright © Biddle Consulting Group, Inc. All rights reserved.

7. Three simple steps to using the Validation Wizard
Create an AutoTest Code containing the test modules you wish to use for employment purposes (e.g. hiring)
- You can also validate linked multiple-hurdle AutoTest Codes if you are using version 3.5 or higher
Turn the Validation Wizard “ON”
Have 7 to 10 of your experienced employees take the test modules in that AutoTest Code and respond to the Validation Wizard’s questions when they appear
Copyright © Biddle Consulting Group, Inc. All rights reserved.

8. Based on the information provided by your Job Experts…
The Validation Wizard will automatically determine if the test modules you chose are valid for your organization so they might be used for employment purposes
The Validation Wizard will also automatically calculate cutoff scores that can be used for employment purposes by your organization
Copyright © Biddle Consulting Group, Inc. All rights reserved.

9. Using the CritiCall® Validation Wizard
Copyright © Biddle Consulting Group, Inc. All rights reserved.

10. Who determines which test modules will be validated?
You, as the employer, determine which test modules will be included in the AutoTest Code to be validated
To do this you must create an AutoTest Code that contains only the test modules you feel are appropriate for the job as it is performed at your agency before you can use the Validation Wizard
We recommend using the Test Creation Wizard feature in CritiCall to determine which test modules should be included in the AutoTest Code you will be validating
Copyright © Biddle Consulting Group, Inc. All rights reserved.

11. Turning the Validation Wizard “ON”
Copyright © Biddle Consulting Group, Inc. All rights reserved.

12. This is a “Screen Shot” of the Administrator’s Program opening screen
To turn the Validation Wizard “on”, first click on the System Customization link in the CritiCall Administrator Program
This is a “Screen Shot” of the Administrator’s Program opening screen
Copyright © Biddle Consulting Group, Inc. All rights reserved.

13. Then, check the “Run Validation Wizard” box.
Finally, select “OK,” and the Validation Wizard is turned “on”
This is a “Screen Shot” of the System Customization section of the Administrator’s Program
Copyright © Biddle Consulting Group, Inc. All rights reserved.

14. To turn the Validation Wizard “off,” return to the System Customization section of the Administrator Program and uncheck the box that you used to activate the Wizard
Copyright © Biddle Consulting Group, Inc. All rights reserved.

15. The next slides show you how!
Who determines which AutoTest Code my Job Experts will validate if there is more than one AutoTest Code available in CritiCall?
You determine whether you allow your Job Experts to choose the AutoTest Code to be validated or whether you only allow them access the one AutoTest Code you wish to validate
The next slides show you how!
Copyright © Biddle Consulting Group, Inc. All rights reserved.

16. In the System Customization section of the Administrator’s program you check this box if you wish to allow your Job Experts to choose which AutoTest Code they are going to validate
This is a “Screen Shot” of the System Customization section of the Administrator’s Program
Copyright © Biddle Consulting Group, Inc. All rights reserved.

17. Or, if you decide not to allow the Job Experts to choose from a list of AutoTest Codes, leave this box unchecked.
You then must specify which one AutoTest Code (the “default”) will be available to the Job Experts to validate by selecting from the list of available AutoTest Codes here.
This is a “Screen Shot” of the System Customization section of the Administrator’s Program
Copyright © Biddle Consulting Group, Inc. All rights reserved.

18. Who Responds to the the Validation Wizard’s Questions?
Copyright © Biddle Consulting Group, Inc. All rights reserved.

19. The Validation Wizard is completed by your own Job Experts
Job Experts (also called “Subject Matter Experts” or “SMEs”) are employees who currently hold the job classification you are testing for, and are considered successful job performers, and/or supervisors who have held the targeted job classification, and/or instructors or trainers for the targeted job classification
Copyright © Biddle Consulting Group, Inc. All rights reserved.

20. How many of my Job Experts should take the Validation Wizard?
The courts have indicated that 7 to 10 Job Experts are sufficient
Of course, if the target classification has fewer than 7 to 10 Job Experts available, a smaller number will have to suffice
For jobs with more than one-hundred current employees, more than 7 to 10 Job Experts is beneficial
Copyright © Biddle Consulting Group, Inc. All rights reserved.

21. How do we choose our Job Experts?
We recommend using employees who have at least one year’s experience with the tasks performed on the job, if possible
The Job Experts you choose should be considered successful job performers
The Job Experts used during the validation process should be representative of the job classification’s employees in terms of gender, race/ethnicity, and functional area of assignment
In addition, underrepresented racial/ethnic and gender minorities should be included, if possible
Copyright © Biddle Consulting Group, Inc. All rights reserved.

22. Can we practice using the Validation Wizard before we record our actual responses?
All entries made into the Validation Wizard are permanently stored and reported by CritiCall. They cannot be deleted or modified.
If you wish to practice using the Validation Wizard you should practice using an AutoTest Code title that will never be used for employment purposes
Copyright © Biddle Consulting Group, Inc. All rights reserved.

23. This is the end of Part 1 of this tutorial
This is the end of Part 1 of this tutorial. Please go to Part 2, which is also located in the User’s Group web pages, when you are ready.
Copyright © Biddle Consulting Group, Inc. All rights reserved.

24. We hope this presentation has been helpful!
Please call CritiCall at with your comments and/or suggestions about this presentation,
or write to us at
Biddle Consulting Group, Inc.
193 Blue Ravine Road, Suite 270
Folsom, CA 95630
Copyright © Biddle Consulting Group, Inc. All rights reserved.

25.
Copyright © Biddle Consulting Group, Inc. All rights reserved.