1. Perspectives on Developing and Publishing Clinical Tests David S. Herzberg, PhD

2. A Career Path Less Travelled... PhD, Clinical Psychology, 1998 Post-Doc in NP, 1998-2000 Chief Operating Officer (VP R&D, 2009 – 2014) (Project Director, 2000-2008)

3. Topics Overview of Test Publishing Test Construction – Item Scaling – Norms Development

4. Test Publishers have a Trade Group! Certification/Licensure Education Industrial/Organizational Workforce Skills Credentialing Clinical

5. Clinical Publishers

6. Test Publishing Is A Process... Author: Acquiring IP through publishing contract Planning: Deliverables, budget, timeline R&D: Data collection, analysis, technical writing Editorial: Optimize the text content Design: Optimize the user interface Technology: Online administration, scoring Marketing: Present the work to an audience Launch: Publish test for clinical use

7. Topics Overview of Test Publishing Test Construction – Item Scaling – Norms Development

8. How Difficult Is A Test Item? WISC-IV Comprehension 9. Tell me some reasons that you should turn off lights when no one is using them. Sample A: Typically developing 4 th graders – 90% ≥ 1-point response Sample B: 2 nd graders with moderate ADHD – 30% ≥ 1-point response

9. Rasch Measurement Principles Also called IRT, single-parameter models Assumes unidimensionality of measurement Single numerical measure for both item difficulty and person ability – Logit scale: mean = 0, SD = 1 – Can be transformed “Sample-free” measurement

10. Rasch Probability Function

11. Item Characteristic Curve

12. Item Information Function

13. SIPT Space Visualization Item Map

14. Topics Overview of Test Publishing Test Construction – Item Scaling – Norms Development

15. Normative Reference Samples

16. Normal Curve and Standard Scores

17. Are these norms?

18. Normally Distributed Test Scores

19. Skewed Distribution Within Narrow Age Band

20. Skewed Distributions Within Age Bands Lead To Nonsensical Standard Scores Age YearRaw Score MeanSD 6458 7474 8499 9517 Example: Raw Score = 40 Age 7 years, 11 mo, 29 days: SS = 74 Age 8 years, 0 mo, 1 day: SS = 87 ????

21. Using Excel To Smooth Means, SDs

22. Inferential Norming

23. Questions or Comments? dherzberg@wpspublish.com www.wpspublish.com