1. Copyright 2005 AMP Update from AMP – New Broker Candidate Testing Method Presented to the GREC 2005 Annual School Meeting December 2, 2005 Lawrence J. Fabrey, PhD Vice President, Measurement Research Applied Measurement Professionals, Inc.

2. Copyright 2005 AMP Overview of Presentation Some (brief) principles of assessment Results of recent Job Analysis New Examination Specifications Purpose and structure of simulations Time frame for implementation Experience a sample simulation (or two or three)

3. Copyright 2005 AMP Principles of Measurement  Links in the Chain of Evidence Used to Support the Validity of Examination Results: Job Analysis Test Specifications Item Writing Examination Development Standard Setting Test Administration Scoring

4. Copyright 2005 AMP Job Analysis Survey sent to a sample of 12,337 real estate professionals –Received responses from 776 brokers and 427 salespersons 166 real estate job tasks and 16 real estate major issues rated for significance –Task ratings used to develop multiple choice examination specifications –Issue ratings used to develop the simulation examination specifications

5. Copyright 2005 AMP New MC Exam Specs – overview

6. Copyright 2005 AMP Detailed Outline –www.goAMP.com

7. Copyright 2005 AMP

9. Free Demo Test

10. Copyright 2005 AMP Free Sample CBT items: www.lxr.com www.lxr.com www.lxr.com click on “take a demo web test now” www.lxr.com

11. Copyright 2005 AMP

12. Simulations: Simulations: Purpose of Simulations To provide accurate assessment of higher order thinking related to a content area of interest That is, testing more than just recall Addressing important issues facing brokers (based on JA results)

13. Copyright 2005 AMP Structure of Simulations Opening Scenario Information Gathering (IG) Sections Decision Making (DM) Sections –Single or multiple DM All choices are weighted (+3 to –3) Passing scores relate to judgment of ‘minimal competence’

14. Copyright 2005 AMP Simulation Specifications

15. Copyright 2005 AMP Simulation Development

16. Copyright 2005 AMP We’ll Have Time to Complete a Simulation or Two Samples available now through the GA REP page on www.goAMP.com First, a “simulated” login, and then, we’ll want your answers

17. Copyright 2005 AMP

20. In case we would need help

21. Copyright 2005 AMP

22. Upon Completion of a Sim

23. Copyright 2005 AMP Several score reports

24. Copyright 2005 AMP

27. Time line for Implementation Pilot testing has begun –Please continue to encourage students to participate Live testing begins March 1, 2006 Delayed score reporting likely More information after the first of the year

28. Copyright 2005 AMP Let’s take a simulation problem (or two or three)

29. Copyright 2005 AMP Georgia Real Estate Examination Program Contact Information Lawrence J. Fabrey, PhD, VP, Measurement Research LFabrey@goAMP.comLFabrey@goAMP.com (913.495.4406) Applied Measurement Professionals, Inc. 8310 Nieman Road, Lenexa KS 66214