AMP Real Estate Broker Simulation Examination Derivation of Test Specifications Jeffrey A. Kelley, PhD Applied Measurement Professionals Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Simulation Overview Simulations help assess skills based on realistic real estate issues The intent is to test job-related aspects of real estate that cannot be tested with multiple-choice items

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Simulation Overview Problems follow a transaction from start to finish (path) Scenario Information gathering Decision making DM IG DM & Close IG DM Scenari o

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Simulation Scoring Facilitative options may receive scores of +3, +2, or +1 Uninformative, wasteful, or unnecessarily invasive or inappropriate options may receive scores of –1, –2, or –3

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona The Simulation Experience…

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Job Analysis Survey Sent to a sample of 12,337 real estate professionals –Received responses from 776 brokers and 427 salespersons 166 real estate job tasks and 16 real estate major issues rated for significance –Task ratings used to develop multiple choice examinations –Issue ratings used to develop the simulation examination specifications

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona How significant are the following issues to your real estate practice? (use the following scale) 0 = Not performed 1 = Not significant 2 = Somewhat significant 3 = Quite significant 4 = Extremely significant ValuationTrust Accounts Training/Supervision of LicenseesRisk Management Property RepresentationsProperty Management NegotiationMarketing of Services FinanceFederal Laws/ Environmental Issues EthicsDocument Preparation Disclosures (including stigmatized property) Asset Management (commercial brokerage) Agency/Non-Agency RelationshipsAdvertising

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Inclusion Criteria Issues with a mean significance rating below 2.15 were removed from consideration –asset management –property management

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Primary v. Secondary Issues Each problem is classified by one primary issue Each section within the problem is classified by a secondary issue, which may or may not be the same as the primary

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona National Broker Simulation Test Specifications – Effective 2006 Eight Scored Simulation Problems (+ 2 pretest problems) One issue is designated as the primary issue for the problem; one property type is also designated. Problems will address several issues, up to one issue for each section in the problem. Within the eight problems all 15 issues must be addressed at least once. Ethics must be addressed in at least four problems. The five bolded issues must be the primary issue for at least one problem per examination. The distribution by property types is as follows: Residential (3), Commercial (2), Property management (1), unspecified (2). Ethics Negotiation Document Preparation Fair Housing Environmental Issues Representation of Services Valuation Advertising Finance Agency/Non Agency Relationships Disclosures (including stigmatized property) Property Representations Trust Accounts Training/Supervision of Licensees Risk Management

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Modifications Federal Laws/Environmental Issues split into separate issues –Federal Laws renamed as Fair Housing The Advisory Board felt that Fair Housing was the pertinent legal issue and wanted to limit the scope Environmental Issues were felt to be clearly distinct from Fair Housing, and warranted a separate issue –Marketing of Services renamed as Representation of Services

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Designation of Required Primary Issues The consensus opinion of the advisory board was that most license law violations were related to these five issues

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Property Types Dimension The Advisory Board wanted to ensure representation for all property types that licensees are allowed to deal in

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Next Steps Pilot testing beginning in October Implementation in Spring 2006

Presented at the 2005 CLEAR Annual Conference September Phoenix, Arizona Speaker Contact Information Jeff Kelley Applied Measurement Professionals 8310 Nieman Rd, Lenexa, KS Phone (913) Fax (913)