From Good to Great -- Administering a Successful LSAT Administration Presented by: The Law School Admission Council Terri Neuman Frances Mercedes Dawn Troutman Anne McKernan 8/8/09

1 What do we mean by a successful administration? Accountability and security of test materials. Satisfactory testing environment. Detailed documentation. Overall goal: Valid scores

2 Stealing of Test Materials Staff Impersonation TimingCollusionCheating Testing Environment Factors that affect score validity Pre- Knowledge

3 Stealing of Test Materials Staff Impersonation Timing Collusion Cheating Testing Environment Factors that affect score validity Pre- Knowledge

4 Stealing of Test Materials Staff Impersonation Timing Collusion Cheating Testing Environment Factors that affect score validity Pre- Knowledge

5 Spacing and Seating Checking ID Prohibited Items Test Book Security Addressing Security Concerns

6 Spacing between test takers There must be: Room for proctors to walk in front of and behind all test takers. At least 5 feet (side- to-side) from one test taker to the next. Spacing and Seating Checking ID Prohibited Items Test Book Security

LSAT Spacing Requirements 42" 30" Head Table 30" 5 ft. 42"

8 Some Notes on Random Seating… 1.Test takers should be seated in no discernible pattern Definitely not alphabetical 2.Create seating charts in advance if possible.

9 Addressing Security Concerns We accept only government-issued ID that is current (not expired) and contains a photo and signature. Acceptable forms include passport books and driver’s licenses. Spacing and Seating Checking ID Prohibited Items Test Book Security

10 Addressing Security Concerns We do not accept government-issued employment ID’s or passport cards. Exceptions are made for some international students on a case-by- case basis Spacing and Seating Checking ID Prohibited Items Test Book Security First & last name on admission ticket must match ID EXACTLY.

11 Addressing Security Concerns We distinguish between electronic and non-electronic items. Spacing and Seating Checking ID Prohibited Items Test Book Security

12 Addressing Security Concerns After “Check-In,” test takers who are seen with electronic items are immediately dismissed and reported. Spacing and Seating Checking ID Prohibited Items Test Book Security

13 Addressing Security Concerns After “Check-In,” non-electronic prohibited items are confiscated and reported. Spacing and Seating Checking ID Prohibited Items Test Book Security

14 If you see it…

15 Act on it. Warning Notice Steps to take every time: Verbal notification to test taker. Written citation to test taker. Detailed SMIR form to LSAC. For more details see our manual, pages 31-32

16 Addressing Security Concerns 1. Prior to test day: Keep test materials secure. 2. On test day: Never leave materials unguarded. 3. Follow published procedures. Spacing and Seating Checking ID Prohibited Items Test Book Security

17 Receive shipment of test materials from LSAC Count materials Repack and store materials securely Check on stored material from time to time Distribute to Room Supervisors on test day Ensuring Test Material Security Step #1 Fax or acknowledgment form Reminder: Retain the cardboard carton!

18 Distribute to Room Supervisors on test day Count materials Room Supervisor counts materials Proctors distribute to test takers Ensuring Test Material Security Step #2 Record serial numbers on SRF Record serial numbers on RSRF

19 Proctors distribute to test takers Collect materials at break Ensuring Test Material Security Step #3 Serpentine style only Directly place each packet on each desk Record used/ unused numbers on RSRF In serial number order

20 “Serpentine” Book Distribution Back of the Room Front of the Room

21 Re-distribute after the break Check every ID Collect materials before the writing sample Ensuring Test Material Security Step #4 Redistribute in the same order as collected. Serpentine style only Directly place each packet on each desk

22 Collect materials before the writing sample Collect answer sheets Steps to take during and after the writing sample Ensuring Test Material Security Step #5 Collect test booklets Confirm receipt of all answer sheets and test booklets Distribute writing sample topic sheets

23 Prepare materials for return to LSAC Ensuring Test Material Security Step #6 After the writing sample, collect response sheets Collect topic sheets During the writing sample Confirm receipt of all response sheets and topic sheets Re-verify receipt of all answer sheets and test booklets After the writing sample Allow test takers to leave

24 Prepare appropriate materials for return to LSAC within 48 hours Deliver to UPS Ensuring Test Material Security Step #7 Print identifying info on white envelopes For further details, see p. 42 of the Supervisor’s Manual Check off appropriate boxes on white envelopes Place white envelopes into UPS “Next Day Air Packs” Pack requested materials into white Tyvek envelopes Place “ExpressPak” labels on the UPS envelopes

25 Prepare remaining materials for return to LSAC within 72 hrs. Deliver to UPS Ensuring Test Material Security Step #8 Secure plastic container with fasteners (provided) For further details, see p. 43 of the Supervisor’s Manual Affix UPS “Ground Service” label on carton Pack remaining materials into plastic container Seal carton with two kinds of tape (provided) Place plastic container into cardboard carton

26 Stealing of Test Materials Staff Impersonation Timing Collusion Cheating Testing Environment Factors that affect score validity Pre- Knowledge

27 Stealing of Test Materials Staff Impersonation Timing Collusion Cheating Testing Environment Factors that affect score validity Pre- Knowledge

28 Factors that affect the Testing Environment Timing Lighting Temperature Noise –traffic, construction, other campus events Writing Surface Restroom accessibility

29 Tips from our Supervisors: Identifying Staff 1.Recruit from academic institutions. Your own and nearby schools. Faculty, staff, and graduate students. 2.Consider other mature, responsible individuals. 3.Key qualities and skills include: Respect for the testing process. Reliability and trustworthiness. Ability to follow directions and work quietly.

30 Tips from our Supervisors: Retaining Staff 1.Stay in touch with staff between tests. Create an list so you can easily send reminders or tips every 6-8 weeks. 2.Evaluate performance after each test. The group as a whole and each staff person. 3.Focus on professional development. Mentoring or “teaming up.” Encourage proctors to develop “Room Supervisor” skills.

31 Tips from our Supervisors: Retaining Staff 4.Provide training. LSAC launched its training program in November, Present setting is an interactive workshop format that provides a forum for:  Explanation of our procedures.  Exchange of ideas.  Resolution of center-specific concerns. Future plans include online tools.

32 Wrap-Up: In today’s presentation we shared some high- level information about: Factors that affect score validity. How LSAC is addressing test security issues. Some of our procedures for handling test materials and administering our test. Advice from our Supervisors about identifying and retaining staff. Our new training program.

33 Q & A