1. Florida Computer-Based Assessment Infrastructure Trial Training November 23, 2010 1

2. FLDOE’s CBT Certification Process Web-based FCAT/EOC Certification Tool Survey to collect information regarding available technology resources and testing plans from schools. Action Plan from Deficient Schools Only to devise a plan to address deficiencies. District-wide Infrastructure Trial to test hardware and network utilization and identify any issues that must be resolved. 2

3. Clarification of On-line Test Content Infrastructure Trial –Invalid sample of test-like material ePat Practice Tests –FCAT Grade 10/Mathematics Retake and Reading Retake –Algebra I End of Course (EOC) –Biology I EOC –Geometry EOC Full Test Content 3

4. Infrastructure Trial vs. ePat Practice Tests Please remember that the content in the Infrastructure Test is NOT appropriate for student practice. 4 Infrastructure Trial Test Practice Tests (ePats) Designed to test school and district infrastructure and requires a specific number of large items Designed specifically to introduce students to the testing platform, the e ‐ tools, and the types of questions that will be on the computer ‐ based assessment Available only through school setup and administration in the Training Center Available to all students from PearsonAccess Will place an equivalent load on district network infrastructure similar to that of actual computer ‐ based testing Runs as “stand alone” software – does not place any data traffic load on district network or internet bandwidth

5. Infrastructure Trial vs. ePat Practice Tests (contd.) Please remember that the content in the Infrastructure Test is NOT appropriate for student practice. 5 Infrastructure Trial TestPractice Tests (ePats) Demonstrates full security of testing platform Does not demonstrate security of testing platform, which makes it more accessible for students to use at home Single trial test developed to be used with all of Florida’s computer ‐ based assessments A new practice test is developed for each content area - FCAT Mathematics Grade 10/Retake and FCAT Reading Retake - Algebra 1, Biology 1, and Geometry EOC

6. Infrastructure Trial: Schedule of Activities Dates School Assessment Coordinator/ Technology Coordinator November 15 -19 Download and read the Infrastructure Readiness Guide. Create your passwords for each Pearson site. November 15 - 30 Create the same testing environment that will be used for Spring testing (e.g., testing rooms, number of computers, appropriate switches and hubs, power supplies). Download and install Proctor Caching Software and TestNav 6.9 software. November 19 and 23 Attend mandatory Infrastructure Trial training. November 24 - 30 Prepare test sessions in the PearsonAcess Training Center and print Student Authorization Tickets. Complete TestNav System Check provided by Pearson to determine network user capacity and bandwidth requirements. Run Proctor Caching and cache content for Trial. December 1 Simulate the appropriate number of student logins based on the total number of computers intended to use concurrently for testing in the spring. Start test session, monitor progress, and stop test session. December 2 - 8 Collect feedback from volunteers and submit summary to district. Complete one comment form online per school. 6

7. School Assessment CoordinatorSchool Technology Coordinator Summary of Responsibilities Create sample studentsSelect proctor cache computer(s) and download and install proctor caching software Create sample test sessionDownload and install TestNav 6.9 on all student workstations and configure TestNav 6.9 to use proctor caching Print Student Authorization TicketsComplete System Check for TestNav 6.9 Cache test contentStart proctor cache software and configure browser setting for pre- caching content Coordinate the Infrastructure Trial –Start test session –Use appropriate script –Monitor session –Stop session Assist with technical issues during the Trial Collect feedback from volunteers and complete school comment form at http://tinyurl.com/infrastructuretrial http://tinyurl.com/infrastructuretrial Purge test content from proctor caching computer after successful completion of trial 7

8. PearsonAccess “Operational” and PearsonAccess Training Center PearsonAccess (www.PearsonAccess.com/fl )www.PearsonAccess.com/fl “Operational” Blue Header –A website used for almost all test preparation (e.g., preID, test setup, administration, and reporting tasks. –The correct administration must be selected every time you log in. Training Center Brown Header –Access the Training Center Tab on the PearsonAccess home page –Provides an opportunity to practice PearsonAccess tasks and means of managing the Infrastructure Trial Note: User accounts are required for school assessment coordinators and technology coordinators to access both sites. 8

9. SCHOOL ASSESSMENT COORDINATOR RESPONSIBILITIES 9

10. Sample students must be created within the Training Center in order to administer the Infrastructure Trial. –Not actual students in your school The number of sample students to be created should be based on the maximum number of computers that will be used concurrently during testing. –Creating at least ten percent more students that you plan to test concurrently to have extra student authorization tickets in the event of any login complications. Each ticket is valid for one login attempt, unless the student is resumed in PearsonAccess. –Instructions for resuming students are provided on pages 53-56 of the Infrastructure Guide. 10 Before Trial: Creating Sample Students

11. 1. Log in to the Training Center. 2. Go to the home page and click Create Students. 3. You will then be prompted to select your organization from a list. Select your organization and then click Next. 11 Before Trial: Sample Students

12. 4. Next, you must –designate a CLASS NAME (create a new class) and USE ALL CAPS –test name (Florida Infrastructure Trial), and –the number of sample students you would like to create. Up to 99 sample students can be created at a time. 5. Click Create Students 12 Before Trial: Sample Students (contd.)

13. 6. A prompt will then appear to continue with creating students. Select Yes – Create Students to continue, or No – Cancel Create to cancel. 7. A confirmation screen will appear once the sample students have been created. 8. Repeat the steps above until you have created sample students for the number of computers that will be tested concurrently, plus at least 10% additional students. 13 Before Trial: Sample Students (contd.)

14. 1. Go to the Test Management tab in the Training Center and click on Manage Test Sessions. 2. Click on New Session. 3. Enter the Session Name, School, Test to be Administered (“Infrastructure Trial”), Read Aloud (“No”), Default Form Group Type (“Main”), Scheduled Start Date, Scheduled Start Time, and Location/Room. 14 Before Trial: Sample Test Session Entering a date and time for a session is for planning only. A session has to manually be started on the Session Details screen.

15. 4. Click View By: Classes to see a list of classes. Click the box next to the name of the class to be added. (View By: Students can also be used and individual students can be selected.) 5. Click Save to create the session. A confirmation page will be displayed once the session has been created. 15 Before Trial: Sample Test Session (contd.)

16. 16 Before Trial: Printing Student Authorization Tickets Authorization tickets include a Login ID and test code for each individual sample student. This information is necessary in order to log in to the Infrastructure Trial. 1. Go to the Session Details screen for that test session. 2. To print authorization tickets, click on Authorizations > Student Authorizations and then select the format in which you would like to download them. The authorization tickets can be downloaded in three different formats: Detail View, Grid View, and List View. –a. Detail View only shows one authorization ticket per page. –b. Grid View shows six authorization tickets per page in a three row/two column layout. –c. List View displays three authorization tickets per page separated horizontally. Note: It is strongly recommended that you select one format and use it consistently at your school.

17. 17 Before Trial: Printing Student Authorization Tickets (contd.) 3. Once you have selected the file you want, open it and print the authorization tickets. Note: For the Spring 2011 administration, Student Authorization Tickets are secure documents and must be stored in a locked limited access location.

18. Before Trial: Configuring Browser Setting for Pre-Caching Content (Technology Coordinator) Once the Infrastructure Trial session has been created, content can now be cached. Notify your technology coordinator to Configure the Browser Setting for Pre-Caching Content (see instructions in Infrastructure Guide pages 43-47) Important Note: The proctor caching software must be enabled and running. The test content cannot be cached from the Proctor Caching computer; instead use any other computer on the same network as the caching computer. 18

19. 19 Before Trial: Configuring Browser Setting for Pre-Caching Content (contd.) Once this is done, a window will open with the status of the proctor cache. Minimize this window while Proctor Caching is running but do not close the window. The Infrastructure Trial is now ready to be cached.

20. 20 Before Trial: Caching Test Content After the technology coordinator has configured the browser setting for pre-caching content then the Infrastructure Trial test is now ready to be pre-cached. Log in to the Training Center and navigate to Test Management > Manage Test Sessions. Select a session to cache and click Proctor Caching in the top yellow bar.

21. 21 Before Trial: Caching Test Content (contd.) After all test items have been retrieved, the status page will present a confirmation message. Once the test has been 100% cached, the Infrastructure Trial can now be started. Note: The main reason a test may not be cached properly is if Pearson’s sites have not been allowed through a district’s or school’s content filter or firewall (see your Technology coordinator if you have a problem).

22. Before Trial: Starting a Test Session The session must be started before sample students are able to log in to the Infrastructure Trial. 1. Go to the Session Details screen for the test session. 2. Click Start in the top left corner of the Session Details screen. 3. A confirmation screen will appear. Select Yes – Start Session to start the session or No – –Cancel if you don’t want to start the session yet. 4. A confirmation page will be displayed once the session has been started successfully. 22

23. Conducting the Infrastructure Trial Schools conduct the Trial using the maximum number of computers that will be tested concurrently during the spring administration. Volunteers log in to complete the Trial test. –Students or adult volunteers can be used - not necessary that computer-based testing students are used. –Trial is NOT appropriate for student practice. –One volunteer can run multiple computers because volunteers supply a random answer every 10 seconds. –Volunteers will log issues on Student Authorization Tickets. Use the script provided in the Infrastructure Readiness Guide. Estimated time for Trial is approximately 30 minutes. 23

24. Launching TestNav 6.9 TestNav 6.9 is launched by double-clicking the TestNav 6.9 icon on the desktop. Enter the URL for the Infrastructure Trial in the Address line. This URL can be found on the student authorization tickets. Click Go and TestNav will present a login page. 24

25. Logging in to the Infrastructure Trial Enter the Login ID and Test Code and click Login. TestNav will load the test items and the welcome screen will appear. 25

26. During the Trial: Monitoring Test Session Once a session has been started, there are a number of actions that may need to be carried out in order to complete the Infrastructure Trial. These actions may include: –resuming sample students, –resuming sample students with saved responses, and –marking tests in completed status. 26

27. During the Trial: Monitoring Test Session (contd.) 27 StatusDescription ReadyThe student has not logged into the session yet, but is ready to be logged in. ActiveThe student is currently in the session. ExitedThe student has exited the session, but has not submitted their responses yet. CompletedThe student has completed the test and has successfully submitted their responses. Marked Complete The student’s responses have been submitted manually. ResumedThe student is ready to log back into the session. Resumed- Upload The student is ready to log back into the session with saved responses.

28. Common Error Codes / Solutions 28 Error Code DescriptionSolution 20004The login information you have provided is incorrect. Please try again! Verify the student login information has been entered correctly and log in again. 20043The test you are attempting to access with this login information is already in progress. If you are attempting to restart this test, please notify your Test Monitor to authorize your login to resume the test. Make sure the student is either in Ready, Resumed, or Resumed-Upload status and log in again. 20007Your test session has not been started. Please notify your Test Monitor! Go to the session page and click Start in the top left corner. Students may now log in.

29. During the Trial: Resuming a Student 1. To resume a sample student, go to the session page and check the box next to the Student Name that needs to be resumed. Then click Resume Test. 29 Note:Test administrators in the room will do this for the full administration.

30. During the Trial: Resuming a Student (contd.) 2. After Resume is clicked, a confirmation page will display. Select Yes – Resume Tests to start the session or No – Cancel if you don’t want to resume the student yet. 3. Another confirmation page will be displayed once the student has been successfully resumed. 4. Go back to the session page and the student’s status will now show “Resumed” and the sample student will now be able to log back in to the session. 5. If a student logs back into the test, but none of their responses appear, the student will need to exit the test again. In order for the responses to be populated again, the student will need to be marked in “Resumed-Upload” status. –To mark the student in “Resumed- Upload” status, the student will need to be resumed twice. 30

31. Exiting the Infrastructure Trial Once all test items have been viewed and tools have been tested in the Infrastructure Trial, the test can be submitted. Submit the test by clicking Submit on the review page. Responses will now be submitted and the student status will show as “Completed” on the session page. 31

32. After the Trial: Stopping the Test Session Stopping a Session 1. Before a session can be stopped, students must be either in “Completed” or “Marked Complete” status. To stop the session, select Stop in the top left corner of the session page. –a. To mark a student’s test complete, the student must be in “Exited” status. –b. Go to the session page and check box beside the student to be marked complete. –c. Click Mark Test Complete. –d. A confirmation page will be displayed and the student’s status will now show “Marked Complete”. 2. After Stop is clicked, a confirmation page will display. Select Yes – Stop Session to stop the session or No – Cancel if you don’t want to stop the session. 3. Another confirmation page will be displayed once the session has been stopped successfully. 32

33. After the Trial: Purging Test Content (Technology Coordinator) Purging Test Content (Windows) Notify your technology coordinator to purge test content To purge test content: –1. Go to Start > Programs > Proctor Caching > Purge Cache. –2. Click Delete to confirm that you would like to purge the contents of the cache. 33

34. After the Trial: Infrastructure Trial Survey To assist Pearson and the FLDOE to identify areas of need and to direct resources and support One representative (School Assessment Coordinator or Technology Coordinator) from each school: –Review all notes on Student Authorization Tickets to provide school-level response –Provide feedback to District Staff by December 3, 2010 –Complete a comment form online available at http://tinyurl.com/infrastructuretrial by December 8, 2010 http://tinyurl.com/infrastructuretrial 34

35. SCHOOL TECHNOLOGY COORDINATOR COMPUTER PREPARATIONS 35

36. Proctor Caching – Network Diagram

37. Proctor Caching – How does it help? Proctor Caching allows you to pre-cache test content to your local network before the test. Reduces burden on your ISP by eliminating redundancy in requests for test content. Stores an encrypted local copy of all pre-cached tests. A caching solution is required for Florida online testing and will deliver the best online testing experience.

38. Test Delivery – Local Installation Download and install TestNav 6.9 on each workstation used for Test Delivery. Configure each machine to communicate with the Proctor Caching machine. More challenging to manage than a server installation. System automation tools like SMS (Windows) and Apple Remote Desktop (Mac) make local installs much more practical.

39. Wireless Networks Best Practices DO use a local installation of TestNav 6.9 –File Share installations will work fine, but a local install for wireless testing increases the odds of success. –Local installations reduce network traffic on access points to just test content and student responses. DO NOT overload access points with too many clients. –The bandwidth curve of online testing is different than normal internet usage. –Use common sense wireless networking principles and past wireless performance as a guide. –Reducing the client to access point ratio for online testing can avoid the access point bottleneck.

40. TestNav 6.9 Installation Best Practices The TestNav 6.9 proxysettings.properties file is the only configurable settings file. This file can be edited with Notepad or TextEdit. Editable variables in proxysettings.properties –Proxy_Host - Designates a proctor caching or proxy machine IP address –Proxy_Port - Designates a proctor caching or proxy machine port number –Primary_Save_Location & Alternate_Save_Location - Designates the Early Warning save locations Student machine logins will need full access to these directories –TestNav/temp –TestNav/Logs –Early Warning Save Locations

41. TestNav 6.9 Installation Best Practices (contd.) Local Installation - If you use hard drive imaging tools like Deep Freeze, you must exclude the TestNav/Logs and Early Warning System save locations. Network Installation –Do not run the TestNav installer on the file server itself. –Run the installer on a client workstation and install TestNav to a shared folder on a network drive. –Once installed to the network drive, ensure the proxysettings.properties file has valid file paths for the save locations.

42. TestNav 6.9 Installation Best Practices (contd.) Firewalls/Content Filters The following domains and ports must be allowed to pass through your Internet firewall or proxy system. Port 443 is for admin access only. Student level traffic is port 80. Hash encryption can inadvertently form a word.

43. TestNav 6.9 Installation Best Practices (contd.) Disable Popup Blocking Software (for PearsonAccess) A pop-up blocker will block the pre-caching screens from opening on administrative workstations. Enable Student Read/Write-Access Students must have read-access to the TestNav installation directory. Students must have read/write access to the TestNav/Logs and TestNav/Temp directory. Students must have read/write access to the Student Response File save locations whether they are located on the workstation or on a network share.

44. TestNav 6.9 Installation Best Practices (contd.) Applications that launch automatically Any applications that may automatically launch on a computer should be configured not to launch during testing sessions. Common applications that may launch automatically include: –Anti-virus software performing automatic updates, –Power management software on laptops warning of low batteries, –Screen savers, and –Email with Auto message notification. Screen resolution All tests are authored to a screen resolution of 1024 x 768 so make sure that your testing machines are capable of 1024 x 768 resolution. Screen Resolutions below this setting will cause an error as TestNav tries to load the test. Screen Resolutions above this setting will cause the test to appear smaller than the available screen size.

45. System Check for TestNav 6.9 The following steps will guide you through the process of using System Check for TestNav 6. –The System Check tool can be found by going to www.pearsonaccess.com/fl and clicking on Support > Additional Resources. The specific URL is www.FLassessments.com/SystemCheck www.pearsonaccess.com/flwww.FLassessments.com/SystemCheck –Click the TestNav 6 tab and follow the instructions provided. –Once you see the “Congratulations” screen in the TestNav window, click the Network User Capacity tab.

46. System Check for TestNav 6.9 (contd.) Click Add Caching Server. Enter a generic name for the Proctor Caching computer to be tested, the IP address of the Proctor Caching computer, and port 4480. Click Save.

47. System Check for TestNav 6.9 (contd.) Select the appropriate Test Administration from the drop-down box. Click Start and System Check will perform a bandwidth test. Once the test has been run, System Check will show an estimate for how many students can be tested on the specified Proctor Caching computer.

48. System Check for TestNav 6.9 (contd.) Click the Testing Volume Calculator tab. This tool will be used to estimate how many users can be tested with the bandwidth that is available.

49. System Check for TestNav 6.9 (contd.) Select the correct test administration Enter the number of students that will be testing concurrently on a single caching server. Slide the green bar under “Available link speed between workstations and Proctor Caching workstations” to specify the available bandwidth between the testing workstations and the Proctor Caching computer.

50. System Check for TestNav 6.9 (contd.) Now slide the green bar under “Average network utilization for the network between workstations and Proctor Caching workstations” to indicate the percentage of bandwidth normally used at this site (excluding the bandwidth congestion for testing). Once this is done, the “Outputs” box will now either be white, yellow, or red.

51. System Check for TestNav 6.9 (contd.) In order for the Infrastructure Trial to be successful, it is highly recommended that the Outputs box display a white background. If anything other than a white background is displayed, odds are that you will encounter difficulties during testing. Once all the tools within System Check for TestNav 6.9 have been used, you have successfully established a plan for your testing environment.

52. TestNav Early Warning System The TestNav™ Early Warning System (EWS) is designed to save student responses locally in the event of a network interruption. EWS saves the student's responses to an encrypted backup file so the student can either continue testing or exit the system without losing data. –Designate two (2) file save locations for student responses in the event of a connectivity loss to the testing servers. Best Practice: Primary response location should be a shared location because it allows access to stored student responses from one location. The alternate response location should be a location on the local workstation. –Students must have full access to the designated “save locations.” –When connectivity is restored and the students are resumed to continue testing, the locally saved responses are transmitted to the testing server and added to the responses already stored there. This activity occurs in the background of the test delivery software while the software continues to provide test questions to the student.

53. Common Technical Errors/Solutions Proctor Caching Configuration error – Looping Not pointed to a proxy server to reach the internet Pre-caching Not changing browser settings before pre-caching Java JRE not installed TestNav 6.9 Windows Firewall – Allow javaw.exe in the TestNav 6.9 folder Network Local Congestion Errors Test loads slowly Percentage indicator increments slowly

54. Support Calls Pearson Access Are you using PC or Mac? What is your user role? What screen are you on? What task were you trying to complete? What was the error message? If there was no error message, what were you trying to complete? Test Nav 6.9 Are you using a PC or a Mac? What task were you trying to complete? What is the session name? Did an error code or message appear? Can you provide a log file? What is the IP address of the proctor caching computer? Do you use a proxy server, if so, what is the IP address? Have the TestNav 6.9 URLs been allowed through your Firewall/Content filter? 54 Information needed to diagnose technical issues Proctor Caching Are you using a PC or Mac? Were you setting up Proctor Caching on a workstation or a server?: Have you installed the Proctor Caching software? Did you start the Proctor Caching software prior to attempting to Proctor Cache? Have the TestNav 6.9 URLs been allowed through your Firewall/Content filter?

55. Pearson Support Technical Assistance During Trial 877-847-3043 or florida@support.pearson.com 55

56. Support Information Support resources for the Infrastructure Trial can be located on the PearsonAccess Florida page under Support > Additional Resources. These resources include downloads for: –Infrastructure Readiness Guide (required) –TestNav 6.9 Technology Guidelines (optional) –Early Warning System Reference Manual (optional) –Proctor Caching User Guide (optional) 56

57. Infrastructure Trial Training Links Materials from today’s training are available online at: http://oada.dadeschools.net/TestChairInf o/InfoForTestChair.asp http://oada.dadeschools.net/TestChairInf o/InfoForTestChair.asp Pearson’s training materials are available online at: www.FLAssessments.com/RegionalTrain ings www.FLAssessments.com/RegionalTrain ings 57

58. District Contact Information Student Assessment and Educational Testing Maria C. Bruguera, Director I Email: mbruguera@dadeschools.net ormbruguera@dadeschools.net Mara Ugando, Staff Specialist Email: mugando@dadeschools.netmugando@dadeschools.net 305-995-7520 Infrastructure and System Support Mr. Roly Avila, Supervisor Email: Ravila@dadeschools.netRavila@dadeschools.net 305-995-3334 58