1

A Complete Solution for Evaluators 2 Framework for Teaching Observer Training Increase the reliability and accuracy of observers Deepen observer knowledge of the components and performance levels in the Framework for Teaching Promote bias awareness Framework for Teaching Scoring Practice Provide observers with opportunities to practice before live observations Deliver feedback to observers including answer key and evidence rationale Framework for Teaching Proficiency Assessment Train observers to deliver valid, reliable judgments based on teaching evidence Increase defensibility of the district’s evaluation system

FOCUS: Home Page 3 TraingTraing

4 Evaluator Training: Overview ~20 hours of video and training content provided o Self paced - total training time may vary 11 online learning modules for observers o Orientation to observer training o Minimizing bias o 9 modules on Framework for Teaching o Overview o Framework for Teaching Components in Domain 2 and Domain 3 detailed rater training on each component and performance level Over 100+ master scored videos

Best Practices for Evaluators to Pass Assessment 5 1.Conduct a system check every time you use the FFTPS Contact IT department if you fail system check Wired internet connection better than wireless 2.Spend enough time training hours of training Train even if you have previous FFT knowledge  The training content supports latest version of FFT and is aligned with the assessment  Training and practicing also gets you familiar with the software used during the assessment.  Many users who considered themselves FFT experts took the assessment without training failed on their first attempt. 3.Practice scoring early and often Recommend 2+ hours of practice (e.g., score the entire set of practice videos 2-3 times) 4.Allocate enough time to take the tests Each test will take ~3-4 hours. Make sure your schedule is clear and avoid interruptions 5.Study hard but be confident! Thousands have passed.

Evaluator Training: Home Page 6

Evaluator Training: Overview Page 7

Evaluator Training: Master Scored Videos 8

Evaluator Training: Exercise Example 9

Scoring Practice: Description 10 Provides opportunities for evaluators to practice: Identifying and recording instructional evidence Aligning the evidence to a specific component of the Framework for Teaching Scoring classroom practice based on the evidence Receiving feedback on the score versus expert-assigned rubric and rationale

Scoring Practice: Evidence and Scoring 11

Scoring Practice: Feedback Page 12

Proficiency Assessment: Overview Two stages. Recommend time to take each stage ~3-3.5 hrs  Stage 1: multiple choice and videos. Stage 2: videos (selected based on user’s grade span)  Passing score based on total score of both stages: Stage 1+ Stage 2  Each stage takes ~3-3.5 hours (user has up to 6 hours to take a stage).  If a user passes each stage on their first attempt, the total testing time will take 6-7 hours  Users should only takes one test attempt per day so test usually takes at least 2 days to complete 2 chances to pass each stage of assessment (see next page for visual examples)  Must pass Stage 1 before moving to Stage 2  If the user passes both Stage 1 and Stage 2 they are considered “proficient”  If user fails a stage twice, they are deemed not proficient and are eligible for “retest” If a user fails an assessment, they must wait a period of time before their next attempt  Fail one attempt: 24 hour lockout period before next attempt at stage  Fail on second attempt: 21 day lockout period before next attempt  Fail overall assessment (i.e., fail a stage twice): lockout period TBD (several weeks) before “retest” “Retest’ follows the same exact process as the “initial test”  Two stages  User starts at Stage 1  Two attempts to pass each stage  If the user is not proficient (fails a stage twice) after retest, there are no additional testing rounds

Pass/Fail Paths – Initial Testing Round Stage 1Stage 2 Pass Outcome for initial test Pass1 st attempt Fail1 st attempt Pass 2 nd attempt 1 st attempt Fail 1 st attempt Pass Fail Pass 2 nd attempt 1 st attempt Pass2 nd attempt PassFail Pass 1 st attempt Pass2 nd attempt Fail1 st attempt FailFail (can “retest”)2 nd attempt Fail1 st attempt PassFail2 nd attempt1 st attempt Fail2 nd attempt Fail (can “retest”) PassFail1 st attempt Fail2 nd attempt Fail (can “retest”)

Overview of System Requirements 16 Network access Local district IT administrator will need to update network settings to allow users to access Teachscape related websites from their school computers and school network Internet connectivity At least 1-2 Mbps download speed Highly recommend using a wired connection while taking the proficiency assessment to ensure a consistent connection Users need to avoid peak network usage times at school when average bandwidth may drop below minimum requirements Hardware and software Can use PCs or Macs that meet minimum requirements for hardware, software, and monitor resolution Users can not use tablet devices (e.g., iPad) with FOCUS Documents with details List of Teachscape Domain Names & IP Addresses.pdf Teachscape-system-requirements.pdf FOCUS user start-up guide.pdf FOCUS training, practice, and proficiency assessment rely heavily on videos. Users systems must be optimized to view videos.

System Check Tool: The user’s and IT staff’s best friend 17 Where to access the “System Check” tool from Help page

System Check Tool: Screenshot 18 In seconds, automatically detects if user meets system requirements for o Hardware o Browser o Monitor o JavasScript, Cookies, Pop Ups Allows user to check if internet connection meets requirements (“speedtest.net”) Allows user to watch a video and listen to audio as a final system test

Additional Support Resources 19

Local Support 20  Co-op/school district cadre of facilitators for administrative support of content  Webinar for Co-op Tech Coordinators  Webinar for Local Tech Coordinators  Arkansas Teachscape Implementation Managers can be reached at:

Customer Support: Role of Local IT and Teachscape 21 Local district IT staff Enable users to access Teachscape related domains and sites Allow Teachscape to use support tool (e.g., Teamviewer) on users hardware if required to resolve a support issue Be the point of contact for users to address any issues identified by the system check tool Contact Teachscape if user continues to experience system problems after local hardware, software, or connectivity issues have been addressed – – Teachscape Be the point of contact for users when they experience problems while taking a proficiency assessment Work with local IT team to resolve issues that cannot be fixed at local level

GETTING STARTED IN TEACHSCAPE s were sent on January 7 with user names and temporary passwords. Grade spans were chosen when registering accounts (Has already been entered for you). Grade spans: K-5, K-8, 6-8, 9-12, and K-12 These grade spans determine the videos you will watch for practice scoring and the assessment. If you need to change grade span, contact Teachscape Tech Support. You will change your password upon first log-in. Make sure you read system requirements and run system check.

TIPS: Proficiency Test Set a goal for yourself. Using Mozilla Firefox helps with technical issues. Log out before you exit Teachscape. Work through training modules regardless of your familiarity with Danielson Framework. DO NOT SKIP!! View and score practice videos with colleagues using the 2011 edition of FFTPS/FOCUS. Review and discuss with colleagues the rationale behind the scoring. Proficiency Test has to be taken independently.

More Tips: Proficiency Test Take certification test outside school day due to bandwidth issues. Set aside an uninterrupted time period (3-4 hours) for each stage of the test. You can pause videos without penalty. Record evidence on paper or directly into Teachscape. If you record evidence on paper, put “see notes” in the evidence box and code that to all components.

And More Tips: Proficiency Test Remember you are not tested only on scoring the videos, but also on bias, interpretation, and applying the framework. After passing Stage 1, it is recommended to wait at least one day before beginning Stage 2. If you are unsuccessful, review your score report and determine a plan of action. During the training process, each co-op/district has facilitators available to assist you.

Even More Tips: Proficiency Test Using a larger monitor aids in seeing more of what is happening in each video Use of an Ethernet connection instead of wireless in highly recommended since Ethernet connections are generally more stable than wireless connections Use of a headset can help users filter out other sounds and distractions in their training and testing situation.

Teachscape Demo Site for FFTES Site can be accessed at User name: arkansas.demo Password: teach To access the FFTES, click on Framework for Teaching Effectiveness Series Teachers may access the site NOW! A QuickStart Guide has been developed to assist demo users in navigating the site.