Join Together Advisory Board Evaluation Team Report Donna Mertens Katrina Bledsoe Heidi Holmes Pauline Ginsburg ACE-DHH Conference Denver, Colorado February 2006 February 2006

Join Together Evaluation Team Obj 1.1 Tom and Karen and Heidi Holmes Obj 1.2/2.3 Shelly, Maribeth, Liz & Karen & Katrina Bledsoe Obj 2.1 Dave Nanci & Pauline Ginsburg Obj 1.4 Kate & Pamela; Obj 2.2 Susan & Brenda; Obj 1.3 Joyce & Sharon & Katrina Obj 2.4 John Sandy AND Donna Mertens

Yr 2 Evaluation Team John McLaughlin & Donna Mertens Assessment Survey Assessment Survey evaluation evaluation On-going TTL consultation On-going TTL consultation TTL Survey TTL Survey Year 2 report Year 2 report

Methods Methods Online survey Online survey Treasure Hunt (Heidi Holmes) Treasure Hunt (Heidi Holmes) And the results are… And the results are…

What is your primary status in terms of deaf education? (results from deafed.net survey)

How often do you visit

How often do you use the following features of

Most frequently used features Job search Job search Post/search for documents of interest Post/search for documents of interest Read Bulletin Board entries; respond to BB threads Read Bulletin Board entries; respond to BB threads Visit Help and FAQ areas Visit Help and FAQ areas Search calendar of events Search calendar of events Communication with team members Communication with team members

Rate the following features in terms of ease of use

Recommended Improvements Mostly very happy; items barely mentioned: accessing bulletin boards & findings what Im looking for Mostly very happy; items barely mentioned: accessing bulletin boards & findings what Im looking for Quality of documents Quality of documents Remember my password; login frustration; internal links broken Remember my password; login frustration; internal links broken Post choice entry; post documents Post choice entry; post documents Too much text; make it friendlier & more transparent – e.g., change documents to Resources and suggestions for teacher Too much text; make it friendlier & more transparent – e.g., change documents to Resources and suggestions for teacher

Best Experiences It is wonderful to have a one-stop point of reference to refer people to. I feel like it is the BEST place to go for anyone interested in deaf education. We've needed something like this for a long time. I'm proud of our collective work to bring the site to fruition and continue to refine it. It is wonderful to have a one-stop point of reference to refer people to. I feel like it is the BEST place to go for anyone interested in deaf education. We've needed something like this for a long time. I'm proud of our collective work to bring the site to fruition and continue to refine it. Finding other teachers of the deaf and making connections. It's a wonderful resource!! Finding other teachers of the deaf and making connections. It's a wonderful resource!! Working with Michelle Hoversten. She is always positive, very helpful and personable. Working with Michelle Hoversten. She is always positive, very helpful and personable.

Year 2 Report Reporting Form Changed by US Department of Education Reporting Form Changed by US Department of Education Survey of TTLs and Interviews with Project leaders Survey of TTLs and Interviews with Project leaders Review of Review of Project leaders and evaluator met for 2 days to construct the first draft of the report – followed by electronic communications Project leaders and evaluator met for 2 days to construct the first draft of the report – followed by electronic communications Report is now at Report is now at

1. Project Objective -Topical Team 1.1 Technology Infrastructure: Create an efficient collaborative network of consortium members (CM), institutes of higher education (IHE), State educational agencies (SEA) and local educational agencies (LEA) that results in empirical evidence regarding the impact of Web-based video conferencing (VC) to reform d/hh teacher preparation. 1.b. Performance Measure Measure Type Quantitative Data Increase number of JT members who use Web-based video conferencing technology (WBVCT). Project TargetActual Performance Data Raw Numb er Ratio% Raw Numbe r Ratio% 25 / 42 / 170% 1.c. Performance Measure Measure Type Quantitative Data Increase the number of technology and software alternatives evaluated for a Virtual Professional Development School (VPDS). Project TargetActual Performance Data Raw Numb er Ratio% Raw Numbe r Ratio% 2 / 7 / 350% 1.d. Performance Measure Measure TypeQuantitative Data Increase the amount of technical assistance provided to the JT community. Project TargetActual Performance Data Raw Numb er Ratio% Raw Numbe r Ratio% 500 / 1,120 / 224%

Year 2 report included Goals for Year 3 Each TTL has established goals that include dissemination and measurement of effects of grant related activities Each TTL has established goals that include dissemination and measurement of effects of grant related activities Priorities established: Priorities established: Engagement with deaf community strengthened Engagement with deaf community strengthened Video based products captioned Video based products captioned Research teams supported by evaluation team Research teams supported by evaluation team

Quarterly reports TTLs interviewed re: accomplishments, challenges, support needs, spin offs; Project leadership interviewed. TTLs interviewed re: accomplishments, challenges, support needs, spin offs; Project leadership interviewed. Document reviews: Executive Advisory Board and TTLs phone conference minutes; TTL postings to ; review of records re: cyber mentors and master teachers. Document reviews: Executive Advisory Board and TTLs phone conference minutes; TTL postings to ; review of records re: cyber mentors and master teachers. Evaluation team supporting research of project teams Evaluation team supporting research of project teams

Synergy Teams are working together Teams are working together Year 3 represents synergy of teams toward achievement of overall Join Together goals Year 3 represents synergy of teams toward achievement of overall Join Together goals Sustainability is a major issue Sustainability is a major issue Any chance for voice recognition software to provide real time captioning for video conferences? Any chance for voice recognition software to provide real time captioning for video conferences?