1. State Plan for FY 2009- 2011 and Program Review of Statewide AT Programs Jeremy Buzzell and Robert Groenendaal

2. PART 3

3. State-level and State Leadership Activities Information Provided in State Plan Review of Program Performance

4. 4 Statutory Requirements for State Plan The application must describe: The Lead Agency and Implementing Entity (if applicable) and how they collaborate with each other The Lead Agency and Implementing Entity (if applicable) and how they collaborate with each other Allocation of funds for State-level and State Leadership activities and how funds are tracked Allocation of funds for State-level and State Leadership activities and how funds are tracked Involvement of public and private entities, including resource commitments Involvement of public and private entities, including resource commitments State funding for the program State funding for the program How State-level and State Leadership activities will be implemented How State-level and State Leadership activities will be implemented

5. 5 State Plan: Identification of State-level Activities Conducted State Financing Activities Performed (select all that apply)  Financial loan program  Access to Telework loan fund  Cooperative buying program  Financing for home modifications program  Telecommunications distribution program  Last resort program  Other program Device Reutilization Activities Performed (select all that apply)  Device exchange  Device reassignment

6. 6 State Plan: Identification of State-level Activities Conducted Device Loan Activity  How many device loan programs do you support? [Number field] Device Demonstration Activity  How many device demonstration programs do you support? [Number field]

7. 7 State Plan: Information Required for Every State-level and State Leadership Activity Enter the year when the program began conducting this activity. [Number field] This is not asked for State Leadership Activities.

8. 8 State Plan: Information Required for Every State-level and State Leadership Activity Select the option that best describes from where this activity is conducted (choose only one). [Drop-down menu]  One central location  Regional sites  A combination of a central location and regional sites If you indicated the use of regional sites, from how many regional sites is the activity conducted? [Number field]

9. 9 State Plan: Information Required for Every State-level and State Leadership Activity This activity is available (choose all that apply): [Check boxes]  By website  By phone  By e-mail  By mail  In person

10. 10 State Plan: Information Required for Every State-level and State Leadership Activity Select the option that best describes the policy of the program for charging individuals with disabilities/professionals... [Drop-down menu]  Nothing  A flat fee  A fee on a variable or sliding scale  A fee is assigned based on the device  A financial donation is requested  A donation of time or other non-financial commitment is requested  An annual fee or similar regular payment arrangement  The fee is based on the length/complexity/value/type  The fee is based on the purpose  Multiple subcontractors are used and they set their own policies  Other

11. 11 State Plan: Information Required for Every State-level and State Leadership Activity Provide any additional information about this activity you wish to share. [Text box]

12. 12 Core Components of Program Review Elements of Program Management Fiscal Management Fiscal Management Personnel Management Personnel Management Contract Oversight Contract Oversight Consumer- responsiveness Consumer- responsiveness Elements of Program Performance Increasing access to, acquisition of, and knowledge about AT Statewideness and comprehensiveness Measurable goals

13. 13 Review of Program Performance The review of Program Performance assesses whether the Statewide AT Program is implementing its Statewide AT Program in accordance with its State Plan for AT, is reporting data that can be supported by the nature of its activities, and is achieving the results intended by the AT Act. This includes: extent to which grantee increases access to, acquisition of and knowledge about AT extent to which grantee increases access to, acquisition of and knowledge about AT extent to which grantee is statewide and comprehensive extent to which grantee is statewide and comprehensive extent to which grantee achieves measurable goals extent to which grantee achieves measurable goals

14. 14 Program Performance Device Loan and Device Demonstration = Increase Access State Financing and Reutilization = Increase Acquisition Training, Public Awareness, Information and Assistance = Increase Knowledge

15. 15 Comprehensive, Statewide Maintain comprehensive statewide programs of technology-related assistance to support programs that are designed to maximize the ability of individuals with disabilities across the human lifespan and across the wide array of disabilities, and their family members, guardians, advocates, and authorized representatives, to obtain assistive technology, and that are designed to increase access to assistive technology. Sec 4(a)

16. 16 Justification for Statewideness, Comprehensiveness, Access, Acquisition, etc. as the Core of Program Performance Standard is universal – not tied to which or how many activities a state does. Standard is universal – not tied to which or how many activities a state does. Reflects quality of program planning and implementation. Reflects quality of program planning and implementation. Can “assess the extent to which.” Can “assess the extent to which.” Better than looking at “maximizing the ability.” Better than looking at “maximizing the ability.” Congressional intent. Congressional intent. Requirement that RSA ensure programs will address the needs of all ages and reasons. Requirement that RSA ensure programs will address the needs of all ages and reasons.

17. 17 Comprehensive, Statewide Comprehensive statewide program means: a consumer responsive program of technology- related assistance for individuals with disabilities, implemented by a State, and equally available to all individuals with disabilities residing in the State, regardless of their type of disability, age, income level, or location of residence in the State, or the type of assistive technology device or assistive technology service required. Sec. 3

18. 18 Comprehensive, Statewide Section 7 of the AT Act of 1998, as amended: Section 7 of the AT Act of 1998, as amended: (a)(3)(B) In administering this Act, the Rehabilitation Services Administration shall ensure that programs funded under this Act will address the needs of individuals with disabilities of all ages, whether the individuals will use the assistive technology to obtain or maintain employment, to obtain education, or for other reasons. (a)(3)(B) In administering this Act, the Rehabilitation Services Administration shall ensure that programs funded under this Act will address the needs of individuals with disabilities of all ages, whether the individuals will use the assistive technology to obtain or maintain employment, to obtain education, or for other reasons.

19. 19 Program Performance: State-level and State Leadership Activities For every activity listed in state plan, RSA will : assess whether the activity increases access to, acquisition of and knowledge about AT assess whether the activity increases access to, acquisition of and knowledge about AT assess whether the activity is statewide and comprehensive assess whether the activity is statewide and comprehensive consider the relevancy and reasonableness of the data consider the relevancy and reasonableness of the data

20. 20 Program Performance Exceptions: Title III AFP Title III AFP Claiming comparability (though must submit documentation) Claiming comparability (though must submit documentation) Coordination and collaboration Coordination and collaboration Technical assistance Technical assistance Transition Transition

21. 21 Third-Party Reviewers Third-party reviewers participate in the review of Program Performance. 3 current or former state directors (or position with similar duties) 3 current or former state directors (or position with similar duties) At least 1 with prior review experience on each team At least 1 with prior review experience on each team Trained, paid volunteers from a standing pool Trained, paid volunteers from a standing pool No reviewers from RESNA or ATAP No reviewers from RESNA or ATAP Participation is not anonymous, but conclusions are. Participation is not anonymous, but conclusions are. Third-party reviewers learn about each activity through review of documents, looking at data, and discussion on webinars.

22. 22 Third-party Reviewers Activities of peer reviewers: Read documents Read documents Participate in webinars Participate in webinars Complete review forms (answer questions) Complete review forms (answer questions) Meet as a group with RSA to discuss results Meet as a group with RSA to discuss results Finalize review forms and submit to RSA Finalize review forms and submit to RSA

23. 23 How to prepare for a review of Program Performance Submit to RSA: Current inventory of devices in both loan and demonstration programs. Current inventory of devices in both loan and demonstration programs. Sample publications. Sample publications. Copies of policies and procedures for state financing, device demonstration, device loan, and device reutilization activities. Copies of policies and procedures for state financing, device demonstration, device loan, and device reutilization activities. Synopses of trainings and copies of sample training materials. Synopses of trainings and copies of sample training materials. Reviewers already will have State Plan and annual data. Reviewers already will have State Plan and annual data. There is no prescribed format for these but must be accessible.

24. 24 How to prepare for a review of Program Performance Develop webinar presentations for each activity that serve as a virtual on-site visit to your program. Develop webinar presentations for each activity that serve as a virtual on-site visit to your program. Length, format and content of presentation are up to the program. Length, format and content of presentation are up to the program. The “presenter” during each webinar is up to the program. Subcontractors are welcome. The “presenter” during each webinar is up to the program. Subcontractors are welcome. Need to be accessible. Need to be accessible.

25. 25 How to prepare for a review of Program Performance Based on documents, data, and discussion, third-party reviewers respond to a series of questions about each activity (separately if you have more than 1 type identified in State Plan): Yes/no with explanation. Yes/no with explanation. Evidence can come from any source of the review Evidence can come from any source of the review Getting a “yes” answer does not depend on a state having any particular structure or program type Getting a “yes” answer does not depend on a state having any particular structure or program type A “no” answer does not automatically mean a state is out of compliance A “no” answer does not automatically mean a state is out of compliance

26. 26 Questions about Program Performance In the questions, note the use of: In the questions, note the use of: “evidence” “evidence” “reasonable” “reasonable” “most” “most” “make it possible” “make it possible” “plan” “plan” “justification” “justification” “capacity” “capacity”

27. 27 Questions about Program Performance For all activities: Is there evidence that the grantee’s level of effort or funding for this activity justifies its inclusion in the grantee’s State Plan? Is there evidence that the grantee’s level of effort or funding for this activity justifies its inclusion in the grantee’s State Plan? (If the grantee claims comparability) Is there evidence of existing comparable support for this activity provided from state or other non-federal resources or entities? (If the grantee claims comparability) Is there evidence of existing comparable support for this activity provided from state or other non-federal resources or entities? Is there evidence that this activity is carried out primarily to meet the intent of the AT Act? Is there evidence that this activity is carried out primarily to meet the intent of the AT Act?

28. State Financing Information Provided in State Plan Program Review Questions

29. 29 State Plan: State Financing - Financial Loan and Telework Program Enter the total endowment of the activity. [Number field]

30. 30 State Plan: State Financing - Financial Loan Program Select the option that best describes the primary source of capital used to begin the activity. [Drop-down menu]  Section 4 of the AT Act of 1998, as amended  Title III of the AT Act of 1998  Title I of the AT Act of 1998  Another federal source  A state source  A state source  A private source

31. 31 State Plan: State Financing Telework Program Select the option that best describes the primary source of capital used to begin the activity. [Drop-down menu]  The Rehabilitation Act of 1973, as amended  Title I of the AT Act of 1998  Another federal source  A state source  A state source  A private source

32. 32 State Plan: State Financing - Financial Loan and Telework Program Select the option that best describes the primary source of support for ongoing operation of the activity. [Drop-down menu]  Section 4 of the AT Act of 1998, as amended  Interest and investments from the original source of capital  Another federal source  A state source  A private source

33. 33 State Plan: State Financing - Financial Loan and Telework Program This activity offers the following types of assistance (select all that apply): [Check boxes]  Revolving loans  Loan guarantees  Low interest loans  Interest buy-downs  Preferred interest loans

34. 34 State Plan: State Financing - Financial Loan and Telework Program The lowest loan amount provided as established by the policies of the activity (leave blank if N/A). [Number field] The highest loan amount provided as established by the policies of the activity (leave blank if N/A). [Number field]

35. 35 State Plan: State Financing - Cooperative Buying, Telecommunications Distribution, Home Modifications, Last Resort Fund, Other Describe the activity. [Text box]

36. 36 Program Performance: State Financing (a) Is there evidence that this state financing activity increases acquisition of AT for targeted individuals and entities? (i) If not, does the grantee provide justification for why the activity does not yet increase acquisition of AT? (ii) If not, does the grantee have a reasonable plan for improving this activity to result in an increase in acquisition? (b) Is there evidence that the structure, practices, and staff expertise of the grantee make it possible to ensure the appropriateness of devices being provided to targeted individuals and entities? (i) If not, does the grantee provide justification for why the current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity?

37. 37 Program Performance: State Financing (c) Is there evidence that the structure of this activity makes it possible to meet the needs of targeted individuals and entities in most areas of the state? (i) If not, does the grantee provide justification for why the current structure is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its structure? (d) Is there evidence that the grantee’s structure, practices and staff expertise make it possible to meet the needs of individuals with diverse needs and a range of ages? (i) If not, does the grantee provide reasonable justification for why its current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity? (e) Is there evidence that the activity utilizes AT Act funds to provide direct payment for devices or services?

38. Device Exchange Information Provided in State Plan Program Review Questions

39. 39 State Plan: Device Exchange Select the option that best describes the type of exchange. [Drop-down menu]  Primarily serves consumers from our state  Is part of a collaborative exchange among states  Serves a particular agency or entity in our state If you indicated that your device exchange is a collaborative among states, identify the states. [Text box]

40. 40 State Plan: Device Exchange If you indicated that your device exchange serves a particular entity or agency, identify the entity or agency and describe the purpose of the exchange. [Text box]

41. 41 State Plan: Device Exchange The online page for this activity can be found at: [Text box] Select the option that best describes with whom the online exchange is affiliated. [Drop-down menu]  ATmatch  Agoranet  AT4All  Not affiliated with other sites

42. 42 State Plan: Device Exchange Select the option that best describes what happens when a device is exchanged. [Drop- down menu]  The transaction is direct consumer-to- consumer  The Statewide AT Program is involved in the transaction

43. 43 State Plan: Device Exchange Select the option that best describes the policy of the program for charging individuals with disabilities for a device. [Drop-down menu]  A flat fee only for posting a device on the site  A flat fee only when a device is exchanged  A percentage of the price when a device is exchanged  Combination  Multiple subcontractors are used and they set their own policies  Other

44. 44 Program Performance: Device Exchange (a) Is there evidence that this device reutilization activity increases acquisition of AT for targeted individuals and entities? (i) If not, does the grantee provide justification for why the activity does not yet increase acquisition of AT? (ii) If not, does the grantee have a reasonable plan for improving this activity to result in an increase in acquisition? (b) Is there evidence that the structure of this activity makes it possible to meet the needs of targeted individuals and entities in most areas of the state? (i) If not, does the grantee provide justification for why the current structure is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its structure? (c) Is there evidence that the grantee employs safeguards to protect the privacy of users and ensure the integrity of exchanges? (i) If not, does the grantee provide justification for why the current safeguards are sufficient? (ii) If not, does the grantee have a reasonable plan for improving its safeguards?

45. Device Reassignment Information Provided in State Plan Program Review Questions

46. 46 State Plan: Device Reassignment Select the option that best describes the reassignment program. [Drop-down menu]  Reassigns computers only  Reassigns general AT  Is an open-ended loan program

47. 47 State Plan: Device Reassignment How do you get the device to the consumer? [Drop- down menu]  The device is shipped via mail or other commercial delivery  The device is delivered to the consumer by staff  The consumer picks up the device at a designated site  Other

48. 48 State Plan: Device Reassignment In the following table, select by device type how the device is reassigned (choose all that apply).

49. 49

50. 50 State Plan: Device Reassignment If applicable, describe how consumers demonstrate need for the reused devices. [Text box] Describe any supports provided to the consumer to ensure successful use of the device [Text box]. If you answered that you offer an open-ended loan program, describe it: [Text box]

51. 51 Program Performance: Device Reassignment (a) Is there evidence that this device reutilization activity increases acquisition of AT for targeted individuals and entities? (i) If not, does the grantee provide justification for why the activity does not yet increase acquisition of AT? (ii) If not, does the grantee have a reasonable plan for improving this activity to result in an increase in acquisition? (b) Is there evidence that the structure, practices, and staff expertise of the grantee make it possible to ensure the appropriateness and safety of devices being provided to targeted individuals and entities? (i) If not, does the grantee provide justification for why the current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity?

52. 52 Program Performance: Device Reassignment (c) Is there evidence that the structure of this activity makes it possible to meet the needs of targeted individuals and entities in most areas of the state? (i) If not, does the grantee provide justification for why the current structure is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its structure? (d) Is there evidence that the grantee’s structure, practices and staff expertise make it possible to meet the needs of individuals with diverse needs and a range of ages? (i) If not, does the grantee provide reasonable justification for why its current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity?

53. Device Loan Information Provided in State Plan Program Review Questions

54. 54 State Plan: Device Loan Select the option that best describes the type of program. [Drop-down menu]  General device loan program  Device loan program for targeted consumers  Device loan program for targeted agencies or entities  Other

55. 55 State Plan: Device Loan If you indicated that you have a device loan program for targeted consumers or devices, describe the specific types of consumers or devices for whom this program is intended and why. [Text box] If you indicated that you have a device loan program for targeted agencies or entities, identify the entity or agency and describe the purpose of the program. [Text box] If you selected other, describe. [Text box]

56. 56 State Plan: Device Loan Devices in the loan pool also are made available for the following (choose all that apply): [Check boxes]  Device demonstrations  Evaluations and assessments  Training  Public awareness

57. 57 Device Loan How do you get the device to the consumer? [Drop- down menu]  The device is shipped via mail or other commercial delivery  The device is delivered to the consumer by staff  The consumer picks up the device at the designated site  Other

58. 58 State Plan: Device Loan Describe any supports provided to the consumer to ensure a successful loan. [text box]

59. 59 Program Performance: Device Loan (a) Is there evidence that the quality, currency, number and scope of devices available for loan make it possible to meet the needs of individuals with diverse needs and a range of ages? (i) If not, does the grantee provide reasonable justification for why the current inventory is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its inventory? (b) Is there evidence that the grantee’s structure, practices, and staff expertise make it possible to meet the needs of individuals with diverse needs and a range of ages? (i) If not, does the grantee provide reasonable justification for why its current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity?

60. 60 Program Performance: Device Loan (c) Is there evidence that grantee’s structure, practices and staff expertise make it possible to provide sufficient support to ensure that a device loan meets the needs of targeted individuals and entities? (i) If not, does the grantee provide justification for why its current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity? (d) Is there evidence that the structure of this activity makes it possible to meet the needs of targeted individuals and entities in most areas of the state? (i) If not, does the grantee provide justification for why the current structure is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its structure?

61. Device Demonstration Information Provided in State Plan Program Review Questions

62. 62 State Plan: Device Demonstration Select the option that best describes the type of program. [Drop-down menu]  General device demonstration program  Device demonstration program for targeted consumers  Device demonstration program for targeted agencies or entities  Other

63. 63 State Plan: Device Demonstration If you indicated that you have a device demonstration program for targeted consumers or devices, describe the specific types of consumers or devices for whom this program is intended and why. [Text box] If you indicated that you have a device demonstration program for targeted agencies or entities, identify the agency or entity and describe the purpose of the program. [Text box] If you selected other, describe. [Text box]

64. 64 State Plan: Device Demonstration Select the option that best describes the primary type of demonstrations provided by the program. [Drop- down menu]  In-person demonstrations from one fixed location  In-person demonstrations at fixed regional sites  In-person demonstrations that move to multiple sites  In-person demonstrations from mobile unit(s)  Virtual demonstrations via technology

65. 65 State Plan: Device Demonstration Devices in the demonstration pool also are made available for the following (choose all that apply): [Check boxes]  Device loans  Evaluations and assessments  Training  Public awareness

66. 66 State Plan: Device Demonstration Select the option that best describes what is shared with the device loan program. [Drop- down menu]  Staff  Space  Not applicable

67. 67 Program Performance: Device Demonstration (a) Is there evidence that the quality, currency, number and scope of devices available for demonstration make it possible to meet the needs of individuals with diverse needs and a range of ages? (i) If not, does the grantee provide reasonable justification for why the current inventory is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its inventory? (b) Is there evidence that the grantee’s structure, practices, and staff expertise make it possible to meet the needs of individuals with diverse needs and a range of ages? (i) If not, does the grantee provide reasonable justification for why its current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity?

68. 68 Program Performance: Device Demonstration (c) Is there evidence that grantee’s structure, practices and staff expertise make it possible to provide thorough device demonstrations meets the needs of targeted individuals and entities? (i) If not, does the grantee provide justification for why its current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity? (d) Is there evidence that the structure of this activity makes it possible to meet the needs of targeted individuals and entities in most areas of the state? (i) If not, does the grantee provide justification for why the current structure is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its structure? (e) Is there evidence that the grantee can provide comprehensive referral information? (i) If not, does the grantee provide justification for why its current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity?

69. State Leadership Information Provided in State Plan Program Review Questions

70. 70 State Plan: Training Select the option that best describes how training is primarily provided. [Drop-down menu]  At fixed sites supported by the Statewide AT Program  At sites arranged by those receiving the training  Via distance learning technology

71. 71 Program Performance: Training (a) Is there evidence that the grantee’s training activities can provide relevant, current, and appropriate information? (i) If not, does the grantee provide justification for why its training is sufficient? (ii) If not, does the grantee have a reasonable plan for improving the relevancy, currency, and appropriateness of its training? (b) Is there evidence that the structure and methods of training make it possible to reach targeted individuals and entities in most areas of the state? (i) If not, does the grantee provide justification for why its structure and methods are sufficient? (ii) If not, does the grantee have a reasonable plan for improving its structure and methods? (c) Is there evidence that the grantee’s structure, practices, and staff expertise and depth and breadth of topics make it possible to meet the needs of individuals and entities with diverse needs? (i) If not, does the grantee provide reasonable justification for why the current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity?

72. 72 Program Performance: Technical Assistance NOTHING

73. 73 State Plan: Public Awareness and Information and Assistance Describe the activity. [Text box]

74. 74 Program Performance: Public Awareness (a) Is there evidence that the grantee’s public awareness activities can provide relevant, current, and appropriate information? (i) If not, does the grantee provide justification for why its public awareness is sufficient? (ii) If not, does the grantee have a reasonable plan for improving the relevancy, currency, and appropriateness of its public awareness? (b) Is there evidence that the structure of the grantee’s public awareness activities make it possible to reach targeted individuals and entities in most areas of the state? (i) If not, does the grantee provide justification for why its structure sufficient? (ii) If not, does the grantee have a reasonable plan for improving its structure?

75. 75 Program Performance: Information and Assistance (c) Is there evidence that the structure, practices, and staff expertise of the grantee makes it possible to provide current and accurate information and assistance in a timely manner? (i) If not, does the grantee provide justification for why the current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity? (d) Is there evidence that the structure of the grantee’s information and assistance activities make it possible to meet the needs of targeted individuals and entities in most areas of the state? (i) If not, does the grantee provide justification for why its structure sufficient? (ii) If not, does the grantee have a reasonable plan for improving its structure? (e) Is there evidence that the structure, practices, and staff expertise of the grantee make it possible to meet the information and assistance needs of targeted individuals and entities with diverse needs? (i) If not, does the grantee provide reasonable justification for why the current capacity is sufficient? (ii) If not, does the grantee have a reasonable plan for improving its capacity?