Sources of beauty: This is what happens when you take a photo of rusted sheet metal and run it through a couple of graphics filters.

“Are We Making a Difference?” The Research and Data Needs of Community Organizations Randy Stoecker 2004

Project-Based Research Diagnose Prescribe Implement Evaluate Diagnose: Needs Assessments Assets Assessments SWOT Analysis Force Field Analysis Prescribe Visioning Charrettes Best Practices Strategic Planning Policy Analysis Implement Community Art Community History Community Theater Target Research Evaluate External Evaluation Internal Evaluation Outcome Evaluation Process Evaluation Utilization Evaluation

The “Community” Context People With the Problem CBO Service provider Resource Provider CBO Service provider Resource Provider Resource Provider

Identified Problem: the research and data capacity of Toledo area community organizations Research Process: community- based research —initiator model Research Decision-Making Structure: Core group Project-Based Research: Round One Diagnose Prescribe Implement Evaluate

We received 33 surveys via the web form, 8 via fax, 12 via , and 27 via postal mail. We suspect, but cannot be certain, that most if not all of the web and surveys were returned from organizations contacted via . The total response was 80 organizations—a response rate of 19%. This is an acceptable response rate given that the survey took 15 minutes to complete. Interviewed seven funders, three of whom funded CDCs Doing The Research Focus Groups with Community Organization Directors and Staff Survey of Community Organizations Interviews with Resource Providers 419 small and medium-size nonprofit organizations identified by Urban Affairs Center and Nonprofit Resource Center: 153 contacted by (27 bounces and 3 refusals) 83 contacted by fax, including 22 of bounces (21 no answers). 234 contacted by postal mail, including fax no answers. 80 responses: 33 via web form 8 via fax return 12 via 27 via postal mail Pre-research focus group of seven nonprofit organization directors: To assess need for research project To outline basic concerns Ongoing focus group using core group over six monthly meetings: To design survey To develop interview guide To provide data analysis and interpretation Interviews with seven of the largest resource providers in Toledo: To learn what data they expected from applicants, and how satisfied they were by the data provided. To learn what data they expected from funded organizations, and how satisfied they were by the data provided. Foci & types of resource providers: Those who funded neighborhood- based organizations Those who funded nonprofits in general Government funders Private funders Focus Groups with Community Organization Directors and Staff Survey of Community Organizations Interviews with Resource Providers

Survey Findings Respondents Levels of Data Collected Collection & Use of Data Training Needs Level of Analysis at Which Organizations Collect Data Level of Analysisn Individual level, i.e. children, youth or adults 72 Family level44 Neighborhood/community level 23 City level 29 County level28 Regional level, i.e. Northwest Ohio 19 State level 14 National level 9 Types of Organizations Responding Typen Youth related, i.e. mentorship or skill development25 Neighborhood development or community building18 Housing or homeless services16 Education, including GED or ESL15 Food storage or distribution15 Mental health 12 Drug or alcohol addiction prevention and recovery 12 Social justice advocacy, political causes12 Culture, race, or ethnicity specific10 Arts, ballet, theater or music related8 Family transitions, i.e. adoption, foster care or divorce7 Emergency relief services, i.e. crime victim support7 Seniors*7 Disability services, i.e. home repairs or accessibility6 Legal services6 Religious*6 Medical or reproductive services5 Nature or environmental efforts3 Topics for which Organizations Collect, Use, and Need Data Topicn Collect n Use n Need Age Sex Race/ethnicity Street/neighborhood-level address data Family characteristics Previous program participant Employment status 3420 (26)* 9 Physical health conditions or disabilities 3321 (24)* 9 Education level Client contact with other organizations Mental health conditions 2614 (17)* 6 Funding resources 2515 (18)* 19 Transportation needs Native or non-native English speaker Criminal record 1910 (13)* 7 School system for children Religious affiliation Drug/alcohol treatment Leadership skill *organizations that use data beyond those that also collect it Organization Training and Education Needs Training Topicn Education on program evaluation59 Funding56 Training on computer programs or software55 Training on spreadsheets47 Education on research methods47 Community-wide database for tracking44 Education on statistical analysis39 Training on geographic information systems35 Training on accounting/budget management35 Data confidentiality and security31 Training on legislation, such as privacy laws28 Pending legislation28 Respondents Levels of Data Collected Collection & Use of Data Training Needs More than half of the organizations need training in evaluation, data management software, research methods, and finding funding. Nearly half have no staff or volunteers with formal research training and the others have only one or two people with such training. The average organization in the survey has five employees and 4 volunteers who, together, spend 56 hours per week collecting, managing, and reporting on data. Only 23 of the 80 organizations collect data at the neighborhood level. Consequently, among nonprofits in general, community development organizations will suffer some of the greatest information hardships. Two thirds or less of the organizations report using the data they collect in most categories, so potentially 18 hours a week of data management work is wasted effort.

Interview Findings Resource Providers… see a need for better research on community needs, but do not expect that research should not be the sole responsibility of community organizations. They, too, lack resources to conduct needed research. have widely varying expectations of what data they expect organizations to use in supporting their applications and evaluations want community organizations to think more theoretically about the relationships between models, strategies, and context. are looking for ways to improve evaluation, with the goal of helping nonprofits enhance the delivery of programs and services.

Using the Research Presentation of findings Panel of community organizations Panel of resource providers Issue-oriented breakout groups September 24 planning meeting Presentation of findings Panel of community organizations Panel of resource providers Issue-oriented breakout groups Developing databases for nonprofits Integrating theory, research, and practice Reducing waste in data collection and management Research methods training Evaluation training Data management software training

Project-Based Research: Round Two Research and data management training programs Researching training options Researching training costs Neighborhood indicators feasibility study Study of national best practices Study of local resource base Diagnose Prescribe Implement Evaluate