1. BPC Alliance Workshop December 7, 2006 Washington, DC HBCU-Research Alliance Evaluation Update Lecia Barker Tim Weston University of Colorado, Boulder ATLAS Assessment & Research Center

2. BPC Alliance Workshop December 7, 2006 Washington, DC Goal, Description of Project Goal: Increase numbers of African-American CS faculty in research careers 8-institution alliance: 3 R1s, 5 HBCUs Theory of Change: –Recruitment: summer REUs at R1s; HBCU masters/doctoral research exchange; HBCU masters students in R1 PhD programs –Research partnerships among faculty leads to greater research visibility, African-American role models –Strengthen undergraduate computing at HBCUs

3. BPC Alliance Workshop December 7, 2006 Washington, DC Evaluation Questions What are the context/background and resources of the institutions with respect to research? What is the research climate at each institution? (e.g., expectations, colloquia) What instructional methods are used by instructors? (e.g., faculty-student interaction, research activities in class) What is the quality and quantity of student and faculty participation in REUs? What do students know, believe about research?

4. BPC Alliance Workshop December 7, 2006 Washington, DC Baseline Institution Profiles Data Collection –Surveyed 37 faculty members at 5 institutions Response rate variable: nearly 100% to 25% –Interviewed project representatives from each university –Reviewed web sites and other records (e.g., curriculum) Written profile will be sent to each representative

5. BPC Alliance Workshop December 7, 2006 Washington, DC Undergraduate Survey Student survey –Student aspirations about graduate school –Experiences with REUs, co-ops, internships, etc. (i.e., competing goals) –Student activities in computer science –Student interactions with professors Reviewing versions, piloting with students Spring administration

6. BPC Alliance Workshop December 7, 2006 Washington, DC Masters Student Survey Aspirations for future Views on graduate school Student-professor Interaction Awareness of research, research careers Experience with research (e.g., skills)

7. BPC Alliance Workshop December 7, 2006 Washington, DC Main Challenges Getting faculty and students to participate in data collection efforts Communicating the purpose of evaluation to stakeholders Setting standards for substantial change: What counts as progress?