1. 1 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Utilizing Institutional Research Learning to Love Data Dr Barry W. Simmons Sr. Director USFA, Virginia Tech * With thanks to Bonnie Joerschke, UGA

2. 2 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Presentation Outline Need for Research Basic Principles and Statistics Data Sources Tools Foibles Examples Sharing Questions The End

3. 3 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Is There Time for Research? Reports are research –FISAP –State Reports –Institutional Reports –Common Data Set (CDS) –U S News and World Reports –National Postsecondary Student Aid Study (NPSAS) –Others?

4. 4 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Make Time for Research Strategic Planning Fund Utilization Grant Applications Knowing Your Student Body Evaluation Compliance Institutional Quality Assurance Program Others?

5. 5 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Basic Principles of Research Quantitative research is the systematic scientific investigation of quantitative properties and phenomena and their relationships. The objective of quantitative research is to develop and employ mathematical models, theories and/or hypotheses pertaining to natural phenomena. The process of measurement is central to quantitative research because it provides the fundamental connection between empirical observation and mathematical expression of quantitative relationships.quantitativephenomenarelationshipsmathematical modelstheorieshypothesesmeasurement empiricalobservation Source: Wikipedia

6. 6 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Basic Principles of Research Qualitative research attemptss to gather an in- depth understanding of human behavior and the reasons that govern human behavior. Qualitative research relies on reasons behind various aspects of behavior. Simply put, it investigates the why and how of decision making, not just what, where, and when. Hence, the need is for smaller but focused samples rather than large random samples, Qualitative researchers, typically rely on four methods for gathering information: (1) participation in the setting, (2) direct observation, (3) in depth interviews, and (4) analysis of documents and materials [2].human behavior reasonsbehaviordecision makingsamples random samples[2] Source: Wikipedia

7. 7 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html BASIC PRINCIPLES OF RESEARCH* Descriptive Statistics –Describes the basic features of the data –Simple summaries –Present quantitative descriptions in a manageable form –Descriptive vs. inferential statistics –Limitations: risk of distorting original data or losing important detail Source: The Web Center for Social Research Methods, www.socialresearchmethods.net/kb/statdesc/htm

8. 8 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html DESCRIPTIVE STATISTICS* Most often used descriptive statistic is “central tendency or range” of a distribution of values: –Mean –Median –Mode –Range

9. 9 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html DEFINITIONS* Mean: the arithmetic average 30 + 80 + 30 + 90 + 30 + 100 = 360/6 = 60 Median: The number in the middle of an ordered list 30 30 30 80 90 100 ^ Mode: The number that occurs most often 30 Range: The highest value minus lowest (100 – 30 = 70)

10. 10 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html DEFINITIONS* Standard deviation –Measures the dispersion of your data –Outlying values can distort the average or range of your data –Steps to calculate a standard deviation: 1.Compute the mean for the data set 2.Compute the deviation by subtracting the mean from each value 3.Square each individual deviation 4.Add up the squared deviations 5.Divide by one less than the sample size 6.Take the square root

11. 11 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html DEFINITIONS* Standard deviation (example) 30 – 60 = -30.000 2 = 900.000000 80 – 60 = 20.000 2 = 400.000000 90 – 60 = 30.000 2 = 300.000000 100 – 60 = 40.000 2 = 1600.000000 5000.000000/5 = 1000.000 = 31.623

12. 12 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html TRENDS* Cross-sectional Analysis –Snapshot of data at a single point in time Longitudinal Analysis –Study of change in data over time –Trend analysis is the simplest type of longitudinal analysis—examines overall change over time; using the past to predict the future Limitation: Does not tell “why or how” the changes occur

13. 13 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html CONSTANT DOLLARS* Dollars reported in terms of the value they had on a previous date. Measures data over time while controlling for changes owing to inflation. Usually gives a clearer view of how something is performing over time. Use Consumer Price Index (CPI) to adjust for inflation.

14. 14 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html CONSTANT DOLLARS* Consumer Price Index –Measure used to track change in prices for common household goods over time –Can be used to compare dollar amounts between years using “constant dollars” –Produced by the Bureau of Labor Statistics www.bls.gov/cpi/ Good reference when updating COA!!!

15. 15 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Types of Data Nominal: Nominal data have no order and thus only gives names or labels to various categories. Ordinal: Ordinal data have order, but the interval between measurements is not meaningful. Interval: Interval data have meaningful intervals between measurements, but there is no true starting point (zero). Ratio: Ratio data have the highest level of measurement. Ratios between measurements as well as intervals are meaningful because there is a starting point (zero). Source: http://www.andrews.edu/~calkins/math/webtexts/stattoc.htm

16. 16 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Data Sources Institution’s Administrative System EDE Express Suite External Databases –Regional –State –National IPEDS CPS Quarterly Sample Surveys Others?

17. 17 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research and Data Resources

18. 18 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Tools Excel SAS SPSS Mini-Tab Crystal Reports Access Others?

19. 19 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Foibles Quality of data –Reliability –Consistency –Stability Understanding of data –Data is data, not information, needs context –Compare and contrast appropriately –If items not well defined, develop your own definition and state it Application of Analysis –Use the correct measure/statistic –Don’t confuse association with correlation with causation –Basis of data…define variables

20. 20 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Affordability Nationwide From:Higher Education Access and Affordability in Virginia Amid the 2008 Credit Crisis: A Cursory Look, Barry W. Simmons Sr. in testimony 12/4/2008 before the Virginia Senate Finance Committee Education Subcommittee Improvements in State Investment---state investment in need- based financial aid as a percentage of the federal investment –Nevada 2% to 48% –North Carolina 3% to 70% –Virginia 6% to 50% –Montana 1% to 9% –Utah 1% to 8% –Washington 24% to 108% –Texas 7% to 32% –Delaware 13% to 49% –Missouri 8% to 29% –West Virginia 12% to 43% Source: Measuring Up 2008 Needs further protocol explanation

21. 21 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Affordability From:Higher Education Access and Affordability in Virginia Amid the 2008 Credit Crisis: A Cursory Look, Barry W. Simmons Sr. in testimony 12/4/2008 before the Virginia Senate Finance Committee Education Subcommittee State Tax Funds Appropriated for Higher Ed Operating Expenses Per $1,000 Personal Income FY07 Virginia $6.53 National $7.08 North Carolina $12.52 Virginia Change from FY1980 to FY2007 ($3.94) National Change from FY1980 to FY2007 ($3.39) Source: Postsecondary Education Opportunity, January 2007 Example of Good Use!!!

22. 22 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Affordability in Virginia From:Higher Education Access and Affordability in Virginia Amid the 2008 Credit Crisis: A Cursory Look, Barry W. Simmons Sr. in testimony 12/4/2008 before the Virginia Senate Finance Committee Education Subcommittee Source: SCHEV Too Low Too High

23. 23 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Affordability in Virginia From:Higher Education Access and Affordability in Virginia Amid the 2008 Credit Crisis: A Cursory Look, Barry W. Simmons Sr. in testimony 12/4/2008 before the Virginia Senate Finance Committee Education Subcommittee Source: SCHEV

24. 24 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Foibles in Research Others?

25. 25 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example Virginia Financial Aid Related Metrics for Restructuring

26. 26 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example Virginia Financial Aid Related Metrics for Restructuring

27. 27 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example

28. 28 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example Virginia Financial Aid Related Metrics for Restructuring

29. 29 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example Michigan State Annual Report

30. 30 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example Michigan State Annual Report

31. 31 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT Financial Statement

32. 32 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example: VT Funds for the Future

33. 33 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT Funds for the Future

34. 34 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT Funds for the Future

35. 35 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT Funds for the Future

36. 36 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT Funds for the Future

37. 37 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT Funds for the Future

38. 38 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT Funds for the Future

39. 39 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT Short Narrative on Presidential Scholarship Initiative (PSI) New Access Program

40. 40 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT PSI Access Program

41. 41 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT PSI Access Program

42. 42 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT PSI Access Program

43. 43 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html

44. 44 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT College Level Summary

45. 45 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example VT College Level Summary

46. 46 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Research Example Open Floor Who’s doing what?

47. 47 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Recap Need for Research Basic Principles and Statistics Data Sources Tools Foibles Examples Sharing Questions The End

48. 48 SASFAA MI 12/2008--Utilizing Institutional Research---Dr. Barry W. Simmons Sr. www.finaid.vt.edu/Presentations/SASFAA_MANAGEMENT/index.html Questions? Contact Info: Dr. Barry W. Simmons Sr. simmonsb@vt.edu