1. National Benchmarking
Eric Paterson, Virginia Tech
ADCA Meeting, 10 January 2017

2. Motivation
There is a trend in academia towards data-supported decision systems for key decisions: Investments, Recruiting, Promotion and tenure, Assessment, and Facilities.    
Getting the right data and making the right data comparisons is critical for making the right decisions.  
At Virginia Tech, metrics and peers are chosen at department level. This includes measures for innovative and “non-traditional” activities.   
Underlying philosophy: profile of each unit, the metrics, and the comparisons can and should progress as each field evolves.    

3. Motivation – Specific example from VT
Promotion and Tenure
Department establish the avenues and tools for demonstrating national impact of the faculty member’s research/scholarly work
Department establish the metrics/thresholds for demonstration of national recognition and leadership
Metrics should be benchmarked nationally – monitor progress in relation to relevant peers
Quantitative and qualitative indicators for external recognition/ national impact of candidate’s research/scholarship
A consensus discovery process led by the faculty and managed by the Department Head
Results become a standardized, transparent, benchmarked, inclusive context for peer evaluation

4.
Academic Analytics is a provider of high-quality, custom business intelligence data and solutions for research universities in the United States and the United Kingdom.
Data Analytics and Decision Science has come to university administration

5. Current ADCA data Basically mimics the ASEE Profiles of Engineering
Student enrollment data
Degree production
Faculty composition
Student and faculty diversity
Not sufficient for benchmarking, or validating data from 3rd-party companies like Academic Analytics

6. Expanded ADCA survey data
Should we expand the annual survey?
Would you be willing to participate if more sensitive data is collected?
What data should we gather?
Would you be OK with an online survey?
Restrict data to participants?