Quality Reports Come from Quality Data Andrew Baldwin College of Management University of Wisconsin- Stout Jan Boyd Information School University of Washington
Overview What is the “why”? What is the best way to display this information? Is the data accurate?
What is the “why”?
What questions need to be answered? ASK!
What’s important to you, Prof? me in! fence Don’t
What’s important to you, Prof? Don’t fence me in! Advising Highlight Research Service Teaching Other
From “Scheduled Teaching” Screen: Screen is “read only” for faculty except comment field.
From the Yearly Narratives Screen From the Scheduled Teaching Screen
Capture all my efforts regardless of current status.
Ask me what makes sense. Outcome: Evidence of the effect of our research activities is felt and understood in many places. Indicator: Researchers create artifacts or tools that are implemented and used by others. Target: Percentage increase in number and variety of artifacts/tools developed.
Evidence of Impact Screen Featured Incorporated Referenced Reviewed Quoted Other Internet Site Magazine Newspaper Podcast Radio Software TV Other Selectors and dates for research group websites
“Evidence of Impact” on the Faculty Activity Report
Make my accomplishments visible externally. Faculty Directory
What is the best way to display this information?
Formatting Level Aggregate vs. Individual Organization Tables vs. Free Form Medium Report vs. Website
Staff Activity Insight Admissions loves the Experts page for recruiting students. Curriculum Manager uses the same data to see who can teach what.
Research Projects for the Web special screen that integrates multiple faculty/current PhDs and has DSAs allowing multiple: People or Collaborators Partners Associated Groups or Centers Sponsors Geographic Impact Locations
Research Services staff can easily report status of grants to the Deans. Staff Activity Insight
Program Evaluation Initiative Intellectual Contributions By Type and Year Required: Title Contribution type Peer-reviewed? Current Status
Is the data accurate?
Data Quality Good data Good reports Bad data Bad reports
Data Imports and Proxies Import as much as possible from central data sources Data entry assistance Graduate students if possible
Make data entry links easy to find (especially for faculty!)
Most teaching is uploaded from central data sources. After Scholarship/Research on Main Menu:
What staff need and faculty seldom do is at the bottom of the menu.
Is the data captured accurately? Does the data make sense? Does anything appear to be missing? Is something included that shouldn’t be?
Strategic Plan Reports – Tables!!
Provide tools for data cleaning. Reports faculty can run themselves: Intellectual Contributions Metadata Presentations Metadata Professional Service Metadata Reports for staff or grad assistants: DCR - Intellectual Contributions with Students DCR - Presentations with Students DCR - Research Projects DCR - Research Projects for the Web DCR - Student Participation
Intellectual Contributions Metadata Easier to spot errors: Contribution type Current status Peer-reviewed
Student Participation Report combines: Intel Contributions Presentations Research Projects
Spreadsheet DCR version of student participation: filter for inconsistency
Macro-Level Data Cleaning Who is a “researcher?”
Macro-Level Data Cleaning
Summary Need to ask questions! What is the “why”? What is the best way to display this information? Is the data accurate?
Questions?