DATA BASED ASSESSMENT OF RESEARCH DOCTORATE PROGRAMS The NEW NRC DATA BASED ASSESSMENT OF RESEARCH DOCTORATE PROGRAMS Not your father’s survey, but the.

Slides:

Advertisements

Similar presentations

Council of Graduate Schools The Ph.D. Completion Project: Phase II Technical Workshop Daniel Denecke, Helen Frasier, and Kenneth Redd December 9, 2006.

Advertisements

Assessing Uncertainty when Predicting Extreme Flood Processes.

Using LibQUAL+ to Develop Accountability with Key Stakeholders Raynna Bowlby Based upon presentation made w/co-presenter Dan O’Mahony (Brown U. Library)

Pilot Study Introduction and Overview 1.  Julie Carnahan Senior Associate - SHEEO MSC Project Director  Terrel Rhodes Vice President.

LibQUAL+ in the UK & Ireland: five years experience J. Stephen Town and Selena Lock, Cranfield University.

Student Learning Outcomes Curriculum Change Request Academic Council Presentation Gary Howard Rosemary Hays-Thomas October 22, 2004.

Human Services Associate in Science Degree Program Program Review Summit April 22, 2008.

2008/2009 Surveys of Indiana University Graduate Students and Chairs/Directors of Graduate Studies 1.

DARTMOUTH COLLEGE ADDRESSING HIGH-RISK DRINKING AND SEXUAL ASSAULT: AN OVERVIEW SYLVIA C. SPEARS, Ph.D. ACTING DEAN OF THE COLLEGE.

The AAMC Faculty Forward Engagement Survey. Why study engagement? Engagement: A heightened emotional and intellectual connection that a faculty member.

Reviewing professional services: Support Process Review (SPR) at the University of Bristol HESA/SUMS Seminar, 24 th June 2011 Helen Galbraith, Director.

2010 MUSC Excellence Faculty/Staff Survey Leadership Development Institute July 23, 2010.

QUALIFYING EXAM PERFORMANCE EXPECTATIONS AND GRADING 2004 Ian Waitz.

The Research Assessment Exercise in the United Kingdom Paul Hubbard International colloquium “Ranking and Research Assessment in Higher Education” 13 December.

Quality Assurance and Development Unit College of Applied Medical Sciences Females 1.

The Academic Assessment Process

1 Research Reviews in the Netherlands A Practical Approach Roel Bennink, coordinator research reviews Quality Assurance Netherlands Universities

COLLEGES of ENGINEERING SCIENCES & APPLIED ENGINEERING PROGRAMS ASSESSMENT.

Orientation for Academic Program Reviews

Project Funded by: E-Outcomes Assessment Project: Technology Linking Assessment & Learning Luvai Motiwalla, Steven Tello & Kathryn Carter College of Management.

Benchmarks from the Harvard Collaborative on Academic Careers in Higher Education (COACHE) Faculty Job Satisfaction Survey University Faculty Meeting October.

1 C-99 Assessing Student Learning in Graduate Degree Programs C-99 Assessing Student Learning in Graduate Degree Programs Bob Smallwood, University of.

Factors affecting contractors’ risk attitudes in construction projects: Case study from China 박병권.

Where Does UMKC Fit in the 2011 Rankings?. Why pay attention to the US News Rankings? Although rankings are imprecise, metrics are important Prospective.

UNIVERSITY OF CALIFORNIA, IRVINE CAOMP UNIVERSITY OF CALIFORNIA, IRVINE CAOMP ONLINE TOOL BOX.

Using Measures of Data Variation to Judge the Credibility of Statistics in the News Looking at Normal Distribution and Its Familiar Curve.

2006 Pacific Nortwest Higher Education Teaching & Learning Conference: The Scholarship of Teaching, Learning, & Assessment: Connections that Work Infusing.

The Institutional Effectiveness Plan An Excellent Way to Convey Evidence of Assessment Ellen M. Boylan, Ph.D. Marywood University NEAIR – 33 rd Annual.

Sample Sample Sample Re-Imagining Faculty Roles and Responsibilities at Mount Royal Robin Fisher and David Hyttenrauch CSSHE conference Vancouver 3 June.

DISSERTATION DEFENSE Robert Crouch. Purpose of Study Setting of Study Theoretical Framework Research Questions Quantitative: Three Questions Qualitative:

Mountain View College Spring 2008 CCSSE Results Community College Survey of Student Engagement 2008 Findings.

Assessment Cycle California Lutheran University Deans’ Council February 6, 2006.

Advancing Marketing Knowledge Kent B. Monroe AMA Winter Educators’ Conference February 12, 2005.

Lifetime Advantages of Degree Completion Presented by: Lauren Hubacheck, Director of Career Services, Salem State University.

Bush School Diversity Report January 29, A General Comparison of Student Data.

Data Development and Pilots Academic Leadership Retreat August 2015.

Washington State University Strategic Plan Overview and Implementation Process On web site at

Community College Survey of Student Engagement JIM Meeting Presentation January 20, 2009 Jerome Ward Director, Institutional Research Cochise College.

The NRC Doctoral Program Assessment Charlotte Kuh National Research Council.

Columbia University :: Office of the Provost :: Planning and Institutional Research NRC Assessment of Research-Doctoral Programs October 27,

Final Update on the New Faculty Course Evaluation & Online System November, 2003.

ASSESSMENT. Assessment is the systematic and on-going process of collecting and reviewing evidence about the College's academic and administrative programs.

On-line briefing for Program Directors and Staff 1.

Defining Academic “Quality”: The Gendered Effects of Admissions Criteria in Doctoral CS and CE Programs Holly R. Lord J. McGrath Cohoon Gender Diversity.

Promotion Process A how-to for DEOs. How is a promotion review initiated? Required in the final probationary year of a tenure track appointment (year.

Columbia University School of Engineering and Applied Science Review and Planning Process Fall 1998.

NCATE for Dummies AKA: Everything You Wanted to Know About NCATE, But Didn’t Want to Ask.

Center for Information and Communication Studies Shaping the Future of Scholarly Communication Carol Tenopir University of Tennessee (Visiting University.

How to participate in LibQUAL+ and effectively utilise the data.

National Research Council Assessment of Doctorate Programs: The Methodology Report E. L. Fink & S. Chai University of Maryland.

Hugo Horta Center for the Advancement of Higher Education, Tohoku University Japan CIES-ISCTE, Portugal.

COLLEGE OF CHARLESTON FACULTY COMPENSATION COMMITTEE Report to Faculty Senate November 5, 2013.

Improving Student Outcomes and Retention with Class Capture Technology Carmen Taylor Burkhalter, Ph.D. Senior Associate Dean Senior Information Officer.

RESULTS OF THE 2009 ADMINISTRATION OF THE COMMUNITYCOLLEGE SURVEY OF STUDENT ENGAGEMENT Office of Institutional Effectiveness, April 2010.

Session 1.31 RISK BASED AUDITING AN OVERVIEW BY R T I JAIPUR.

Drake Curriculum Analysis Committee Assessment Update September 2012.

Staff Survey Results Research Excellence Framework All Staff Open Meeting Monday 23 February 2015.

Authentic Assessment Using Rubrics to Evaluate Project-Based Learning Curriculum content created and presented by Dr. Alexandra Leavell Associate Professor.

Several Concerns and Possible Solutions for International Students in U.S Higher Education System Class 497A Yi Meng.

Personal Assessment of the College Environment (PACE) Survey Summary of Fall 2014 Results Presentation to College Council Executive Cabinet August 5, 2015.

RESULTS OF THE 2009 ADMINISTRATION OF THE COMMUNITYCOLLEGE SURVEY OF STUDENT ENGAGEMENT Office of Institutional Effectiveness, September 2009.

Human Resources Office of 1 Summary of Results College of Design Dean’s Reports.

Engaging students in information literacy through the Internet Detective Bob Glass and Margaret Kendall (LearnHigher, MMU) Emma Place (RDN, University.

NWEA Measures of Academic Progress (MAP)

LibQUAL+ in the UK & Ireland: five years experience

Derek Herrmann & Ryan Smith University Assessment Services

Council of Chairs Fall Meeting October 9, 2018.

SUNY Oneonta’s CLA Results:

Taught Postgraduate Program Review

2019 Academic Administrator Workshop

Presentation transcript:

DATA BASED ASSESSMENT OF RESEARCH DOCTORATE PROGRAMS The NEW NRC DATA BASED ASSESSMENT OF RESEARCH DOCTORATE PROGRAMS Not your father’s survey, but the mother of all surveys

TAKE HOME POINTS There is no ONE right way to do rankings. UA did fine! Solidly in step with our ABOR peers. Many programs near top. Much more than rankings. Most valuable as a benchmarking tool for improvement and accountability 2

nrc.arizona.edu

Many ways to develop rankings— NRC did it in FIVE ways. TWO OVERALL ‘QUALITY’ rankings, reported as ranges, with 90% confidence intervals 1.R = regression-based. Small # of raters, hence some are quirky. 2.S = survey-based weights derived from an idealized question about relative importance of variables Not all variables are used in these overall rankings Samples in your packet

5 In your packet if you want further information

6

7

Samp Sample of program rankings: Geography 8

Plus 3 dimensions (the 20 variables fall into these categories): 3.Research Activity 4.Student Support and Outcomes Sample in your packet 5.Diversity of the Academic Environment 9

Example: Student Support & Outcomes 10

Related effort on PhDs.org will permit rankings with user determined weights

NRC says: “The production of rankings from measures of quantitative data turned out to be more complicated and to have greater uncertainty than originally thought. As a consequence, the illustrative rankings are neither endorsed nor recommended by the National Research Council (NRC) as an authoritative conclusion about the relative quality of doctoral programs... “The reader who seeks a single, authoritative declaration of the ‘best programs’ in given fields will not find it in this report.”

DEMO on NRC site I want to study LINGUISTICS (52 programs) In the EAST or WEST (31 programs) I want good probability of FINISHING (11) I need financial support (9) I’d like to study with diverse faculty (5) I care about faculty research, citations I should go to ARIZONA!

Communication Plan UA Internal Release External Release Workshops & visits with colleges & departments Groups such as Assessment Council, Faculty Senate, SPBAC