1. Initiative for Optimal Doctoral Completion

2. How are UGA programs performing with respect to doctoral completion figures? All of this leads to the question:

3. How are UGA programs performing? We examined the performance of one cohort: the 474 doctoral students who entered programs between Fall of 1998 and Summer of 1999.

4. 30% 4% 33% 66% 7% 60% Completion Status for All Doctoral Programs 1998-1999 Cohort (N=475) 20% 40% 80% 100% 60% N=144 N=18 N=313 Withdrew

5. 30% 4% 33% 66% 7% 60% 30% 6% 64% 30% 3% 68% 34% 6% 60% 25% 1% 74% 57% 43% Completion Status by Broad Field 1998-1999 (N=475) %

6. 30% 4% 33% 66% 7% 60% Time to Degree for All Programs 1998-1999 Cohort (Graduates Only N=313) Median=4.67 # Students Years

7. 30% 4% 33% 66% 7% 60% Time To Degree by Broad Field 1998-1999 Cohort (N=313)

8. 30% 4% 33% 66% 7% 60% Time to Withdraw for All Programs 1998-1999 Cohort (Non-completers Only. N=144) Median=1.67 # Students Years

9. 30% 4% 33% 66% 7% 60% Time To Withdraw by Broad Field 1998-1999 Cohort (N=144)

10. How Does UGA Compare to Other Universities? Broad FieldPercent Completion UGA 1998-1999 CGS National 1992-1995 Duke 1991-1995 Humanities624961 Life Sciences656373 Math and Physical Sciences 455560 Social Sciences645650 ALL PROGRAMS 665764

11. What the UGA Graduate School will do during the Initiative Create Data Systems to help faculty understand the performance of their programs. Provide faculty members with Web-based Information Resources to foster self-study and program improvement. Provide Direct Support to those programs most in need of improvement.

12. Creating Data Systems Two things have become clear during our preliminary work: 1.In general, most faculty members do not know how well their programs are performing with respect to doctoral completion. 2.In general, programs do not keep track of reasons for non-completion.

13. Three Data Activities Drillable Data Set for faculty investigation and program self assessment Non-Completion Reasons systematically collected, tabulated, and shared with programs Follow-up questionnaire data collected from completers and non-completers

14. Drillable Database The Graduate School worked with the Office of Institutional Research to construct a data base that faculty could use to understand their program performance. Starting this week, that data base is available to faculty to study patterns in their own programs and compare them with other university programs.

15. Completion Figures for All Programs

16. Completion Figures for One High Performing Program

17. Completion Figures for One Low Performing Program

18. The Need for Interpretive Benchmarks No one involved in higher education believes that 100% of admitted students should graduate. But how does a program determine whether or not it is performing well? –By comparing itself with other programs in the nation and –By comparing itself with other programs at UGA.

19. 30% 4% 33% 66% 7% 60% Interpretive Benchmarks: Graduation 1998-1999 Cohort (N=75 Programs)

20. 30% 4% 33% 66% 7% 60% Interpretive Benchmarks: Time to Degree 1998-1999 Cohort (N=75 Programs)

21. 30% 4% 33% 66% 7% 60% Interpretive Benchmarks: Time to Withdraw 1998-1999 Cohort (N=75 Programs)

22. Establishing Benchmarks This Spring, the Graduate School will convene an advisory committee on benchmarks. We would welcome volunteers with expertise to help us create quality benchmarks that are: –technically defensible and –of maximum acceptability to the graduate faculty.

23. Non-Completion Reasons The Graduate School will distribute a “Non- completer List” to all Graduate Coordinators for their respective doctoral programs. Graduate Coordinators will be asked to visit a web site to complete a very brief report stating the reason for each non-completion.

24. Follow-up Student Questionnaires The questionnaires will collect data that will help us better understand doctoral completion and non-completion. Separate web-based surveys will be conducted for completers and non-completers twice a year. Results will be shared with faculty. Pilot administration will begin this Spring.

25. Information Activities Through a website and email, information will be provided to all members of the graduate faculty to enable them to: –Understand the issues surrounding the use of doctoral completion figures as an indicator of program quality –Engage in program level self-study and program improvement

26. Direct Support to Programs For programs who recognize the need to improve their doctoral completion figures, the Graduate School will work collaboratively with faculty to develop and carry out a plan of action.

27. Actions YOU can take After this session, go back and investigate your own program’s performance using the drillable database. Share the data with your colleagues and discuss at upcoming faculty meetings.

28. Framework for Action At the Graduate School, we developed a Framework for Action that sets forth conditions that are likely to lead to high doctoral completion. (See green handout.) We urge you to use the framework to assess your program with respect to the four conditions in the framework.

29. Does Your Program Fulfill the Four Conditions in the Framework? Condition #1: The right people apply for doctoral study. Do you have a high quality website? Do you provide potential applicants with realistic information about academic demands, funding, and time to completion? Condition #2: The right applicants are admitted as doctoral students. Does the admissions process rely on faculty judgment and insight about an applicant’s likelihood of success? Or is it largely a clerical task? Assessing your Program

30. Does Your Program Fulfill the Four Conditions in the Framework? Condition #3: Students and faculty form productive working relationships. How are students matched with major professors? Is there a process to remedy a bad match? How do new professors learn to mentor doctoral students? Condition #4: Students experience social support from fellow students. Do students have the opportunity to interact professionally (seminars, mini- conferences)? Do students have a location where they can interact socially (lunchroom, lounge, etc.)? Assessing Your Program

31. If the statistics and your own inquiries point to a need for improvement... Review the four strategy sheets (handouts) to see ideas for improving your program. Visit our website to see strategies that other programs have used in the past. Contact the graduate school to ask for our help. Program Improvement

32. Questions, Comments and Concerns?