1. NRC 2010 Survey of Research Doctorates GSNB 1 2010 NRC Survey “A Data-Based Assessment of Research-Doctorate Programs in the United States

2. NRC 2010 Survey of Research Doctorates GSNB 2 The Most Useful Website http://chronicle.com/page/NRC-Rankings/321/

3. NRC 2010 Survey of Research Doctorates GSNB 3 “The Book” A Data-Based Assessment of Research-Doctorate Programs in the United States Jeremiah P. Ostriker, Paul W. Holland, Charlotte V. Kuh, and James A. Voytuk, editors; Committee to Assess Research- Doctorate Programs; National Research Council ISBN: 0-309-15005-1, 296 pages, 8 1/2 x 11, (2010) Download (free) from: http://www.nap.edu/catalog/12850.html

4. NRC 2010 Survey of Research Doctorates GSNB 4 Participation 4,838 doctoral program 212 universities (72% public) + 9 university combinations that offer joint programs (e.g., RU and UMDNJ) 62 fields of study [NOTE: for a field of study to be included, there had to have been at least 500 Ph.D.s awarded between ‘99-’04 by at least 25 universities] 236,417 doctoral students at the time of the study; RU ranked #35, with an average of 254 Ph.D. students between ‘02-’06 Each university paid between $5-$20K to have its data listed in this study

5. NRC 2010 Survey of Research Doctorates GSNB 5 Data Collection from Primary Sources Institutional questionnaire – asked for list of doctoral programs and asked about institution-specific practices Questionnaire to each grad program – list of faculty, and asked about student, faculty and program characteristics Individual faculty questionnaire (87,515 respondents – 88% response rate) – asked about educational, work, research and publication history Student questionnaire sent to advanced doctoral students – focused on student educational background, experiences while in the program, including research activities, and post-graduation plans.

6. NRC 2010 Survey of Research Doctorates GSNB 6 Data Collection from Secondary Sources Publications and citations (all fields except humanities) Data from Science Citation Index; citation count from ‘00-’06 for pubs from ‘81-’06 Humanities pubs and books from ‘96-’06 taken directly from c.v.’s Faculty honors from 224 scholarly societies representing all fields. Highly prestigious awards differentiated from other recognitions. Survey of Earned Doctorates (completed by Ph.D. candidates)

7. NRC 2010 Survey of Research Doctorates GSNB 7 20 Dimensional Measures - Research Publications Average citations per publication Percent of program faculty holding grants Honors and awards per faculty member Interdisciplinarity as measured by the percent of associated faculty, i.e., members of the graduate program who are outside the graduate program’s department [NOTE: this presented problem for RU]

8. NRC 2010 Survey of Research Doctorates GSNB 8 20 Dimensional Measures – Student Funding and Outcomes Average GRE ’04-’06 (verbal for humanities, quantitative for other fields) Percent of students with full support in first year Percent of first year students with external funding Average annual Ph.D.s graduated ’02-’06 (program size – comment on its effect on R vs. S) Average completions (8 yrs humanities; 6 yrs other fields) Time to degree for full- and part-time students Percent Ph.D.s with definite plans for academic positions (including postdocs) ‘01-’05 [based on SED]

9. NRC 2010 Survey of Research Doctorates GSNB 9 20 Dimensional Measures – Student Funding and Outcomes (cont’d) Student workspace (+1 if 100% have work space; -1 if <100% have work space) Health insurance (+1 if health insurance provided; -1 if health insurance not provided) Student activities (orientation, international student orientation, language screening, writing instruction, statistics instruction, awards provided for teaching/research, proposal prep assistance, on-campus conferences, research integrity training, grad student association, posted grievance procedure, mtgs with GPDs, annual review, teaching improvement assistance, travel support for prof mtgs)

10. NRC 2010 Survey of Research Doctorates GSNB 10 20 Dimensional Measures - Diversity Percent non-Asian minority core or new faculty Percent female core or new faculty Percent non-Asian minority students Percent female students Percent international students

11. NRC 2010 Survey of Research Doctorates GSNB 11 NRC Approach to Rankings The committee was keenly aware of the complexity of assessing quality in doctoral programs and chose to approach it in two separate ways. The first, the general survey (S) approach, was to present faculty in a field with characteristics of doctoral programs and ask them to identify the ones they felt were the most important to doctoral program quality. The second, the rating or regression (R) approach, was to ask a sample of faculty to provide ratings (on a scale of 1 to 5) for a representative sample of programs and then to ascertain how, statistically, those ratings were related to the measurable program characteristics. In many cases the rankings that could be inferred from the S approach and the R approach were very similar, but in some cases they were not. Thus the committee decided to publish both the S-based and R-based rankings and encourage users to look beyond the range of rankings on both measures.

12. NRC 2010 Survey of Research Doctorates GSNB 12 Characteristics Included in the Weighting Process CATEGORY I—Program Faculty Quality a. Number of publications (books, articles, etc.) per faculty member b. Number of citations per faculty member c. Receipt of extramural grants for research d. Involvement in interdisciplinary work e. Racial and ethnic diversity of the program faculty f. Gender diversity of the program faculty g. Reception by peers of a faculty member’s work, as measured by honors and awards

13. NRC 2010 Survey of Research Doctorates GSNB 13 Characteristics Included in the Weighting Process (cont’d) CATEGORY II—Student Characteristics a. Median GRE scores of entering students b. Percentage of students receiving full financial support c. Percentage of students with portable fellowships d. Number of student publications and presentations e. Racial and ethnic diversity of the student population f. Gender diversity of the student population g. A high percentage of international students

14. NRC 2010 Survey of Research Doctorates GSNB 14 Characteristics Included in the Weighting Process (cont’d) CATEGORY III—Program Characteristics a. Average number of Ph.D.’s granted over the previous five years b. Percentage of entering students who complete a doctoral degree c. Time to degree d. Placement of students after graduation e. Percentage of students with individual work space f. Percentage of health insurance premiums covered by the institution or program g. Number of student support activities provided at either the institutional or program level

15. NRC 2010 Survey of Research Doctorates GSNB 15 Faculty Importance Weights by Broad Field Faculty Productivity (%) Student Support and Outcomes (%) Program Diversity (%) Agricultural Sciences 45.230.525.1 Biological and Health Sciences 45.131.923.7 Physical and Mathematical Sciences 48.929.722.2 Social and Behavioral Sciences 49.128.223.6 Humanities 46.428.925.6 Engineering 46.531.822.5

16. NRC 2010 Survey of Research Doctorates GSNB 16 Faculty Importance Weights - Research Publications per Faculty Cites per Publication Percent of Faculty with Grants Awards per Faculty Agricultural Sciences 0.3490.1750.3480.128 Biological and Health Sciences 0.3140.1920.3770.118 Physical and Math Sciences 0.2810.2580.2940.167 Social & Behav Sciences 0.3760.2500.2160.158 Humanities 0.591n/a0.1240.284 Engineering 0.2910.2380.3040.167

17. NRC 2010 Survey of Research Doctorates GSNB 17 Faculty Importance Weights – Student Outcomes Full Support - First Year Percent Completion – 6 or 8 Yrs Time to DegreePercent Grads in Academic Positions Agricultural Sciences 0.3040.231-0.1090.357 Biological and Health Sciences 0.2590.264-0.1350.342 Physical and Math Sciences 0.3060.221-0.1140.359 Social & Behav Sciences 0.2910.229-0.1100.370 Humanities 0.3160.245-0.1020.337 Engineering 0.3460.200-0.0990.356

18. NRC 2010 Survey of Research Doctorates GSNB 18 Faculty Importance Weights - Diversity Non-Asian Minority Faculty Female Faculty Non-Asian Minority Students Female Students Internat. Students Agricultural Sciences 0.1010.1240.3480.2310.196 Biol and Health Sciences 0.1150.1730.3620.2350.115 Physical and Math Sciences 0.0590.1440.2000.3180.279 Social & Behav Sciences 0.1560.1500.2980.1660.230 Humanities 0.1720.212 0.1920.213 Engineering 0.0830.1070.2810.2950.234

19. NRC 2010 Survey of Research Doctorates GSNB 19 General Conclusions from the R and S Weightings Indicators of research activity are of the greatest importance to faculty in determining program quality by means of the S measures, which are based on the program characteristics that faculty say explicitly are important. In many cases program size is very important when quality is measured by the regression-based, or R measures. Of the student support and outcome characteristics, placement in an academic position and support in the first year are highly weighted. Completion rates and time to degree are not. Faculty view student diversity as important, when considered with other diversity measures, but not as a direct predictor of overall program quality.

20. NRC 2010 Survey of Research Doctorates GSNB 20 Correlation between R and S Correlation of medians > 0.75 for all fields except: Animal Science Ecology and Evolution Pharmacol, Toxicol, Enviro Health Civil & Enviro Engin Mechanical Engin Operations Res, Systems Engin, Industrial Engin Communication Comparative Lit French Philosophy Spanish Statistics Linguistics Sociology

21. NRC 2010 Survey of Research Doctorates GSNB 21 NRC Methodology – S Ratings Ask faculty to rate how important 20 characteristics are to program quality in their field [NOTE: ~40-50 raters/program] Randomly draw half of faculty importance ratings 500 times to produce 500 ‘direct’ weights Match the direct weights to 500 randomly adjusted sets of normalized program data to rank each program 500 times – these are the overall ‘Survey of Faculty’ ratings (a/k/a the S ratings)

22. NRC 2010 Survey of Research Doctorates GSNB 22 NRC Methodology – R Ratings Ask faculty to rate the quality of a sample of specific programs in their field Randomly draw half of faculty program ratings 500 times to produce 500 ‘regression-based’ weights [NOTE: both principal components and regression analyses were used] Match the regression-based weights to 500 randomly adjusted sets of normalized program data to rank each program 500 times – these are the overall ‘Regression Analysis’ ratings (a/k/a the R ratings)

23. NRC 2010 Survey of Research Doctorates GSNB 23 Highly Ranked RU Programs – 5 th P’tile < 20 ProgramS RankingR RankingResearch Ranking Philosophy 111 History 91213 Compar Lit 20 English 167 Art History 1018 Linguistics 4 French 19 Anthropology 17 Sociology 12 Geography 17 Mathematics 141210 Statistics 11

24. NRC 2010 Survey of Research Doctorates GSNB 24 Highly Ranked RU Programs – 5 th P’tile < 20 ProgramS RankingR RankingResearch Ranking Indust Syst Engineer 2012 Biomed Engineer 16 Entomology 11184 Food Science 922 Nutrition 9155 Ecology & Evolution 20 Plant Science 6 Animal Science 18 Microbiol & MolGen 17212 Physiology 1319 Oceanography 13 Planning & Pub Pol 152012 Communication 112

25. NRC 2010 Survey of Research Doctorates GSNB 25 This is probably something that we shouldn’t do, but...... If you do an ordinal ranking of all universities according to the NUMBER of grad programs at each university that rank in the 5 th percentile (S or R rankings) at 10 or better, then Rutgers ranks at #45 (with 11 programs) If you do an ordinal ranking of all universities according to the PERCENTAGE of grad programs at each university that rank in the 5 th percentile (S or R rankings) at 10 or better, then Rutgers ranks at #81 (at 23.4%)

26. NRC 2010 Survey of Research Doctorates GSNB 26 School of Arts and Sciences

27. NRC 2010 Survey of Research Doctorates GSNB 27 School of Arts & Sciences (Humanities) S Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range History of Art58304336.513 Compar Lit4620382918 English L&L11916443028 French43243730.513 History13792416.515 Linguistics5227413414 Philosophy901534 Spanish6035574622

28. NRC 2010 Survey of Research Doctorates GSNB 28 School of Arts & Sciences (Humanities) R Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range History of Art58103321.523 Compar Lit46213628.515 English L&L1197291822 French4330403510 History137121915.57 Linguistics5242916.525 Philosophy901322 Spanish60315040.519

29. NRC 2010 Survey of Research Doctorates GSNB 29 School of Arts & Sciences (Humanities) Research Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range History of Art58183124.513 Compar Lit46122719.515 English L&L119255238.527 French4319312512 History13713312218 Linguistics5228403412 Philosophy90184.57 Spanish60364741.511

30. NRC 2010 Survey of Research Doctorates GSNB 30 School of Arts & Sciences (Humanities) Student Outcomes Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range History of Art58405145.511 Compar Lit4615352520 English L&L11939876348 French4327373210 History13715654050 Linguistics5217332516 Philosophy9032815.525 Spanish60335242.519

31. NRC 2010 Survey of Research Doctorates GSNB 31 School of Arts & Sciences (Humanities) Diversity Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range History of Art589251716 Compar Lit4641710.513 English L&L11973621.529 French431958 History13741076 Linguistics5213312218 Philosophy90214231.521 Spanish603191116

32. NRC 2010 Survey of Research Doctorates GSNB 32 School of Arts & Sciences (Social Sciences) S Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Anthropology8239635124 Economics117628171.519 Geography4933474014 Political Sci10547675720 Psychology236559876.543 Sociology118315442.523

33. NRC 2010 Survey of Research Doctorates GSNB 33 School of Arts & Sciences (Social Sciences) R Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Anthropology8217473230 Economics11762947832 Geography4921413120 Political Sci105234835.525 Psychology23636825946 Sociology118122518.513

34. NRC 2010 Survey of Research Doctorates GSNB 34 School of Arts & Sciences (Social Sciences) Research Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Anthropology82264937.523 Economics11755776622 Geography4917392822 Political Sci105537262.519 Psychology236508969.539 Sociology118223729.515

35. NRC 2010 Survey of Research Doctorates GSNB 35 School of Arts & Sciences (Social Sciences) Student Outcomes Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Anthropology8269797410 Economics11765998234 Geography494147446 Political Sci105377254.535 Psychology23613419816664 Sociology118659881.533

36. NRC 2010 Survey of Research Doctorates GSNB 36 School of Arts & Sciences (Social Sciences) Diversity Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Anthropology8220403020 Economics117214812 Geography493127.59 Political Sci105366349.527 Psychology23692165128.573 Sociology118397456.535

37. NRC 2010 Survey of Research Doctorates GSNB 37 School of Arts & Sciences (Phys & Math Sci) S Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Chemistry1786913910470 Computer Sci 126661028436 Earth Sci1407211191.539 Mathematics127144127.527 Phys & Astro1604210573.563 Statistics61234232.519

38. NRC 2010 Survey of Research Doctorates GSNB 38 School of Arts & Sciences (Phys & Math Sci) R Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Chemistry1786312895.565 Computer Sci 126468163.535 Earth Sci14045756030 Mathematics127123624 Phys & Astro16030705040 Statistics61274837.521

39. NRC 2010 Survey of Research Doctorates GSNB 39 School of Arts & Sciences (Phys & Math Sci) Research Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Chemistry178411157874 Computer Sci 12642966954 Earth Sci140471017454 Mathematics127103020 Phys & Astro160291036674 Statistics61112819.517

40. NRC 2010 Survey of Research Doctorates GSNB 40 School of Arts & Sciences (Phys & Math Sci) Student Outcomes Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Chemistry1788716112474 Computer Sci 1265610580.549 Earth Sci1406611389.547 Mathematics12736966660 Phys & Astro160501228672 Statistics6132544322

41. NRC 2010 Survey of Research Doctorates GSNB 41 School of Arts & Sciences (Phys & Math Sci) Diversity Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Chemistry17846987252 Computer Sci 12619513532 Earth Sci1407711696.539 Mathematics12755897234 Phys & Astro1604510072.555 Statistics61113824.527

42. NRC 2010 Survey of Research Doctorates GSNB 42 School of Engineering

43. NRC 2010 Survey of Research Doctorates GSNB 43 School of Engineering S Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biomed Engin 7434624828 Chem Engin 10652887036 Civil & EnviroEng 1316212191.559 ECE1365910682.547 Mater Sci Engin 847482788 Mechanical Engin 1288611399.527 Syst Engin & Oper Res 7420423122

44. NRC 2010 Survey of Research Doctorates GSNB 44 School of Engineering R Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biomed Engin 7416322416 Chem Engin 106416854.527 Civil & EnviroEng 131501067856 ECE13650947244 Mater Sci Engin 84466756.521 Mechanical Engin 12858907432 Syst Engin & Oper Res 74346147.527

45. NRC 2010 Survey of Research Doctorates GSNB 45 School of Engineering Research Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biomed Engin 7429654736 Chem Engin 10630725142 Civil & EnviroEng 1314311880.575 ECE13629815552 Mater Sci Engin 8463797116 Mechanical Engin 128671118944 Syst Engin & Oper Res 74123724.525

46. NRC 2010 Survey of Research Doctorates GSNB 46 School of Engineering Student Outcomes Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biomed Engin 74226141.539 Chem Engin 106469570.549 Civil & EnviroEng 131378661.549 ECE13699122110.523 Mater Sci Engin 84447157.527 Mechanical Engin 1289110698.515 Syst Engin & Oper Res 746241518

47. NRC 2010 Survey of Research Doctorates GSNB 47 School of Engineering Diversity Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biomed Engin 74265339.527 Chem Engin 10620503530 Civil & EnviroEng 1315710882.551 ECE13684325.535 Mater Sci Engin 84295642.527 Mechanical Engin 12813292116 Syst Engin & Oper Res 74123523.523

48. NRC 2010 Survey of Research Doctorates GSNB 48 School of Environmental and Biological Sciences

49. NRC 2010 Survey of Research Doctorates GSNB 49 SEBS S Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Animal Science 6031554324 Ecol & Evol94487360.525 Entomology2811251814 Earth Sci (Enviro Sci) 140368761.551 Food Science 4992416.515 Nutrition4492617.517 Plant Science 116237649.553

50. NRC 2010 Survey of Research Doctorates GSNB 50 SEBS R Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Animal Science 6039554716 Ecol & Evol9420463326 Entomology2818282310 Earth Sci (Enviro Sci) 14050907040 Food Science 492179.515 Nutrition44152620.511 Plant Science 11664726.541

51. NRC 2010 Survey of Research Doctorates GSNB 51 SEBS Research Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Animal Science 6018463228 Ecol & Evol9429654736 Entomology2842112.517 Earth Sci (Enviro Sci) 140288456 Food Science 492181016 Nutrition445231418 Plant Science 11623855462

52. NRC 2010 Survey of Research Doctorates GSNB 52 SEBS Student Outcomes Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Animal Science 6029514022 Ecol & Evol9444806236 Entomology281925226 Earth Sci (Enviro Sci) 140711139242 Food Science 49303130.51 Nutrition443231320 Plant Science 116115231.541

53. NRC 2010 Survey of Research Doctorates GSNB 53 SEBS Diversity Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Animal Science 6061912.513 Ecol & Evol9438665228 Entomology281622196 Earth Sci (Enviro Sci) 140224935.527 Food Science 4910201510 Nutrition44112618.515 Plant Science 116447157.527

54. NRC 2010 Survey of Research Doctorates GSNB 54 Interunit Life Science Programs

55. NRC 2010 Survey of Research Doctorates GSNB 55 Life Sciences (Interunit Programs) S Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biochem, Biophys, Struc Biol 159361006864 Cell Devel Biol 122441027358 Microbiology7417453128 Pharmacol, Toxicol, Enviro Health 116801109530 Physiology6313432830

56. NRC 2010 Survey of Research Doctorates GSNB 56 Life Sciences (Interunit Programs) R Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biochem, Biophys, Struc Biol 15927755148 Cell Devel Biol 1227911496.535 Microbiology742181016 Pharmacol, Toxicol, Enviro Health 116248554.561 Physiology63195637.537

57. NRC 2010 Survey of Research Doctorates GSNB 57 Life Sciences (Interunit Programs) Research Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biochem, Biophys, Struc Biol 159271016474 Cell Devel Biol 1223610369.567 Microbiology74124729.535 Pharmacol, Toxicol, Enviro Health 11626946068 Physiology6328564228

58. NRC 2010 Survey of Research Doctorates GSNB 58 Life Sciences (Interunit Programs) Student Outcomes Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biochem, Biophys, Struc Biol 159631259462 Cell Devel Biol 122249157.567 Microbiology74326347.531 Pharmacol, Toxicol, Enviro Health 11610511511010 Physiology635352030

59. NRC 2010 Survey of Research Doctorates GSNB 59 Life Sciences (Interunit Programs) Diversity Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Biochem, Biophys, Struc Biol 1599231614 Cell Devel Biol 12215493234 Microbiology7411312120 Pharmacol, Toxicol, Enviro Health 11625694744 Physiology6313332320

60. NRC 2010 Survey of Research Doctorates GSNB 60 Other Programs

61. NRC 2010 Survey of Research Doctorates GSNB 61 Other Programs S Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Oceanogr & Atmos Sci 50134428.531 Communic8333614728 Pub Affairs, Pub Policy, Pub Admin 5415312316 Music63465952.513

62. NRC 2010 Survey of Research Doctorates GSNB 62 Other Programs R Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Oceanogr & Atmos Sci 50224131.519 Communic831 4282 Pub Affairs, Pub Policy, Pub Admin 54203527.515 Music63315241.521

63. NRC 2010 Survey of Research Doctorates GSNB 63 Other Programs Research Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Oceanogr & Atmos Sci 5094426.535 Communic83122317.511 Pub Affairs, Pub Policy, Pub Admin 54122518.513 Music63214030.519

64. NRC 2010 Survey of Research Doctorates GSNB 64 Other Programs Student Outcomes Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Oceanogr & Atmos Sci 5027453618 Communic837581786 Pub Affairs, Pub Policy, Pub Admin 54193627.517 Music634351478

65. NRC 2010 Survey of Research Doctorates GSNB 65 Other Programs Diversity Rankings FieldNumber of Programs 5 th P’tile95 th P’tileInterp. Median 90% Range Oceanogr & Atmos Sci 505191214 Communic83316045.529 Pub Affairs, Pub Policy, Pub Admin 54263731.511 Music63405346.513

66. NRC 2010 Survey of Research Doctorates GSNB 66 Comparisons of Graduate Programs http://graduate-school.phds.org/about/rankings

67. NRC 2010 Survey of Research Doctorates GSNB 67 General Conclusions Program size is positively associated with most measures of the research productivity of doctoral programs, even when productivity is measured on a per capita basis. As for student characteristics, the larger programs are also more likely to have higher average GRE scores, except in the humanities. There is a size difference for median time to degree; students in the larger programs take about half a year longer to complete their degrees. In the physical and social sciences a significantly greater percentage of large programs collect outcomes data for their students. Interestingly, size, analyzed within broad fields, does not appear to be associated systematically with the percentage of students with support in their first year, which is high across the board, or completion rates, or the percentage of students who plan on a position in academia (including postdoctoral study) after graduation.

68. NRC 2010 Survey of Research Doctorates GSNB 68 How Can We Assist You? Rob Heffernan has produced numerous tables that analyze the NRC data. These are available. Comparisons of Rutgers program-specific variables against mean/std dev for all other grad programs in the same field (viz., publications per allocated faculty member, citations per publication, percent of faculty with grants, awards per allocated faculty member, faculty interdisciplinarity, percent first year students with full support, completion rate, time to degree, percent underrepresented minority faculty, percent female faculty, percent underrepresented minority students, percent female students, percent international students, number of students who graduated, GRE scores, number of student activities kukor@aesop.rutgers.edu

69. NRC 2010 Survey of Research Doctorates GSNB 69 Other Helpful Websites http://graduate-school.phds.org/about/ranges http://graduate-school.phds.org/about/quality_scores http://chronicle.com/article/New-Doctoral-Program-Rankings- /124634/?sid=at&utm_source=at&utm_medium=enhttp://chronicle.com/article/New-Doctoral-Program-Rankings- /124634/?sid=at&utm_source=at&utm_medium=en http://chronicle.com/page/2010-Rankings- Doctoral/321/?sid=pm&utm_source=pm&utm_medium=enhttp://chronicle.com/page/2010-Rankings- Doctoral/321/?sid=pm&utm_source=pm&utm_medium=en http://chronicle.com/article/New-Doctoral-Program-Rankings- /124634/http://chronicle.com/article/New-Doctoral-Program-Rankings- /124634/

70. NRC 2010 Survey of Research Doctorates GSNB 70 Supplemental Slides

71. NRC 2010 Survey of Research Doctorates GSNB 71 Data Collection from Primary Sources Institutional questionnaire – asked for list of doctoral programs and asked about institution-specific practices (viz., health benefits, collective bargaining, definition of A.Y., doctoral student representation [race/ethnicity] in 5 broad categories [life sci., phy. sci. & math, engin., soc. sci., humanities]

72. NRC 2010 Survey of Research Doctorates GSNB 72 Data Collection from Primary Sources (cont’d) Questionnaire to each grad program (4,838 programs) – list of faculty, and asked about student, faculty and program characteristics English (hum.), ChemE (engin.), Econ (soc.sci.), Physics (phys.sci.) and Neuroscience (life sci.) were asked to provide list of advanced doctoral students Faculty were divided into Core, New and Associated – NRC definition presented problem for RU

73. NRC 2010 Survey of Research Doctorates GSNB 73 Data Collection from Primary Sources (cont’d) Grad program questionnaire (cont’d) – info collected on faculty and student gender, race/ethnicity, number of students in program, number of doctoral degrees awarded per year, time to degree completion, admits/enrolled, definition of full- time status, candidacy requirements, GRE scores, whether TA experience is required, TA obligations, employment assistance and outcomes, availability of workspace for each student, financial support.

74. NRC 2010 Survey of Research Doctorates GSNB 74 Data Collection from Primary Sources (cont’d) Individual faculty questionnaire (87,515 respondents – 88% response rate) – asked about educational, work, research and publication history Important part of this questionnaire was section that asked faculty to identify those factors which they thought were critical to the quality of doctoral education in their field Faculty were also asked if they would be willing to rate other programs within their field If a faculty member participates in more than one grad program, the faculty member was allocated according to the number of dissertations supervised in each program; effort could not exceed 100%

75. NRC 2010 Survey of Research Doctorates GSNB 75 Data Collection from Primary Sources (cont’d) Student questionnaire sent to advanced doctoral students (i.e., admitted to candidacy) in the fields noted above (11,888 responses – 73% response rate) – focused on student educational background, experiences while in the program, including research activities, and post-graduation plans. Rating questionnaire sent to a stratified sample of faculty who agreed to be raters of doctoral programs in their field.

76. NRC 2010 Survey of Research Doctorates GSNB 76