1. Methodological Issues in Survey Research Jeremy McMillen, James Randy McBroom, Barbara Langham, Texas A&M University-Commerce

2. Survey Research Methods Mail Surveys (postal service, campus alternatives) E-Surveys (e-mail initiated, mail initiated) Telephone On-Site Variations Hybrid and Combination (example, mail survey with internet response option)

3. Graduating Student Survey – Internet Purposes – Support Strategic Planning – SACS Accreditation – Program, Department Review – Student Services Review – “Customer Satisfaction” Report Component – Retention, Graduation Issues

4. Graduating Student Survey-Internet Population – All Students Graduating in Spring, 2001 (N=646) Initial Contact – Letter from University President Containing: – Request to Complete Questionnaire – Web-Site of Questionnaire – Instructions, Including Password, Implied Consent Notice, and Incentive Notice ($100 Savings Bond)

5. Graduating Student Survey-Internet Questionnaire: 52 Item Instrument on Web-Site with Direct Data Entry Case-Control: Minimal Follow-Up: Letter After 3 Weeks to All Cost: – Monetary: $ 200 – Personnel Hours: 10 Response Rate: 19.2% Time Frame: 6 weeks

6. Graduate Student Engagement Survey- Mail Purposes – Outgrowth of National Survey of Student Engagement – Large, Diverse Graduate Student Population (Masters and Doctoral) – Lack of Information on Graduate Students – SACS Accreditation – Support Strategic Planning

7. Graduate Student Engagement Survey- Mail Population – All Degree Seeking Graduate Students (Masters and Doctoral) Enrolled in Spring, 2001 (N=1,648) Sampling Procedure – Stratified Random Sampling, Doctoral Students Weighted Final Sample Size – 666 Total (548 Masters, 118 Doctoral)

8. Graduate Student Engagement Survey- Mail Initial Contact – Mailed Package from Researcher Containing: – Cover Letter with Instructions, Implied Consent Notice – 83 Item Questionnaire – Stamped, Addressed Return Envelope – Coded Case-Control Postcard

9. Graduate Student Engagement Survey- Mail Questionnaire: 83 Item Instrument Case-Control: Coded Post Card Follow-Up: Entire Package to Non-Respondents After 3 Weeks Cost: – Monetary: $ 1,200 – Personnel Hours: 120 Hours (Approximately) Response Rate: 50% Time Frame: 9 Weeks

10. Comparison of Methods Internet – Incentive ($100) – Minimal Case-Control – Follow-Up 3 Weeks – Cost $200 10 Hours – Time Frame 6 Weeks – Response Rate 19.2% Mail-Out – No Monetary Incentive – Good Case-Control – Follow-Up 3 Weeks – Cost $1,200 120 Hours – Time Frame 9 Weeks – Response Rate 50%

11. Conclusion Internet – Advantages and Disadvantages Mail-Out – Advantages and Disadvantages

12. Contacts Jeremy McMillen, Director of Institutional Research jeremy_mcmillen@tamu-commerce.edu (903)886-5509 Randy McBroom, Assistant to the President for Planning and Institutional Effectiveness randy_mcbroom@tamu-commerce.edu (903)886-5926 Barbara Langham, Assistant Data Analyst, Office of Institutional Research barbara_langham@tamu-commerce.edu (903)468-3149 Texas A&M University-Commerce P.O. Box 3011 Commerce, TX 75429-3011