Enterprise-wide Survey Software Management Systems and Response Rates Analysis and Strategies: Results from membership survey Presenter: Victoria Porterfield.

Slides:

Advertisements

Similar presentations

Developing a distinctive approach to the Academys work in Scotland Alastair Robertson Senior Adviser, Scotland Presentation at University of Stirling,

Advertisements

UCSC History. UCSC: A brief history 60s University Placement Committee A lot of field trips/interaction with employers.

Learning through Service Community Service-Learning at the University of Guelph Cheryl Rose, CSL Specialist, Student Life Executive Director, Canadian.

The Student Experience at Risk: Government Policy in the Measurement and Enhancement of Student Experience Dr Laura Hougaz Study Connections, ACPET Assoc.

In medieval times, a preceptor shared his knowledge with his students

2008 National Survey of Student Engagement – SUNY Oneonta Patty Francis Steve Perry Fall 2008.

Maximizing Your NSSE & CCSSE Results

2012 National Survey of Student Engagement Jeremy D. Penn & John D. Hathcoat.

April 2010 Minnesota’s P-20 Statewide Longitudinal Education Data System (SLEDS) Minnesota Office of Higher Education.

Rhianna R. Andrews, MSW, Whitney L. Benakis MSW, Anissa T. Cox, MED Association University Center of Disabilities, University of Missouri, Columbia, MO.

Assessing Undergraduate Sustainability Knowledge Campus Wide: Adam Zwickle - OSU Tomas Koontz - OSU Andrew Bodine - OSU Mark Stewart – UMD Nicole Horvath.

Measuring the Impact of Service-Learning on Student Retention and Civic Skills Matthew Roy, Ph.D. Assistant Vice Chancellor for Civic Engagement University.

Standards for Qualitative Research in Education

1 Student Characteristics And Measurements of Student Satisfaction Prepared for: The Faculty Council Subcommittee on Retention The Office of Institutional.

Promoting Student Engagement: Involving Students with NSSE Planning and Results William Woods University NSSE Users’ Workshop October 6-7, 2005.

UST Exempt Staff Council A series of forums for exempt staff to discuss a proposed new university committee Richelle Wesley, Associate University Registrar.

Introduction ENHANCING EDUCATION THROUGH PARTNERSHIPS WITH UTILITIES Sharon A. Jones, PE, PhD--Lafayette College 1 Amy Zander--Clarkson University 2 Douglas.

National Research Agenda to Support Transformation National Learning Infrastructure Initiative Focus Session June, 2003 Copyright Jillian Kinzie, 2003.

MSU Student Evaluations of Advising (NSSE) Chris Fastnow Office of Planning and Analysis January 15, 2009.

A Report on Progress toward the Strategic Goals Presented to the Valencia District Board of Trustees on behalf of the College Planning Council.

Student Services Assessment Lee Gordon Assistant Vice President for Student Services Purdue University.

Want to be first in your CLASSE? Investigating Student Engagement in Your Courses Want to be first in your CLASSE? Investigating Student Engagement in.

Connecting Work and Academics: How Students and Employers Benefit.

Assessment Surveys July 22, 2004 Chancellor’s Meeting.

Report of the Results of the Faculty Survey of Student Engagement William E. Knight and Jie Wu Office of Institutional Research Presentation to the Faculty.

A member of the Minnesota State Colleges and Universities system, Bemidji State University is an affirmative action, equal opportunity employer and educator.

Results of AUC’s NSSE Administration in 2011 Office of Institutional Research February 9, 2012.

Presentation of Results NSSE 2003 Florida Gulf Coast University Office of Planning and Institutional Performance.

Starting Student Chapters. Agenda Outreach Develop Student Chapter Startup Documents Coordinate with Student Chapter Sponsor Approval Coordinate with.

Before & After: What Undergraduates and Alumni Say About Their College Experience and Outcomes Angie L. Miller, NSSE & SNAAP Research Analyst Amber D.

Campus Forum on Institutional Accreditation HLC Team December 3, 2013.

International Strategic Enrolment Management at the University of Victoria 2015 BCCIE Summer Seminar Carolyn Russell, Director, Student Recruitment and.

How to Write a Critical Review of Research Articles

Lesli Scott Ashley Bowers Sue Ellen Hansen Robin Tepper Jacob Survey Research Center, University of Michigan Third International Conference on Establishment.

Key features of the University of Manchester Professor Cathy Cassell Deputy Director (Academic) Sarah Featherstone Head of Undergraduate Services Original.

Assessing SAGES with NSSE data Office of Institutional Research September 25 th, 2007.

National Survey of Student Engagement 2009 Missouri Valley College January 6, 2010.

From Cyclical to Continuous Improvement: Assessment Feedback and Program Metrics Derek J. Herrmann, Coordinator of University Assessment Services Kristen.

STUDENT RECRUITING PROGRAM ANALYSIS Instructional Systems Graduate Program.

Ann Campion Riley University of Missouri

NATIONAL SURVEY OF STUDENT ENGAGEMENT AT IU KOKOMO Administrative Council 26 September 2007.

Community College Survey of Student Engagement (CCSSE) Benchmarks of Effective Educational Practice Summary Report Background: The Community College Survey.

Monitoring public satisfaction through user satisfaction surveys Committee for the Coordination of Statistical Activities Helsinki 6-7 May 2010 Steve.

What could we learn from learning outcomes assessment programs in the U.S public research universities? Samuel S. Peng Center for Educational Research.

LEAPSE Kenny Lynch & Lindsey McEwen University of Gloucestershire RGS-IBG Annual Conference 2 nd September 2010 Student community engagement and employability.

6 th Annual Conference ~ Minneapolis Welcome To Minneapolis.

Georgia Tech-NSF ADVANCE Institutional Transformation Program Mary Lynn Realff, Director and Co-PI March 31, 2005.

Hugo Horta Center for the Advancement of Higher Education, Tohoku University Japan CIES-ISCTE, Portugal.

Bonds and bridges: The relative importance of relations with peers and faculty for college student achievement Sandra Dika, PhD Assistant Research Professor.

RESULTS OF THE 2009 ADMINISTRATION OF THE COMMUNITYCOLLEGE SURVEY OF STUDENT ENGAGEMENT Office of Institutional Effectiveness, April 2010.

Our Story: Our Story: The Story of One Student Affairs Division’s Quest to Improve Assessment Don Whalen, Coordinator of Assessment, Department of Residence.

Evaluating Efforts to Support Collaborative Research: Lessons Learned from the AHRQ MCC Research Network Jessie Gerteis, MPH Abt Associates, Inc. 27 th.

Let Quality Guide Quality Evaluation Recent Trends Implemented in the Middle East.

Shimon Sarraf Jennifer Brooks James Cole Xiaolin Wang National Survey of Student Engagement Indiana University Bloomington What is the Impact of Smartphone.

CSWE Overview This resource highlights key aspects of the mission of the Commission on Research and its goals for the next 5 years. It will then.

The Committee will: Assess and report on technology resources, status and needs. Create concept papers in support of strategic directions approved by.

2009 C OMMUNITY C OLLEGE S URVEY OF S TUDENT E NGAGEMENT & F ACULTY S URVEY OF S TUDENT E NGAGEMENT RESULTS FOR IVCC (CCSSE AND CCFSSE) Cathy Bangert &

Academic Program Needs Assessment Report An Overview Presented by: S.J. Sethi, Ph.D. Executive Director Office of Institutional Research & Effectiveness.

Information Retention in e-Learning De Leon Kimberly Obonyo Carolyne Penn John Yang Xiaoyan.

ASCCC Cultural Competency and Advocacy Plan Update Cleavon Smith, Berkeley City College Carolyn Holcroft, Foothill College.

Faculty Senate Pat Hulsebosch, Office of Academic Quality 11/17/08.

Alumni Survey March 2009.

A nationwide US student survey

Rose Krebill-Prather, PhD

The University of Texas System Assessment of

ACADEMIC PERFORMANCE Presentation to the UNC–Chapel Hill Faculty Council January 27, 2017 James W. Dean, Jr. Executive Vice Chancellor and Provost.

Derek Herrmann & Ryan Smith University Assessment Services

The Heart of Student Success

Tuesday, March 12, 2019 | – 12:20 PM – 1:10 PM

SACS Coordinators Meeting Academic Units

Presentation transcript:

Enterprise-wide Survey Software Management Systems and Response Rates Analysis and Strategies: Results from membership survey Presenter: Victoria Porterfield Office of Institutional Research and Academic Planning Rutgers – The State University of New Jersey

Enterprise-wide Survey Software and Response Rates Overview of Declining Response Rates Much of the research conducted on survey response rates, including higher education surveys, has witnessed a decline of response rates. –Fosnacht, Sarraf, Howe & Peck (2013) –National Research Council (2013) –National Survey of Student Engagement (2014) –Sax, Gilmartinn, & Bryant (2003) Web surveys have particularly suffered in recent years –Dillman, Phelps, Tortora, Swift, Kohrell, Berck, & Messer (2009) –Manfreda, Berzelak, Haas, & Vehovar (2008) –Petchenik & Watermolen (2011)

Enterprise-wide Survey Software and Response Rates Why this study was done? Overall, response rates for SERU have declined over time Two possible contributors: –General survey fatigue –Enterprise-wide survey software which has become increasingly available at higher education institutions in recent years

Enterprise-wide Survey Software and Response Rates General survey fatigue

Enterprise-wide Survey Software and Response Rates Enterprise-wide survey software There are positives with enterprise-wide survey software –Easier to develop social science research –Cheaper to develop social science research –Many of the same enterprise-wide survey software products are used at different institutions (i.e. Qualtrics), which can be used to collaborate surveys with other institutions But…. –With increased access to survey software, there are more surveys which can contribute to survey fatigue

Enterprise-wide Survey Software and Response Rates Enterprise-wide survey software What are the response rate differences before and after the survey software became more available?

Enterprise-wide Survey Software and Response Rates Enterprise-wide survey software But can’t these differences be attributed to general survey fatigue? Certainly! Therefore, the access of each institution’s enterprise-wide survey software was evaluated. Three schools have “high coordination” efforts –Clear and prominent terms of use policy –Formal survey coordination committee –Limits on access Three schools have “low coordination” efforts –May require IRB but otherwise can gain access

Enterprise-wide Survey Software and Response Rates Enterprise-wide survey software 2-sample t-tests revealed significant differences between each group

Enterprise-wide Survey Software and Response Rates Conclusions For the most part, SERU response rates are declining –General survey fatigue is hurting response rates –Enterprise-wide survey software may be hurting response rates if coordination/restrictions are not employed across campus Further research with more institutions is recommended to learn more about the intertwining relationship with survey fatigue, enterprise-wide software, and response rates.

Enterprise-wide Survey Software and Response Rates Questions? Comments? Special thanks to Iowa, Minnesota, Pittsburgh, Texas A&M, and Washington for participating in this study Contact information: Victoria Porterfield

Enterprise-wide Survey Software and Response Rates References Dillman, D. A., Phelps, G., Tortora, R., Swift, K., Kohrell, J., Berck, J., & Messer, B. L. (2009). Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internetq. Social Science Research, 38, Fosnacht, K., Sarraf, S., Howe, E., & Peck, L. (2013). How important are high response rates for college surveys? Paper presented at the annual forum of the Association for Institutional Research, Long Beach, CA. Manfreda, K. L., Bosnjak, M., Berzelak, J., Haas, I., & Vehovar, V. (2008). Web surveys versus other survey modes. A meta-analysis comparing response rates. International Journal of Market Research, 50(1), 79–104 National Research Council. (2013). Nonresponse in social science surveys: A research agenda. Washington, DC: The National Academies Press National Survey of Student Engagement. (2014). NSSE 2014 U.S. response rates by institutional characteristics. Petchenik, J., & Watermolen, D. J. (2011). A cautionary note on using the Internet to survey recent hunter education graduates. Human Dimensions of Wildlife 16(3): Sax, L. J., Gilmartin, S. K., & Bryant, A. N. (2003). Assessing Response Rates and Nonresponse Bias in Web and Paper Surveys. Research in Higher Education, 44 (4), 409–432.