Www.monash.edu.au Platform Influences on Survey Delivery and Response Rate Presenter Phillip Adams Evaluations Manager Australasian Higher Education Evaluation.

Slides:



Advertisements
Similar presentations
EFFECTS OF BOLOGNA PROCESS ON GEOGRAPHY DEPARTMENTS IN TURKISH UNIVERSITIES Dr. Yilmaz Ari Department of Geography, Balikesir University, Turkey. Future.
Advertisements

USDA May 21, 2003 Sustainable Rangelands Roundtable.
The Africa Action Plan An IEG Evaluation CSO Forum April 15, 2011.
Development Data Platform Vilas Mandlekar DECDG e-DevelopmentThematic Group March 24, 2005.
Increasing information literacy at NTNU and St.Olavs Hospital Implementation of an e-learning tool Karen Johanne Buset Sigvor Kvale NTNU Library, Trondheim,
THE GLOBAL FRAMEWORK FOR CLIMATE SERVICES: NEXT STEPS Geoff Love Director, Responsible for the Taskforce Secretariat World Meteorological Organization.
1 Measuring ICT4D: ITUs Focus on Household and Individual Market, Economics & Finance Unit Telecommunication Development Bureau.
Dr David Nicol Project Director Centre for Academic Practice University of Strathclyde Re-engineering Assessment Practices in Scottish.
INDIANA UNIVERSITY LIBRARIES Enabling the library in university systems Trial and evaluation in the use of library services away from the library Chris.
Options appraisal, the business case & procurement
Building online support for HE teachers as digital innovators Diana Laurillard London Knowledge Lab Institute of Education OER in the disciplines 26 October.
HERODOT International Conference: Torun, Poland 2-5 September Tuning and European Higher Education Geography Kevin Crawford & Karl Donert Liverpool.
Student Engagement: Indicators 5, 6 and 7 Dr Sarah Williamson Head of Learning and Teaching Support and Sarah Ingram Student Voice Officer
Quality management in Higher education area-overview of projects
A-G Updates and the New Piece of the Puzzle: Common Core Monica H. Lin, Ph.D. Associate Director of Undergraduate Admissions University of California |
SPEAQ Workshop Practitioner-led quality assurance and enhancement UNIVERSITY OF SOUTHAMPTON LLAS Centre, Faculty of Humanities Southampton SO17 1BJ
Learning from ELIR: piloting a new approach Thelma Barron, Assistant Director, QAA Scotland.
The University of Priština, temporary settled in Kosovska Mitrovica (UPKM) Danijela Kulić, assistant lecturer, Faculty of Philosophy Nemanja Vasić, assistant.
Agent-Based Architecture for Intelligence and Collaboration in Virtual Learning Environments Punyanuch Borwarnginn 5 August 2013.
Holistic professional learning: e-portfolios for academic development in higher education Belinda Allen Learning and Teaching Unit UNSW.
Smarter learning Professor Hamish Coates
The University of Melbourne > Centre for the Study of Higher Education The Sessional Staff Project at The University of Melbourne National Colloquium:
DEPARTMENT OF EMPLOYMENT, EDUCATION AND TRAINING Diversity, inclusion and participation.
Online learning projects Some critical factors Prepared by: Paul Trahair 29 August 2003.
Does good policy mean good practice? Release was granted by these university students.
Assuring quality at La Trobe AUQA – WHAT DOES IT MEAN FOR YOU?
Assessing Student Learning Outcomes In the Context of SACS Re-accreditation Standards Presentation to the Dean’s Council September 2, 2004.
Developing an Effective Tracking and Improvement System for Learning and Teaching Achievements and Future Challenges in Maintaining Academic Standards.
Security Education and Awareness Workshop January 15-16, 2004 Baltimore, MD.
ARMENIA: Quality Assurance (QA) and National Qualifications Framework (NQF) Tbilisi Regional Seminar on Quality Management in the Context of National.
Delivering Planning Education Now and in the Future Ruth Richards London South Bank University.
The Student Experience at Risk: Government Policy in the Measurement and Enhancement of Student Experience Dr Laura Hougaz Study Connections, ACPET Assoc.
Student Leadership in Curriculum Development and Reform project Presented by Kylie Jackson - Project Manager (UWS) Supported by the Australian Government.
Reading Rodski: User Surveys Revisited The 25 th IATUL Annual Conference Krakow 2004 Dr. Grace Saw University of Queensland Cybrary Brisbane, Australia.
Your Life Your Choice Your Life Your Choice was launched by the Premier and Minister for Communities, Child Safety and Disability Services in September.
An Investigation of Ebook Lending in UK Public Libraries Christopher Gibson Department of Computer and Information Sciences University of Strathclyde
International Telecommunication Union Committed to connecting the world ITU ACADEMY Jaroslaw Ponder
1 Development of National Qualification Frameworks Gerald Burke Monash University – ACER Centre for the Economics of Education and Training (CEET) Regional.
Standards and Guidelines for Quality Assurance in the European
ELECTRONIC DATA COLLECTION SYSTEM Howard Hamilton.
WebQuilt and Mobile Devices: A Web Usability Testing and Analysis Tool for the Mobile Internet Tara Matthews Seattle University April 5, 2001 Faculty Mentor:
Oman’s System of Quality Management for Higher Education
Georgia Tech Research on Accessible Distance Education (GRADE) Robert L. Todd, Project Director.
Blackboard Strategies: Using Blackboard Pedagogically.
QS 702 Phase II: Encouraging the Integration of Technology Into Higher Education.
Data collection and analytics......applied to crop surveys, market surveys, maintenance... Technology Case Study a Multi forms feed into a web-based monitoring.
ACJRD 16 th Annual Conference 4 th October  2007: Prevention and Early Intervention Programme, funded by DYCA and The Atlantic Philanthropies;
 This prepares educators to work in P-12 schools (1)  It provides direction (1)  It is knowledge-based, articulated, shared, coherent, consistent with.
On-Line Discussion Forums: New Platforms to supplement Professional Development at Walter Sisulu University BY Z.G.Baleni RPL Manager 10/16/20151.
Report on the Benchmarking Study Evaluation 2006 Margarita Moreno, Manager Document Supply Service National Library of Australia.
Unit 1 – Preparation for Assessment 1.2 Discuss approaches to auditing the capabilities and capacity of an college in or der to evaluate its readiness.
Intel ® Teach to the Future Pre Service Evaluation across Asia - Gaining the Country Perspective - Deakin University Faculty of Education Consultancy and.
The Use of Blogs in Learning and Teaching E-Learning Conference East London International Convention Centre 31 October – 1 November 2011 Mmampho Gogela.
Revamping GXEX1401 Nor Edzan Che Nasir University of Malaya.
How to use blocks to improve the teaching and learning experience January 2013.
Beyond WCAG: Experiences in Implementing BS 8878 E.A. Draffan with thanks to Ronise Nepomuceno.
Teaching in teams: lessons from systematic review training NCRM Training the Trainers Event 4 th June 2007 Angela Harden and Karen Bird MRS Node EPPI Centre,
Crystal Scales of Justice Friday 23 October 2015 Judicial Institute for Scotland Introducing the Judicial Hub A digital transformation project Sheriff.
Dept of Science and Technology Education, Faculty of Education
ASSESSING THE IMPACT OF THE E- LEARNING STRATEGY IMPLEMENTATION AT WALTER SISULU UNIVERSITY Presenter: T. Mayisela E-learning Specialist Mthatha Campus;
LibQUAL+ ® Survey Administration LibQUAL+® Exchange Northumbria Florence, Italy August 17, 2009 Presented by: Martha Kyrillidou Senior Director, Statistics.
Queensland University of Technology CRICOS No J HOW RESEARCHERS FIND INFORMATION IN THE NEW DIGITAL AGE Gaynor Austen Director, Library Services.
A centre of expertise in digital information managementwww.ukoln.ac.uk UKOLN is supported by: Effective Web Site Training Workshop: Benchmarking Web Sites.
19 NOVEMBER 2014: PORTFOLIO COMMITTEE The Presidency Department of Planning Monitoring and Evaluation THE PRESIDENTIAL HOTLINE.
Learning Management System Selection Framework Learning Management System Selection Committee Prepared by the Process Advisory Committee.
Let Quality Guide Quality Evaluation Recent Trends Implemented in the Middle East.
LAMS: The Learning Activity Management System James Dalziel Professor of Learning Technology & Director, Macquarie E-Learning Centre Of Excellence (MELCOE)
QAA COLLABORATIVE PROVISION AUDIT DRAFT REPORT. QAA CPA Process Submission by the University of Self Evaluation Document (SED) (December 2005) Selection.
Massimo Rimondi - CINECA - EQUASP IT coordinator
Tools for Infusing QM Standards into the Course Development Process
Presentation transcript:

Platform Influences on Survey Delivery and Response Rate Presenter Phillip Adams Evaluations Manager Australasian Higher Education Evaluation Forum 2008 Friday 2 October, 2008

Presentation Outline CHEQ (Centre for Higher Education Quality) The Way We Were The Response The Outcomes

CHEQ Established in September 2000 Lead and support quality assurance and improvement various areas of teaching, research, research training and support services

The Evolution Two drivers for the change – Quality was an integral part of the higher education sector Need for institutional measures of academic activity

Unit Evaluations The way we were 1998 – 2002 item bank academics create own survey 2002 – 2004 faculty takes responsibility faculty-wide questionnaire conduct at least every five years

The issues 1998 – 2002 singular, aggregated report per unit/subject no university benchmarking capacity

The issues 2002 – 2004 patchy take up saw mix of academic & faculty reports still no university benchmarking capacity few opportunities for monitoring improvement

Major change in common items across university Up to 10 faculty items To be taken of each unit each year it is offered Results posted on a common website Results to be systematically considered by faculty

Re-engineering Technology And Processes both paper-based and online surveys for all units large volume of survey responses in short turnaround time system capable of storing data in any survey, online or paper, in single location improved access to results for staff and key stakeholders reduced cost of survey development and processing allowed automated reporting on WWW 2005, CHEQ introduced Survey Management System (SMS). Significant benefits from change in technology and processes:

PDF survey Benefits able to fill in without downloading presentation appealing Drawbacks practically clumsy poor accessibility for visually impaired

PDF survey limitations Three main types of student queries/complaints students unfamiliar with a fillable PDF browser version incompatibilities web browser setup Plus lack of accessibility for visually impaired disenfranchised students

Our response prepared “how-to” information sheets initially assisted VI over phone and with customised survey shifted from PDF to HTML form

Outcomes student familiarity accessible for visually impaired assisted over phone special form design considerations No browser compatibility issues

Outcomes Zero complaints about access

Outcomes Increase in web based response rate

Conclusion Quality cycle relies on the effectiveness of the evaluation system Better meet the needs of stakeholders Survey more user friendly Positive influence on response rate