How should we measure & show online learning? Tim O’Riordan Web and Internet Science (WAIS) www.ecs.soton.ac.uk/people/tor1w07.

Slides:



Advertisements
Similar presentations
Teaching for Higher Order Outcomes Peter Ling June 2012.
Advertisements

‘What is it and how could it help me and my pupils?’
Discourse Analysis of Students’ Research Papers Roman Taraban Texas Tech University July 2010.
Designing and Planning a Teaching Session This document is licensed under the Attribution-NonCommercial-ShareAlike 2.0 UK: England & Wales license, available.
Well written objectives will… Provide clear direction for instruction Convey what is to be learned to students Provide a clear guide for assessment.
ORIC – Open Educational Resources for the Inclusive Curriculum 1 This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike.
SCIS Oration We are pleased to sponsor Joy McGregor for the SCIS Oration.
Increasing Doctoral Student Persistence: Strategies for Fostering Community Amanda J. Rockinson-Szapkiw, LPC, Ed.D. Lucinda S. Spaulding, Ph.D. School.
MJM22 Digital Practice and Pedagogy Week 3 What is e-learning?
Learning Taxonomies Bloom’s Taxonomy
IRMA WWW-BASED SEMINAR AS A PART OF KNOWLEDGE WORK COURSE: IS IT WORTH IT? Pekka Makkonen University of Jyväskylä Information Systems Science Finland.
DSI WWW-BASED SEMINAR AS A PART OF KNOWLEDGE WORK COURSE: WHO BENEFITS FROM IT? Pekka Makkonen University of Jyväskylä Information Systems Science.
Investigating Relationships among Elements of Interaction, Presence, and Student Learning in a Graduate Online Course Lydia Kyei-Blankson, Department of.
ABC Curriculum Showcase Coventry Public Schools February 10, 2009 An introduction for parents and community members Left click your mouse to advance to.
A Framework for Analysing Critical Thinking in Computer Conferencing EURO-CSCL, Maastricht March 22, 2001 Walter Archer.
Online databases and Media Literacy Amy Power February 2013.
COMMUNICATION STRATEGIES IN ONLINE ENVIRONMENTS. WELCOME o Facilitator name Position at university Contact info.
WEB 2.00 AND TEACHING CURRICULUM BY : KAMBIZ ASKARPOUR.
Marie-Luce Bourguet Projects in the areas of: Multimedia processing Multimedia / Web design.
Health Sciences and Practice & Medicine Dentistry and Veterinary Medicine Higher Education Academy Subject Centres Karen Campbell Macmillan Lecturer in.
College Reading and Learning Association Conference Richmond, VA 10/29/09.
Biggs’ Constructive Alignment: Evaluation of a Pedagogical Model Applied to a Web Course
Mary Pat Wenderoth Department of Biology University of Washington Learning Taxonomies What are they? Why use them? Scholars 2010.
GOOD MORNING. 2 Objectives of Learning VANAJA.M Assistant Professor Department of Education Acharya Nagarjuna University.
Flexible approaches to using technology for online interaction University of Aberdeen Teaching and Learning Symposium January Sarah Cornelius and.
Do tangible interfaces enhance learning? Richard Haines.
What has this got to do with NCEA?
Biggs & Collis (1982) SOLO Taxonomy Overview and ideas for use Robin Trangmar Coleg Llandrillo.
Web + logs = Weblogs or Blogs Teaching and Learning with Technology March 16.
Literacy and Technology Presented by Julia Cohn
1 Setting Appropriate Assessment and Grading Criteria.
1 Meta-Analysis of the Effectiveness of Pedagogical Agent 報 告 人:張純瑋 Kim, M. & Ryu, J. (2003). Meta-analysis of the effectiveness of pedagogical agent.
State University of New York An Emerging Model for Online Learning MERLOT International Conference – August A Systemic Approach to Online Learning.
DHA-Intel Teachers’ Training 2011 Integrating IT in Classroom Group V June 20 – 24 Welcome to DA Model High School Beach View At: DADC Lab - 1 Syed Irfan.
A study of social presence in blended social work education Professor Walter LaMendola, PhD University of Denver.
My Reflections Curriculum Design: Reflective Journal Jennifer L. Ceville ED532-EC03--Dr. Breece Unit 10—March 10, 2006 Kaplan University.
Welcome to Grade 8 English! Ms. McWatters. This class will be... Equitable & Inclusive Ÿ “To improve outcomes for students at risk, all partners must.
Project Based Learning: Challenges & Opportunities John R. Mascazine, Ph.D. Ohio Dominican University Science Education Council of Ohio January 25 – 26,
Teaching and Learning Activities for Deep Learning Dr. Julian Hermida Algoma University Workshop on Teaching and Learning February 18, 2009.
ET4 Online Symposium, 2013 Using Text Analytics to Enhance Data-Driven Decision Making Liz Wallace Director, Institutional Research Melissa Layne, Ed.D.
ORGANIZING LEARNING LEARNING TAXONOMIES. BLOOM’S TAXONOMY ORIGINAL FORMAT Uses six levels in a hierarchy Each level depends on those preceding in the.
© 2012 Boise State University1 Using VoiceThread (VT) to Provide Interactive Learning and Build Community Jesús H. Trespalacios Educational Technology.
Media Specialists and the Things They Can Do! By Raina Dupree.
By Bundhun Amit Varma HMOA  Define Online Discussion  Recognise models of online discussions ◦ Synchronous ◦ Asynchronous  Distinguish three.
SOLO Taxonomy SOLO Taxonomy. What level is your understanding of SOLO taxonomy.
Chemistry teacher education for future Chemistry teacher education for future.
Innovation in Learning Analytics and Learning Scenarios in Clinical Psychiatry WEDNESDAY APRIL │ K1.28 Carolyn Hodgman Leading Education Initiatives,
UDL &DIFFERENTIATION Keyona Lewis EDU 673 Instructor Analisa Smith March 28, 2015.
Online Discussions for Student Interaction Swapna Kumar School of Teaching and Learning April 15, 2011.
By Kadir Kozan 1. Research Problem Rationale/Significance/Why? Conceptual Frameworks Data Collection & Analysis Validity Limitations 2.
Blooms taxonomy With TPACK information. Blooms Taxonomy.
BEYOND PRETTY QUIZZES CMA E-Learning Day 2015 Stephen McConnachie.
Issues in Categorising Learning Designs HELEN WALMSLEY-SMITH STAFFORDSHIRE UNIVERSITY.
Assessing Student Learning Using the Blackboard Discussion Board Assessment Workshop York College CUNY April 7, 2010 Wenying Huang-Stolte, Ph.D. William.
Knowledge-Building and Moderation in Asynchronous Computer Conferencing Sarah Schrire Kibbutzim College of Education.
Joyce Bahhouth Bladen Community College
Presented by Marie Lippens
How should we measure & show online learning?
Sue Sentance, Philip Howlett,
Teaching and Learning with Technology
Understanding Levels of Thinking using:
SCIENCE With Mr. Tsoukalis.
Title: Validating a theoretical framework for describing computer programming processes 29 November 2017.
Servicenumber.org/internet-explorer. Resolve Issue Internet Explorer.
Using The Flipped Classroom To Engender Collaborative Learning
Оцењивање засновано на стандардима
Taxonomies Bloom’s taxonomy of educational objectives: Cognitive Domain (Bloom & Krathwohl, 1956) A taxonomy for learning, teaching, and assessing: A revision.
Presentation to the ACARA Digital Technologies National Working Group
CMC Meina Zhu, Susan C. Herring, and Curtis J. Bonk
Developing Online Discussion Forums to Promote Higher-Order Thinking
Presentation transcript:

How should we measure & show online learning? Tim O’Riordan Web and Internet Science (WAIS)

b.socrative.com IVGEL7YU How should we measure online learning?

Web & Internet Science How should we measure online learning? b.socrative.com IVGEL7YU

b.socrative.com IVGEL7YU How should we measure online learning?

Motivations Image: Illustration from the front cover of The Queenslander 16/08/1934. State Library of Queensland, NKCR

Learning analytics Image: Blackboard usage, University of Southampton ©2015 How should we measure online learning?

…typical measurements include time spent, number of logins, number of mouse clicks, number of accessed resources, number of artifacts produced, number of finished assignments, etc. But is this really getting to the heart of the matter? Duval, E. (2011). Attention please! Learning Analytics for Visualization and Recommendation. In Proceedings of LAK11: 1st International Conference on Learning Analytics and Knowledge, 9–17. February 27-March 1, 2011, Banff, Alberta. Eric Duval, 2011 How should we measure online learning?

Pedagogical frameworks How should we measure online learning? Image: Student scientists learn the engineering design process, U.S. Army RDECOM ©2015, CC BY 2.0

Content analysis Image: Ambrose Congreve. National Library of Ireland, NKCR Weltzer-Ward, L. (2011) ‘Content analysis coding schemes for online asynchronous discussion’, Campus-Wide Information Systems, 28, pp. 56–74. How should we measure online learning?

DiAL-e Framework S. Atkinson, “What is the DiAL-e Framework?,” 2009; the-dial-e/. Image: A demonstration television studio. ITN/British Universities Film & Video Council, Narrative, Author, Empathise, Collaborate, Conceptualise, Inquiry, Research, Representation, Figurative How should we measure online learning?

Bloom Krathwohl, D. R. (2002) ‘A Revision of Bloom’s Taxonomy: An Overview’, Theory Into Practice, 41(4), pp. 212–218. Image: Blind athletes at Overbrook, Pa. Library of Congress, NKCR Remember Understand Apply Analyse Evaluate Create How should we measure online learning?

SOLO Biggs, J. B., Wales, N. S. and Collis, K. F. (1982) Evaluating the Quality of Learning: Structure of the Observed Learning Outcome Taxonomy. New York, NY: Academic Press Image: Jewish children with teacher. Samarkand, Library of Congress, NKCR Prestructural Unistructural Multistructural Relational Extended abstract How should we measure online learning?

Community of Inquiry Garrison, D. R., Anderson, T. and Archer, W. (2001) ‘Critical thinking, cognitive presence, and computer conferencing in distance education’, American Journal of Distance Education, 15(1), pp. 7–23. Image: Business Management Training. BBC World Service, CC BY-NC 2.0 Cognitive presence: Trigger Explore Integrate Resolve How should we measure online learning?

Data Image: University of Southampton,Archaeology of Portus MOOC. FutureLearn Ltd How should we measure online learning?

Method 600 comments from 12 steps to 4 rating methods. Categorised and scored learning activity. Calculate average rating per step (PV). Correlate per step and per comment ratings. How should we measure online learning? Image: University of Southampton,Archaeology of Portus MOOC. FutureLearn Ltd,

b.socrative.com IVGEL7YU How should we measure online learning?

Results Correlation between Bloom and SOLO How should we measure online learning? r 2 = p = <0.001

Results Correlation between Bloom and Community of Inquiry How should we measure online learning? r 2 = p = <0.001

Visualisation Images: Analytics app wireframe, Jisc Effective Learning Analytics © 2014 How should we measure online learning?

Visualisation Image: SITS:Vision Student Insight, Tribal Group/University of Wolverhampton, 2014 How should we measure online learning?

Visualisation How should we measure online learning? Off-topic Remember Understand Apply Analyse Evaluate Create Evaluate Analyse Apply Understand Remember Off-topic

Visualisation Image: Richard Wagner als Verlagsgefährte, Tabelle III. Ludwig Strecker, 1951 How should we measure online learning?

Future work Diverse subjects. More coders. Machine learning. Visualisation. How should we measure online learning?

b.socrative.com IVGEL7YU How should we measure online learning?

@studywbv timswww.wordpress.com Thank you… eprints.soton.ac.uk/376609/ How should we measure online learning? b.socrative.com IVGEL7YU