‘Technology Enhanced Learning’ Prof Derek France Dept of Geography & Development Studies Solent Learning Community: Workshop, Southampton Solent University, June 2010

Objectives Context - literature Context – podcasting Podcasting Assessment Feedback Conclusions Video Podcasts (VP) / Digital Stories (DS) Lessons Learned Concluding thoughts Action Plan References Outline structure

Ice breaker….. Form a line up for all workshop participants.. –by date of birth Jan1st to Dec 31 st You have 2 minutes –Your understanding, experience and application of podcasting for learning. You have 2 minutes

An appreciation of Web 2.0 technologies with the potential to enhance teaching practice Evaluate podcasting for summative, formative and generic feedback An increased understanding of the impact of video podcasting on the student learning experience An evidence-base for colleagues on how to use appropriate learning and teaching strategies to integrate podcasting in the curricula. Objectives

Brief Context: Literature Current generation of students have been described as ‘digital natives’ (Prensky, 2001) Oblinger and Oblinger (2005) characterise modern students as the ‘net generation’ who are digitally literate, highly Internet familiar, highly social, crave interactivity in image rich environments and don’t think in terms of technology, they think in terms of activity which technology enables. Higher Ambitions (2009) identified the need to develop and enhance higher level skills in HE.

Brief Context: Literature ‘Greater focus on technology will produce real benefits for all’ (Department of Education and Skills, UK, 2005, p.2) HEFCE, UK (2009, p.6) more cautiously states that, ‘focus should be on student learning rather than on developments in technology per se, enabling students to learn through, and be supported by technology’ Prensky (2009) now advocates ‘Digital Wisdom’ and ‘Digital Enhancement’

Web 2.0 ‘Social Web’ (Shirky, 2003).

Definition: -Digital audio and/or video file which can be played on a mobile device -Files typically downloaded from a server via the internet Brief context: podcasting

Definition: -Digital audio and/or video file which can be played on a mobile device -Files typically downloaded from a server via the internet Brief context: podcasting Use of familiar, popular and widely-owned technology Learning ‘on the move’

Lights, Camera, Action! Purpose Extension To Lectures Support Fieldwork Support Practical Work Supplement Online Teaching Assessment Develop Students’ Study Skills Bring Topical Issues Convergence Developer Length Structure Reusability Medium Style Capacity Frequency Stand Alone LecturesTutorsStudentsSenior StudentsOthers (Experts) AudioVideo Integrated with VLE Temperate (Immediacy, Alive)Reusable Single SessionMultiple Sessions Short (10 minutes or less)Longer (10+) Formal (Lecture)Informal (Conversation, Discussion) Large Student CohortsSmall Groups of Students WeeklyFortnightlyMonthlyRegularly …… A Framework for Developing Podcast Content (Nie, 2007)

Lights, Camera, Action! Model 1: Support Lectures Model 2: Support Fieldwork Model 5: Assessment Tool Screencasting, podcating lectures Lecture summaries Pre-lecture listening materials (complex concepts) “iWalk”: Location-based information Instruction on technique & equipment use Video footage prepare for field trip Model 4: Support Practical-based Learning Model 3: Support 3-Dimensional Learning Model 6: Provide Feedback Lecture recordings Digital Story-telling Anatomical Specimens (Structures, tissues, dissections) Software teaching & learning (replace text-based instructions) Student-created podcast based on field trips Student-created podcast to address climate change Model 7: Supplement Lectures Bring topical issues Guidance & tips Assessment tasks Supplement Online teaching Skills Development Models of Podcasting (Impala project, 2007)

Podcasting Assessment Feedback

Assessment – central to the student experience: “frames learning, creates learning activity and orients all aspects of learning behaviour” (Gibbs, 2006, 23). Feedback – central to learning from assessment: “feedback quantity and quality are the probably the most important factors in enhancing students’ learning (Race, 1999, 27). However: “the literature on student experiences of feedback tells a sorry tale” (Handley et al, 2007, 1). “many students commented on ‘cryptic’ feedback which often posed questions, but gave no indication of where they went wrong” (GfK, 2008, 8) Brief context: assessment and feedback

In small groups assess your expectations of the benefits of podcasted feedback for staff and students In 2 minutes In small groups assess your expectations of the challenges of podcasted feedback for staff and students In 2 minutes

One year, 2008 – 2009: Two modules – 1 st yr (69 students); Final yr (34 students). One formative and summative assessment exercises (3 rd ) & four generic large group feedback opportunities (1 st ). For each assignment: Summative (Sm) -generic overview commentary combined with bespoke feedback on the group presentation Formative (Fm) - informal podcast based on the e-postcard Sm and Fm sent to the feedback section of each student’s VLE-based e-portfolio Larger group generic feedback of four coursework assessments and placed in the online module space. The case study

Feedback portal within the institutional VLE Upload via modular e-learning areas Feedback Uploading & Tracking

Accessing the feedback

1. Pre-feedback questionnaire: Experience of podcasts; current views about feedback and expectations. (L4, 58, 90% response rate.) (L6, 28, 82% response rate.) 2.Post-feedback questionnaire: Engagement and perceptions. (L4, 30, 46% response rate.) (L6, 29, 85% response rate.) 3. Focus group discussions: Exploring emerging themes in more detail. (one at L6: 6 students; one at L6: 8 students.) Methods of evaluation

Prior experiences ‘Confidence’ in using IT was high, over 90% of students) Pre university podcasting experience relatively low at 37% compared to final year students of 82% Prior negative feedback experiences L4, 17% and L6, 13%

Formative Feedback N = 87

Summative Feedback N = 87

Generic Large Group Feedback N = 90

Summative versus Formative versus Generic All three forms of podcasted feedback were valued by students Formative was generally more appreciated than summative due to its potential immediacy to improve grade Large group generic feedback was appreciated, and students recommended that it should continue and is seen as better than front of class feedback (less embarrassment).

The potential for more depth and detail: Over 70% of students commented on this… ‘it felt really long. If you’d written this out it would have felt like a whole book. I really got a lot out of it, though’. Hearing your voice seems to make the course seem closer, less distance. More personalised: “This feedback felt that the work had really been looked at and evaluated personally.” ‘I listened to this at home and it felt like you were in the room with me and I wasn’t totally comfortable with that’. More understandable? You get “the tone of voice with the words so you could understand the importance of the different bits of feedback.” Nature and content of the feedback

Responsiveness to receiving information verbally: “Don’t just briefly read it, you actually listen to it and take it in.” “Novel, hearing voice 'goes in' better than just reading.” “Better, goes in more. Can remember feedback from podcast but not from written.” Greater sensitivity to the spoken word: ‘I liked the feedback for what it was, but I also found it a bit depressing. It was very personal… I felt I let you down’. “Any criticism will hit home more.” “May be harder to hear a poor mark, rather than receiving it in writing.” [I am least looking forward to] “hearing disappointment in their voices.” Engagement with the feedback

Potential to do more harm than good? Accepted characteristics of good feedback (irrespective of method of delivery)… Facilitates the development of self assessment (reflection) in learning Encourages teacher and peer dialogue around learning Helps clarify what good performance is (goals, criteria, expected standards). Provides opportunities to close the gap between current and desired performance Delivers high quality information to student about their learning Encourages positive motivational beliefs and self esteem Provides information to teachers that can be used to help shape the teaching. Juwah et al (2004)

Opportunity to diversify assessment feedback strategies. Adherence to well-established guidance on assessment design/timing and feedback content/style remains critical. Overwhelmingly positive from the students – especially distance learners Students described it as personal, intimate, well-thought out The potential to engage students with podcasted feedback irrespective of group size. Conclusion

Student and Staff voices

Learner Generated Video Podcasts and Digital Stories

Hardware

Software

Podcasts from the field New for 2007/8 and rolling out for a L4 core module “Foundations for Successful Studentship” Fieldwork element Potential to increase student engagement through:- –Digital story telling –Learner generated video podcasts Integrated component of the field report

Learner Generated Video Podcasts (VP) Core first year module n= Three UK locations; Devon, Wales, Liverpool Student work in small groups on a research project Plan with the aid of a story board

Learner Generated Video Podcasts Record the video sequence using digital cameras to cut down post production editing Back at University compile podcast and share on the VLE Bespoke pre and post VP/ DS questionnaire Student focus groups

Marking Criteria Research report (weighted 70%)Digital component (weighted 30%) Research objectives Project rationale/justification Methods of data collection Analysis and interpretation Conclusion (including critique) Writing style Use and incorporation of digital component Quality of content Content complements / enhances the report Quality of presentation Sound quality Creativity

Positive: “Do something different from the normal way of presenting assignments” “The challenge to make an engaging and interesting podcast” “Using the new technology, the experience” “Being creative and pulling all the information together” Negative: “Appearing on film” “Speaking into the camera” “Actually having to create and star in the podcast” “It will be different and hard because I have never done it before” What are you most looking forward to about creating VP /DS

Student Responses Creating video podcasts enhanced my learning experience of the subject: 82% (07/08) and 86% (08/09) of students agreed with this statement and Creating video podcasts made me more motivated to learn about the subject 65% (07/08) and 60% (08/09)of students agree with this statement Creating video podcasts encouraged better group interaction: 86% and 90% of students agreed with this statement (07/08) and (08/09) I am not comfortable working with new technologies: 82% and 81% of students disagreed with this statement (07/08) and (08/09)

Enjoyment: “Liked to hear the sound of my own voice” “Easy and different so more enjoyable than just writing” “Good group project, got the group to bond” Engagement: “Feels more personal as it’s your own voice and not just a piece of paper you hand in. “learnt how to do podcasting and the information stands out more, learning is better” Experience: “Bit embarrassing showing the lecturer how to do something they already know.” “remembered what you did as you wrote it in the script” Student Comments

n=63 Identify 3 separate words which best describe your experiences…

Lessons Learned Plan ahead Podcast content and production must be appropriate. People being recorded in the field must give their consent to the production of the podcast Allow time for students to play and experiment with the equipment Staff technical ability essential Take care that no students are disadvantaged Link to external partners

The process of using a storyboard to create a timeline of presentation elements helps co-ordination and co-operation between group members. If used strategically, potential to blend multiple learning spaces of fieldwork and VP/DS to enrich the student learning experience Learner generated VP/DS provides an opportunity to engage students in the discipline and develop new communication and presentation skills Technology no barrier to students Does the current positive feedback reflect a ‘novelty phase’ or is podcasting now just an integral part of students’ learning ‘toolkit’? Concluding Thoughts

Action Plan What have I learnt? What I am going to do next? –Where will I be in 3 months –Fill out the postcard What 3 things can you feedback to colleagues?

And finally….. Form a line up for all workshop participants.. –Your understanding, experience and application of podcasting for learning. You have 2 minutes

Further sources of information

Department for Education and Skills (2005) Harnessing technology transforming learning and children’s services Available online at (accessed 6 nd April 2009) France, D., and Ribchester, C. (2008) Podcasts and Feedback. In Salmon, G., Edirisingha, P. (Ed.) Podcasting for Learning in Universities, pp Milton Keynes: Open University Press. Gibbs, G. (2006). How assessment frames student learning. In C. Bryan and K. Clegg (Eds.), Innovative Assessment in Higher Education (pp 23-36). London: Routledge. GfK (2008) NUS/ HSBC Students Research. GfK Financial London, Study Number Handley, K., Szwelnik, A., Ujma, D., Lawrence, L., Millar, J. & Price. M. (2007). When less is more: Students’ experiences of assessment feedback. Paper presented at the Higher Education Academy Annual Conference, July Retrieved June 5, 2008 from HEFCE. (2009). E-learning strategy. Retrieved August 20, 2009 from Higher Ambitions (2009) Higher Ambitions, Online at content/uploads/publications/Higher-Ambitions.pdfhttp:// content/uploads/publications/Higher-Ambitions.pdf Juwah, C, Macfarlane-Dick, D, Matthew, B, Nicol, D, Ross D., & Smith, B (2004) Enhancing the Student Learning through effective formative feedback. Higher Education Academy, York. References

IMPALA. (2007). Resources and tools for creating podcasts. Retrieved July 4, 2009 from Nie, M. (2007). Podcasting for GEES Subjects. Paper presented at the IMPALA 2 workshop, Dec Retrieved June 5, 2009 from Oblinger, D. G, and Oblinger, J. L. (2005) Educating the Net Generation. Educause. Available online at (accessed 5 nd April 2010) Prensky, M. (2001) Digital Natives Digital Immigrants. On the Horizon, 9, No 5. MCB University Press %20Digital%20Natives,%20Digital%20Immigrants%20-%20Part1.pdf (accessed 20 th August 2009) %20Digital%20Natives,%20Digital%20Immigrants%20-%20Part1.pdf Prensky, M. (2009) H. Sapiens Digital: From Digital Immigrants and Digital Natives to Digital Wisdom. Innovate, 5, No3, pp1-9. (accessed 20 th August 2009). Ribchester, R., France, D., and Wheeler, A. (2008) Podcasting: A tool for Enhancing Assessment Feedback? In O’Doherty, E. (Ed) The Fourth Education in a Changing Environment Conference Book Informing Science Press. Ribchester, C., France, D., and Wakefield, K. (2008) It was just like a personal tutorial’: Using podcasts to provide assessment feedback, Higher Education Academy Annual Conference. References

Race, P. (1999). Enhancing student learning. Birmingham: SEDA. Salmon, G. & Edrisingha, P. (2008). Eds. Podcasting for Learning in Universities. Maidenhead: Open University Press. Including companion website: Shirky, C. (2003) Social software and the politics of groups. Networks, economics and culture mailing list [online] 9 th March Available at: (Accessed April 18th 2010) Wakefield, K., and France, D. (forthcoming) Bringing digital technology into Fieldwork. Planet