Speech pathology students’ responses to ePortfolios Abigail Lewis Speech Pathology Psychology and Social Science

Outline Background Project Results Application

Background Speech Pathology courses use portfolios for demonstration of clinical competency (?reflection) New course, new design = eP! SP students at ECU used MyExpo ePortfolio template since July 2010 launch Assessed each semester for 4 years - formative & summative

Design Template developed, information embedded, in BlackBoard (MyExpo) – Section A: Reflections on my learning – Section B: My development of competency – Section C: My records Introduced 1st Yr S2 Submit S1 & S2 2 nd yr 10% Submit S1 & S2 3 rd & 4 th yr substantial Ongoing tweaking based on feedback

Evaluate Investigate use of ePortfolios by SP students to inform a trial of the new ePortfolio platform Pebble+ in Semester 2 Project funded by ECU Teaching and Learning grant Ethics approval received

Methodology Questionnaires through Qualtrics to 2 nd, 3 rd and 4 th years July 2012 Focus groups 2 nd, 3 rd and 4 th yrs August to October 2012 Staff interviewed Nov 2012 Roll out Pebble+ to 1 st, 2 nd and 3 rd years August 2012 onwards (Questionnaires repeated November 2012)

Questionnaires Bio data – age, yrs at uni Technology – comfortable, confident 5 point Likert agreement scale for statements about: – Engagement with portfolio – Technology – Educational value – Reflections, evidence, records – The future Free text questions for NVivo

Focus group script How do you use technology in your everyday life? How did you find developing your Portfolio using technology? What do you understand the purpose of the ePortfolio to be? What additional features or improvements can you suggest to the ePortfolio system? Can see yourself using the ePortfolio after you graduate as part of your lifelong learning as a speech pathologist? Thematic analysis using NVivo

Results - Response rates Year2 nd years3 rd years4 th years Total number Questionnaire response 6 = 43%11 = 46%8 = 53% Focus group response 2 = 14%12 = 50%8 = 53%

Technology in general When I use technology I am comfortable (mean response across all 3 years) When I have to use technology I feel confident I can work it out (mean response across all 3 years)

Engagement

+ve 37 references: – “The concept is a good idea, having somewhere to file important documents as to monitor my progress.” 3 rd year -ve 70 references: – “...I don’t feel like we’ve put as much time and effort into it we’ve slapped in what we’ve had to have so that it is there to be presented for marking but I don't think it’s a useful tool for us personally” 3 rd year

Technology

+ve 39 references – “... the ePortfolio’s given me the confidence to use it... somewhere else whereas I wouldn’t of even thought about using it before” 4th -ve 72 references – “it’s just frustrating when it doesn’t work properly” 3rd – “It was very difficult to work out” 3rd

Educational Value

Educational value +ve 20 references – “I think going back to the goals as well it’s sort of helps you to work out how to set goals for your clients as well” 3rd – “you are actually going to need this to apply for jobs it’s not something to be fluffy about” 4th -ve – 24 references – “we’ve already learnt everything we really are just uploading it” 3rd

My Reflections

Reflections +ve – 7 references – “It's also interesting to see how far you've come. I've already noticed a difference in my writing etc. in the two years” 4th -ve – 16 references – “I’ve never been one for journal writing or reflections or goals that’s just me not liking those sorts of things” 4th

My evidence of competency

Evidence +ve – 15 references – “Helped to see which competencies are necessary for graduation” 4th -ve –6 references – “There is no technology involved in the program to monitor and track for you what competencies you have achieved or what is still outstanding - apart from you physically going into it and looking at what you have uploaded” 3rd

Records

+ve – 7 references – “Keeping all my documents organised and up to date. It is also very helpful when it comes to refreshing my memory on previous pracs” 4th -ve – 1 reference

The future

Future +ve – 16 references – “they told us but I hadn’t really grasped that and fully understood the importance of that in getting a job until just then” 4th -ve – 20 references – “I don’t know what the end result of this is are we supposed to show it to prospective employees or I still don’t really get what’s the point of it” 2nd

Application Platform – user friendly, flexible, allow creativity, no glitches, easy to organise and format, exportable, share with employers Support and training (compulsory) – mini videos, tutes, handouts, tip sheets, FAQ, manual, clear, consise, repeated, at right time, keep explaining value & relevance Peer support/training

Application continued Graded complexity and workload across years, not one fixed template, relevant to current level and placements Link to future – peer reports, applying for jobs, lifelong learning, ongoing accreditation