1. The University of SydneyPage 1 NSW Learning Analytics Working Group Meeting Presented by Kathryn Bartimote-Aufflick Institute for Teaching and Learning, DVC(Education) Portfolio 30 June 2015 Plenary discussion: Academic analytics versus learning analytics – Rivals or complementary strangers

2. The University of SydneyPage 2 iconarchive.com In pairs What’s your definition of… Academic analytics? Learning analytics? Business intelligence? Discuss, argue…

3. The University of SydneyPage 3 A taxonomy for analytics Learning analytics (LA) & educational data mining (EDM) Learner analytics & personalization Academic/instit utional analytics Systemic improvement Unit of analysis Online activity events Individual students Whole organization or a sub-unit Whole sector Data provenance Use existing data e.g. LMS, MOOC Actively collect data Use existing data Actively collect data Data examples Access, learning materials usage, task completion, discussion/chat/wik i/blog participation, grades, interactions Learning (& other) styles, prior learning, socioeconomic status Student admissions, student records, finance, staff performance U.S. schools national/state longitudinal testing, teacher & student background information, teacher evaluations

4. The University of SydneyPage 4 A taxonomy for analytics (continued) Learning analytics (LA) & educational data mining (EDM) Learner analytics & personalization Academic/instit utional analytics Systemic improvement Type of work to date Detect patterns; analyze which patterns linked to achievement; design interventions (LA) or adapt the technology (EDM) to influence student activity and alter patterns Explore relationships between learner differences and persistence/achi evement; support or re- direct students at risk Student progression to inform future admissions; productivity in central services; staff productivity; benchmarking ‘Data-driven decision making’ by teachers, schools, districts; teacher value- added models Future possibilities ? Enhanced visual feedback for students & teachers; evidence- based actions Optimize for all students; over time; evidence- based measures Develop and share common metrics and models across institutions 

5. The University of SydneyPage 5 References Chatti, M.A, Dyckhoff, A.L., Schroeder, U. & Thüs, H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning, 4(5/6), 318-331. Piety, P.J., Hickey, D.T., & Bishop, M.J. (2014). Educational data sciences – Framing emergent practices for analytics of learning, organizations, and systems. Paper for the Learning and Knowledge Analytics (LAK) Conference 24-28 March 2014 in Indianapolis, USA. http://dx.doi.org/10.1145.2567574.2567582http://dx.doi.org/10.1145.2567574.2567582 Romero, C. & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics: Part C: Applications and Reviews, 40(6), 601-618. Siemens, G. (2012). Learning analytics: Envisioning a research discipline and a domain of practice. Paper for the Learning and Knowledge Analytics (LAK) Conference 29 April – 2 May 2012 in Vancouver, Canada.

6. The University of SydneyPage 6 Group discussion Form groups 1.Learning analytics/educational data mining [back left] 2.Learner analytics & personalization [back right] 3.Institutional analytics [front centre] Discuss the following –What are some problems worth solving in this area? Select one to discuss in depth –What data sources would be useful to gain insight into this problem? –What personnel skill sets would be needed to grapple with this problem? –What actions might be appropriate to address this problem? konaapplemac.com

7. The University of SydneyPage 7 Quick report back Key issues arising out of the discussion… Roadblocks? Promising new ideas? Points of overlap and collaboration? Thank you Simon Buckingham Shum (UTS) Panos Vlachopoulos (MQ)

8. The University of SydneyPage 8 Next… Grant opportunities (Sydney internal) Educational Innovation Grants, close 27 Aug with earlier internal deadlines http://www.itl.usyd.edu.au/awards/educationa l_innovation_grants.htm http://www.itl.usyd.edu.au/awards/educationa l_innovation_grants.htm (National) OLT, cross-institutional, close approx late Nov with earlier internal deadlineshttp://www.olt.gov.au/grants-and- projects/innovation-and-developmenthttp://www.olt.gov.au/grants-and- projects/innovation-and-development Analytics gatherings #edtech talk Gregor Kennedy ‘Logging students: Understanding digital learning one click at a time’ Mon 27 Jul http://tiny.cc/v4dzzx http://tiny.cc/v4dzzx Australian Learning Analytics Summer Institute (ALASI) 26-27 Nov, University of Sydney Learning Analytics & Knowledge (LAK) Conf 25-29 April 2016, University of Edinburgh, UK http://lak16.solaresearch.org/ http://lak16.solaresearch.org/ Stay in touch –http://listserv.uts.edu.au/mailman/listinf o/nswlawghttp://listserv.uts.edu.au/mailman/listinf o/nswlawg –kathryn.aufflick@sydney.edu.aukathryn.aufflick@sydney.edu.au –@abelardopardo –@SoLAResearch