1. ePortfolio Effectiveness: A Tool for Accessing and Utilizing the Evidence Jessica R. Chittum, Virginia Tech Jacquelyn McCarthy Woodyard, Virginia Tech Lauren H. Bryant, The Friday Institute, North Carolina State University January 24, 2015 Annual Meeting of the AAC&U © 2015 Chittum, Woodyard, Bryant

2. Background Why assess the landscape of ePortfolio research? o As of 2008, 51% of higher education institutions incorporated some form of ePortfolio in students’ learning experiences (Clark & Eynon, 2009) o Requires resources This all begs the question: o What do we actually KNOW about how well ePortfolios work? © 2015 Chittum, Woodyard, Bryant

3. Overall Findings © 2015 Chittum, Woodyard, Bryant

4. Findings Article Type 1996-20121996-2014 N % N % Descriptive49429242 EmpiricalAffective39346329 Outcomes18163617 Assessment & Evaluation 0084 Technological109188 Total116 -- 217 -- © 2015 Chittum, Woodyard, Bryant

5. Findings

6. Findings Article Type 1996-20121996-2014 N % N % Descriptive49429242 EmpiricalAffective39346329 Outcomes18163617 Assessment & Evaluation 0084 Technological109188 Total116--217-- © 2015 Chittum, Woodyard, Bryant

7. Findings Category 1 : DESCRIPTIVE An argument for the use of ePortfolio, often citing learning theory Examples: o Example of ePortfolios in use o Anecdotal “dos and don’ts” o Data from other findings but nothing original o Theoretical arguments 92 articles, 42% of the sample © 2015 Chittum, Woodyard, Bryant

8. Findings Article Type 1996-20121996-2014 N % N % Descriptive49429242 EmpiricalAffective39346329 Outcomes18163617 Assessment & Evaluation 0084 Technological109188 Total116--217-- © 2015 Chittum, Woodyard, Bryant

9. Findings Category 4: TECHNOLOGICAL Presents data and models on the structure and usability of ePortfolio platforms. First appeared in 2005 Examples: o User interface o Original or adapted platforms o Descriptive of specific technological needs 18 articles, 8% of sample © 2015 Chittum, Woodyard, Bryant

10. Findings

11. Findings Article Type 1996-20121996-2014 N % N % Descriptive49429242 EmpiricalAffective39346329 Outcomes18163617 Assessment & Evaluation 0084 Technological109188 Total116--217-- © 2015 Chittum, Woodyard, Bryant

12. Findings Category 2: EMPIRICAL, AFFECTIVE Original data addressing the participants’ feelings about ePortfolios. Examples: o Opinions about ePortfolios o Perceptions of ePortfolio’s impact on their learning Data collection: o Surveys, open-ended response items, interviews, focus groups, etc. 63 articles: 59% of empirical, 29% of total © 2015 Chittum, Woodyard, Bryant

13. Findings Article Type 1996-20121996-2014 N % N % Descriptive49429242 Empirical Affective39346329 Outcomes18163617 Assessment & Evaluation 0084 Technological109188 Total116--217-- © 2015 Chittum, Woodyard, Bryant

14. Findings Category 3: EMPIRICAL, OUTCOMES Presents original data, qualitative or quantitative, on student outcomes First appeared in our sample in 2006 Example outcomes: o Learning, motivation, engagement, reflective practice Data collection: o Rubrics, case studies, questionnaires, interviews, etc. 36 articles: 34% of empirical,17% of sample © 2015 Chittum, Woodyard, Bryant

15. Findings Article Type 1996-20121996-2014 N % N % Descriptive49429242 Empirical Affective39346329 Outcomes18163617 Assessment & Evaluation 0084 Technological109188 Total116--217-- © 2015 Chittum, Woodyard, Bryant

16. Findings Category 3: EMPIRICAL, ASSESSMENT & EVALUATION Presents original data on tools for assessing students’ ePortfolios or some other assessment or evaluation o Not focused on impact of ePortfolio on outcomes or perceptions of ePortfolios First recognized in our sample in 2013 Examples: o Tests of rubrics/tools for assessing ePortfolios o Evaluating institutional preparedness for ePortfolio implementation 8 articles: 7.4% of empirical, 3.6% of sample © 2015 Chittum, Woodyard, Bryant

17. Discussion What does this new category tell us about the direction of research? © 2015 Chittum, Woodyard, Bryant

18. Trend

19. Next Steps It makes sense that research started with descriptive papers and empirical investigations into people’s perceptions. We must continue to focus on empirical evidence of student outcomes, validated assessment tools, and reliable platforms. We decided to help researchers and educators easily access information that can facilitate ePortfolio research and implementation as we continue this upward trend. © 2015 Chittum, Woodyard, Bryant

20. Discussion Raise of hands: how many of you have tried to locate peer-reviewed articles about ePortfolios? As researchers and educators, what obstacles (if any) have you run in to trying to find research about ePortfolios? © 2015 Chittum, Woodyard, Bryant

21. Obstacles Generalities – show me what you are referencing! What happened, specifically. More than a conclusion! MORE EMPIRICAL EVIDENCE PLEASE How does ePortfolio impact motivation- How do you demonstrate that impact? Disciplinary differences – journal locating. Pointing others to resources. Terms! Applied and practical, local situations – need to extract principles for widespread application! Not a whole lot out there in general, even LESS for a specific discipline. About ePortfolio End © 2015 Chittum, Woodyard, Bryant

22. eportfolio.uga.edu Feel free to go to this site with your own device for the next part of the presentation © 2015 Chittum, Woodyard, Bryant

23. Discussion What could be helpful on this site for you right now as a researcher and/or practitioner? (based on what you’ve seen so far) o Talk to those nearby Obstacles © 2015 Chittum, Woodyard, Bryant

24. End Download a PDF of the handout on the website: eportfolio.uga.edu/about-eportfolio/ Do you want a PPT on the website as well? Remember: Collaborate and Contact Us QUESTIONS? © 2015 Chittum, Woodyard, Bryant

25. Contact Jessica Chittum, Virginia Tech, chittumj@vt.educhittumj@vt.edu Jacquelyn Woodyard, Virginia Tech, jcmccart@vt.edujcmccart@vt.edu Website contact: eportfolioevidence.contact@gmail.com eportfolioevidence.contact@gmail.com © 2015 Chittum, Woodyard, Bryant