Karen Swan Kent State University Research Center for Educational Technology Assessing the Impact of Technology on Learning.

Slides:



Advertisements
Similar presentations
Christopher Graham Garnet Education UK. I dont do rhetorical questions !
Advertisements

Performance Assessment
The Teacher Work Sample
California Standards for the Teaching Profession
“Digital technologies are for education as iron and steel girders, reinforced concrete, plate glass, elevators, central heating and air conditioning.
Strategies to Increase Connectedness in Online Mathematics Courses Sonia Ford Midland College Midland, Texas AMATYC 2013 S001.
Teacher Librarians. Contact Information Mary Cameron Iowa Department of Education (515)
Do the Data Support our Assumptions? Charles D. Dziuban Patsy D. Moskal University of Central Florida.
Implications of Web-based Learning for Student Evaluation of University Teaching Chuck DziubanSteve Sorg Research Initiative for Teaching Center for Distributed.
“Writing to Learn” Adolescent Research and Development Team.
Social Presence Social Presence What is it? And How Do We Measure It? Patrick R. Lowenthal | University of Colorado Denver.
Reactive Behavior Patterns in Distributed Learning: Bridging Student Resources and Cognition Charles D. Dziuban Patsy D. Moskal University of Central Florida.
Recruitment of online tutors Sharon Slade, Fenella Galpin OU Business School.
A Look at Online Teaching and Learning at UCF Charles D. Dziuban Patsy D. Moskal University of Central Florida.
Barry Spencer A Transformation Case Study Barry Spencer.
An Approach to Creating and Facilitating Workshops Library Instructor College Fall 2010 Charles Dershimer Erping Zhu Center For Research on Learning and.
Introduction to Workshop 10 Choosing Learning and Teaching Approaches and Strategies.
State University of New York A model for online learning in the SUNY Learning Network NLII Annual Meeting – January Online Learning Environments:
Planning, Instruction, and Technology
Understanding the Process and the Product Professional Development Spring, 2012.
Reflective Pathways from Theory to Practice Brewton-Parker College Education Division.
Matt Moxham EDUC 290. The Idaho Core Teacher Standards are ten standards set by the State of Idaho that teachers are expected to uphold. This is because.
Interactive Science Notebooks: Putting the Next Generation Practices into Action
Instructional Design Project - Presentation EME 620 Spring 2015 Benson Callier Rotunda Wilcox.
LECTURER OF THE 2010 FIRST-YEAR STUDENT: How can the lecturer help? February 2010.
Designing an Effective Online Developmental Literacy Course David Caverly, Ph.D., Texas State University National Association for Developmental Education.
Interstate New Teacher Assessment and Support Consortium (INTASC)
Eportfolio: Tool for Student Career Development and Institutional Assessment Sally L. Fortenberry, Ph.D., and Karol Blaylock, Ph.D. Eportfolio: Tool for.
Standards-Based Science Instruction. Ohio’s Science Cognitive Demands Science is more than a body of knowledge. It must not be misperceived as lists of.
Connected Learning with Web 2.0 For Educators Presenter: Faith Bishop Principal Consultant Illinois State Board of Education
Learners’ Attitudes and Perceptions of Online Instruction Presented by: Dr. Karen S. Ivers Dr. JoAnn Carter-Wells Dr. Joyce Lee California State University.
1. Principles Equity Curriculum Teaching 3 Assessment Technology Principles The principles describe particular features of high-quality mathematics programs.
Integrating Differentiated Instruction & Understanding by Design: Connecting Content and Kids by Carol Ann Tomlinson and Jay McTighe.
=_A-ZVCjfWf8 Nets for students 2007.
* Research suggests that technology used in classrooms can be especially advantageous to at-risk, EL, and special ed students. (Means, Blando, Olson,
Inquiry and Investigation. What was the TOPIC? PROBLEM? CIVIC INQUIRY?
Building Trust & Effective Communication Alisa Cooper, EdD Faculty, Assistant Chair/eCourses Coordinator English Department Glendale.
THE DANIELSON FRAMEWORK. LEARNING TARGET I will be be able to identify to others the value of the classroom teacher, the Domains of the Danielson framework.
Twilight Training October 1, 2013 OUSD CCSS Transition Teams.
Gouri Banerjee, Ph. D. Dept. Math & IT, Emmanuel College Boston, Massachusetts. 1 Gouri Banerjee Blended Learning Environments, 2010.
Using Understanding by Design
Curriculum Report Card Implementation Presentations
ENGAGING STUDENTS FOSTERING ACHIEVEMENT CULTIVATING 21st CENTURY GLOBAL SKILLS Designing Engaging Units for 21 st Century Learners Consider the 21st Century.
Crysten Caviness Curriculum Management Specialist Birdville ISD.
Dr. Karen Gerlach Please spend some time chatting with your classmates Week 7 Seminar The Final Project.
State University of New York An Emerging Model for Online Learning MERLOT International Conference – August A Systemic Approach to Online Learning.
Instructional Strategies Teacher Knowledge, Understanding, and Abilities The online teacher knows and understands the techniques and applications of online.
Mentoring School Name Date Mentor’s Name. OVERVIEW What is Mentoring? The Mentoring Menu The Coaching Process.
Problem-Solving Approach of Allied Health Learning Community.
Using edTPA Data for Program Design and Curriculum Mapping Mary Ariail, Georgia State University Kristy Brown, Shorter University Judith Emerson, Georgia.
Google Earth INTEGRATING GLOBAL THINKING. Why Use Virtual Tours? Flexible Tool: History, Science, Math, English, etc. An Interactive Way to Explore Supports.
February 28.  Unit plans feedback (that I have completed)  Expectations for reflections  Pre-Internship Expectations  Questions you always wanted.
 “I have to teach the same information skills each year because students do not learn them.”  “I don’t have time to give tests so I do not assess student.
By Bundhun Amit Varma HMOA  Define Online Discussion  Recognise models of online discussions ◦ Synchronous ◦ Asynchronous  Distinguish three.
Mobile Learning and the Online Community of Inquiry M. Cleveland-Innes M. Ally source:
Taeho Yu, Ph.D. Ana R. Abad-Jorge, Ed.D., M.S., RDN Kevin Lucey, M.M. Examining the Relationships Between Level of Students’ Perceived Presence and Academic.
Teaching in Blended Learning Environments: Creating and Sustaining Communities of Inquiry Dr. Norm Vaughan Dr. Marti Cleveland-Innes Dr. Randy Garrison.
Assessment Online. Student Assessment Design learner-centered assessment that include self-reflection Design grading rubrics to assess discussions, assignments,
Interactivity in Asynchronous Courses eCampusAlberta Christine Marles, MDE Feb. 24, 2015.
Teaching and Learning Online What Makes Sense When Moving Courses Online.
Earth Educators’ Rendezvous Workshop Leader Webinar Introduction Workshop Design Best Practices Utilizing the Web Tools Evaluation Instruments David McConnell,
MAKING THE SHIFT: FROM CLASSROOM TO ONLINE COURSE DESIGN: SESSION 4 Patricia McGee, PhD and Veronica Diaz, PhD.
Instructional Coaching Samir Omara RELO-NileTESOL Trainer s. m
Incorporating InTeGrate Materials into your Course and Syllabus
Dos and Don’ts for Effective E-Learning Practices
Kozan, K. , & Richardson, J. C. (2014)
Creating a Community of Inquiry
Approaches to Learning (ATL)
Presentation transcript:

Karen Swan Kent State University Research Center for Educational Technology Assessing the Impact of Technology on Learning

The Great Media Debate Kozma VS Clark

What is the question?

outcomes processes inputs

outcomes processesinputs satisfaction retention success achievement proficiencies performance

Understanding By Design, Wiggins & McTighe enduring understandings important to know & do worth being familiar with achievement

outcomes processesinputs satisfaction retention success achievement proficiencies performance

outcomes processesinputs learner characteristics design learning resources professional development

learner characteristics F2F, E, M 85.9% n=11, % n=6, % n=2, % n= % n=2, % n=5, % n= % n=1, % n=1, % n= % n= % n=3, % n=2, % n= % n=526 Arts & Sciences, Business Admin., Hospitality Mgmt. Education Engineering Health & Pub. Affairs O femalesmalesA&SBA & Hosp. mgmt F2FE, M, OE, MF2F Overall factors influencing success (Dziuban & Moskal, 2006)

learner characteristics reactive behavior patterns (Long-Dziuban frame) aggressivepassive independent high energy, action-oriented, not concerned with approval, speaks out freely, gets into confrontational situations low energy, not concerned with approval, prefers to work alone, resists pressure from authority, non-communicative dependent high energy, action-oriented, concerned with approval, rarely expresses negative feelings, performs at or above ability Low energy, concerned with approval, highly sensitive to the feelings of others, compliant and pleasing

outcomes processesinputs learner characteristics design learning resources professional development

design

outcomes processesinputs learner characteristics course design learning resources professional development

learning ubiquitous technologies outcomes processesinputs use representation s conceptualization s learning UbiComp Effects (RCET, 2006)

multiple representations across a wide range of media UbiComp Effects (RCET, 2006)

percentage of time spent in: regular classroom SBCAC individual small groups large groups whole class GROUP SIZE UbiComp Effects (RCET, 2006)

CONCEPTUAL UNDERSTANDING average rating across classes high ability10 medium ability9.4 low ability8.5 special needs9.3 UbiComp Effects (RCET, 2006)

TEACHING PRESENCE PRESENC E SOCIALCOGNITIVE PRESENC E EDUCATIONAL EXPERIENCE Community of Inquiry Model (Garrison, 2006) outcomes processesinputs

Teaching Presence Design & Organization 1. The instructor clearly communicated important course topics. 2. The instructor clearly communicated important course goals. 3. The instructor provided clear instructions on how to participate in course learning activities. 4. The instructor clearly communicated important due dates/time frames for learning activities. Facilitation 5. The instructor was helpful in identifying areas of agreement and disagreement on course topics that helped me to learn. 6. The instructor was helpful in guiding the class towards understanding course topics in a way that helped me clarify my thinking. 7. The instructor helped to keep course participants engaged and participating in productive dialogue. 8. The instructor helped keep the course participants on task in a way that helped me to learn. 9. The instructor encouraged course participants to explore new concepts in this course. 10.Instructor actions reinforced the development of a sense of community among course participants.

Direct Instruction 11. The instructor helped to focus discussion on relevant issues in a way that helped me to learn. 12. The instructor provided feedback helped me understand my strengths and weaknesses. 13.The instructor provided feedback in a timely fashion. Social Presence Affective Expression 14.Getting to know other course participants gave me a sense of belonging in the course. 15.I was able to form distinct impressions of some course participants. 16. Online or web-based communication is an excellent medium for social interaction. Open Communication 17.I felt comfortable conversing through the online medium. 18.I felt comfortable participating in the course discussions. 19.I felt comfortable interacting with other course participants.

Group Cohesion 20.I felt comfortable disagreeing with other course participants while still maintaining a sense of trust. 21. I felt that my point of view was acknowledged by other course participants. 22.Online discussions help me to develop a sense of collaboration. Cognitive Presence Triggering Event 23. Problems posed increased my interest in course issues. 24. Course activities piqued my curiosity. 25.I felt motivated to explore content related questions. Exploration 26. I utilized a variety of information sources to explore problems posed in this course. 27. Brainstorming and finding relevant information helped me resolve content related questions. 28. Online discussions were valuable in helping me appreciate different perspectives.

Integration 29. Combining new information helped me answer questions raised in course activities. 30. Learning activities helped me construct explanations/solutions. 31. Reflection on course content and discussions helped me understand fundamental concepts in this class. Resolution 32. I can describe ways to test and apply the knowledge created in this course. 33. I have developed solutions to course problems that can be applied in practice. 34. I can apply the knowledge created in this course to my work or other non-class related activities.

outcomes processesinputs pedagogy interactions assessment

course design course assignments instructor feedback instructor instructor /discussion affect learning content analysis– “additional comments:” (Swan, Schenker, Lin, Shea & Aviv, 2006) pedagogy

rprprprp design & organization.64 < < < <.01 facilitating discourse.64 < < < <.01 direct instruction.64 < < < <.01 SUMMER 2002 (n=1140) SPRING 2003 (n=6088) satisfactionper. learn. teaching presence (Shea, et al., 2003, 2004) satisfactionper. learn. pedagogy

outcomes processesinputs pedagogy interactions assessment

interactions interactivity & generations (Hartman,Moskal & Dziuban, 2005)

social software commenting tools (Track Changes, audio/ video feedback) threaded discussion, chat, whiteboards / application sharing (Elluminate, Wimba, Learnlinc) blogs wikis distributed classification systems (Digg, Plum, Flickr YouTube) interactions

outcomes processesinputs pedagogy interactions assessment

~criteriacriteria total posts total threads posts/thread thread depth greatest depth ~criteriacriteria initial posts/stud initial post length responses/stud** response length* messages read** *significant at p>.05; **significant at p>.01 assessment of online discussion (Schenker, Swan, Arnold & Kuo, 2006)

enduring understandings important to know & do worth being familiar with Assessment Types informal checks observation/dialogue quizzes/tests academic prompts performance task/project assessment Understanding By Design, Wiggins & McTighe

assessment: rubrics discussion postings rubrics (Pelz, 2004)

points0 points1/2 point1 point article summaryno summary of articleweak summary of article, misses some major points clear summary of article, addresses all major points covered in article addresses questions poseddoesn't address any of the questions addresses only some questions or some questions superficially addresses all questions well &/or adds original critique links to module content, other lit. &/or personal experiences doesn't link to either module or own experience weak links to module &/or own experience strong links to module topics &/or own experience points0 points1/2 point1 point objectivesobjectives neither state what students will learn nor match evaluation rubrics weak objectives (don't state what students will learn or don't match rubrics) objectives clearly state what students will learn from the lesson and are linked to evaluation assessmentno rubricsrubrics don't match objectives &/or don't give skill levels w/in categories rubrics give specific descriptions of skill levels w/in categories and categories match objectives scope and sequence poorly structured lesson inappropriate for grade level, curriculum & objectives weak lesson that doesn't clearly address objectives. well structured lesson that fits curriculum and grade level and clearly addresses objectives activitiesno activitiesweak links between activities, lesson and curriculum excellent activities encouraging active learning, & transfer of learning to other areas of curriculum lesson plan rubrics article critique rubrics assessment: rubrics

AAHE ePortfolio clearinghouse collection of student work providing evidence of learning linked to learning goals demonstrating progress over time multiple media include reflections on works programmatic, across courses assessment: e-portfolios

assessment: student response systems self-assessment as well as data collection, engagement, interactivity

outcomes processes inputs

Karen Swan Kent State University Research Center for Educational Technology