This material is based upon work supported by the National Science Foundation under Grant No. 0126793 and 0341468. Any opinions, findings, and conclusions.

Slides:



Advertisements
Similar presentations
Advancing Communication Competencies: Using Technology for Core Instruction and Resources Trudy Bayer Slippery Rock University of Pennsylvania Karen Curto.
Advertisements

Standard 22A Curricular Structure HT Accredited Curriculum.
Using Test Item Analysis to Improve Students’ Assessment
Utilization-focused Assessment in Foundations Curriculum: Examining RCLS 2601: Leisure in Society Clifton E. Watts, PhD Dept. of Recreation & Leisure Studies.
The Moon, the Earth, and the Sun Unit Portfolio Presentation Chris Hain.
Enhancing Electrical Engineering Education by Developing Online Courses M. Mohandes, M. Dawoud, A. Hussain, M. Deriche, A. Balghonaim Electrical Engineering.
TABLE 1: Comparison of scores from the year the immediate feedback format was used to the previous year when multi-format exams were used. * p < 0.05 compared.
Challenge Question: Why is being organized on the first day of school important? Self-Test Questions: 1.How do I get my classroom ready? 2.How do I prepare.
Principles of High Quality Assessment
New Hampshire Enhanced Assessment Initiative: Technical Documentation for Alternate Assessments Alignment Inclusive Assessment Seminar Brian Gong Claudia.
College of Engineering Hybrid Course Formats That Facilitate Active Learning Professor David G. Meyer School of Electrical and Computer Engineering.
Replacing “Traditional Lectures” with Face-to-Face Directed Problem Solving Sessions and On-Line Content Delivery David G. Meyer Electrical & Computer.
Grade 12 Subject Specific Ministry Training Sessions
Assessing and Evaluating Learning
Assessing Students Ability to Communicate Effectively— Findings from the College of Technology & Computer Science College of Technology and Computer Science.
Where Technology and Information Literacy Meet: Interactive Web-based Tutorials for Lifelong Learning October 2, 2005 LITA National Forum Pamela Jackson.
FLCC knows a lot about assessment – J will send examples
Research & Statistics Student Learning Assessment comparing Online vs. Live (Face to Face) Instruction.
Formulating objectives, general and specific
Tips on Preparing a Successful Educational Research Proposal Fiona Fui-Hoon Nah, professor, BIT Nancy J. Stone, professor and chair, Psychological Science.
METHODS Study Population Study Population: 224 students enrolled in a 3-credit hour, undergraduate, clinical pharmacology course in Fall 2005 and Spring.
Enhancing Parents’ Role in Higher Education Assessment Anne Marie Delaney Director of Institutional Research, Babson College.
Developing Evaluation Instruments
From Learning Goals to Assessment Plans University of Wisconsin Parkside January 20, 2012 Susan Hatfield Winona State University
Instructional Accommodations Inservice. Who deserves accommodations? Everyone! Instructional accommodations are not just for students who are struggling.
EVALUATION REPORT Derek R. Lane, Ph.D. Department of Communication University of Kentucky.
Student Learning Outcomes: Interpretations, Validity, and Factor Development Krista Soria and Laura Gorny This project was funded by the Undergraduate.
Learning to Teach Elementary Science: From Preservice to Induction Change Associated with Readiness, Education, & Efficacy in Reform Science Dr. Betty.
Before & After: What Undergraduates and Alumni Say About Their College Experience and Outcomes Angie L. Miller, NSSE & SNAAP Research Analyst Amber D.
The Genetics Concept Assessment: a new concept inventory for genetics Michelle K. Smith, William B. Wood, and Jennifer K. Knight Science Education Initiative.
The Influence of Blended Learning Model on Developing Leadership Skills of School Administrators Dr. Tufan AYTAÇ Dr. Tufan AYTAÇ Education Specialist The.
Effective Lesson Planning EnhanceEdu. Agenda  Objectives  Lesson Plan  Purpose  Elements of a good lesson plan  Bloom’s Taxonomy – it’s relevance.
This material is based upon work supported by the National Science Foundation under Grant No , and Any opinions, findings, and.
MODULE 7 Putting All Together and Designing the Course.
Paul Parkison: Teacher Education 1 Articulating and Assessing Learning Outcomes Stating Objectives Developing Rubrics Utilizing Formative Assessment.
A Preliminary Investigation of Student Perceptions of Online Education Angela M. Clark University of South Alabama Presented at ISECON 2003 San Diego,
Human Learning Asma Marghalani.
Case Study: Redesign of an Online MIS Course to Include Multiple Learning Styles Gary Ury Northwest Missouri State University
Online and Hybrid Course Design. Define Terms Traditional course Web Enhanced course Hybrid course Online course.
S&T Student Course Evaluations: Beyond Question 7 – Part 2 Dan Cernusca, Ph.D. Instructional Design Specialist Missouri University of Science and Technology.
Chapter 1 Defining Social Studies. Chapter 1: Defining Social Studies Thinking Ahead What do you associate with or think of when you hear the words social.
Shaking Up Statistics: A Blended Learning Perspective My Vu, Erin M. Buchanan, Kayla Jordan, Marilee Teasley, Kathrene Valentine Missouri State University.
Novice drafters’ spatial visualization development influence of instructional methods and individual learning styles Advisor : Min-Puu Chen Presenter :
This material is based upon work supported by the National Science Foundation under Grant No , and Any opinions, findings, and.
Selected Teaching-Learning Terms: Working Definitions...
Performance-Based Assessment HPHE 3150 Dr. Ayers.
An Analysis of Three States Alignment Between Language Arts and Math Standards and Alternate Assessments Claudia Flowers Diane Browder* Lynn Ahlgrim-Delzell.
Reasoning Mind, Inc. Using Technology to Close the Achievement Gap Presenter: Reid Whitaker, Principal, Port Houston Elementary NAESP.
Standards-Based Science Assessment. Ohio’s Science Cognitive Demands Science is more than a body of knowledge. It must not be misperceived as lists of.
Online students’ perceived self-efficacy: Does it change? Presenter: Jenny Tseng Professor: Ming-Puu Chen Date: July 11, 2007 C. Y. Lee & E. L. Witta (2001).
ABSTRACT In this study, structural equation modeling is applied to examine the determinants of students’ satisfaction and their perceived learning outcomes.
Assessment Ice breaker. Ice breaker. My most favorite part of the course was …. My most favorite part of the course was …. Introduction Introduction How.
Assessing the Impact of the Interactive Learning Space Initiative on Faculty Morale and Student Achievement Ball State University 2015 Spring Assessment.
FSM NSTT Teaching Competency Test Evaluation. The NSTT Teaching Competency differs from the three other NSTT tests. It is accompanied by a Preparation.
Taeho Yu, Ph.D. Ana R. Abad-Jorge, Ed.D., M.S., RDN Kevin Lucey, M.M. Examining the Relationships Between Level of Students’ Perceived Presence and Academic.
Peer-Led Team Learning Workshop Chemistry at UWG “Pilot” project with workshops during Grant and full-fledged program in PLTL Program.
Bill Flipped Classroom & PBL: Theory and Practice Katie Back Channel:
Dr. Marciano B. Melchor University of Ha’il, KINGDOM OF SAUDI ARABIA May 2013.
Teacher Work Sample. Lectures Objectives: 1.Define the teacher work sample. 2.Integrate lesson plans with a practice Teacher Work Sample in terms of the.
Paula Miles School of Psychology & Neuroscience
Interview Responses: Job Satisfaction
Adaptive Lessons for Pre-Class Preparation for a Flipped Classroom
Multi-faceted Approach to Improve Learning in Pharmacokinetics
Multi-faceted Approach to Improve Learning in Pharmacokinetics
Adaptive Lessons for Pre-Class Preparation for a Flipped Classroom
Student Satisfaction Results
Unit 7: Instructional Communication and Technology
Susan K. Michael and Richard L. Jew
Investigation of Inverted and Active Pedagogies in STEM Disciplines: A Preliminary Report Reza O. Abbasian Texas Lutheran University, Department of.
This material is based upon work supported by the National Science Foundation under Grant #XXXXXX. Any opinions, findings, and conclusions or recommendations.
Presentation transcript:

This material is based upon work supported by the National Science Foundation under Grant No and Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation ASSESSING TEACHING METHODS FOR A COURSE IN NUMERICAL METHODS Autar Kaw and Melinda Hess University of South Florida Modalities of how the course was taught: Effectiveness of four instructional delivery modalities – 1) Traditional lecture in Summer 2002, 2) Web-enhanced lecture in Summer 2003, 3) Web-based self-study in Summer 2004, and 4) Combined web-based self-study & classroom discussion in Spring 2005, was investigated for a single instructional unit (Nonlinear Equations) over separate administrations of an undergraduate course in Numerical Methods. Assessment instruments: 1) a student satisfaction survey were used to gather relevant data to compare the delivery modalities, and 2) student performance on a 4 question multiple-choice examination. Abstract: How does the way a topic is taught affect learning? We used four different ways to teach a course unit in a Numerical Methods course, and assessed the effect via a student satisfaction survey and student examination performance. Questions Mean out of 7* (SD) Fp 2002 (n=38) 2003 (n=27) 2004 (n=43) 2005 (n=38) In terms of their value in helping me acquire foundational knowledge and skills, I'd say that the presentations were (1.21) 5.86 (1.06) 4.53 (1.32) 4.92 (1.01) 7.83<.0001 In terms of their value in reinforcing information presented both in the reading assignments and in the problem sets, I’d say that the presentations were (1.19) 5.86 (1.03) 4.49 (1.25) 5.08 (0.93) 8.55<.0001 In terms of their value in helping me learn to clearly formulate a specific problem and then work it through to completion, I'd say that the presentations were (1.40) 5.86 (1.09) 4.30 (1.25) 4.89 (1.10) 10.05<.0001 In terms of their value in helping me develop generic higher-order thinking (e.g. analysis, synthesis and evaluation from Bloom's taxonomy brochure I gave you) and problem solving skills, I’d say that the presentations were 4.34 (1.27) 5.61 (0.98) 4.14 (1.37) 4.74 (1.12) 8.69<.0001 In terms of their value in helping me develop a sense of competence and confidence, I'd say that the presentations were (1.25) 5.68 (1.20) 3.95 (1.24) 4.76 (0.90) 13.22<.0001 Overall, I’d say that the clarity of the explanations contained in the presentations were (1.32) 6.04 (0.94) 4.35 (1.33) 5.16 (1.04) 12.75<.0001 In terms of helping me see the relevance of the course material to my major, I'd say the presentations were (1.27) 5.79 (1.08) 4.02 (1.37) 4.82 (1.07) 12.20<.0001 Overall, I’d say that the helpfulness of the illustrative examples and practical applications contained in the presentations were (1.40) 5.71 (0.96) 4.28 (1.25) 5.03 (0.90) 9.25<.0001 * 1=Truly Inadequate, 2=Poor, 3=Adequate, 4=Good, 5=Very Good, 6=Excellent, 7=Truly Outstanding Student Satisfaction Results: Student Performance Results: Table 1 – Sample Size and Means of Incoming GPA(MPGPA) and Final Examination Score ClassN MPGPAUpper BloomLower Bloom Mean (max=4) SD Mean (max=2) SD Mean (max=2) SD The results of the two-factor Analysis of Variance (ANOVA) using the mean pre-requisite GPA and Course Delivery Modality was used to examine student performance Effect of pre-requisite GPA – The effect of the pre-requisite GPA (MPGPA) on the final examination score is significant with a 90% confidence level for Nonlinear Equations upper and lower level Bloom scores. Students with prerequisite GPA higher than MPGPA perform better on these scores. Effect of course delivery mode – The effect of course delivery mode on the final examination score was not significant at the 90% confidence level for Nonlinear Equations upper and lower level Bloom scores. Thus, students receiving instruction under the different modalities did not vary significantly across the different methods of instruction. Effect of pre-requisite GPA and course delivery mode interaction – The effect of the interaction between GPA and delivery modality on the lower level Bloom questions was significant. This indicates that different ability level students may perform better based on mode of course delivery ANOVA Analysis to Address Pre-Requisite Preparation: The findings of both the cognitive assessment data as well as the survey data suggests that the use of web-based modules provides students with enhanced likelihood to succeed in the course. Students consistently performed better on achievement measures as well as survey items from the 2003 cohort as compared to the other three groups of students. Students in the cohort that received their instruction in the more traditional, face-to-face mode, without benefit of either supplementary or primary web-based materials, consistently performed lower than the other three groups, both on achievement measures as well as satisfaction measures. The findings of the qualitative data support the contention presented by other research that students find different and varied resources helpful. The use of multiple methods within the web modules created, e.g., textbook, notes, lecture videos, simulations and exercises, provides a variety of resources that maybe more or less helpful to specific student depending on their learning style. Conclusions: