The Effect of Formative Assessment in Brazilian University Physics Courses Omaha, August 1 st, 2011 Émerson Cruz and Gerd Kortemeyer Michigan State University.

Slides:



Advertisements
Similar presentations
Just what you need to know and do NOW!
Advertisements

College Algebra Redesign Oklahoma State University College Algebra is the lowest level OSU math course. Required for many non-science majors. Annual enrollment:
Classroom Response Systems: iClickers NJIT Physics Department August 2009.
Assessment with LON-CAPA Username: Your “Alias” Password: purdue Select: LB 272 – Intro Physics …
Evaluating Online Tutorials for Data Structures and Algorithms Courses June 24, Simin Hall, PhD Mechanical Engineering Prof. Clifford A. Shaffer,
Distance Learning through Technology Survey Summer 2002 Survey distributed to all exclusively on-line classes in Summer Survey was also mailed to.
Learning Community II Survey Spring 2007 Analysis by Intisar Hibschweiler (Core Director) and Mimi Steadman (Director of Institutional Assessment)
Antonio Anne Margarette Madalang Kyle Marron Ritual Krizza
Hybrid Statistics Clicks Janet Winter Penn State Berks.
Areas of Potential ECE-ENE Collaboration Dave Meyer Electrical & Computer Engineering March 5, 2005.
Technology as a solution to implementing active-learning pedagogies... Ann C. Smith University of Maryland College Park MD PKAL 2003 Boulder Colorado.
The Nexus Explored: A Generalised Model of Learning Styles Damian Gordon, Gordon Bull e-Learning Research Group, School of Computing, Dublin Institute.
COURSE REDESIGN MANAGERIAL FINANCE Dr. Shannon Donovan, Professor, Accounting and Finance, Bridgewater State University
The LON-CAPA Resource Sharing Network Gerd Kortemeyer Michigan State University.
Effectively Teaching Accounting Online or Hybrid
Enhancing Student Learning Through Error Analysis
Blended Courses: How to have the best of both worlds in higher education By Susan C. Slowey.
LON-CAPA 1 The LearningOnline Network with Computer- Assisted Personalized Approach (LON-CAPA) Gerd Kortemeyer Michigan State University.
LON-CAPA 1 Knowing what 400 students know Gerd Kortemeyer Michigan State University... before it’s too late.
LON-CAPA 1 The LearningOnline Network with Computer- Assisted Personalized Approach (LON-CAPA) Gerd Kortemeyer Michigan State University.
 8 years teaching English at SMSU  7 ½ years mentoring high school CEP teachers  Professional awareness of disconnect in high school and college standards.
…improves student performance! “I use the LearnSmart modules within Connect Management to get students familiar with the material and engaged with the.
Making Big Classes Small: Penn State’s Blended Learning Initiative Renata Engel John T. Harwood January 30, 2006 Copyright Penn State, This work.
METHODS Study Population Study Population: 224 students enrolled in a 3-credit hour, undergraduate, clinical pharmacology course in Fall 2005 and Spring.
Creating an OER Course to Enhance Student Learning Kipp Snow Brandi Ulrich Anne Arundel Community College.
SLIDE 1 Innovations Conference March SLIDE 2 The National Lone Star Report Aligning Technology with Student Success.
Tammy Muhs General Education Program Mathematics Coordinator University of Central Florida NCAT Redesign Scholar Course Redesign: A Way To Improve Student.
The Role of Automation in Undergraduate Computer Science Chris Wilcox Colorado State University 3/5/2015.
THE TEACHING ISSUE IN BRAZIL An innovative pathway in recruitment and in teacher training program As I’m a new member of this International Alliance,
Student Success. Creative Problem-Solving for Bottleneck Courses: A Low Completion Rate Course Project Project Objectives:  Define and diagnose the factors.
Curriculum Innovations in the Department of Informatics of TEI-A Prof. K. Georgouli Nis, 24 March 2006 SCM Tempus project CO15A05.
 “…the systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and.
Student Centered Teaching Through Universal Instructional Design Part II.
Introduction to LON-CAPA May 13 th, 2010 Dalhousie University Gerd Kortemeyer Michigan State University.
1 Quality, quantity and diversity of feedback in WisCEL courses enhances relationships and improves learning John Booske Chair, Electrical and Computer.
Glen Hatton Introduction to Financial Accounting TURNING THE ACCOUNTING CLASSROOM UPSIDE DOWN Randy Hoffma n Introduction to Managerial Accounting PHASE.
Maximizing Learning Using Online Assessment 2011 SLATE Conference October 14, /12/ P. Boyles, Assistant Professor, Chicago State University,
Oct. 18, 2002Indiana University How Do Students Use Textbooks? Dennis Jacobs Department of Chemistry and Biochemistry University of Notre Dame TextRev.
Redesign of Precalculus Mathematics THE UNIVERSITY OF ALABAMA College of Arts and Sciences Course Redesign Workshop October 21, 2006.
Lack of Learning or Lack of Studying? An Inquiry into Low Exam Scores Katherine M. Sauer Metropolitan State College of Denver February.
Question 1 Why did a majority of students perceive the innovative web-enhanced Japanese language courses favorably and participate in additional online.
Student Success in Mathematics: Guiding Principles Teresa Thiel Shahla Peterman University of Missouri-St. Louis Math Technology Learning Center.
Teaching Thermodynamics with Collaborative Learning Larry Caretto Mechanical Engineering Department June 9, 2006.
Teaching a Distance Learning Course Presented by David R. Maidment, Dept of Civil Engineering University of Texas at Austin 20 January 1999 Concepts of.
Mapping the Changing Technological Landscape: Faculty and Student Surveys on Educational Technology Cara Lane, Research Scientist Catalyst Research and.
Assessing SAGES with NSSE data Office of Institutional Research September 25 th, 2007.
Web-based Assessment and Instructional Support David Lippman WAMAP Project Lead WAMAP Project Lead Pierce College 2009 TMP Summer Institute Your FREE Math.
Presented at the MCRI Workshop May 2009 by Dr. Megan E. Bradley Full Implementation Results for General Frostburg State University MCRI Workshop.
Student Preferences For Learning College Algebra in a Web Enhanced Environment Dr. Laura J. Pyzdrowski, Pre-Collegiate Mathematics Coordinator Institute.
The Impact of Distance Teaching on College Faculty Trudy Abramson & George Fornshell School of Computer and Information Sciences, Nova Southeastern University,
Assessment in Online Courses Gerd Kortemeyer Michigan State University APS/AAPT 2013 Department Chairs Conference and Workshop Workshop Access
GATEWAY INITIATIVE Hillsborough Community College Fall 2007 Preliminary Results A Formative Evaluation.
The Assessment Continuum Gerd Kortemeyer Michigan State University Jan 25th, 2012 Before, in, and after lecture.
Integrating Web-based Blackboard™ into ESL Discussion and Writing Activities Presenter: Professor Lyra Riabov Southern New Hampshire University Presentation.
Final Report. WST 100 and WST 300 Large introductory course traditionally serving up to 2400 students a year in 18 sections With redesign we are able.
The Assessment Continuum James (J.T.) Laverty Michigan State University April 16, 2012 Slides borrowed from: Gerd Kortemeyer Before, in, and after lecture.
Michigan State University Gathering and Timely use of Feedback from Individualized On-Line Work. Matthew HallJoyce ParkerBehrouz Minaei-BigdoliGuy AlbertelliGerd.
LON-CAPA The LearningOnline Network with CAPA Gerd Kortemeyer Michigan State University East Lansing, USA.
Student Opinions of Online Learning Systems Nicholas Verno, Senior CIS Major Westminster College Faculty Advisor - Dr. Terri Lenox.
Dr. Bill Bailey, Dr. Gregory L. Wiles & Professor Thomas R. Ball Kennesaw State State University Marietta, GA The Converged Classroom.
Team-Based Learning (TBL) Richard Yuretich Department of Geosciences University of Massachusetts Amherst.
Research Problem The role of the instructor in online courses depends on course design. Traditional instructor responsibilities include class management,
UCLA Graduate School of Education & Information Studies National Center for Research on Evaluation, Standards, and Student Testing An Exploratory Study.
Teaching and learning online: Perceptions of UAF Rural Campus Instructors Victor and Natalia Zinger UAF.
Student perception and satisfaction in Online Certificate Courses Erman Yukselturk Middle East Technical University Fethi A. Inan The University of Memphis.
Technology’s Effect on Gender Equity in Science Education Deborah A. Kashy, Gerd Kortemeyer, & David Harris Michigan State University Analyses of Gender.
21 st Century Communications Technology, Online Higher Education Innovation, and Remaining Challenges David Reeves Government Relations Charles Sturt University.
Adventures in flipping a cell biology course Dr. Katie Shannon Biological Sciences Missouri S&T How do online videos and textbook reading engage students.
Challenges of Implementing PBL in Higher Learning Institutions in Developing Countries: A Case of SUA, Tanzania Sangeda A., Ndossi D. Sokoine University.
Michigan State University
Presentation transcript:

The Effect of Formative Assessment in Brazilian University Physics Courses Omaha, August 1 st, 2011 Émerson Cruz and Gerd Kortemeyer Michigan State University

Émerson Cruz Study carried out by my graduate student Émerson Cruz Cannot be here today In Brazil collecting data

Formative Assessment Most post-secondary physics courses in Brazil offer no meaningful formative assessment ◦ no feedback from assigned homework ◦ traditional “transmission mode” lectures Implementing ◦ online homework with immediate feedback ◦ clickers Studying ◦ faculty and student acceptance ◦ effect on grade distribution

Collaboration Partners

Implementation Hurdles Our educational study quickly turned into a case study of implementation hurdles ◦ Public institutions:  grading structure based solely on exams  no possibility to give points for homework or clickers  exams very traditional and highly computational  no regular computer access for large percentage of students  no infrastructure to sell clickers and register them to individual students  had to distribute one classroom set to several sections at the beginning of lectures  no correlation data between clickers and grades  no reward structure for correctly answering questions ◦ Private institution:  Smaller statistics  Highly non-traditional student population (professionals)

No hard data yet Anecdotes Results from these two institutions Collaboration Partners

USP University of São Paulo ◦ one of the three public universities funded by the State of São Paulo. ◦ one of the largest institutions of higher education in Latin America ◦ approximately 75,000 enrolled students

Unianhanguera Unianhanguera ◦ one of the biggest private universities in Brazil ◦ more than 50 campuses spread out in seven Brazilian states ◦ largely non-traditional student population (professionals)

Usage USP ◦ Two sections of physics for engineers course  other sections traditional with different instructors  additional comparison: same instructor in previous years ◦ Online homework (LON-CAPA)  only 54 of the 157 accounts used  no grading incentive  76 of the 157 students said they used online homework  working in groups  access problems ◦ Clickers  given out at beginning of lectures  no data collected on correctness, participation, etc. Unianhanguera ◦ Two-month course ◦ Online homework  one section with and one without online homework (same instructor)  grading incentive: bonus points  all 55 students worked on online homework ◦ No clickers

Survey Results Gave a survey in both settings on usage habits and perceived helpfulness

First Action when Encountering New Problem

USA and Brazil: ◦ Male students tend to immediately try out a solution before reading up on the topic or seeking help  “Real men don’t read manuals or ask directions” Brazil: ◦ Students do not communicate with lecture personnel ◦ Brazil, private institution:  Students rarely read up on topic  Seek more help from peers First Action when Encountering New Problem

Additional Time-on-Task versus Perceived Helpfulness USA and Brazil: ◦ Online homework mostly perceived as helpful Brazil: ◦ Students report less time-on-task  Perception that online should be more time-efficient?  Sense of security due to more clearly defined expectations leading to less studying time?

Clickers Found broad student acceptance in survey at USP Instructor reports that lectures became more lively and interactive ◦ But: no hard data

Effect on Grades USA: ◦ particularly helpful for students who are about to fail the course Brazil: ◦ no significant difference ◦ USP: both with parallel sections (different instructors) and with sections taught previously (same instructor) ◦ Unianhanguera: with parallel section (same instructor)

Why no effect? Discrepancy: ◦ Students perceived online homework and clickers as helpful  Novelty? ◦ No significant difference in grades  Unable to reproduce USA results Why? ◦ Systemic change needed  value-system of a course is communicated by what is graded and on exams ◦ Many logistical hurdles in implementation  including lack of student internet access Only just beginning!

Acknowledgements Thanks to Prof. Hélio Dias at USP Thanks to i>Clicker for loaning us a classroom set of clickers