Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills Presenter: Han, Yi-Ti Adviser: Chen, Ming-Puu Date: March 30, 2009 Serkan, S. & Ferhan, H. (2009). Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills. Computers & Education (In Press).

Introduction The Secretary’s Commission on Achieving Necessary Skills (1991) regarded higher order thinking competencies : critical thinking, decision making, problem solving and reasoning. Integration of constructivist approaches such as problem based learning (PBL) into the instructional endeavors carries utmost importance (Yasar, 1998). Problem based learning (PBL) 3 basic principles : It is necessary to have a problem to trigger learning. It is a holistic approach involving interaction of several learning approaches and methods. It is almost always student-centered. PBL activities are designed in a way that is possible for instructors to offer guidance for ill-structured and complicated problems (Gallagher. Stepien, & Rosenthal, 1992).

Introduction Barrows(1985) summarizes the features of ill-structured problems: Sufficient information to understand the problem is more than the information provided in the problem situation. New information about the problem situation can change the definition of the problem. Different perspectives are necessary to interpret information. There is no definite and single solution for the problem. The Watson–Glaser classification of Critical thinking skills (CTS) involves defining problem, determining possible solutions and strong assumptions, drawing valid conclusions regarding the solution and evaluation these conclusions (Kaya,1997). Such skills are: inference 、 recognition of assumptions 、 deduction 、 interpretation 、 evaluation of arguments.

Introduction Cho and Jonassen(2002) examined students’ use of online discussion supports to back up their discussions on problem situations. Students meaningfully transferred what they had learnt from online discussion facilities to their actual discussions during problem solving. Donnelly (2006) conducted a case study where online PBL techniques were integrated into a face-to-face setting. group activities the instructor’s role the student–content and student–student interaction

Methods Research questions Do the content knowledge test scores of the online PBL group increase more significantly than the scores of the online instructor- led group? Do the CTS scores of the online PBL group increase more significantly than the scores of the online instructor-led group? 40 students attended Computer II course randomly assigned to the experiment (16 females and 4 males) and the control group (15 females and 5 males) matched pairs base on subjects’ prior content knowledge, prior CTS scores （ Watson–Glaser critical thinking skills test ）, final grades from the Computer I course, Internet use hours per week, and gender.

In order to implement online activities, MOODLE was used. Computer II-A : experiment group who were exposed to online PBL activities. Computer II-B : control group who were exposed to online instructor-led activities. All subjects were provided training on online course delivery during the first week and on effective search strategies during the second week of the implementation. Class activities were implemented beginning with the third week. Methods

The experiment group was exposed to PBL activities involving ill-structured problem scenarios which were developed through the following steps (Jonassen, 1997): Introduction of the problem situation Expectations from the group members Opinions about the problem Prior knowledge about the problem Required information to solve the problem Determining plans Solution process Evaluation Even though they were supposed to work in groups and implement PBL strategies during group activities, they were asked to prepare individual reports on the problem solution according to the standards determined at the beginning of the semester. Methods

The control group, on the other hand, was provided with the summary contents each week. They were exposed to following activities (Horton, 2000): Introduction of new information Information resources Participation Information sharing Evaluation Feedback They completed assignments according to predetermined standards, participated in instructor-led online discussion forums, and shared their comments with the instructor and other peers through online communication tools.

Results Content knowledge acquisition Online PBL did not have a different effect than online instructor- led activities in terms of content knowledge acquisition. Even though both groups had significantly higher scores in the posttest, it was not possible to maintain that one of the group outperformed the other.

Results Critical thinking skills The PBL group had higher gains in terms of CTS than the instructor-led group even though they were equal at the inception.

Conclusions and discussion Online interaction tools provided to the control group in the current study could be as effective as PBL activities in increasing low-level cognitive skills along with keeping motivation higher. In this regard, the method was not purely instructor-centered, it can be suggested that if the control group was exposed to a more instructor-centered group, the differences can be greater. Age level of subjects can be another significant indicator of the differences in the PBL research. Such findings implied that PBL could be more effective with younger learners.

Conclusions and discussion A final evaluation can be conducted about the CTS difference between the groups in regard to the roles of instructors. the experiment group: the instructor provided learners with clues during online discussions and led them to think deeper, discuss more, reflect further and conduct more research. the control group: the instructor provided with direct responses for their questions. Moreover, the corrections were always immediate. This led the control group students to use ready information without questioning and thinking deeper. In brief, the role assumed by the course instructor can have a significant influence on the development of critical thinking skills in an online PBL environment.