1. IMMEX: Providing Insight into Problem Solving Using Technology Charlie Cox Preliminary Oral Defense

2. Outline What is IMMEX? Why use IMMEX? Proposed project

3. What is IMMEX? Originally developed for the UCLA medical school. Internet – Based Software Novel Assessment Tool

4. IMMEX Problems Case – Based Non-precribed strategies Immediate Assessment http://ublib.buffalo.edu/libraries/projects/cases/case.html

5. Prolog

8. Problem Space

11. What is unique about IMMEX? Immediate feedback Tracks HTML movements Search Path Map

15. Strategy Interpretations Most commonly 3 strategy - types can be identified: Limited Efficient Prolific Artificial Neural Networks Hidden Markov Models

16. Limited Search Path Map

17. Additional Example

18. Prolific Search Path Map

19. Efficient Search Path Map

20. Strategy Analysis using ANNs Pattern Recognition Uses a 6 x 6 grid for pattern recognition

21. A Node From Hazmat Problem Space Item PROBABILITYPROBABILITY Background Flame, Solubility, Conductivity Litmus HCl, NaOH Precipitins

23. Hidden Markov Modeling Used to study student transitions when working problems. Predictive Modeling Soller, A., and Lesgold, A. (2003). A Computational Approach to Analyzing Online Knowledge Sharing Interaction. Proceedings of Artificial Intelligence Education, 2003, Australia. 253.

24. HMM Probabilities Initial Transition a ij = Pr[q t+1 =S j |q t =S i ] Emission or Observational Probabilities b j (k) = Pr(v k at t|q t = S i ]

25. Stevens et. al. ITS, 2004, accepted

26. Transition Table To State: 12345 10.990.00 20.050.550.020.070.31 From State:30.060.340.220.330.05 40.030.01 0.940.01 50.020.030.00 0.95 Stevens et. al., ITS, 2004, accepted

27. Transition Summary Stevens et. al., ITS, 2004, accepted

28. Framing, Transitioning, Stabilization State Strategy SequenceDescriptionTrajectory 132 33 28 33 33 Limited test selections, few background resourcesLocalized 212 18 24 20 1 Many tests becoming fewer with progress.Progressive 35 24 6 18Many test selections.Localized 44 22 33 33 Resource extensive going to data.Shifting 54 6 14 25 30 19 Shifts between data rich and data lean strategies.Shifting

29. Item Response Theory Examines each item individually as it is added and removed. 1 - parameter logistic Student ability Item Difficulty

30. Research Objectives Does teaching style influence problem solving? Passive vs. Active Methods IRT and States will be compared Cooper, M.M. (1995), Cooperative Learning: An Approach for Large Enrollment Courses Journal of Chemical Education. 162.

31. Research Objectives Stabilization Gender Effects Period of Time for Stabilization

32. Research Objectives The Effect of Formal Reasoning on Problem Solving using the GALT test. Spatial Ability Bunce, Diane M.; Hutchinson, Kira D. J. Chem. Educ. 1993, 70, 183. Herron, D. The Chemistry Classrom: Formulas for Successful Teaching, American Chemical Society, Washington DC, 1995.

33. Transfer of Knowledge Problem Similarities Teaching Style Gender

34. IMMEX Problems for the Study In - Stereo OrganoMech Lewis Structure Finding Carbon’s Neighbors TLC Separation Specta Analysis

35. In - Stereo Figures Line Structure

36. Lewis Structure

37. Newman Projection

38. Sawhorse Projection

39. 3 - D Ball and Stick Figure

40. 3 - D Wireframe

41. 3 - D Stick Model

42. Plugin Rotation in 3 - D space Switch between the possible 3 - D figures while rotating.

43. TLC Problem -- Unknown Analysis Unknown identification based upon TLC analyses.

44. Additional Information Developing Solvent Stationary Phase Solvent Volume Visualization Method Library R f Values Examples of TLC of a Known Compound

45. Spectra Analysis 1 H, 13 C, IR, and MS data is available for students to elucidate an unknown’s structure.

46. Spectra Analysis Continued

47. Additional Spectra Analysis INFO 1.Example Spectra a. Benzaldehyde b. 2-butanone c. Benzene d. Butylamine e. Propionic Acid 2.Correlation Tables 3. Library

48. Preliminary Results Lewis Structure (Male and Female Strategies) p < 0.000

49. Lewis Structure Performance p = 0.151

50. Stabilization FemaleMale

51. Spectra Analysis (GPA & State)

52. Interventions -- Collaborative Grouping

53. State Distribution -- Collaborative Grouping

54. In - Stereo