Download presentation
Presentation is loading. Please wait.
Published byAnissa McDowell Modified over 9 years ago
1
Assessed: 2007, 2010, 2011, 2013
3
PHIL 101 (Introduction to Philosophy: Ethics) GE elective choice BA 300 (Ethical Decision Making in Business) Required course for all BSBA students Preparation for the Major Requirements Our students also learn and practice these skills in additional courses as listed however assessment occurs in BA 300. Core Courses in the BSBA Major Advanced Courses in the BSBA Major
4
2007 NOTE: The current SLO #1 & SLO #2 were combined into a single SLO at the time (referred to below as SLO #1). Current SLO #3 is referred to below as SLO #2. SLO #1 & SLO #2 were assessed via embedded questions in the final exam of the required core course, BA 300 (Ethical Decision Making in Business). 3 questions were written by the class coordinator of BA 300 that addressed SLO #1 4 questions were written by the class coordinator of BA 300 that addressed SLO #2 SLO #3 (now SLO #4) was not assessed in 2007 because at the time it was the intention to assess it via a case analysis in MGT 405 that would be chosen for its ethics content. BA 300 was added as a required new course in 2006. Insufficient numbers of students would have taken BA 300 and moved on to MGT 405 by 2007 for a meaningful assessment of SLO #3 to occur in 405. It was later decided that this SLO would also most appropriately be assessed in BA 300 and this occurred in 2010.
5
Cycle #1 (2007): ▪Fall Semester 2007, Spring Semester 2008, Summer Session 2008 in BA 300 (Ethical Decision Making in Business) ▪Sample Size: 423 Cycle #2 (2010): ▪Spring Semester 2010 in BA 300 (Ethical Decision Making in Business) ▪Sample Size: 594 Cycle #3 (2011): ▪Fall Semester 2011 in BA 300 (Ethical Decision Making in Business) ▪Sample Size: 633 Cycle #4 (2013): ▪Spring Semester 2013 in BA 300 (Ethical Decision Making in Business) ▪Sample Size: 544
6
BENCHMARKS: 70% of our students should be able to correctly respond to questions assessing each of the student learning outcomes.
7
2007
8
QuestionCorrectIncorrectTotal % Correct 119223045.50% 23725088.15% 33497382.70% Average of 3 questions 72.12% “70% should be able to correctly respond”; On average, 72% could Question #1 did not meet the benchmark
9
QuestionCorrectIncorrectTotal % Correct 130311971.80% 230911373.22% 33913192.65% 428214066.82% Average of 4 questions 76.12% “70% should be able to correctly respond”; On average, 76% could Question #4 did not meet the benchmark
10
“70% OF OUR STUDENTS SHOULD BE ABLE TO RESPOND CORRECTLY TO QUESTIONS DESIGNED TO MEASURE THEIR KNOWLEDGE OF ETHICAL REASONING SLO #1 & SLO #2.” BENCHMARK ACHIEVED
11
BA 300 was introduced in 2006 as a fully face-to-face course but was then developed as a hybrid course in order to accommodate demand. In 2007-2008 there were fully face-to- face and hybrid sections both being taught. Assessment analysis was undertaken to compare the two delivery modes.
12
QuestionFully F-to- F Correct % Hybrid Correct % Hybrid Advantage 142.3%50.0%+7.7 284.5%92.4%+7.9 380.6%81.9%+1.3 469.0%79.2%+10.2 579.3%71.5%-7.8 693.4%93.1%-0.3 763.4%72.2%+8.8
13
On five of the seven questions, students in hybrid sections answered correctly more frequently than those in fully face-to-face sections. For four of these five questions there was a statistically significant difference between performance in the two delivery modes. For the two questions where the face-to-face students “beat” the hybrid students, one difference was statistically significant. The intent of the analysis was not to determine whether a hybrid delivery mode was better or worse than a fully face-to-face delivery mode. With the plan in place to go to all hybrid delivery in Fall 2008 for reasons unrelated to student learning however, this assessment was carried out to ensure that hybrid delivery did not produce significantly less learning. Results suggest that this is not the case.
14
Assessment results suggest no need for change. The BA 300 course coordinator carefully considered the two questions on which the benchmark of 70% was not achieved and determined that the questions required some adjustment. Further, this analysis produced the decision to split the first SLO into two separate outcomes. BA 300 instructors were also advised to focus more strongly on the specific issues addressed in the two questions. BA 300 went to a hybrid delivery mode for all sections as planned.
15
2010
16
QuestionCorrectIncorrectTotal % Correct 15593594.11% 248311181.31% 35603494.28% Average of 3 questions 89.90% “70% should be able to correctly respond”; On average, 90% could. All individual questions met the benchmark.
17
QuestionCorrectIncorrectTotal % Correct 15514392.76% 240518968.18% 348710781.99% Average of 3 questions 80.98% “70% should be able to correctly respond”; On average, 81% could. Question #2 missed the benchmark by a small percentage.
18
QuestionCorrectIncorrectTotal % Correct 15078785.35% 25534193.10% 35454991.75% Average of 3 questions 90.07% “70% should be able to correctly respond”; On average, 90% could. All individual questions met the benchmark.
19
QuestionCorrectIncorrectTotal % Correct 15068885.19% 25435191.41% 328131347.31% Average of 3 questions 74.64% “70% should be able to correctly respond”; On average, 75% could. Question #3 missed the benchmark by a significant percentage.
20
“70% OF OUR STUDENTS SHOULD BE ABLE TO RESPOND CORRECTLY TO QUESTIONS DESIGNED TO MEASURE THEIR KNOWLEDGE OF ETHICAL REASONING (SLOS 1 – 4).” BENCHMARK ACHIEVED
21
Assessment results suggest no need for change. The BA 300 course coordinator carefully considered the two questions on which the benchmark of 70% was not achieved. It was determined that the problematic question (SLO 4, Q#3) required an application that was potentially tricky. The question will be adjusted in future assessments. BA 300 instructors were also advised to focus more strongly on the specific issues addressed in the two questions that did not meet the 70% benchmark.
22
2011
23
QuestionCorrectIncorrectTotal % Correct 15765791.0% 237525859.2% 342021366.4% Average of 3 questions 72.2% “70% should be able to correctly respond”; On average, 72.2% could. Questions #2 & #3 both missed the benchmark.
24
QuestionCorrectIncorrectTotal % Correct 15656889.3% 251711681.7% 351312081.0% Average of 3 questions 84.0% “70% should be able to correctly respond”; On average, 88% could. Performance on all questions exceeded the benchmark.
25
QuestionCorrectIncorrectTotal % Correct 141921466.2% 25854892.4% 350113279.1% Average of 3 questions 79.2% “70% should be able to correctly respond”; On average, 79.2% could. Question #1 missed the benchmark.
26
QuestionCorrectIncorrectTotal % Correct 15686589.7% 240522864.0% 348614776.8% Average of 3 questions 76.8% “70% should be able to correctly respond”; On average, 76.8% could. Question #2 missed the benchmark.
27
“70% OF OUR STUDENTS SHOULD BE ABLE TO RESPOND CORRECTLY TO QUESTIONS DESIGNED TO MEASURE THEIR KNOWLEDGE OF ETHICAL REASONING (SLOS 1 – 4).” BENCHMARK ACHIEVED
29
Although assessment results suggest no significant need for change, the comparison between 2010 & 2011 suggests significant declines on SLO #1 & SLO #3. The BA 300 course coordinator will meet with the BA 300 teaching faculty to examine how material related to these two student learning outcomes is covered and changes, if deemed appropriate, will be made.
30
2013
31
QuestionCorrectIncorrectTotal % Correct 14756987.3% 240613874.6% 342711778.5% Average of 3 questions 80.2% “70% should be able to correctly respond”; On average, 80.2% could. All individual questions also exceeded the benchmark.
32
QuestionCorrectIncorrectTotal % Correct 14647685.9% 24429881.9% 34825889.3% Average of 3 questions 85.7% “70% should be able to correctly respond”; On average, 85.7% could. Performance on all questions exceeded the benchmark.
33
QuestionCorrectIncorrectTotal % Correct 135019064.8% 24588284.8% 335818266.3% Average of 3 questions 72.0% “70% should be able to correctly respond”; On average, 72.0% could. Questions #1 & #3 missed the benchmark.
34
QuestionCorrectIncorrectTotal % Correct 15231796.9% 25004092.6% 337015270.9% Average of 3 questions 86.8% “70% should be able to correctly respond”; On average, 86.8% could. All individual questions met or exceeded the benchmark.
35
“70% OF OUR STUDENTS SHOULD BE ABLE TO RESPOND CORRECTLY TO QUESTIONS DESIGNED TO MEASURE THEIR KNOWLEDGE OF ETHICAL REASONING (SLOS 1 – 4).” BENCHMARK ACHIEVED
37
Although assessment results suggest no significant need for change, the comparison between 2010, 2011, & 2013 suggest some changes worth watching: SLO #1 dropped significantly between 2010 & 2011 but began to bounce back in 2013. SLO #2 performance has remained largely consistent. SLO #3 has declined with each assessment and in 2013 was close to missing the established benchmark. SLO #4 performance grew very strongly in 2013. The BA 300 course coordinator will meet with the BA 300 teaching faculty to examine how material related to SLO #3 is covered. A plan for changed or enhanced coverage will be developed.
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.