Computer Engineering Program Outcomes Assessment Prepared by Prof. Mayez Al-Muhammad and Dr. Aiman El-Maleh Dept. of Computer Engineering King Fahd University of Petroleum & Minerals, Saudi Arabia Prepared by Prof. Mayez Al-Muhammad and Dr. Aiman El-Maleh Dept. of Computer Engineering King Fahd University of Petroleum & Minerals, Saudi Arabia

2 OutlineOutline n ABET EC2K n Program Educational Objectives n Program Outcomes n Relation of Program Outcomes & Educational Objectives n Program Outcomes Coverage in Curriculum n Program Objectives & Outcomes Assessment Process n Course Outcomes Assessment n Program Outcomes Assessment n Conclusions n ABET EC2K n Program Educational Objectives n Program Outcomes n Relation of Program Outcomes & Educational Objectives n Program Outcomes Coverage in Curriculum n Program Objectives & Outcomes Assessment Process n Course Outcomes Assessment n Program Outcomes Assessment n Conclusions

3 ABET EC 2K n Industry mutation: Engineers should be educated in a way to facilitate their adaptation to important industry mutation (Bio, Nano, Health, Comp. Technology, change in products, etc) n Shift in Engineering Education Teacher-Centered Focus Teacher-Centered Focus Traditional classroomTraditional classroom Distance learning using synchronous video-conferencingDistance learning using synchronous video-conferencing Learner-Centered Focus (outcome-based) Learner-Centered Focus (outcome-based) Interactive multimediaInteractive multimedia Educational solutions designed by multi-skilled academic teamsEducational solutions designed by multi-skilled academic teams Asynchronous learning (any time and anywhere)Asynchronous learning (any time and anywhere) n Fall 2007, all Engineering programs at KFUPM seek ABET 2K accreditation. n Industry mutation: Engineers should be educated in a way to facilitate their adaptation to important industry mutation (Bio, Nano, Health, Comp. Technology, change in products, etc) n Shift in Engineering Education Teacher-Centered Focus Teacher-Centered Focus Traditional classroomTraditional classroom Distance learning using synchronous video-conferencingDistance learning using synchronous video-conferencing Learner-Centered Focus (outcome-based) Learner-Centered Focus (outcome-based) Interactive multimediaInteractive multimedia Educational solutions designed by multi-skilled academic teamsEducational solutions designed by multi-skilled academic teams Asynchronous learning (any time and anywhere)Asynchronous learning (any time and anywhere) n Fall 2007, all Engineering programs at KFUPM seek ABET 2K accreditation.

4 INSTITUTION VISION n KFUPM vision To be a vibrant multicultural University of international repute focusing on quality education and innovative research that prepares professionals and entrepreneurs to lead social, economic and technical development in the region. To be a vibrant multicultural University of international repute focusing on quality education and innovative research that prepares professionals and entrepreneurs to lead social, economic and technical development in the region. n CCSE main objectives To provide the skilled manpower needed for the fulfillment of the country's development plans. In particular: information & computer scientists, computer engineers, and systems engineers. To provide the skilled manpower needed for the fulfillment of the country's development plans. In particular: information & computer scientists, computer engineers, and systems engineers. To prepare students for graduate work and research in their field of specialization. To prepare students for graduate work and research in their field of specialization. To provide a link through which computer technologies and their applications could be transferred to the country. To provide a link through which computer technologies and their applications could be transferred to the country. To provide the country, through research and graduate studies, with skills, ideas, and innovations in certain areas of advanced technologies. To provide the country, through research and graduate studies, with skills, ideas, and innovations in certain areas of advanced technologies. n KFUPM vision To be a vibrant multicultural University of international repute focusing on quality education and innovative research that prepares professionals and entrepreneurs to lead social, economic and technical development in the region. To be a vibrant multicultural University of international repute focusing on quality education and innovative research that prepares professionals and entrepreneurs to lead social, economic and technical development in the region. n CCSE main objectives To provide the skilled manpower needed for the fulfillment of the country's development plans. In particular: information & computer scientists, computer engineers, and systems engineers. To provide the skilled manpower needed for the fulfillment of the country's development plans. In particular: information & computer scientists, computer engineers, and systems engineers. To prepare students for graduate work and research in their field of specialization. To prepare students for graduate work and research in their field of specialization. To provide a link through which computer technologies and their applications could be transferred to the country. To provide a link through which computer technologies and their applications could be transferred to the country. To provide the country, through research and graduate studies, with skills, ideas, and innovations in certain areas of advanced technologies. To provide the country, through research and graduate studies, with skills, ideas, and innovations in certain areas of advanced technologies.

5 Program Objectives n Objective 1: Practice profession with confidence and global competitiveness and make intellectual contributions to it. n Objective 2: Pursue a life-long career of personal and professional growth with superior work ethics and character. n Objective 3: Pursue advanced study and research at the graduate level. n Objective 1: Practice profession with confidence and global competitiveness and make intellectual contributions to it. n Objective 2: Pursue a life-long career of personal and professional growth with superior work ethics and character. n Objective 3: Pursue advanced study and research at the graduate level.

6 Program Outcomes … n (a) an ability to apply knowledge of mathematics, science, and engineering n (b) an ability to design and conduct experiments, as well as to analyze and interpret data n (c) an ability to design a system, component, or process to meet desired needs n (d) an ability to function on multi-disciplinary teams Our interpretation of multidisciplinary teams includes teams of individuals with similar educational backgrounds focusing on different aspects of a project as well as teams of individuals with different educational backgrounds. n (e) an ability to identify, formulate, and solve engineering problems n (a) an ability to apply knowledge of mathematics, science, and engineering n (b) an ability to design and conduct experiments, as well as to analyze and interpret data n (c) an ability to design a system, component, or process to meet desired needs n (d) an ability to function on multi-disciplinary teams Our interpretation of multidisciplinary teams includes teams of individuals with similar educational backgrounds focusing on different aspects of a project as well as teams of individuals with different educational backgrounds. n (e) an ability to identify, formulate, and solve engineering problems

7 … Program Outcomes … n (f) an understanding of professional and ethical responsibility n (g) an ability to communicate effectively n (h) the broad education necessary to understand the impact of engineering solutions in a global and societal context n (i) a recognition of the need for, and an ability to engage in life-long learning Our interpretation of this includes teaching students that the underlying theory is important because the technology will change, coupled with enhancing their self-learning ability. n (f) an understanding of professional and ethical responsibility n (g) an ability to communicate effectively n (h) the broad education necessary to understand the impact of engineering solutions in a global and societal context n (i) a recognition of the need for, and an ability to engage in life-long learning Our interpretation of this includes teaching students that the underlying theory is important because the technology will change, coupled with enhancing their self-learning ability.

8 … Program Outcomes n (j) knowledge of contemporary issues Our interpretation of this includes presenting students with issues such as the impact of globalization, the outsourcing of both engineering and other support jobs as practiced by modern international companies. n (k) an ability to use the techniques, skills, and modern engineering tools necessary for engineering practice. n (l) Knowledge of Probability and Statistics and their applications in Computer Engineering n (m) Knowledge of Discrete Mathematics n (n) The ability to design a system that involves the integration of hardware and software components n (j) knowledge of contemporary issues Our interpretation of this includes presenting students with issues such as the impact of globalization, the outsourcing of both engineering and other support jobs as practiced by modern international companies. n (k) an ability to use the techniques, skills, and modern engineering tools necessary for engineering practice. n (l) Knowledge of Probability and Statistics and their applications in Computer Engineering n (m) Knowledge of Discrete Mathematics n (n) The ability to design a system that involves the integration of hardware and software components

9 Relation of Program Outcomes and Educational Objectives Program Educational Objectives Program Outcomes 1. Practice profession with confidence and global competitiveness and make intellectual contributions to it a, b, c, d, e, g, k, l, m, n 2. Pursue a life-long career of personal and professional growth with superior work ethics and character f, i, h, j 3. Pursue advanced study and research at the graduate level a, b, e, g, i, k

10 Program Outcomes Coverage in Curriculum n Program outcomes are injected and well covered by core courses in the program curriculum. n Each program outcome is addressed by a set of core courses in the program. n Learning outcomes of core courses mapped to program outcomes with a level of emphasis being either low (L), medium (M), or High (H). n Level of emphasis for an outcome is determined based on the weight as follows: Course outcome weight < 10%, given a Low rank (L). Course outcome weight < 10%, given a Low rank (L). Course outcome weight between 10% and 20% given a Medium rank (M). Course outcome weight between 10% and 20% given a Medium rank (M). Course outcome weight  20% given a High rank (H). Course outcome weight  20% given a High rank (H). n Program outcomes are injected and well covered by core courses in the program curriculum. n Each program outcome is addressed by a set of core courses in the program. n Learning outcomes of core courses mapped to program outcomes with a level of emphasis being either low (L), medium (M), or High (H). n Level of emphasis for an outcome is determined based on the weight as follows: Course outcome weight < 10%, given a Low rank (L). Course outcome weight < 10%, given a Low rank (L). Course outcome weight between 10% and 20% given a Medium rank (M). Course outcome weight between 10% and 20% given a Medium rank (M). Course outcome weight  20% given a High rank (H). Course outcome weight  20% given a High rank (H).

11 Program Outcomes Coverage in Curriculum ABCDEFGHIJKLMN COE 202HHL COE 203M H LL H COE 205HLLL COE 305MLHLHLL COE 308HHLLL COE 341MHHLL COE 344MLHLL COE 360LLHLLM COE 390MHLMM COE 400MM MLMLLH COE 485LMHMLLMLLLM COE 351HMMHMM COE 399MMHMH STAT 319H ICS 252H IAS 211H ENGL 214H

12 Program Educational Objectives Assessment Process Alumni and employer Surveys Program Outcomes Faculty Discussion and Consideration Refine Courses and Program Assess Success of Graduates Student Exit Survey Program Objectives Advisory Board

13 Program Outcomes Assessment Process Program Educational Objectives (PEOs) Program Outcomes (POs) Course Outcome Assessment COE Exit Exam Industrial Advisory Board Assessment Committee & Undergraduate Committee ABET Feedback Course Learning Outcomes (CLOs) CLOs Computer Engineering Program Graduate Exit Survey/ Alumni Survey/ Employer Survey COE 390, COE 400, COE 485, COE 399, COE 350/351 KFUPM Internal Assessment

14 Program Outcomes Assessment Process n Two committees to conduct assessment process, assessment committee and undergraduate committee. n Assessment committee responsible of design and control of the direct and indirect assessment processes, design and control of the direct and indirect assessment processes, data collection and presentation, data collection and presentation, data delivery to undergraduate committee. data delivery to undergraduate committee. n Undergraduate Committee responsible of Carrying out analysis of direct and indirect assessment data provided by the Assessment Committee and the Faculty based on course assessment results. Carrying out analysis of direct and indirect assessment data provided by the Assessment Committee and the Faculty based on course assessment results. identify potential problems and suggest recommendations for making improvements. identify potential problems and suggest recommendations for making improvements. Implementing approved recommendations. Implementing approved recommendations. n Two committees to conduct assessment process, assessment committee and undergraduate committee. n Assessment committee responsible of design and control of the direct and indirect assessment processes, design and control of the direct and indirect assessment processes, data collection and presentation, data collection and presentation, data delivery to undergraduate committee. data delivery to undergraduate committee. n Undergraduate Committee responsible of Carrying out analysis of direct and indirect assessment data provided by the Assessment Committee and the Faculty based on course assessment results. Carrying out analysis of direct and indirect assessment data provided by the Assessment Committee and the Faculty based on course assessment results. identify potential problems and suggest recommendations for making improvements. identify potential problems and suggest recommendations for making improvements. Implementing approved recommendations. Implementing approved recommendations.

15 Course Outcomes Assessment … n Each COE course has a Course Learning Outcomes Table that includes the following for each outcome: Outcome indicators and details: this describes the main course topics that will be focused on to achieve the outcome. Outcome indicators and details: this describes the main course topics that will be focused on to achieve the outcome. Suggested assessment methods and metrics. Suggested assessment methods and metrics. Outcome minimum weight: this indicates the importance of the outcome in the course. It is the minimum weight from the total course score (out of 100) that must be used for assessing the outcome or covering the outcome in the course. Outcome minimum weight: this indicates the importance of the outcome in the course. It is the minimum weight from the total course score (out of 100) that must be used for assessing the outcome or covering the outcome in the course. A mapping between the course learning outcome and ABET program outcomes. A mapping between the course learning outcome and ABET program outcomes. Each outcome is given a rank as Low, High, Medium that correlates with the weight used for assessing the outcome. Each outcome is given a rank as Low, High, Medium that correlates with the weight used for assessing the outcome. n Each COE course has a Course Learning Outcomes Table that includes the following for each outcome: Outcome indicators and details: this describes the main course topics that will be focused on to achieve the outcome. Outcome indicators and details: this describes the main course topics that will be focused on to achieve the outcome. Suggested assessment methods and metrics. Suggested assessment methods and metrics. Outcome minimum weight: this indicates the importance of the outcome in the course. It is the minimum weight from the total course score (out of 100) that must be used for assessing the outcome or covering the outcome in the course. Outcome minimum weight: this indicates the importance of the outcome in the course. It is the minimum weight from the total course score (out of 100) that must be used for assessing the outcome or covering the outcome in the course. A mapping between the course learning outcome and ABET program outcomes. A mapping between the course learning outcome and ABET program outcomes. Each outcome is given a rank as Low, High, Medium that correlates with the weight used for assessing the outcome. Each outcome is given a rank as Low, High, Medium that correlates with the weight used for assessing the outcome.

16 … Course Outcomes Assessment n Course outcomes are assessed by course instructors both directly and indirectly. n Suggested direct assessment of course learning outcomes based on using Course Learning Outcomes Evaluation Table includes the following for each outcome: Outcome minimum weight. Outcome minimum weight. Outcome weight: this is to be filled by the instructor indicating how much weight was used by the instructor for assessing the outcome. Outcome weight: this is to be filled by the instructor indicating how much weight was used by the instructor for assessing the outcome. Assessment Method: this describes what methods were used to asses the outcome, the weight of each method, and the evidence of assessment. Assessment Method: this describes what methods were used to asses the outcome, the weight of each method, and the evidence of assessment. Class Average: indicates the student’s average performance in the outcome. Class Average: indicates the student’s average performance in the outcome. n Course outcomes are assessed by course instructors both directly and indirectly. n Suggested direct assessment of course learning outcomes based on using Course Learning Outcomes Evaluation Table includes the following for each outcome: Outcome minimum weight. Outcome minimum weight. Outcome weight: this is to be filled by the instructor indicating how much weight was used by the instructor for assessing the outcome. Outcome weight: this is to be filled by the instructor indicating how much weight was used by the instructor for assessing the outcome. Assessment Method: this describes what methods were used to asses the outcome, the weight of each method, and the evidence of assessment. Assessment Method: this describes what methods were used to asses the outcome, the weight of each method, and the evidence of assessment. Class Average: indicates the student’s average performance in the outcome. Class Average: indicates the student’s average performance in the outcome.

17 Course Learning Outcomes Table Example (COE 205) Course Learning Outcomes Outcome Indicators and Details Assessment Methods and Metrics Min. Weight ABET 2000 Criteria 1. Ability to analyze, design, implement, and test assembly language programs.  Instruction Set Architecture  Number (unsigned and signed) and character representation  Addressing modes  Syntax, semantics, and effect on flags of Pentium instructions.  Input/output.  Arithmetic and logic operations.  Flow-control structures.  Procedures.  Macros.  String manipulation.  Interrupt mechanism.  Implementation of Pseudo code algorithms in assembly language.  Assignment  Quizzes  Exams  Project 55%C(H)

18 Course Learning Outcomes Table Example (COE 205) Course Learning Outcomes Outcome Indicators and Details Assessment Methods and Metrics Min. Weight ABET 2000 Criteria 2. Ability to use tools and skills in analyzing and debugging assembly language programs.  Assembly language vs. machine language.  Assembling and linking assembly programs (including use of multiple files).  Use of debugger to analyze and debug programs.  Use of libraries.  Lab work 4%K(L) 3. Ability to design the datapath and control unit of a simple CPU.  Fetch-execute cycle  Data, address and control busses  Register transfer  Data path design: 1-bus, 2-bus and 3-bus CPU.  Derivation of control steps for assembly instructions.  Hardwired Control unit design  Microprogrammed control unit design.  Fixed vs. variable instruction format.  Assignments  Quizzes  Exams 15%C(M)

19 Course Learning Outcomes Table Example (COE 205) Course Learning Outcomes Outcome Indicators and Details Assessment Methods and Metrics Min. Weight ABET 2000 Criteria 4. Ability to demonstrate self- learning capability.  Ability to learn a course topic alone (e.g. Macros)  Course Project may involve topics not studied in the course  Assignment  Quizzes 2%I(L) 5. Ability to work in a team.  Project is divided into separate parts that will be integrated for project completion.  Project 2%D(L)

20 Course Learning Outcomes Evaluation Table Example (COE 205) Outcome Min. Weight Assessment Method Assign.QuizzExam I Exam II Exam III Final Exam Lab Work Proj.Total O155%15%8%15%20%5%8%71% Average12.1%5.3%9.5%12.1%4.1%7%50.1%(70.6%) Evidence#1-4#1-4, 6Q1-5 #1-13Rep. O24%5% Average4.1%4.1% (82%) Evidence#1-13 O315%20% Average11.8%11.8% (59%) EvidenceQ1-5

21 Course Learning Outcomes Evaluation Table Example (COE 205) Outcome Min. Weight Assessment Method Assign.QuizzExam I Exam II Exam III Final Exam Lab Work Proj.Total O42% Avg.1.3%1.3% (65%) Eviden.#5 O52% Avg.1%1% (50%) Eviden. Rep. Weight15%10%15%20% 10% 100% Average12.1%6.6%9.5%12.1%11.8 % 8.2%8%68.3%

22 Course Learning Outcomes Indirect Assessment Example (COE 205) Criteria Student Evaluation E (4)G (3)A (2)P (1) NA (0)Composite 1. As a result of this course, my ability to analyze, design, implement, and test assembly language programs can be described as, As a result of this course, my ability to use tools and skills in analyzing and debugging assembly language programs can be described as, 0 3. As a result of this course, my ability to design the datapath and control unit of a simple CPU can be described as, 0 4. As a result of this course, my ability to demonstrate self-learning capability can be described as, 0 5. As a result of this course, my ability to work in a team can be described as, 0 Number of Responses: 20

23 Course Assessment Results Example (COE 205) Section#Source of Outcome Data Outcome1Outcome2Outcome3Outcome4Outcome5 IInstructor Evaluation 64.8%48.2%72.3%62.8%61.7% Student Survey 75%65%68.2%73.3%75% IIInstructor Evaluation 77.8%80.7%70.1%75.2% Student Survey 88.25% 69%75%86.8% IIIInstructor Evaluation 77.4%86%77.5%78%78.8% Student Survey 87%79%77.8%81.5%80.3% OverallRecommend.AcceptableNeeds Improvem. Needs Improvem. Acceptable

24 Course Assessment Results Example (COE 205) n Observations: Outcome 2 and Outcome 5 have not been assessed directly in Section II and Section III and the lab mark has been used. Outcome 2 and Outcome 5 have not been assessed directly in Section II and Section III and the lab mark has been used. Based on the overall assessment and instructors feedback, it seems that Outcome 2 and Outcome 3 need improvement. All Other outcomes are considered well- achieved. Based on the overall assessment and instructors feedback, it seems that Outcome 2 and Outcome 3 need improvement. All Other outcomes are considered well- achieved. n Recommendations: Outcome 2 needs more emphasis in the lab and should be directly assessed by lab instructors. Outcome 2 needs more emphasis in the lab and should be directly assessed by lab instructors. Outcome 3 can be improved by increasing the number of assignments on this part from one to two. Outcome 3 can be improved by increasing the number of assignments on this part from one to two. n Observations: Outcome 2 and Outcome 5 have not been assessed directly in Section II and Section III and the lab mark has been used. Outcome 2 and Outcome 5 have not been assessed directly in Section II and Section III and the lab mark has been used. Based on the overall assessment and instructors feedback, it seems that Outcome 2 and Outcome 3 need improvement. All Other outcomes are considered well- achieved. Based on the overall assessment and instructors feedback, it seems that Outcome 2 and Outcome 3 need improvement. All Other outcomes are considered well- achieved. n Recommendations: Outcome 2 needs more emphasis in the lab and should be directly assessed by lab instructors. Outcome 2 needs more emphasis in the lab and should be directly assessed by lab instructors. Outcome 3 can be improved by increasing the number of assignments on this part from one to two. Outcome 3 can be improved by increasing the number of assignments on this part from one to two.

25 Program Outcomes Assessment n For each program outcome, an assessment and evaluation plan is developed that contains the following elements: Assessment and Evaluation Methods: This describes what assessment methods are used to collect data and how will the data be evaluated and interpreted. Assessment and Evaluation Methods: This describes what assessment methods are used to collect data and how will the data be evaluated and interpreted. Performance Criteria: This determines the criteria used to indicate that an outcome has been achieved with satisfactory levels or needs improvement. Performance Criteria: This determines the criteria used to indicate that an outcome has been achieved with satisfactory levels or needs improvement. Logistics: This indicates when the data will be collected and who will collect it, interpret it, and report the results. Logistics: This indicates when the data will be collected and who will collect it, interpret it, and report the results. n For each program outcome, an assessment and evaluation plan is developed that contains the following elements: Assessment and Evaluation Methods: This describes what assessment methods are used to collect data and how will the data be evaluated and interpreted. Assessment and Evaluation Methods: This describes what assessment methods are used to collect data and how will the data be evaluated and interpreted. Performance Criteria: This determines the criteria used to indicate that an outcome has been achieved with satisfactory levels or needs improvement. Performance Criteria: This determines the criteria used to indicate that an outcome has been achieved with satisfactory levels or needs improvement. Logistics: This indicates when the data will be collected and who will collect it, interpret it, and report the results. Logistics: This indicates when the data will be collected and who will collect it, interpret it, and report the results.

26 Assessment Methods n Industrial Advisory Board n Employer Survey n Graduate Exit Survey n Computer Engineering Exit Exam n Seminar Course (COE 390) n System Design Laboratory (COE 400) n Senior Design Project (COE 485) n Cooperative Work (COE 350/351) n Summer Training (COE 399) n Industrial Advisory Board n Employer Survey n Graduate Exit Survey n Computer Engineering Exit Exam n Seminar Course (COE 390) n System Design Laboratory (COE 400) n Senior Design Project (COE 485) n Cooperative Work (COE 350/351) n Summer Training (COE 399)

27 Industrial Advisory Board n Attend Advisory Board regular meeting. n Review of department area of concentrations and recommend some enhancement to undergraduate program in some specialized areas. n Provide inputs on the undergraduate student qualifications and skills based on new trends and local industry needs. n Provide feedback on the Educational Objectives and Program Outcomes and their implications on the program curriculum. n Provide feedback on the achievement of program outcomes by our graduates. n Attend Advisory Board regular meeting. n Review of department area of concentrations and recommend some enhancement to undergraduate program in some specialized areas. n Provide inputs on the undergraduate student qualifications and skills based on new trends and local industry needs. n Provide feedback on the Educational Objectives and Program Outcomes and their implications on the program curriculum. n Provide feedback on the achievement of program outcomes by our graduates.

28 Program Outcomes Assessment Program Outcome Assessment & Evaluation Methods Performance CriteriaLogistics (a)an ability to apply knowledge of mathematics, science, and engineering  Samples of COE 400, COE 485 and COE 351 reports  Math 101, Math 102, Math 201, Math 260, Phys. 101, Phys. 102, chem  Exit exam  Graduate Exit Survey  Coop Employer Survey  A score  2.5 out of 4  Average GPA  2.5 out of 4  A score  60%  A score  3 out of 5 Assessments will be conducted every semester. However, grades of Math, Phys. & Chem. Courses will be collected and analyzed once a year. (b) an ability to design and conduct experiments, as well as to analyze and interpret data  Samples of COE 400, COE 344 and COE 305 lab reports  Graduate Exit Survey  Coop Employer Survey  A score  2.5 out of 4  A score  3 out of 5 Assessments will be conducted every semester.

29 Program Outcomes Assessment Program Outcome Assessment & Evaluation Methods Performance CriteriaLogistics (c) an ability to design a system, component, or process to meet desired needs  Samples of COE 400, COE 485 and COE 351 reports  Graduate Exit Survey  Coop Employer Survey  A score  2.5 out of 4  A score  3 out of 5 Assessments will be conducted every semester. (d) an ability to function on multi-disciplinary teams  Samples of COE 400, COE 485 and COE 351 reports  Peer & instructor evaluations in COE 400  Graduate Exit Survey  Coop Employer Survey  A score  2.5 out of 4  A score  3 out of 5 Assessments will be conducted every semester.

30 Oral Presentation Assessment Rubric Needs Improvement Meets Expectations Exceeds Expectations Quality of Content  Audiene awareness (interacts with audience: e.g. stepping toward audience and speaking to them, not at them)  Focus: goal, evidence, conclusion (gives audience a roadmap and follows it)  Transistions (phrases smoothly link one part to next  Use of visual aids (to tell the story and enhnce the quality of the presentation  Does not interact with audience  Does not give audience an adequate road map of goal, evidence and conclusion  Abruptly transitions from one phase to the next  Does not use visual aids effectively to tell the story; too much dependency on visual aids  Some interaction with audience  Gives audience an adequate road map of goal, evidence and conclusion  Transitions are generally smooth  Overall, uses visual aids effectively to tell the story; visual aids add to presentation  Interacts with audience throughout presentation  Gives audience very clear road map of goal, evidence and conclusion  Very smooth Transitions  Uses visual aids very effectively to tell the story; visual aids enhance presentation

31 Oral Presentation Assessment Rubric Needs Improvement Meets Expectations Exceeds Expectations Mechanics  Body position (e.g., facing audience or screen))  Eye contact (e.g., scanning entire audience)  Body movement (e.g. hand gestures, stepping back)  Visual aids (e.g., clear, not too busy, readable size font)  Delivery (e.g., fluency, pace, voice projection, um’s, uh’s) Does not effectively use (e.g.’s):  Body position (faces screen)  Eye contact (not enough, looking down a lot)  Body movement (lack of gestures, glued to overhead)  Visual Aids (too busy, blurry)  Delivery (too fast, too many um’s, not projecting voice, lack of enthusiasm) Effectively uses (e.g.’s):  Body position (faces audience most of the time)  Eye contact (some scanning of audience, looking at people)  Body movement (some hand gestures, steps back f/ OH))  Visual Aids (can read clearly, usually not too much material)  Delivery (good pace, usually projects voice, some enthusiasm) Very effectively uses (e.g.’s):  Body position (always facing audience)  Eye contact (excellent scanning of audience, looking at people)  Body movement (good use of hand gestures, steps back)  Visual Aids (clear, right amount on each slide)  Delivery (excellent pace, projects voice, great enthusiasm)

32 Oral Presentation Assessment Rubric Needs Improvement Meets Expectations Exceeds Expectations Questions  Asks audience for questions  Answers questions effectively and smoothly  Does not ask for questions  Does not answer questions adequately  Asks for questions  Answers questions adequately  Effectively opens (“I’d be happy to answer questions”)  Answers questions effectively and smoothly

33 ConclusionsConclusions n COE department seeking accreditation from ABET EC 2K as one quality assurance for its BSc program. n COE department determined to improve program both technical and behavioral components to meet EC 2K. n New instruction techniques for outcome-based education will be gradually introduced at all levels to improve quality. n Industrial Advisory Board is important channel to provide department with feedback on achievement of long term educational objectives as experienced by our COE alumni. n COE department seeking accreditation from ABET EC 2K as one quality assurance for its BSc program. n COE department determined to improve program both technical and behavioral components to meet EC 2K. n New instruction techniques for outcome-based education will be gradually introduced at all levels to improve quality. n Industrial Advisory Board is important channel to provide department with feedback on achievement of long term educational objectives as experienced by our COE alumni.