1. a. ABET Update i. Overview of documents submitted to ABET (Self-Study) EWRE Retreat 8/2/2005 ii. What we need to do between now and ABET visit in November

2. Page 1/89

3. Objectives B.2.Program Educational Objectives B.2.1Mission Statements (University, College, Department) B.2.2Constituents (students, employers, alumni, faculty, graduate schools) B.2.3Educational Objectives 1.Graduates will be prepared with a solid foundation in mathematics, sciences, and technical skills needed to analyze and design environmental engineering systems. 2.Graduates will possess strong written, oral, and graphical communication skills, and will be able to function on multi-disciplinary teams. 3.Graduates will be familiar with current and emerging environmental engineering and global issues, and have an understanding of ethical and societal responsibilities. 4.Graduates will have the ability to obtain professional licensure, and will recognize the need for engaging in life-long learning. 5.Graduates will have the necessary qualifications for employment in environmental engineering and related professions, for entry into advanced studies, and for assuming eventual leadership roles in their profession.

4. Potential Problem: “Criterion 2. Program Educational Objectives Although institutions may use different terminology, for purposes of Criterion 2, program educational objectives are broad statements that describe the career and professional accomplishments that the program is preparing graduates to achieve.” CRITERIA FOR ACCREDITING ENGINEERING PROGRAMS Effective for Evaluations During the 2005-2006 Accreditation Cycle

5. B.2.4Relationship Between Educational Objectives and Institutional Mission B.2.5Relationship Between Educational Objectives and Accreditation Criteria B.2.6How Curriculum and Processes Ensure Achievement of Objectives B.2.7Process Used to Establish, Review, and Revise Objectives B.2.8Ongoing Evaluation of Level of Achievement of Objectives B.2.9Revisions to Objective Assessment Process

6. Figure B.2.1. Educational Objective Evaluation Process Ed. Obj’s Eval/Rev. Employer & Alumni Survey Constituent Com. Mtg Fall ‘05 Fall ‘11 ABET Visit Fall ‘06 Fall ‘08 Fall ‘09 Fall ‘10 Fall ‘07 Outcomes Assessment Outcomes Assessment Outcomes Assessment Outcomes Assessment Outcomes Assessment Constituent Com. Mtg Ed. Obj’s Eval/Rev. Employer & Alumni Survey Year - 1 -2 -3 -4 -5 -6 Outcomes Assessment

7. EBI Alumni Survey Use for Objectives Table B.2.2(a). Selected EBI Questions to Assess Environmental Engineering Program Objectives Objective 1: Graduates will be prepared with a solid foundation in mathematics, sciences, and technical skills needed to analyze and design environmental engineering systems. Q51Importance/Performance: Degree that your engineering education enhanced your ability to apply knowledge of mathematics Q49Importance/Performance: Degree that your engineering education enhanced your ability to apply knowledge of science Q10Extent the engineering degree provided technical skills necessary to succeed Q23Importance/Performance: Degree that your engineering education enhanced your ability to analyze and interpret data Q25Importance/Performance: Degree that your engineering education enhanced your ability to design a system, component, or process to meet desired needs Q29Importance/Performance: Degree that your engineering education enhanced your ability to identify or formulate engineering problems Q31Importance/Performance: Degree that your engineering education enhanced your ability to solve engineering problems Objective 2: Graduates will possess strong written and oral communication skills. Q39Importance/Performance: Degree that your engineering education enhanced your ability to communicate using written progress reports Q41Importance/Performance: Degree that your engineering education enhanced your ability to communicate using oral progress reports Et cetera…

8. Results

9. Employer Survey Ranking (1=Not at All, 3-4=Moderately, 7 =Extremely) Figure B.2.2. Employer Survey Results Number of Rankings Out of 8

10. Table B.2.1. Summary of Employer Survey Results

11. Survey results agree (roughly) Objective

12. Outcomes B. 3.Program Outcomes and Assessment33 B.3.1Program Outcomes33 B.3.2.Process for Producing Outcomes41 B.3.3Assessment Process41 B.3.4Application of Results to Program Development and Improvement51 B.3.5Results of Assessment and Changes Implemented To Improve Program52 B.3.6Materials Available for Review During Visit61

13. Table B3.1 Matrix Showing Relationship Between Program Educational Objectives and Program Outcomes

14. Table B3.2 Relationship of UD Environmental Engineering Outcomes to ABET “(a) through (k)” Criteria and Environmental Engineering Program Criteria

16. Table B3.4 Relationship of UD Environmental Engineering Outcomes to AAEE Environmental Engineering Program Criteria

17. Outcome Assessment Tools (1) Alumni Questionnaire (2) Educational Benchmarking, Inc. (EBI) senior survey (3) Student Focus Groups (4) student sample work (5) Fundamentals of Engineering (FE) exam results (6) Faculty Course Self Assessment (FCSA)

18. Figure B.3.3. Annual Outcomes Assessment Schedule September December March June FE Exam Student Focus Groups EBI Senior Survey for mid-year graduates Student sample work and FCSA forms for fall semester submitted EBI Senior Survey Alumni Reunion – Complete questionnaires Student sample work and FCSA forms for spring semester submitted. Faculty synthesize all assessment results Group retreat. Changes to courses and curriculum are proposed and discussed Student sample work collected

19. Annual schedule

20. Table B.3.11. Curriculum Modifications and Supporting Metrics from 2001-2005.

21. Figure B.3.4. Averaged Results for Alumni Questionnaires 2001-2005.

22. Figure B.3.6. Average Score Ratio for all Outcomes, UD/All Respondents. EBI Senior Survey Results

23. Figure B.3.8. UD Percent Passing the FE Exam

24. Figure B.3.9. UD Results for FE Exam by General Subject Area

25. Engineering Economics vs. Time

26. Engineering Economics – Sr. Design

27. Environmental Engineering Specialty Topics

29. Faculty Course Self Assessment Forms

30. Notes: (faculty comments regarding differences between Target Learning Levels and Assessment Levels) 1. Students currently do not design any experiments. The course should be modified to include experimental design in future years, perhaps as part of a homework assignment. 2. Students think they know more than they actually do because an almost ideal natural system was selected for the final project. Real data from an actual groundwater site should be used in the final class project so students gain an appreciation for the complexity of natural systems. 3. What does N/D mean? A key should be provided. Assessment results: (a summary of major results of all assessment) 1. Suggested Changes: (faculty recommendations on course changes) 1. Show and/or incorporate more realistic data into the final group project to give students a better appreciation of the difficulty in modeling pollutant fate and transport in natural systems. 2. While it may be difficult for students to design experiments that they then conduct, it is relatively simple to ask students to come up with an experimental design as part of a homework assignment or exam. This should be done in future years.

31. Summary (in Steve’s Opinion) 1.Program credentials are extremely good 2.We are shaky on having established “closed loops” with a regular, cyclical routine 3.Our Objectives may be too much like Outcomes 4.Some outcomes and Objectives are not assessed with much specificity 5.We have lots of things to do for November

32. ii. What we need to do between now and ABET visit in November

34. ABET Issues

37. Summary (in Steve’s Opinion)

41. ABET Issues

45. Outcomes and

46. ABET Issues Outcomes and

47. ABET Issues

53. Summary (in Steve’s opinion) 1.ABET doesn’t care how good the program is – just whether you have the process running smoothly 2.We’d better do what we still have to do 3.There are so many details and requirements that any program is still at the mercy of the program evaluators