Best Practices In Design Outcomes Of A Survey P. H. King, PhD, PE Joan Walker, PhD Vanderbilt University

Design Survey, 13 respondents, late 2003 How many credit hours & terms – design course Which measures are required, as needed, not needed Grading examples? Suggested additions re ABET & design?

Course Structure: Credits programs 33 programs program program program 3 to 61 program (variable credit) 81 program (over 6 terms)

Topics: Rank ordered Final Written Paper Periodic Written Reports Periodic Oral Reports Prototype Project Notebook Final Oral Presentation Health & Safety Analysis Final Poster Presentation 13, 0, 0 11, 2, 0 9, 2, 2 9, 1, 3 8, 1, 4 8, 4, 1 8, 1, 4 Columns are: Required, As needed, Not Required

Topics: Rank ordered, Continued Order of Magnitude Calc. Societal Impact Market/Econ. Analysis Design History File Ethical Concerns Grant Proposal Patent Application Manufacturability 7, 1, 5 6, 3, 4 6, 1, 6 5, 6, 2 4, 3, 6 3, 4, 6 Columns are: Required, As needed, Not Required

Topics: Rank ordered, Continued Cite Relevant Standards Sustainability Environmental Impact Political Considerations 2, 8, 3 1, 3, 9 0, 9, 4 0, 3, 10 Columns are: Required, As needed, Not Required

Suggested Additions to List Manuscript ready for journal publication K-12 outreach presentation of project Proof of concept prior to design Aesthetic considerations Timeline System Specification Peer review

Suggested Additions To List (If ABET) Teamwork & Leadership (2) Peer & Self Evaluations Design Controls Engineering Analysis (FEM) Innovation Quality Controls Design of Experiments

Grading Schemes Collected: Course Grading Scheme 7 Peer Review 2 Design Notebook 1 Oral Report 1 Design Report 2 Poster Judging 1 Proposal Grading 1

Oral Grading Sheet - Marquette Presentation Skills/Organization: (30 pts) Were members of group professional in appearance?5 points Were speakers adequately prepared for presentation and questions? 10 pts Was presentation clear and understandable?10 pts Were visual aids sufficient in numbers and properly used? 5 pts Technical Content of Presentation: (30 pts) Did group demonstrate sufficient technical understanding and base concept(s) on sound engineering principles? 15 pts Did prototype/key deliverable adequately communicate proposed concept? 15 pts

Oral Grading Sheet Continued Salability: (40 pts) Was audience convinced that: proposed concept will meet customer needs?_______(15) proposed concept is technically feasible?_______(10) proposed concept is economically viable?_______(10) group can complete project by May 2004?_______(5) TOTAL _______(100) + comments to speaker … + comments to course coordinator …

Paper & Poster - Vanderbilt 1 Engineering goals __/20 Problem Statement: clear problem definition (identify constraints & alternatives), definition based on customer requirements (demands & wishes) F E - E E + Prototype, test and/or prediction of performance: manufacturability; proof of concept; prototype can be a database which is established or revised. F E - E E + Documentation of problem solution: feasibility analyses (if no prototype); validation and verification (meets customer demands and industry standards) F E - E E + Safety, Health & Risk Analysis: safety & risk analysis; demonstration of appropriate mathematical analyses; environmental impact na E - E E + Economic/market consideration: Can it be made? Can people afford it? What is the number of potential users? Mathematical analyses if necessary. Market survey? na E - E E +

Continued … 2 Creative ability __/20 Approach: logical analysis, consideration of alternatives; example of generation of ideas, ideation and innovation F E - E E + Originality: new, non-obvious, a contribution to the body of engineering knowledge; na E - E E + 3 Thoroughness __/20 Documentation of effort: e.g., project notebook; Innovation Work Bench; Design file, etc. F E - E E + Literature review & Patent search, References: primary sources; patents… F E - E E + Application of Standards (if applicable): relevant standards cited, e.g., FDA,, ISO, etc. na E - E E + 4 Overall Competence in Design __/25 Proper application of modern engineering techniques, skills and tools to problem F E - E E + Demonstrated ability to design system, component or process F E - E E + Problem scope: Design difficulty (e.g., open- v. closed-ended problem), magnitude of design challenge; is the problem trivial or not? na E - E E +

Continued 5 Clarity of presentation __/10 Engineering layout: easy to read, mix of text and pictures F E - E E + Well-written: is it a stand alone summary? Convincing evidence of solution’s quality; links findings to project statement? F E - E E + Overall impact: overall communication; convincing that this is a good solution F E - E E + Evidence of teamwork: can the evaluator have a substantive exchange about the project with each team member? na E - E E + 6Ethical/Societal/Political considerations: __/5 Ethical/Societal/Political considerations: Is anyone being excluded? Ethical treatment of subjects (human and animal)? F E - E E +

Other sources TIDEE – transferable integrated design engineering education - tools/design-processes.html tools/design-processes.html BESTEAMS – building engineering student team effectiveness and management systems -

Material Solicited Please send to Material will be posted on VaNTH website: design_education.htm in the near future design_education.htm

Thank You! Questions or Comments? This work is supported primarily by the Engineering Research Centers Program of the National Science Foundation under Award Number EEC