Testing Procedures Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Testing Procedures Engineering Design and Development © 2013 Project Lead The Way, Inc.

Design Process Presentation Name Course Name Unit # – Lesson #.# – Lesson Name Design Process Let’s take a look at where we are in the product development process. [click] You’ve completed your prototype. Now it’s time to test how well your solution meets your design criterial.

Rule of Thirds Research and Exploration Design and Construction Prototypes Engineering Design and Development Lesson 4.1 Plan for the Prototype Rule of Thirds Research and Exploration Design and Construction Testing, Documentation, and Presentation Problem Selection Design Specification Testing Criteria & Method Topic Background Decision Matrix Testing Procedure Problem Statement Concept Testing Physical Testing Statement of Purpose Design Proposal Record Data Cited Validation Gantt Chart (timeline) Critical Design Review Cited Justification Sketching Refinement Redesign and Refine Past & Present Solutions Technical Drawing Re-test Market Research Material List Determine Conclusion Problem Proposal Cost Multimedia Display   Tool Selection Web Page Tool Safety Research Paper Mock Up & Modeling Electronic Portfolio Prototype Construction Testing Criteria & Method At this point, you are beginning the final third of your project. [click] Testing will determine how well you have solved your problem and guide you in making improvements to better meet the design criteria. But before you begin the testing phase, you must carefully plan your approach.

Testing Procedures Discussion Questions What is a test? Purpose Quantitative vs Qualitative Before you Begin Establish Criteria Documentation Bias Procedure Important Questions Thanks and Acknowledgement

What does a test look like? Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Discussion Questions ©istock.com Why do you test? ©istock.com [Ask students why a design should be tested?] Why not just mass produce the design and save the money that would be spent on testing? What does a test look like? What must be true in order for the test to safely provide reliable and valuable information? What does a test look like?

Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase What is a Test? An examination, evaluation, observation, or trial used to determine and document capabilities, characteristics, effectiveness, reliability and/or suitability of a material, product, or system ©istock.com

Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Purpose What do you need to know in order to ensure the successful performance of your design? What will the test determine? You already have a set of specifications that describe exactly what your product should be able to do in order to perform successfully. Revisit these specifications. What should you test to ensure that your product will meet all of the criteria? You may have to test more than one thing. In the test shown here, EDD students are measuring the torque produced by their Utili-tool design using a torque meter. The Utili-tool was designed to dislodge snow and ice from the chute of a snow blower.

Quantitative vs Qualitative Data Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Quantitative vs Qualitative Data Quantitative Data that can be measured Numerical value Qualitative Data that can not be measured Describes a quality or categorization Pass-fail, yes-no, or categorical ©istock.com What type of data is needed from each test? Quantitative data can be measured and is represented by numerical values. For example, the viscosity of a fluid might be measured with a viscometer such that the measurement is represented by a numerical value. Qualitative data describes a quality or categorization. For example, determining whether a design is aesthetically attractive to the target market may require a consumer survey in which the respondents are asked if they like the look of the product. The yes-no answers is considered qualitative data. [click] Or, asking respondents to rate the quality of a speaker or headphones is considered qualitative data.

Materials List everything you THINK you will possibly need. Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Materials ©istock.com List everything you THINK you will possibly need. Remember – someone else should be able to duplicate the test with this list. On site concrete test

Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Before You Begin List the initial conditions that either MUST exist or WILL exist at the start of the test. Identify all potential hazards. Identify what safety precautions will be in place to address the potential hazards. Identify the safety controls you have in place before the test begins. Gloves being tested under high water pressure. ©istock.com

Before You Begin Identify WHO is responsible for WHAT – write it down. Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Before You Begin Identify WHO is responsible for WHAT – write it down. Does anyone of authority need to sign off before you set up your test? ©istock.com Pressure chamber with instrumentation

Establish Criteria How will you know if your test is successful? Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Establish Criteria How will you know if your test is successful? Is your test pass or fail? Have you established a benchmark? ©istock.com Gloves being tested under high water pressure.

Documentation How will you record your results? Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Documentation How will you record your results? What scientific or mathematic principles are you using? ©istock.com Bias is a prejudice for a particular point of view. Cognitive Bias - In some cases bias can be attributed to a prejudice of the observer toward a particular point of view due to life, loyalty and local concerns. Confirmation Bias - In other cases, bias can arise when decision makers attribute more significance to positive results than negative results in a conscious or unconscious effort to confirm a claim. Selection Bias – Sometimes pertinent data is not collected or discarded in order to produce positive results. Be sure that your test design is not can not only show that your design meets the specification or performs as intended, but that it will also indicate a failure if your design does not meet the specification

Bias Have you eliminated any bias or subjectivity? Testing Procedures Engineering Design and Development Lesson 5.1 Plan the Test Phase Bias Have you eliminated any bias or subjectivity? Cognitive bias – observer effects that arise from various life, loyalty and local concerns Confirmation bias –more weight placed on evidence that confirms claims than on evidence that refutes claims Selection bias – samples are intentionally (not randomly) selected to produce positive results Bias is a prejudice for a particular point of view. Cognitive Bias - In some cases bias can be attributed to a prejudice of the observer toward a particular point of view due to life, loyalty and local concerns. Confirmation Bias - In other cases, bias can arise when decision makers attribute more significance to positive results than negative results in a conscious or unconscious effort to confirm a claim. Selection Bias – Sometimes pertinent data is not collected or discarded in order to produce positive results. Be sure that your test design is not can not only show that your design meets the specification or performs as intended, but that it will also indicate a failure if your design does not meet the specification ©istock.com

Procedure Have all initial conditions been met? Have all safety conditions been met? Are all personnel in place? List every step in painstakingly minute detail. Think “science lab”. Anybody should be able to reproduce your test and results.

Important Questions Will the test verify and validate the design? Is the test designed to show that the product meets specifications or that it fulfills its intended purpose? Is the test valid? Does the test measure what it is designed to measure? Is the test reliable? Does the test procedure give consistent results each time it is run? Is it repeatable? Will the test produce accurate measurements? Are the data measurements close to the actual value of the quantity being measured?

Thanks and Acknowledgement Be sure to thank those who helped for their cooperation or assistance? Thank you notes/letters are appreciated because those can be displayed at places of business

Testing Procedures Discussion Questions What is a test? Purpose Quantitative vs Qualitative Before you Begin Establish Criteria Documentation Bias Procedure Important Questions Thanks and Acknowledgement