Why Are My Tests Dumb? Jeff Offutt George Mason University.

Slides:

Advertisements

Similar presentations

Compare and Contrast Ask Questions Compare Contrast.

Advertisements

Introduction to Software Testing Chapter 1 Model-Driven Test Design Paul Ammann & Jeff Offutt

Computer Science 209 Testing With JUnit. Why Test? I don ’ t have time, I ’ ve got a deadline to meet The more pressure I feel, the fewer tests I will.

Managing Testing Presented by: Dana Ali Al-Malki.

Of 23 Generating Automated Tests from Behavioral Models Jeff Offutt (Research with Dr. Nan Li, currently with MediData Solutions) Software Engineering.

Introduction to Software Testing Chapter 9.3 Challenges in Testing Software Test Criteria and the Future of Testing Paul Ammann & Jeff Offutt

Test Driven Development George Mason University. Today’s topics Review of Chapter 1: Testing Go over examples and questions testing in Java with Junit.

© Copyright Jeff Offutt, 2000 WESAS, 5/00 1 Analyzing Software Architecture Descriptions to Generate System-level Tests Aynur Abdurazik, Zhenyi Jin, Jeff.

Reasons to study concepts of PL

1 Performance Measurement CSE, POSTECH 2 2 Program Performance Recall that the program performance is the amount of computer memory and time needed to.

Software Engineering Experimentation Software Engineering Specific Issues (Mostly CS as well) Jeff Offutt

Dr. Pedro Mejia Alvarez Software Testing Slide 1 Software Testing: Building Test Cases.

BACS 287 Basics of Programming BACS 287.

Using a Debugger. SWC What is ”debugging”? An error in a computer program is often called a ”bug”… …so, to ”debug” is to find and get rid of errors in.

1 Software Development Topic 2 Software Development Languages and Environments.

Introduction to Software Testing Chapter 9.3 Challenges in Testing Software Test Criteria and the Future of Testing Paul Ammann & Jeff Offutt

Higher Computing Computer Systems S. McCrossan 1 Higher Grade Computing Studies 3. Computer Performance Measures of Processor Speed When comparing one.

Quality Attributes of Web Software Applications – Jeff Offutt By Julia Erdman SE 510 October 8, 2003.

Testing in Extreme Programming

User Interface Overview Jeff Offutt SWE 432 Design and Implementation of Software for the Web.

Algorithms and Programming

Custom Reporting in Blackboard Learn. What happens between clicking run and getting the report? Connect to a data source Where is the information?

Just as there are many human languages, there are many computer programming languages that can be used to develop software. Some are named after people,

Software Engineering Experimentation Software Metrics Jeff Offutt

Introduction to Software Testing Chapter 8.1 Building Testing Tools –Instrumentation Paul Ammann & Jeff Offutt

Fabio Montella October 2011

Differentiating “Combined” Functions Deriving the Product Rule for Differentiation.

Sequencing Shuffle the cards and place in a pile with the numbers facing down. Order the cards from 0 to 11. How fast can you do this?

Title Your Name University Name Date Instructor Name.

I Power Higher Computing Software Development Development Languages and Environments.

Sequencing 1 Shuffle the cards and place in a pile with the numbers facing down. Order the cards from 0 to 11. How fast can you do this?

Sep 13, 2006 Scientific Computing 1 Managing Scientific Computing Projects Erik Deumens QTP and HPC Center.

How to Program? -- Part 1 Part 1: Problem Solving –Analyze a problem –Decide what steps need to be taken to solve it. –Take into consideration any special.

IGCSE Revision Lesson 9 I can represent inequalities graphically I can solve simple linear inequalities ≤ ≥ >

pictures_slideshow/article.htm.

The Functions and Purposes of Translators Translators, Interpreters and Compilers - High Level Languages.

Lesson 3.5. ACT Practice Questions 1)Get out a piece of paper, and put your name on it. 2)I am going to show you 3 practice ACT math questions, and I.

Computer Programming 12 Lesson 6 – Loop structure By: Dan Lunney.

Software Testing and Quality Assurance Practical Considerations (1) 1.

By Trawex Technologies. Online Hotel booking softwareOnline Hotel booking software can make your business much more productive by saving time and by improving.

1 Support for Scientific Computing People: Bruce Beckles Nick Maclaren Services: Courses Advice.

Test Automation CS 4501 / 6501 Software Testing

I N T R O D U C T I O N T O F A C T Business Bridges 2016

Beyond Test Automation (Why Are My Tests Dumb?)

The software engineering solutions focuses on the development of software specially customized and tailored according to the usage requirement of projects.

Ch 11 Resource Constraints and Linear Programming

Accidental and Essential Problems Excise Tasks

It is great that we automate our tests, but why are they so bad?

From Spec-based Testing to Test Automation and Beyond

פחת ורווח הון סוגיות מיוחדות תהילה ששון עו"ד (רו"ח) ספטמבר 2015

Software Testing and Maintenance Maintenance and Evolution Overview

Test Automation CS 4501 / 6501 Software Testing

Equality or Inequality?

مديريت موثر جلسات Running a Meeting that Works

(some of) My Research Engineering is about getting technology to do what it does well so humans can do what they do well Jeff Offutt Professor of Software.

Norman 7 A: User-Centered Design

Integration: Definite Integration

Generations & Types of Computers

Fractions: Unit fractions of amounts

Fractions: Multiplying with mixed numbers

Assignment 6 Navigation VI Editor comparison

Systems Development Lifecycle

Fractions: Dividing with mixed numbers

Types of Errors And Error Analysis.

Inequalities: Listing numbers with division

Fractions of Amounts Find ¼ of £24 = Find ¾ of £24 = Find ½ of £48 =

GCSE Computing.

Architecture Issue in the New Disciple System

Presentation transcript:

Why Are My Tests Dumb? Jeff Offutt George Mason University

Old Style Tests AMOST 2015 © Jeff Offutt2 Values invented by humans Scripts were pieces of paper with steps 1.Turn on computer 2.Type : “Run myProgram” 3.Enter name : “George P. Burdell” 4.Enter age : “-25” Simple directions to humans Slow! Error prone! Limited repeatability! Almost impossible to integrate criteria These are as dumb as single-cell organisms !!

Limitations AMOST 2015 © Jeff Offutt3 Single-cell tests are incompatible with model-based testing

Modern Dumb Tests Test values –Created by a mix of humans and test data generators –Satisfy well-documented goals, test criteria, or specialized domain needs Integrated into automated test scripts (eg, JUnit) Includes a small amount of brain power … these tests know what results to expect (eg, JUnit assertions) Fast … repeatable … AMOST 2015 © Jeff Offutt4 These multi-cellular tests show the first signs of intelligence!

Multicellular Tests AMOST 2015 © Jeff Offutt5 Test Values Expected results Before values After values Why is it there? But this test does not know When should it run? When should it change? When should it die?

Intelligent Tests AMOST 2015 © Jeff Offutt6 Intelligent tests need self-awareness and self-determination!