Cognitive Biases in Testing Srikanth S Krishnan Sr. Director QA Oracle India Srikanth S Krishnan Sr. Director QA Oracle India.

Slides:



Advertisements
Similar presentations
Lecture 3 Social Cognition. Social Cognition: Outline Introduction Controlled and Automatic Processing Ironic Processing Schemas Advantages and disadvantages.
Advertisements

Who is Karl Popper? And what has he done to us?.
1 Intuitive Irrationality: Reasons for Unreason. 2 Epistemology Branch of philosophy focused on how people acquire knowledge about the world Descriptive.
Behavioral Finance Ahmed Elshahat October 27 th 2006 CPE.
Behavioral Economics Udayan Roy ECO54 History of Economic Thought.
Perception and Cognitive Biases Chapter 5. Perception and Negotiation The role of perception –“Perception is the process of screening, selecting, and.
Social Cognition AP Psychology.
Decision making and economics. Economic theories Economic theories provide normative standards Expected value Expected utility Specialized branches like.
Judgment and Decision Making How Rational Are We?.
Chapter 3 Producing Data 1. During most of this semester we go about statistics as if we already have data to work with. This is okay, but a little misleading.
Cognitive Psychology Chapter 7. Cognitive Psychology: Overview  Cognitive psychology is the study of perception, learning, memory, and thought  The.
Linear Regression.
CLASH OF THE RETURN POLICIES VS.. QUESTION  What factors make having a return policy a profitable strategy?  How do varying types of return policies.
ORGANIZATIONAL BEHAVIOR
Cognitive Processes PSY 334 Chapter 10 – Reasoning & Decision-Making August 21, 2003.
Copyright 2010 McGraw-Hill Companies
Area of psychology that refers broadly to mental processes or thinking
CHAPTER 8 Estimating with Confidence
Organizational Behavior: An Experiential Approach 7/E Mgt 4310 Topic 8.
BCOR 1020 Business Statistics
REASONING AND DECISION MAKING Shannon Baker And Alyssa Candelario.
Perceiving the Self and Others
UUCF Summer RE 2011 Brain Glitches Session 6: Anchoring Bias And the Decoy Effect.
Chapter 3: Social Cognition
Elasticity of Advertising Ted Mitchell. How to Increase Unit Sales Increase Product Quality Offer more Product Features/Service Increase Advertising/Shelve.
Blake Reno and Kyle Puckett. We seek out weak evidence to support our existing beliefs. We ignore evidence that undercuts those beliefs.
ALLISON SPIELMAN ADVISORS Cognitive Decision Making: How Your Brain Can Fool You January 29, 2013.
Decision making Making decisions Optimal decisions Violations of rationality.
UTILITY ANALYSIS.
STA Lecture 161 STA 291 Lecture 16 Normal distributions: ( mean and SD ) use table or web page. The sampling distribution of and are both (approximately)
CHAPTER 8 Estimating with Confidence
MODULE 23 COGNITION/THINKING. THINKING Thinking is a cognitive process in which the brain uses information from the senses, emotions, and memory to create.
Chapter 5 Social Cognition. What is Social Cognition? The processes by which information about people is processed and stored Thinking about people Humans.
PERSON PERCEPTION Forming Impressions of Others. Effects of Physical Appearance Judgments of other’s personalities are swayed by their appearance Those.
“I” Statements. Purpose of Using “I” Statements “I” Statements Help You ________ Avoid putting someone else down Express your feelings honestly Take ownership.
Decision Making How do people make decisions? Are there differences between making simple decisions vs. complex ones?
Behavioral biases and heuristics: a primer
Data Analysis Econ 176, Fall Populations When we run an experiment, we are always measuring an outcome, x. We say that an outcome belongs to some.
Perception, Cognition, and Emotion in Negotiation
Behavioral Economics Combining Psychology & Economics.
Chapter 4 Perceiving Persons.
Copyright © 2010 Pearson Education. All rights reserved. Chapter 3 Social Cognition: How We Think about the Social World.
// 5100 Gamble Drive, Suite 503, St. Louis Park, MN // [952] Leveraging Psychology in Software Engineering John.
Social Cognition © 2014 Wadsworth Cengage Learning Chapter 5 Can you tell who was the silver medalist by only looking at their facial expressions?
Barriers to reasoning rationally Variables that interfere with quality thinking.
Exercise 2-6: Ecological fallacy. Exercise 2-7: Regression artefact: Lord’s paradox.
Copyright 2016 © McGraw-Hill Education. Permission required for reproduction or display Jeff J Mitchell/Getty Images.
MODULE 9 MANAGERS AS DECISION MAKERS “Decide first, then act” How do managers use information to make decisions and solve problems? What are the steps.
Cognition and Language. Cognition: thinking, gaining knowledge, and dealing with knowledge. I. Categorization A. Categorization: in general, we categorize.
Cognitive Processes PSY 334 Chapter 10 – Reasoning & Decision-Making.
 I’m selling $5.  The $5 goes to the highest bidder.  Highest bidder pays the amount bid.  Second highest bidder also must pay the amount bid but gets.
Why Good Project Managers Make Bad Choices: An Introduction to Project Decision-Making Lev Virine, Ph.D. Intaver Institute Inc.
Perceiving the Self and Others
Reasoning and Judgment PSY 421 – Fall Overview Reasoning Judgment Heuristics Other Bias Effects.
Behavioural Finance Impact on financial markets and individual investors.
CHAPTER 8 Estimating with Confidence
Cognition: Thinking and Language
Economic Decisions and Systems
CHAPTER 8 Estimating with Confidence
DECISION MAKING: CHOICES AND CHANCES
Phil 101: Logic Spring 2013.
The Role of User Interface for Home Area Networks
Chapter 8: Decision Making
Personality Development
Chapter 17 Measurement Key Concept: If you want to estimate the demand curve, you need to find cases where the supply curve shifts.
CHAPTER 8 Estimating with Confidence
POLI 421 January 14, 2019 Tversky and Kahneman on Heuristics and Biases Slovic on misperceptions of risk POLI 421, Framing Public Policies.
Chapter 8: Decision Making
From Predictably Irrational by Dan Ariely
Behavioral Economics Combining Psychology & Economics.
Presentation transcript:

Cognitive Biases in Testing Srikanth S Krishnan Sr. Director QA Oracle India Srikanth S Krishnan Sr. Director QA Oracle India

What is a Cognitive Bias ?

It is the human tendency to make systematic errors in certain circumstances based on cognitive factors rather than evidence.

Heuristics Statistical mis-estimates Memory errors Social Constructs

Tester’s Delusion Spots Test Planning Test Design Test Advocacy

Anchoring

Guess the percentage of African Nations in the UN.

Anchoring Will you be happier if you get a 100% raise?

Bidding after stating the last 2 digits of social security number

Why are black pearls more expensive?

occurs when people consider a particular value for an unknown quantity before estimating that quantity

Effect on Estimation New Feature vs. regression testing of existing features

Effect on Negotiation

Relativity

Would you mind walking 5 min to save $10 on a $ 50 pen?

Would you mind walking 5 min to save $10 on a $ 1000 suit?

Decoy Effect or Asymmetric dominance effect

Option AOption B Coverage Cost

Option AOption BOption C Coverage Cost

People not only compare things, but also compare things that are easily comparable.

The Price of Ownership Endowment Effect

How much would you pay for a Coffee Mug ?

Applies to ideas as well as objects.

The more effort you put into something the more ownership you feel. IKEA Effect

Ex. Manager from Finance

Test repository clean up Which one will you get rid of? (assume similar coverage) Suite1 Created with 100 man days effort Suite2 Created with 30 man days effort

Effect of Expectation Confirmation bias: Self-Fulfilling Prophecy

How do you get more women in the orchestra?

Positive vs. negative Test cases.

Seeing patterns where none exist.

e xi st

Influence of great UI.

Negativity Bias More attention is given to negative than positive experiences

The lingering effect of a nasty bug.

Sunk Costs

Concorde Fallacy “I have spent so much time doing the setups.”

Concorde Fallacy Why test a build that has been obsoleted?

Paradox of Choice

Concorde Fallacy More is not always better

Burn your bridges

Concorde Fallacy Why don’t we keep this server just in case?

Procrastination

Concorde Fallacy Choose your own deadline

Concorde Fallacy The hockey-stick effort curve

Concorde Fallacy Milestones and distributed deadlines

Resurrection to Rationality

overcoming channeling

References and Acknowledgements Predictably Irrational – Dan Ariely Nudge – Thaler & Sunstein Blink – Malcolm Gladwell Sway – Brafman (Ori & Rom) Wikipedia Predictably Irrational – Dan Ariely Nudge – Thaler & Sunstein Blink – Malcolm Gladwell Sway – Brafman (Ori & Rom) Wikipedia

Concorde Fallacy Thank You Twitter: sriks7