Four Paradigms of IS Development Survey Design and Hypothesis Testing (Proposal) by Jie (Jennifer) Xu.

Slides:



Advertisements
Similar presentations
Introduction Describe what panel data is and the reasons for using it in this format Assess the importance of fixed and random effects Examine the Hausman.
Advertisements

“Students” t-test.
Chapter 9 Hypothesis Testing Understandable Statistics Ninth Edition
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
Chapter 14, part D Statistical Significance. IV. Model Assumptions The error term is a normally distributed random variable and The variance of  is constant.
Econ 488 Lecture 5 – Hypothesis Testing Cameron Kaplan.
Chi square.  Non-parametric test that’s useful when your sample violates the assumptions about normality required by other tests ◦ All other tests we’ve.
Chapter 8: Estimating with Confidence
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
What is MPC? Hypothesis testing.
Econ 140 Lecture 151 Multiple Regression Applications Lecture 15.
6.2 Tests of Significance. Formalizing We saw in the last section how to find a confidence interval. In this section, we use the confidence interval to.
EPIDEMIOLOGY AND BIOSTATISTICS DEPT Esimating Population Value with Hypothesis Testing.
Chapter 8 Inference for Proportions
QUALITATIVE AND LIMITED DEPENDENT VARIABLE MODELS.
Chi-square Test of Independence
Lecture Inference for a population mean when the stdev is unknown; one more example 12.3 Testing a population variance 12.4 Testing a population.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 9-1 Chapter 9 Fundamentals of Hypothesis Testing: One-Sample Tests Basic Business Statistics.
PY 427 Statistics 1Fall 2006 Kin Ching Kong, Ph.D Lecture 5 Chicago School of Professional Psychology.
Chapter 9 Hypothesis Testing.
BCOR 1020 Business Statistics
Chapter 10: Estimating with Confidence
TESTING A HYPOTHESIS RELATING TO THE POPULATION MEAN 1 This sequence describes the testing of a hypothesis at the 5% and 1% significance levels. It also.
EC220 - Introduction to econometrics (review chapter)
1 In the previous sequence, we were performing what are described as two-sided t tests. These are appropriate when we have no information about the alternative.
Modular 15 Ch 10.1 to 10.2 Part I. Ch 10.1 The Language of Hypothesis Testing Objective A : Set up a Hypothesis Testing Objective B : Type I or Type II.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 9 Hypothesis Testing.
Overview of Statistical Hypothesis Testing: The z-Test
© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 9. Hypothesis Testing I: The Six Steps of Statistical Inference.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 9-1 Chapter 9 Fundamentals of Hypothesis Testing: One-Sample Tests Business Statistics,
Means Tests Hypothesis Testing Assumptions Testing (Normality)
4-1 Statistical Inference The field of statistical inference consists of those methods used to make decisions or draw conclusions about a population.
1 Chapter 10: Section 10.1: Vocabulary of Hypothesis Testing.
Section 10.1 ~ t Distribution for Inferences about a Mean Introduction to Probability and Statistics Ms. Young.
Week 8 Fundamentals of Hypothesis Testing: One-Sample Tests
Psy B07 Chapter 4Slide 1 SAMPLING DISTRIBUTIONS AND HYPOTHESIS TESTING.
Copyright © 2009 Cengage Learning 15.1 Chapter 16 Chi-Squared Tests.
10.2 Tests of Significance Use confidence intervals when the goal is to estimate the population parameter If the goal is to.
Copyright © 2009 Pearson Education, Inc LEARNING GOAL Interpret and carry out hypothesis tests for independence of variables with data organized.
Chapter 9 Fundamentals of Hypothesis Testing: One-Sample Tests.
Section 9.3 ~ Hypothesis Tests for Population Proportions Introduction to Probability and Statistics Ms. Young.
Lecture 16 Section 8.1 Objectives: Testing Statistical Hypotheses − Stating hypotheses statements − Type I and II errors − Conducting a hypothesis test.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 8 Hypothesis Testing.
Chapter 16 Data Analysis: Testing for Associations.
Welcome to Econ 420 Applied Regression Analysis Study Guide Week Four Ending Wednesday, September 19 (Assignment 4 which is included in this study guide.
Physics 270 – Experimental Physics. Let say we are given a functional relationship between several measured variables Q(x, y, …) x ±  x and x ±  y What.
Hypothesis Testing An understanding of the method of hypothesis testing is essential for understanding how both the natural and social sciences advance.
Fall 2002Biostat Statistical Inference - Confidence Intervals General (1 -  ) Confidence Intervals: a random interval that will include a fixed.
Chap 8-1 Fundamentals of Hypothesis Testing: One-Sample Tests.
Four Paradigms of Information Systems Development A proposed empirical study.
Hypothesis Testing Errors. Hypothesis Testing Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean.
BPS - 5th Ed. Chapter 151 Thinking about Inference.
Criteria for selection of a data collection instrument. 1.Practicality of the instrument: -Concerns its cost and appropriateness for the study population.
Inferential Statistics Inferential statistics allow us to infer the characteristic(s) of a population from sample data Slightly different terms and symbols.
The Analysis of Variance ANOVA
When should you use fixed effects estimation rather than random effects estimation, or vice versa? FIXED EFFECTS OR RANDOM EFFECTS? 1 NLSY 1980–1996 Dependent.
Understanding Basic Statistics Fourth Edition By Brase and Brase Prepared by: Lynn Smith Gloucester County College Chapter Nine Hypothesis Testing.
1 Regression Review Population Vs. Sample Regression Line Residual and Standard Error of Regression Interpretation of intercept & slope T-test, F-test.
Is there a dominant paradigm for information systems development? An empirical study.
The Question: The purpose of this study is to empirically show that the assumptions that lead to categorizing users or system developers in one of the.
Chapter 7: Hypothesis Testing. Learning Objectives Describe the process of hypothesis testing Correctly state hypotheses Distinguish between one-tailed.
Chapter 9 Hypothesis Testing Understanding Basic Statistics Fifth Edition By Brase and Brase Prepared by Jon Booze.
4-1 Statistical Inference Statistical inference is to make decisions or draw conclusions about a population using the information contained in a sample.
Chapter Nine Hypothesis Testing.
9.3 Hypothesis Tests for Population Proportions
CORRELATION ANALYSIS.
Spearman Rank Order Correlation Example
One-Way Analysis of Variance
STA 291 Spring 2008 Lecture 18 Dustin Lueker.
The z-test for the Mean of a Normal Population
Presentation transcript:

Four Paradigms of IS Development Survey Design and Hypothesis Testing (Proposal) by Jie (Jennifer) Xu

Four Paradigms: Functionalism: developer-as-systems expert; Social Relativism:developer-as-systems- facilitator; Radical--Structuralism:Developer-as-labor- partisan; Neohumanism:developer-as-emancipator- or-social-therapist.

Functionalism: Developer-as- system-expert Social Relativism:developer- as-systems-facilitator Radical Structuralism: Developer-as- labor-partisan Neohumanism: developer-as- emancipator-or- social-therapist Subjective Objective Order Conflict

Y= β 1 F + β 2 S +β 3 R + β 4 N + ε where y = the indicator of the approach used; Dummy variables: F = indicator of Functionalism, F= 1 if one believes Functionalism, F=0 otherwise; R = indicator of Radical Structuralism, R = 1 if one believes Radical Structuralism, R=0 otherwise; S = indicator of Social Relativism, S=1 if one believes Social Relativism, S=0 otherwise; N= indicator of Neohumanism, N=1 if one believes Neohumanism, N=0 otherwise; ε = error term.

Assumptions (1) Survey takers are rational and answer questions honestly; (2) No autocorrelation; ( This assumption is reasonable since the survey deals with people at one time period ) (3) Heteroscidasticity is allowed. ( var(u) can varies with age, education level, sex, etc.)

Data Hypothetical Data: y F S R N

Estimation Approach: OLS ( without heteroscidasticity) WLS ( with heteroscidasticity)

Hypothesis Testing Use ---- F test to test the joint significance of the coefficients. (If the F value is greater then a critical value, we reject the null hypothesis and conclude that there are more than one paradigms.) T test to test the significance of a specific coefficient.

Survey Design (1) Sample Selection Sample Size >= 30 Participator: managers IS developers

(2) Question Set a) Assumption Part These questions ask mainly about the assumptions that the survey taker may believe. These questions are grouped into 4 sets. Each set consists of equal number, say 5, of questions. Group 1--Functionalism; Group 2--Social Relativism; Group 3--Radial Structuralism; Group 4--Neohumanism. All the questions are yes/no questions. The survey taker is supposed to answer "yes" if he believes the assertion provided or "no" otherwise. A typical question may look like this: " The system developer play a neutral and objective role in system development. A. Yes B. No."

E.g. Assumption question set

For example, the number of "yes" that participator A gives for each set is given: Number of "Yes" Paradigm 5 Functionalism 2 Social Relativism 1 Radial Structuralism 0 Neohumanism The this participator uses paradigm of Functionalism and the values of the dummy variables (F,S,R,N) are set to 1, 0,0,0, respectively.

a) Application part Choice value of the indicator of paradigms A-Functionalism 1 B-Social Relativeism 2 C-Radical Structuralism 3 D-Neohumanism 4

Problems with Methodology (1) Data problem Sometimes it is hard to classify the survey takers just by the number of "yes". Suppose a participator has two 4's for set 2 and set 3 and 0 for the other two sets. Then we can not tell whether the person believes Social Relativism or Radical Structuralism. If we set both S and R to 1, then this may lead to multicollinearity. One alternative way is to allow some weights to each question and allow higher weigh to the question about the role of system developer, since the answer to this question is largely determines the paradigm people use.

(2) Sample problem The sample is mainly consists of developers and managers in mediate or large companies. Thus it may not be random. If most the survey takers are from the large companies which usually hold one specific paradigm, the result of the hypothesis test will tend to favor the null hypothesis.

(3) Survey design problem Questions provided cannot well describe the properties of these different paradigms. If the survey taker is not familiar with context of the empirical case provided in the application part, he/she may end up with an "wrong" choice. (For instance, if the UTOPIA example is given, and the survey taker are not familiar with the technique in typesetting and the relationship between editor and typesetter, he/she may have no idea about which approach to choose.)