1. Sample Surveys Seminar #4
by: Mike DeDad

2. NCEE Standards in Economics: Survey of Students and the Public
What is/are the population(s) of interest?
All adults 18 years of age of older in the United States
All students in grades 9-12 in the United States

3. NCEE Standards in Economics: Survey of Students and the Public
Does this sample adequately represent the population of interest?
We can’t really know for sure, but they think it does
Louis Harris & Associates, Inc. completed 1,010 telephone interviews with a national cross-section of adults 18 years of age or older. Interviews of the public averaged 10 minutes in length and were conducted from Harris' facilities in Youngstown, OH, between January 22, 1999 and February 3, 1999.
A nationally representative sample of 1,085 students in grades 9 through 12 were surveyed during an English class using a self-administered questionnaire. Interviews averaged fifteen minutes in length and were conducted between January 26, 1999 and March 4, 1999.

4. NCEE Standards in Economics: Survey of Students and the Public
From another Louis Harris and Associates, Inc. survey
“The Louis Harris and Associates, Inc. Telephone Sample is based on a methodology that is designed to produce representative samples of persons in telephone households in the selected geographic region. The Harris Telephone Sample makes use of random-digit selection procedures that assure sample representation of persons in both households that are "listed" in telephone directories, as well as persons in households that are "unlisted" in telephone directories.“
What type of bias would probably be of the biggest concern with this type of sampling?
Non-response

5. NCEE Standards in Economics: Survey of Students and the Public
What is the variable of interest?
The respondents’ levels of interest in domestic or international politics, business or finance, economics, natural history, and science.
What was, or should have been, the format of these survey questions?
Closed survey questions with choices of:
very interested/somewhat interested/not interested
Categorical or Quantitative?
Categorical

6. Northeast Region Marine Recreational Economics Survey
5. How old were you on your last birthday?
ENTER NUMBER
Don't Know 8
Refused 9
What is the variable of interest and what type is it?
Age on his or her last birthday  Quantitative if they enter their actual ages
What is the problem with asking the question this way?
It is a slightly sensitive topic

7. Northeast Region Marine Recreational Economics Survey
What is a better way of asking this question?
5. How old were you on your last birthday? (IF RESPONDENT HESITATES, QUICKLY GO TO Q.5A.)
ENTER NUMBER
Don't Know 8
Refused 9
5a. That is, in which of the following age groups do you belong?
16 to to
36 to to
56 to and over 6
Don't Know Refused
How does this change the variable of interest?
It is now categorical

8. Northeast Region Marine Recreational Economics Survey
19. Code Gender:
Male 1
Female 2
IF UNCERTAIN, SIMPLY ASK WHAT IS YOUR GENDER?
What is wrong with this question?
Too blunt
What would be a better way to get an answer to this?
Unfortunately, there really isn’t a much better way

9. Fund$Raiser Cyberzine: Past Fundraising Survey Questions and Results
When is the last time you bought a candy bar from someone knocking on your door?
Within 30 days- 8% Within 90 days- 4% Within the last year- 20% Never- 68%
What is wrong with this question?
Overly restrictive options
Doesn’t give the option of “more than a year ago”
Most likely caused many people to answer “never” (68%)

10. Fund$Raiser Cyberzine: Past Fundraising Survey Questions and Results
What time of year does your group do the most fundraising?
Fall % Winter % Spring % Year Round %
What is wrong with this question?
Overly restrictive options
Doesn’t give the option of “summer”

11. Fund$Raiser Cyberzine: Past Fundraising Survey Questions and Results
How has your nonprofit's fundraising been affected by September 11th?
Hurt - 63% No Affect - 26% Helped - 11%
What is wrong with this question?
Overly restrictive options
Doesn’t give the option of “I don’t know”

12. Fund$Raiser Cyberzine: Past Fundraising Survey Questions and Results
Describe your attitude towards fundraising.
Can't wait - 50% I will if I have to - 35% Not again!- 10% Never again!- 5%
What is wrong with this question?
Unbalanced Response Options
Negative responses outweigh positive (results are surprising)
Possible deliberate bias
Volunteer Bias

13. What Do You Wear to Bed? What is wrong with this question?
What do you do on a Friday night?
Stay in and go to bed early
Head out with friends/significant other to eat
Hit the bars and party til morning
What is wrong with this question?
Deliberate bias
Just because someone stays in, it doesn’t mean they have to go to bed early (implies that this is not “cool”)
Wording of the choices implies that partying is the “coolest” choice

14. Sources