Survey Instrumentation Chapter 10 Test Bank Docx Singleton

CHAPTER 10

Survey Instrumentation

Multiple Choice

1. The cognitive processing perspective on survey interviewing
   1. attends to the mental steps required to answer survey questions.
   2. focuses on the mental tasks demanded of the interviewer.
   3. focuses on the cognitive rules for successfully sustaining the respondent’s attention.
   4. suggests that interviews are more demanding cognitively than other forms of interaction.
2. Theoretical analyses of the interviewer-respondent interaction suggest that respondents typically will
   1. tell interviewers when they perceive a question as vague or ambiguous.
   2. not answer opinion or attitude questions when they have no opinion.
   3. assume automatically that more difficult questions require more time to answer.
   4. feel pressure to respond promptly, even if their reply is a haphazard guess or hasty estimate.
3. Suppose a campus survey includes the following two questions: “How would you rate your academic experience?” and “How would you rate your college experience?” According to Grice’s maxim of nonredundancy, respondents should
   1. be annoyed by having to answer questions that are nearly redundant.
   2. interpret the questions as having a different meaning.
   3. give highly similar responses to the two questions that will undermine measurement validity.
   4. invariably ask interviewers to explain how the questions differ from one another.
4. According to rational choice theory, __________ behavior is likely when questions are difficult and the respondent’s motivation is low; __________ behavior is likely when questions are easily answered and the respondent’s motivation is high.
   1. satisficing; optimizing
   2. optimizing; satisficing
   3. antagonistic; cooperative
   4. optimizing; cooperative
   5. satisficing; antagonistic
5. Open-ended questions work best
   1. in questionnaires and in the later stages of research.
   2. with less motivated respondents.
   3. when respondents vary widely in their knowledge or prior thought on an issue.
   4. with large samples that generate a wide variety of responses.
6. Compared with closed-ended questions, open-ended questions
   1. require skilled interviewers to elicit complete responses.
   2. work best in mail questionnaire surveys where respondents have more time to respond.
   3. are more difficult to develop.
   4. tend to be used by researchers when they have a thorough knowledge of respondents.
7. Compared with open-ended questions, closed-ended questions
   1. are easier to develop.
   2. require less prior knowledge of respondents.
   3. require less effort from respondents and interviewers.
   4. are more difficult to code and analyze.
8. Experiments comparing responses to closed-ended and open-ended questions have found that
   1. open-ended questions are better.
   2. closed-ended questions are better.
   3. the results are similar as long as the response options in the closed question represent the most frequent responses to the open question.
   4. the results are similar as long as the questions are similarly worded.
9. According to the textbook, indirect questions are
   1. based on the notion of projection.
   2. easier to code than direct questions.
   3. frequently used in modern survey research.
   4. relatively high in reliability and validity.
10. Which of the following types of questions is rarely used in survey research today?
11. open-ended questions
12. closed-ended questions
13. contingency questions
14. filter questions
15. indirect questions
16. Which of the following is consistent with Grice’s relevance principle?
    1. Respondents voluntarily answer “don’t know” if this option is not explicitly offered.
    2. Respondents see the numerical scale values of a question as pertinent to the interpretation of the question.
    3. Respondents use the option “Other_____(please explain)” when the listed alternatives do not match their true feelings.
    4. Respondents respond differently to a general question when it is preceded by a specific question than when the general question is asked first.
17. Which of the following is true about response formats for survey questions?
    1. It is always better to include an explicit “don’t know” option for opinion questions.
    2. For measuring attitudes, the optimum number of categories is four.
    3. Because of their explicit meaning, the numerical values of rating-scale endpoints (e.g., 0 to 6 or –3 to +3) are arbitrary.
    4. Adjectival labeling of each response category can clarify the meaning of rating scales.
18. Which of the following questions would serve best as the opening question for a survey of campus alcohol use?
    1. Do you ever drink alone?
    2. Would your father approve of your present drinking habits?
    3. What is your major?
    4. Do you presently drink beer, liquor, or wine?
    5. What is your year in school?
19. In a survey study of campus alcohol and drug use, what is the best placement within a questionnaire or interview schedule for the following question: “Have you ever gotten into trouble with the law because of drinking?”
    1. opening question
    2. toward the beginning
    3. middle
    4. end

1. What is the best placement in a survey for the following question: “What is your age?”?
   1. opening question
   2. toward the beginning
   3. middle
   4. end
2. Which of the following questions should be placed toward the end of a questionnaire or interview in a survey study of campus alcohol use?
   1. Do you ever drink alone?
   2. What is your year in school?
   3. Would your father approve of your present drinking habits?
   4. When did you have your first drink of beer or wine?
   5. How often do you have a beer, liquor, or wine?
3. What is the major wording problem with the following question: “Do you approve of the irresponsible person who would drive after having several drinks?”?
   1. inappropriate vocabulary
   2. leading question
   3. lack of precision
   4. double-barreled
4. What is the major wording problem with the following question (asked of respondents who say they drink beer): “When you drink beer, how much, on the average, do you usually drink at any one time? [ ] quite a bit [ ] a moderate amount [ ] very little”?
   1. inappropriate vocabulary
   2. leading question
   3. lack of precision
   4. double-barreled
5. What is the major wording problem with the following question: “How satisfied are you with the number and fairness of the tests in this course?”
   1. inappropriate vocabulary
   2. leading question
   3. insensitive wording
   4. lack of precision
   5. double-barreled
6. What is the major wording problem with the following question: “On a typical weekday how many hours do you watch television? [ ] 0–2 [ ] 3–5 [ ] 6–10 [ ] 10 or more”?
   1. inappropriate vocabulary
   2. leading question
   3. lack of precision
   4. double-barreled
7. What is the major wording problem with the following survey question: “Is the leadership in your family matriarchal, patriarchal, or egalitarian?”
   1. inappropriate vocabulary
   2. leading question
   3. lack of precision
   4. double-barreled
   5. insensitive wording
8. Survey questions that have been used in previous research
   1. may be used without permission unless they have been copyrighted.
   2. should be modified if used in subsequent research to provide evidence of construct validity.
   3. often are so poorly written that they cannot be re-used.
   4. are of little use because they seldom fit current research objectives.
   5. Both c and d are true.
9. Which of the following is not recommended as a way of resolving the frame of reference problem in survey instruments?
   1. reason analysis
   2. telescoping
   3. funnel sequence of questions
   4. inverted funnel sequence of questions
10. In contrast to an inverted funnel sequence of questions, a funnel sequence
    1. moves from more general to progressively more specific questions.
    2. involves strictly open-ended questions.
    3. moves from the most specific questions to the most general.
    4. assures that respondents share the same frame of reference for answering general questions.
11. The objective of reason analysis is to
    1. generate a comprehensive set of questions for finding out why people do things.
    2. get respondents to provide more rational responses to questions.
    3. help respondents to avoid memory distortion.
    4. prompt respondents to answer questions about which they have no firm opinions.
12. Which of the following was not mentioned in the text as an effective way of helping respondents to remember better?
    1. limit the reference period to six months or less
    2. ask respondents to check their records
    3. provide a helpful question sequence
    4. ask respondents to consult their spouses or children when unsure
13. Which of the following statements is true of survey instrument design?
    1. It is unethical to use survey questions developed by other researchers.
    2. Slight changes in question wording can produce great differences in responses.
    3. The simple question “Why?” is usually the best way of finding out the reasons for people’s behavior.
    4. Survey researchers avoid trying to help respondents to remember because this invariably leads to memory distortion.
14. Social desirability and acquiescence response tendencies draw attention to
    1. difficulties respondents have in understanding open-ended questions.
    2. biases produced by the form and/or content of survey questions.
    3. problems with indirect questions.
    4. the need for filter and contingency questions.
15. The “social desirability effect” refers to
    1. respondents’ tendency to give answers that project a positive self-image.
    2. true class differences in happiness and mental health.
    3. the tendency to agree with a statement regardless of its content.
    4. higher response rates obtained by pleasant than unpleasant interviewers.
16. What kind of question is the following: “Do you ever drink beer?

Yes (Go to question 15) No (Go to question 20)”?

• 1. funnel question
  2. inverted funnel question
  3. filter question
  4. contingency question

1. Questions that apply to some respondents but not to others are called
   1. funnel questions.
   2. filter questions.
   3. contingency questions.
   4. matrix questions.
2. A follow-up probe such as “What did you think I meant by ‘stopping smoking’?” is most likely to be used during which phase of survey research?
   1. cognitive interviewing pretesting
   2. field pretesting
   3. interviewer training
   4. actual data collection
3. Which of the following statements is true of cognitive interviewing and field pretesting?
   1. Cognitive interviewing is one of several field pretesting techniques.
   2. Both methods are likely to use unrepresentative samples of paid subjects.
   3. Both methods focus exclusively on the respondent’s perspective on the interviewing process.
   4. Field pretesting generally precedes cognitive interviewing.
   5. They use complementary techniques with different strengths and weaknesses.
4. Which of the following questions is field pretesting least likely to address?
   1. Is the language of questions appropriate for the target population?
   2. Are transitions smooth and informative?
   3. Are there questions that respondents resist answering?
   4. Is a respondent’s gender related to his or her responses to questions?
5. Respondent and interviewer debriefings
   1. inform respondents and interviewers of the true objectives of the survey, much like the debriefing session in an experiment.
   2. provide different perspectives on question-and-answer problems with a survey instrument.
   3. enable field supervisors to evaluate the effectiveness of interviewers.
   4. prepare respondents and interviewers to perform their proper roles during an interview.
6. Which of the following methods is most likely to be a part of field pretesting?
   1. think-aloud interviews
   2. probing questions
   3. paraphrasing follow-ups
   4. interviewer debriefings

True and False

T F 1. In deciphering their proper role in a survey interview, respondents may rely on the implied principles of ordinary conversation.

T F 2. Conversational analysis suggests that respondents assume that interviewers will ask only clear questions that are relevant to their knowledge or experiences.

T F 3. Respondents are likely to adopt a satisficing strategy when questions are easily answered and their motivation is high.

T F 4. The development of closed-ended questions requires considerable knowledge of respondents before the data are collected.

T F 5. Open-ended questions are best used in FTF surveys and in the early stages of research.

T F 6. Schuman and Scott found nearly identical responses to a closed-ended question and a similarly worded open-ended question.

T F 7. Indirect questions are rarely used in survey research today.

T F 8. It is unethical for researchers to use survey questions developed by other researchers.

T F 9. Slight changes in question wording can produce great differences in responses.

T F 10. It is good to use words such as “usually,” “occasionally,” and “sometimes” because respondents are uncomfortable in giving more precise answers.

T F 11. To economize on space and time, questions should be worded when possible so that they address two or more issues simultaneously.

T F 12. Leading questions are an effective way of getting honest, unbiased answers on sensitive issues.

T F 13. Routine background questions are best placed at the beginning of a questionnaire because that is where respondents expect to see them.

T F 14. Sensitive questions are best placed at the beginning of a survey when the respondent’s interest is high.

T F 15. Arranging questions in a funnel sequence is one way to control for a respondent’s frame of reference.

T F 16. The simple question “Why?” is usually the best way of finding out the reasons for people’s behavior.

T F 17. Survey researchers avoid trying to help respondents to remember because this invariably leads to memory distortion.

T F 18. Some respondents tend to agree with attitude and opinion statements regardless of the statement’s contents.

T F 19. The social desirability of survey responses tends to be associated with respondents’ social class.

T F 20. The purpose of pretesting is to check for associations among variables to see if a larger study is worth doing.

T F 21. Unfortunately, the use of pretesting has little or no effect on the quality of survey data.

T F 22. In cognitive interviewing, interviewers interview themselves by imagining how they would interpret and answer the questions.

T F 23. The purpose of cognitive interviewing techniques is to identify potential wording, ordering, and formatting problems with survey questions.

T F 24. Cognitive interviewing procedures are better at diagnosing problems than providing solutions.

T F 25. The sample of persons used in field pretesting should be as heterogeneous as the target population.

T F 26. Field pretesting tests the survey instrument under realistic interview conditions.

Essay

1. Explain what the textbook authors means when they state that a survey interview “is a social occasion subject to the influences of the social world.” Provide at least two examples of how this perspective sheds light on the way in which respondents answer survey questions.
2. Describe the conditions when it is best to use (a) open-ended questions and (b) closed-ended questions in survey research.
3. A student planning a survey on altruism seeks your advice. She is interested in documenting the level of altruism at her college, plans to do a Web survey, and is trying to figure out what questions to ask.
   1. Below are three of the many questionnaire items she is considering as possible measures of altruism. Focusing on the wording or language of the questions, carefully explain what is wrong with each item.
      • 1. Do you care about the homeless people in this country? [yes] [no]
        2. Do you regularly offer assistance to strangers? [yes] [no]
        3. Do you and your family contribute to United Way? [yes] [no]
   2. How would you revise each item to make it acceptable?
   3. Aside from your feedback on these items, what advice would you give her regarding types of question and question order?
   4. What recommendations would you make regarding the administration of the survey?
4. What is the “frame of reference” problem in survey instrumentation? Describe three ways in which it is resolved.
5. What is the difference between cognitive laboratory interviewing and field pretesting? When is each set of methods used? What purposes and information does each form of pretesting provide?