Exam Questions Chapter 9 Survey Research

CHAPTER 9

Survey Research

Multiple Choice

1. Which of the following is not a general feature of survey research?
   1. direct observation of behavior
   2. large probability samples
   3. structured questionnaires and/or interviews
   4. quantitative data analysis
2. Most surveys are structured, which means that
   1. there is a one-on-one relationship between the researcher and the respondent.
   2. they use random selection to select respondents.
   3. the same questions are asked in the same order for all respondents.
   4. the interviewer decides when, where, and how to ask the questions.
3. The General Social Survey (GSS), described throughout Chapter 9,
   1. focuses on political behavior and attitudes.
   2. has a target population consisting of all undergraduate students in the United States.
   3. is primarily of interest to market researchers.
   4. was designed to make high-quality survey data available for secondary analysis.
4. The General Social Survey (GSS), described throughout Chapter 9,
5. is a panel survey.
6. is a face-to-face interview survey.
7. is a mixed mode survey.
8. uses a semi-structured interview.
9. has been Web-based since 2002.
10. Suppose you hypothesize that the more sociology courses a student takes, the more sensitive he or she becomes to the needs of others. You then ask a random sample of students at your college how many sociology courses they have taken and also ask them a set of questions measuring social sensitivity. Finally, you calculate the association between the two variables. This is an example of a
11. laboratory experiment.
12. cross-sectional survey.
13. longitudinal survey.
14. social network survey.
15. To study marital adjustment among newlyweds, researchers select a sample of couples who applied for marriage licenses in Worcester County, Massachusetts, between April and June 2017. They then interview the couples repeatedly over a four-year period. This is an example of a
16. cross-sectional study.
17. trend study.
18. panel study.
19. cohort study.
20. To determine how much racial prejudice declined in the last half of the twentieth century, a researcher examines answers to the same questions asked in several different polls conducted from the 1940s through 1990s. This is an example of a
    1. cross-sectional survey.
    2. trend study.
    3. panel study.
    4. cohort study.
21. A survey design in which people are asked questions at essentially one point in time is called a(n) __________ study; a survey design that questions the same people repeatedly over time is called a(n) __________ study.
22. cross-sectional; panel
23. explanatory; descriptive
24. descriptive; cross-sectional
25. panel; explanatory
26. If a researcher surveyed the entire 2018 graduating class at your college in order to study friendship patterns and their relationship to career choices, this would be an example of a
    1. cross-sectional design.
    2. cohort design.
    3. panel design.
    4. social network design.
    5. contextual design.
27. Cross-sectional survey designs are to longitudinal survey designs as __________ is to __________.
    1. panel study; trend study
    2. explanatory; descriptive
    3. contextual; sociometric
    4. one survey; two or more surveys
28. Which survey design provides information on individual changes in reported attitudes and behavior?
    1. trend study
    2. cohort study
    3. panel study
    4. social network study
29. A __________ study may consist of the secondary analysis of several different surveys conducted at different points in time; a __________ study surveys the same individuals at more than one point in time.
    1. cross-sectional; trend
    2. trend; panel
    3. contextual; social network
    4. panel; trend
    5. panel; cohort
30. Cohort studies
    1. compare different age groups within a single cross-sectional survey.
    2. survey specific cohorts (e.g., children of the Depression) repeatedly over their life course.
    3. combine the features of social network and contextual survey designs.
    4. examine the influences of life course, cohort, and historical period.
31. Among the various survey designs, panel surveys have two unique problems consisting of __________ and __________.
    1. attrition; panel conditioning
    2. cohort effects; delayed response
    3. panel routinization; testing effects
    4. unreliable measurement; attitude change
32. Compared with face-to-face interview studies, telephone interview studies
    1. cost more.
    2. take more time to complete.
    3. demand greater attention to staff supervision.
    4. require simpler survey questions.
33. Which of the following is an advantage of the mailed questionnaire over the face-to-face interview?
    1. greater flexibility
    2. higher response rate
    3. lower cost
    4. greater control over respondents’ reactions to the survey
34. Sample quality tends to be lowest in a __________ survey, and response rates generally are highest in a __________ survey.
    1. face-to-face; telephone
    2. face-to-face; mail
    3. mail; face-to-face
    4. mail; telephone
    5. telephone; telephone
35. Presently, the most common survey design is a __________, and the most common survey mode is a __________.
    1. cross-sectional design; face-to-face interview
    2. cross-sectional design; telephone interview
    3. cross-sectional design; mailed questionnaire
    4. panel design; face-to-face interview
    5. panel design; mailed questionnaire
36. A telephone interview survey tends to have a higher response rate than a __________ survey and shorter answers (and more nonresponses) to open-ended questions than a __________ study.
    1. mailed questionnaire; mailed questionnaire
    2. mailed questionnaire; face-to-face interview
    3. face-to-face interview; face-to-face interview
    4. face-to-face interview; mailed questionnaire
37. Random-digit dialing serves to
    1. increase response rates.
    2. increase sample quality by reaching respondents with unlisted numbers.
    3. decrease the cost of telephone surveys by reducing dialing time.
    4. increase sample size.
38. By automating many of the interviewer’s tasks, computer-assisted personal and telephone interviewing (CAPI and CATI)
    1. reduce interviewer mistakes such as asking questions in the wrong order and recording inappropriate responses.
    2. eliminate biases due to respondents’ reactions to the interviewer’s gender, race, and personality.
    3. increase the need for staff supervision and feedback.
    4. reduce the degree of rapport between interviewer and respondent.
39. Compared with other survey modes, Internet surveys
    1. are more costly.
    2. place greater constraints on questionnaire design.
    3. generally have higher response rates.
    4. are subject to greater coverage error.
40. Which survey mode is likely to produce the least error in terms of coverage and nonresponse?
    1. face-to-face interview
    2. telephone interview
    3. mailed questionnaire
    4. Internet survey
41. Suppose you are doing a survey in which sample quality and precision are of utmost importance, and you need to ask some critical open-ended questions. Which survey mode would work best?
    1. face-to-face interview
    2. telephone interview
    3. mail questionnaire
    4. mixed mode combining telephone interviews with a mailed questionnaire
42. Mixed-mode surveys
    1. are of limited use because of their added cost.
    2. are recommended when the timeliness of the survey is important.
    3. may be used to screen and locate respondents and to increase response rates.
    4. have declined in popularity because they tend to compound survey error.
43. Which of the following sequences is correct regarding the process of planning and conducting a survey?
    1. choose sampling frame 🡪 design sample 🡪 choose survey mode 🡪 recruit respondents
    2. choose survey mode 🡪 construct questionnaire 🡪 pretest 🡪 collect data
    3. construct questionnaire 🡪 pretest 🡪 choose survey mode 🡪 collect data
    4. pretest 🡪 choose survey mode 🡪 recruit respondents 🡪 collect data
    5. design sample 🡪 choose sampling frame 🡪 choose survey mode 🡪 recruit respondents
44. A good cover letter for a mailed questionnaire would do all but which of the following?
    1. communicate the general purpose of the study
    2. give assurances of respondents’ anonymity and/or confidentiality
    3. explain how the respondent was selected
    4. not identify the survey sponsor in order to avoid bias
    5. offer incentives such as a copy of the study
45. According to the theory of survey participation, interviewers are most likely to gain the cooperation of a respondent if they
    1. always dress formally (e.g., men wear a tie) and act in an official manner.
    2. use a brief but effective introduction.
    3. make it clear that the interview is confidential.
    4. tailor their approach to their observations of the neighborhood and the respondent’s reactions.
46. In a structured or standardized interview, the interviewer should
    1. ask every question in its proper sequence and exactly as written.
    2. avoid using probes such as “Is there anything else?”
    3. suggest the most common answer if the respondent is uncertain.
    4. allow respondents to take as long as they need to answer questions.
47. Which of the following procedures is recommended in a standardized interview?
    1. Pull the respondent back on track if he or she strays from the point of the question.
    2. Change the wording of the question if it seems appropriate for a particular respondent.
    3. Change the order of questions if a respondent's answer suggests a question that appears later in the interview.
    4. To save time, record responses to open-ended questions immediately after the interview is completed rather than during the interview.
48. Proponents of standardized interviewing argue that its main advantage is that it
    1. reduces interviewer error.
    2. makes it easier for the interviewer to establish rapport with the respondent.
    3. prevents respondents from misinterpreting the meaning of questions.
    4. simplifies the task of supervising interviewers and verifying completed interviews.
49. Some social scientists are critical of the practice of standardized interviewing because
    1. there is no evidence that shows that it reduces interviewer error.
    2. it can lead interviewers to disregard respondents’ misinterpretations of questions.
    3. it ignores different interviewer styles.
    4. it restricts the form and content of the questions that may be asked.
    5. it prevents respondents from making different interpretations of questions.
50. Response effects in surveys represent a problem in
    1. measurement validity.
    2. nonresponse bias.
    3. sampling error.
    4. study design.
51. Response effects and interviewer effects in surveys
    1. represent problems in measurement reliability.
    2. are comparable, respectively, to demand characteristics and experimenter effects in experiments.
    3. can be reduced by increasing the response rate.
    4. are least problematic in a face-to-face survey.
52. Response effects are most likely be a problem in __________ surveys, and supervision and quality control are least likely to be a problem in __________ surveys.
    1. face-to-face; telephone
    2. telephone; face-to-face
    3. face-to-face; mail
    4. mail; face-to-face
53. The best rule of thumb on follow-up mailings in mail surveys is that
    1. researchers should use as many follow-ups as necessary to achieve a satisfactory response rate.
    2. more than one follow-up is ineffective and may anger respondents.
    3. more than three follow-up mailings is generally fruitless.
    4. a copy of the questionnaire should be included with each follow-up.
54. Regarding the stages of and procedures for conducting a survey,
    1. the purpose of pretesting is to check for associations among variables to see if a larger study is worth doing.
    2. one purpose of a cover letter is to deceive respondents so they won’t become preoccupied with figuring out the true purpose of the survey.
    3. the goal of standardized interviewing is to eliminate the interviewer as a source of measurement error.
    4. follow-up efforts seldom are made because of their negligible effects on response rates.
55. Regarding the stages of and procedures for conducting a survey,
56. computer-assisted interviewing eliminates the need for pretesting the survey instrument.
57. follow-up efforts are especially important in mail surveys.
58. supervision and quality control are most difficult in a telephone survey.
59. in personal interview surveys, interviewer training generally focuses on teaching interviewers how to detect whether respondents are telling the truth.
60. Which of the following steps would not be included in the field administration of a survey?
61. pretesting
62. manipulation check
63. interviewer training
64. field supervision
65. follow-up efforts
66. To gain the cooperation of nonrespondents, survey researchers
    1. may make numerous follow-up attempts to reach them.
    2. have found that more than one follow-up is not cost effective.
    3. use follow-ups in telephone surveys, but not in FTF or mail surveys.
    4. never attempt to convert clear refusals to participate.
67. Compared with experiments, surveys generally are
    1. less economical.
    2. less susceptible to reactive measurement effects.
    3. less effective in testing causal relationships.
    4. lower in external validity.
68. Which of the following is not an advantage of survey research?
    1. feasibility of large samples
    2. detailed social description
    3. broad scope of possible topics
    4. flexible data analysis
    5. nonreactive measurement
69. What is a serious weakness that surveys share with experiments?
    1. susceptibility to reactive measurement effects
    2. use of convenience samples
    3. limited number of variables that can be studied
    4. frequent use of deception
70. Which of the following is a weakness of survey research?
    1. sample size
    2. cost effectiveness
    3. range of possible topics
    4. reliance on self-reports

True and False

T F 1. Most survey interviews are unstructured.

T F 2. Surveys may be used for both descriptive and explanatory research.

T F 3. Social researchers today are more apt to do a secondary analysis than to conduct an original survey themselves.

T F 4. The General Social Survey is an adjunct to the decennial census that is conducted every ten years.

T F 5. The most common survey design is the cohort study.

T F 6. The principal difference between a trend study and a panel study is whether or not the same individuals are surveyed over time.

T F 7. Social network and contextual studies are types of longitudinal surveys.

T F 8. A major consideration in choosing a survey mode is coverage error.

T F 9. Face-to-face interviewing is the most expensive and time-consuming mode of survey research.

T F 10. Face-to-face interviews tend to have higher response rates than other survey modes.

T F 11. Although popular in the 1970s, telephone interviewing is now seldom used because of its high cost.

T F 12. Administration and staff supervision in a telephone interview are simpler than in a face-to-face interview study.

T F 13. Computer-assisted interviewing can eliminate biases due to the respondent’s reaction to personal characteristics of the interviewer.

T F 14. Web surveys generally allow for more flexible questionnaire design than other survey modes.

T F 15. One way to increase return rates in questionnaire studies is to reduce costs for the respondent.

T F 16. The major weakness of Internet surveys is the strictures they place on questionnaire design.

T F 17. Like cover stories in experiments, most cover letters for surveys necessarily involve deception.

T F 18. Interviewer training consists mostly of teaching interviewers how to detect whether respondents are telling the truth.

T F 19. Interviewer training may be combined with pretesting the survey instrument.

T F 20. A good way to minimize interviewer bias is to withhold information about the general purpose of the study.

T F 21. The purpose of pretesting is to check for associations among variables to see if a larger study is worth doing.

T F 22. Standardization prevents respondents from misinterpreting the meaning of survey questions.

T F 23. Follow-up efforts seldom are made in surveys because of their negligible effect on response rates.

T F 24. Researchers may use monetary incentives and specially trained interviewers to convert reluctant respondents.

T F 25. Like experiments, surveys are susceptible to reactive measurement effects.

T F 26. Compared with experiments, surveys generally study larger samples and a wider range of topics.

T F 27. Compared with experiments, surveys generally are less effective in testing for cause and effect.

Essay

1. Suppose the Office of Student Involvement at your college has decided to submit a grant proposal to conduct a campus survey of student volunteering. The aims of the survey are to document volunteering among current students—who volunteers, the kinds of volunteer activities in which students engage, and their motivations for volunteering. They have hired you as a research consultant to help them prepare the proposal. Carefully describe what you would recommend regarding (a) type of survey design, (b) choice of survey mode, and (c) sampling design. Be sure to justify your recommendations by describing the pros and cons of each.
2. In what ways is the choice of a survey mode crucial to the design and planning of a survey? How does it affect (a) time and cost, (b) type of questions that can be asked, (c) choice of sampling frame, and (d) quality of the sample?
3. What are the principal arguments pro and con regarding the use of standardized interviewing procedures?
4. Describe some sources of measurement error in surveys attributable to the (a) interviewer and (b) respondent.
5. Compare and contrast the strengths and weaknesses of surveys and experiments.