6th Edition Verified Test Bank Ch.7 Experimentation

CHAPTER 7

Experimentation

Multiple Choice

1. The most distinctive feature of social scientific experiments is
   1. a laboratory setting.
   2. the experimenter’s control over events to which subjects are exposed.
   3. the direct observation of behavior.
   4. random sampling.
2. Which of the following is not an essential feature of a true experiment?
   1. manipulation of the independent variable
   2. random assignment
   3. at least one comparison or control group
   4. laboratory setting
   5. measurement of the dependent variable
3. How does the manipulation of the independent variable in an experiment strengthen inferences about cause and effect?
   1. It eliminates the effects of most extraneous variables.
   2. It establishes the time order of the events (or variables).
   3. It proves that a causal relationship exists.
   4. It determines that the observed association is nonspurious.
4. Which causal criterion is supported in an experiment by random assignment?
   1. association
   2. direction of influence
   3. nonspuriousness (elimination of rival explanations)
5. Which causal criterion is supported in an experiment by treating participants in all experimental groups exactly alike except for the manipulation of the independent variable?
   1. association
   2. direction of influence
   3. nonspuriousness (elimination of rival explanations)
6. In an experiment investigating the effects of stress on the desire to affiliate with others, half of the subjects complete an easy test of mental ability and half complete a difficult test. What procedure is used to ensure that any differences in the desire to affiliate are due to differences in test difficulty and not to characteristics of the subjects?
   1. random assignment
   2. manipulation check
   3. pretest
   4. replication
   5. debriefing
7. What does it mean when the results of an experiment are statistically significant?
   1. measurement of the dependent variable is valid.
   2. manipulation of the independent variable is valid.
   3. the independent variable is likely to have affected the dependent variable.
   4. the results may be generalized to other sample populations.
8. Which causal criterion is established in an experiment by tests of statistical significance?
   1. association
   2. direction of influence
   3. nonspuriousness (elimination of rival explanations)
9. What is the purpose of tests of statistical significance in an experiment?
   1. to establish direction of influence
   2. to determine if random assignment created similar experimental and control groups
   3. to determine the generalizability of the findings
   4. to determine if chance is a reasonable explanation of experimental results
   5. to test the reliability of the measurement of the dependent variable
10. Matching subjects on control variables in an experiment
    1. is just as effective in controlling for extraneous variables as is random assignment.
    2. is easier to implement than random assignment.
    3. may be used in conjunction with random assignment.
    4. is intended to increase an experiment’s external validity.
11. The pool or sample of participants in laboratory experiments most typically consist of a
    1. simple random sample.
    2. systematic sample.
    3. stratified random sample.
    4. convenience sample.
12. Which of the following procedures is least likely to be found in an experiment?
    1. random sampling
    2. random assignment
    3. measurement of the dependent variable
    4. tests of statistical significance
13. Use of college student volunteers limits the __________ of an experiment.
    1. internal validity
    2. external validity
    3. experimental realism
    4. mundane realism
14. Which of the following processes could not be used for the purpose of increasing the external validity of experimental results?
    1. probability sampling
    2. random assignment
    3. replication
    4. sampling for heterogeneity
15. Which of the following procedures is intended to ensure or enhance a study’s internal validity?
    1. replication
    2. random sampling
    3. random assignment
16. __________ is used to ensure internal validity, whereas __________ increases external validity.
    1. Random assignment; matching
    2. Matching; random assignment
    3. Random assignment; random sampling
    4. Random sampling; random assignment
17. Experiments tend to be __________ in internal validity and __________ in external validity.
    1. low; low
    2. low; high
    3. high; low
    4. high; high
18. Testing and confirming a hypothesis in both laboratory and field experiments, among a variety of populations in a wide range of situations enhances the __________ of experimental findings.
    1. measurement reliability
    2. internal validity
    3. external validity
    4. reactivity
19. Which of the following sequences is correct regarding the process of conducting an experiment?
    1. introduce experiment 🡪 perform manipulation check 🡪 debrief 🡪 measure dependent variable
    2. debrief 🡪 acquire informed consent 🡪 randomly assign participants to conditions 🡪 perform manipulation check
    3. introduce experiment 🡪 manipulate independent variable 🡪 measure dependent variable 🡪 debrief
    4. randomly assign participants to conditions 🡪 acquire informed consent 🡪 measure dependent variable 🡪 manipulate the independent variable
20. Pretesting in an experiment is most similar to which of the following features of a theatrical production or play?
    1. writing the script
    2. rehearsing the play
    3. promoting the play to attract an audience
    4. auditioning actors for roles in the play
21. Which of the following procedures is designed to satisfy participants’ suspicions about the purpose of an experiment?
    1. pretesting
    2. cover story
    3. acquisition of informed consent
    4. manipulation check
22. Which of the following is true of the cover story in an experiment?
23. It is designed to enhance experimental realism.
24. It rarely involves deception.
25. If sufficiently detailed, it can take the place of debriefing.
26. It usually is presented between the manipulation of the independent variable and the measurement of the dependent variable.
27. When was the manipulation check performed in the epileptic seizure experiment?
    1. during pretesting
    2. immediately before the manipulation of the independent variable
    3. immediately after the manipulation of the independent variable
    4. during the post-experimental interview
28. Which of the following stages in a laboratory experiment would be optional?
    1. subject recruitment and acquisition of informed consent
    2. random assignment
    3. manipulation of the independent variable
    4. manipulation check
    5. measurement of the dependent variable
29. Which of the following is not an advantage of behavioral measures of the dependent variable in comparison with verbal reports?
    1. easy to devise
    2. lower participant awareness of being measured
    3. greater precision
    4. measuring what people do is better than measuring what they say they will do
30. Researchers generally agree that debriefing
    1. is an optional procedure whose primary purpose is subject enlightenment.
    2. is easier to carry out in field experiments than in laboratory experiments.
    3. should be omitted when participants have been deceived because the revelation of deception may prove embarrassing.
    4. may provide important information about how participants reacted to experimental procedures.
31. What is a primary objective of debriefing?
    1. to pay participants and thank them for their participation
    2. to make sure that participants were behaving naturally during the experiment
    3. to inform participants about any deception and explain the true purpose of the experiment
    4. to present the results of the experiment
32. An experiment that has an impact on and seems real to subjects but that bears little resemblance to real-life situations would be __________ in experimental realism and __________ in mundane realism.
    1. low; low
    2. low; high
    3. high; low
    4. high; high
33. Which of the following is true of experimental and mundane realism?
    1. They are equally important in an experiment.
    2. Experimental realism is considered to be more important than mundane realism.
    3. Mundane realism is considered to be more important than experimental realism.
    4. Without mundane realism, experimental findings are meaningless.
34. Typical of “impact experiments,” Darley and Latane’s epileptic seizure experiment, described in the text, was __________ in experimental realism and __________ in mundane realism.
    1. low; low
    2. low; high
    3. high; low
    4. high; high
35. According to research cited in the text, when subjects in an experiment perceived a conflict between “being a good subject” and “looking good” to the experimenter, they chose to
    1. be a “good subject.”
    2. confirm the experimenter’s hypothesis as they perceived it.
    3. “look good.”
    4. be rebellious and sabotage the experiment.
36. A subject in an experiment on prejudice toward the physically handicapped is asked by the experimenter to be honest and follow instructions scrupulously—in other words, to adopt the role of “faithful subject.” This implies that
    1. the experimenter knew the subject was prejudiced toward people with handicaps.
    2. the experimenter was trying to minimize the effect of demand characteristics.
    3. the experimenter was trying to reduce experimenter bias.
    4. “role” was the independent variable in this experiment.
37. The notion of demand characteristics suggests that subjects respond to an experimental task
    1. strictly according to the “demands” or instructions of the experimenter.
    2. based on available cues such as the setting, equipment, instructions, and so forth.
    3. based on experimental demands outlined in the informed consent agreement.
    4. honestly and naively when they are convinced that the experiment demands it.
38. Which of the following procedures would be most effective for reducing the impact of demand characteristics?
    1. satisfy subjects’ suspicions about the experiment by providing a good cover story
    2. randomly assign subjects to experimental conditions
    3. match subjects on relevant characteristics
    4. debrief subjects thoroughly at the end of the experiment
    5. tell subjects that their performance as subjects will be evaluated
39. One means of controlling for biases due to the social nature of experiments is to
40. keep subjects isolated from one another throughout the course of the experiment.
41. place the manipulation of the independent variable and the measurement of the dependent variable in the same context.
42. perform the experiment in a natural setting, as in a field experiment.
43. tell subjects that their performance as subjects will be evaluated.
44. If possible, the experimenter who manipulates the independent variable should not also administer the measure of the dependent variable because
    1. these two tasks require different talents, and few people are able to perform both adequately.
    2. a single person performing both tasks decreases experimenter realism.
    3. a single person performing both tasks decreases external validity.
    4. a single person performing both tasks increases the likelihood of experimenter expectancy effects.
45. In laboratory experiments,
    1. manipulation of the independent variable may have more than one meaning to subjects.
    2. debriefing is an optional procedure when deception is used.
    3. self-reports are generally preferred over behavioral measures of the dependent variable.
    4. subjects often try to guess the hypothesis in order to sabotage the experiment.
46. In comparison with laboratory experiments, field experiments tend to be
    1. higher in internal validity.
    2. lower in external validity.
    3. lower in experimental realism.
    4. higher in mundane realism.
47. In comparison with laboratory experiments, field experiments
    1. rarely involve manipulation of the independent variable.
    2. afford less control over design and measurement.
    3. are less likely to raise ethical issues.
    4. usually involve more extensive debriefing.
    5. are more likely to be internally valid.
48. Which of the following is not an advantage that field experiments typically have over laboratory experiments?
    1. greater mundane realism
    2. lower likelihood of experimenter or demand characteristic effects
    3. closer approximation of real-life situations
    4. greater sample heterogeneity
    5. greater control of experimental events
49. Which of the following is an advantage of survey-based experiments in comparison with laboratory and field experiments?
    1. focus on what people say rather than how they act or behave
    2. use of a larger and more diverse sample of research participants
    3. random assignment of participants to experimental conditions
    4. control over the conditions of observation
50. Which of the following is true of the experimental approach to social research?
    1. It is used almost exclusively for explanatory, hypothesis-testing purposes.
    2. It is the most common methodological approach in sociology.
    3. It typically uses simple random sampling to select participants.
    4. It affords less control over extraneous variables than other research approaches.
51. Which of the following is a limitation of the experimental approach?
    1. It is always carried out in an unnatural laboratory setting.
    2. It provides weak evidence of causal relationships.
    3. It cannot be incorporated into other research approaches such as surveys.
    4. It tends to produce results that have limited external validity.
52. Which of the following is an advantage of the experimental approach?
    1. minimization of reactive measurement effects
    2. high internal validity
    3. low sampling error
    4. high external validity

True and False

T F 1. Experiments afford less control over extraneous variables than other approaches to social research.

T F 2. In a “perfect” experiment, the only rival explanation for the study hypothesis is that the results are due to chance factors.

T F 3. When possible, matching should be substituted for random assignment.

T F 4. Tests of statistical significance indicate whether differences among experimental conditions are likely to have occurred by chance.

T F 5. An experiment’s internal validity depends upon how well it controls for extraneous variables.

T F 6. “External validity” refers to the generalizability of study results.

T F 7. Laboratory experiments usually are high in external validity.

T F 8. The most common method of selecting a pool or sample of subjects in experiments is simple random sampling.

T F 9. Most experiments are conducted with college students as subjects.

T F 10. The use of college student volunteers limits the internal validity of an experiment.

T F 11. Replication is often used to increase the generalizability of experimental results.

T F 12. Pretesting in an experiment may take the place of a cover story or introduction.

T F 13. A manipulation check determines whether the independent variable had a causal influence on the dependent variable.

T F 14. Behavioral measures are generally preferred over self-report measures of the dependent variable.

T F 15. Generally, mundane realism is considered to be more important than experimental realism.

T F 16. Laboratory experiments tend to be high in experimental realism and low in mundane realism.

T F 17. Debriefing is generally viewed as an optional, albeit desirable feature of experiments.

T F 18. A strength of laboratory experiments is the absence of reactive measurement effects.

T F 19. The most typical motives of experimental research participants are helping the experimenter and making a good impression.

T F 20. The most common subject role is that of the subject who tries to guess the experimenter’s hypothesis in order to sabotage the experiment.

T F 21. In a double-blind experiments, participants are blind to (1) the hypothesis and to (2) the fact that they are participating in an experiment.

T F 22. The double-blind technique is designed to control for experimenter effects.

T F 23. Demand characteristics are less likely to be a problem in field experiments than in laboratory experiments.

T F 24. The units of analysis in experiments are always individuals.

T F 25. Compared with laboratory experiments, field experiments are less likely to raise ethical problems because participants rarely know they are in an experiment.

T F 26. Experimental designs may be incorporated into questionnaire surveys.

Essay

1. Experiments are designed to test causal hypotheses. Carefully explain the logic of experimentation by discussing how experiments effectively meet the three requirements for establishing causal relationships.
2. The textbook likens the process of conducting an experiment to staging a play. Explain how each of the following parts of an experiment compares to the stages of producing a play: (a) designing the study, (b) recruiting research participants, and (c) pretesting.
3. Experiments are particularly susceptible to reactive measurement in the form of demand characteristics and experimenter effects. Explain how these effects can adversely affect the results of an experiment. How do experimenters attempt to control such effects?
4. In 1988 Paul Tracy and James Fox conducted a field experiment to measure the extent to which auto body repair shops in Massachusetts inflate repair estimates for collision damage claims to insurance companies. The logic of the research involving obtaining estimates for body-damage repair costs for the same vehicles, under conditions when the damage was covered by insurance and when it was not. In short, they took 1987-model collision-damaged vehicles to selected auto body shops. At each shop, they obtained estimates of repair costs for two cars, one of which was presented as being covered by insurance and the other of which was not. Whether a car was presented as insured or uninsured at a given shop was determined by random assignment. (Statistical results clearly indicated that repair estimates were higher for vehicles presented as insured.)
   1. What is the independent variable in this experiment?
   2. What is the dependent variable?
   3. Suppose that only male drivers in their early twenties posed as owners of the vehicles. What effect, if any, would this have on the internal and external validity of the study?
5. Compare the advantages and disadvantages of field experiments versus laboratory experiments.