Ch.12 Experimental Research Weak and Strong + Exam Questions - Educational Research 6e Answer Key + Test Bank by Robert Burke Johnson. DOCX document preview.
Chapter 12: Experimental Research: Weak and Strong Designs
Learning Objectives
- Explain how experiments produce evidence of causality.
- Describe the different ways an independent variable can be manipulated.
- Explain the importance of control in experimental research and how control is achieved.
- Explain the different ways of controlling the influence of potentially confounding variables.
- Explain why some experimental research designs are weak designs and others are strong designs.
- Compare and contrast factorial and repeated-measures designs.
- Explain the concept of an interaction effect.
Multiple Choice
1. An experiment involves:
a. The use of several dependent variables
b. A focus on prediction of criterion variables
c. Studying a phenomenon as it naturally occurs
d. Studying a phenomenon under strictly controlled conditions
Learning Objective: 3
Cognitive Domain: Comprehension
Answer Location: The Experiment
Difficulty Level: Easy
2. In which of the following examples is the independent variable manipulated by the presence versus absence technique?
a. In one experimental condition teachers receive in-service training. In the other condition, the teachers receive no training.
b. In one experimental condition teachers receive in-service training. In the other experimental condition the teachers receive a written training document for study.
c. In one experimental condition, the teachers receive one day of in-service training. In the second condition, the teachers receive two days of training. In the third condition, the teachers receive three days of training.
d. In one experimental condition teachers receive in-service training from a college professor. In the second condition, the teachers receive in-service training from a peer.
Learning Objective: 2
Cognitive Domain: Application
Answer Location: Ways to Manipulate an Independent Variable
Difficulty Level: Medium
3. In which of the following examples is the independent variable manipulated by the amount technique?
a. In one experimental condition teachers receive in-service training. In the other condition, the teachers receive no training.
b. In one experimental condition teachers receive in-service training. In the other experimental condition the teachers receive a written training document for study.
c. In one experimental condition, the teachers receive one day of in-service training. In the second condition, the teachers receive two days of training. In the third condition, the teachers receive three days of training.
d. In one experimental condition teachers receive in-service training from a college professor. In the second condition, the teachers receive in-service training from a peer.
Learning Objective: 2
Cognitive Domain: Application
Answer Location: Ways to Manipulate an Independent Variable
Difficulty Level: Medium
4. A technique used to statistically equate groups that differ on a pretest or some other variable or variables is called:
a. Analysis of covariance
b. Counterbalancing
c. Matching
d. Carry over effect
Learning Objective: 4
Cognitive Domain: Knowledge
Answer Location: Analysis of Covariance
Difficulty Level: Easy
5. In which of the following examples is the independent variable manipulated using the type technique?
a. A researcher is interested in the effects of rehearsal on memory performance. She has one group of students use rehearsal whereas a control group does not rehearse.
b. A researcher is interested in the effects of rehearsal on memory performance. She has one group of students rehearse items for 5 seconds, a second group for 10 seconds, and a third group for 15 seconds.
c. A researcher is interested in the effects of rehearsal on memory performance. She has one group of students rehearse each item for 10 seconds. She has another group rehearse each item for 20 seconds. Finally, the third group rehearses each item for 30 seconds.
d. A researcher is interested in the effects of rehearsal on memory performance. She has one group of students rehearse items individually, one item at a time. A second group rehearses using a grouping technique, in groups of five. The third comparison group rehearses “freely” as they see fit.
Learning Objective: 2
Cognitive Domain: Application
Answer Location: Ways to Manipulate an Independent Variable
Difficulty Level: Medium
6. Experimental control refers to:
a. Manipulating the independent variable using the presence versus absence technique.
b. Eliminating any differential influence of extraneous variables.
c. Eliminating the dependent variable.
d. Using the amount technique to manipulate an independent variable.
Learning Objective: 3
Cognitive Domain: Knowledge
Answer Location: Control of Confounding Variables
Difficulty Level: Easy
7. The procedure that maximizes the probability that the comparison groups will be equated on all extraneous variables is called:
a. Random selection
b. Random sampling
c. Random assignment
d. Counterbalancing
Learning Objective: 4
Cognitive Domain: Knowledge
Answer Location: Random Assignment
Difficulty Level: Easy
8. When members of comparison groups are selected in order to equate the groups on one or more variables that are correlated with the dependent variable, this is called:
a. Matching
b. Counterbalancing
c. Random assignment
d. A factorial design
Learning Objective: 4
Cognitive Domain: Knowledge
Answer Location: Matching
Difficulty Level: Easy
9. A researcher is interested in the effects of a preschool program on later school performance. Because she is concerned that socio-economic status (SES) is a potential extraneous variable in her study, she picks children to study who are only from low SES homes. The control technique she used in this study was:
a. Matching
b. Random assignment
c. Holding the extraneous variable constant
d. Statistically controlling the extraneous variable
Learning Objective: 4
Cognitive Domain: Application
Answer Location: Holding the Extraneous Variable Constant
Difficulty Level: Medium
AACSB Standard:
10. A researcher is interested in whether a new reading program for 5th graders will lead to better performance than a traditional program. She is also concerned that the program effects might vary or be confounded with prior reading achievement. Hence, she includes prior reading achievement in her study as a variable. The control technique she used in this study was:
a. Matching
b. Random assignment
c. Holding the extraneous variable constant
d. Building the extraneous variable into the design
Learning Objective: 4
Cognitive Domain: Application
Answer Location: Building the Extraneous Variable into the Research Design
Difficulty Level: Medium
11. When a researcher notices that participants success in one condition is influenced by their experiences in the previous condition, she potentially has a(n):
a. Order effect
b. Carryover effect
c. Sequencing effect
d. Random effect
Learning Objective: 4
Cognitive Domain: Application
Answer Location: Counterbalancing
Difficulty Level: Medium
12. A strategy for overcoming sequencing effects is called:
a. Random assignment
b. Matching
c. Analysis of covariance
d. Counterbalancing
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Counterbalancing
Difficulty Level: Medium
13. Counterbalancing involves:
a. Presenting the experimental conditions to different groups of participants in different orders so that sequencing effects are controlled.
b. Using analysis of covariance.
c. Matching participants on several variables.
d. Holding all extraneous variables constant.
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Counterbalancing
Difficulty Level: Medium
14. A researcher carries out a study of memory strategies. She has all participants get three different memory strategies to use to learn lists of 20 words. She discovers that after she gives participants Strategy A to use, they have difficulty using strategies B and C. The problem of Strategy A influencing Strategy B and C performance suggests that one problem with the study is:
a. A carryover effect
b. An order effect
c. Random assignment
d. Random sequencing effect
Learning Objective: 4
Cognitive Domain: Application
Answer Location: Counterbalancing
Difficulty Level: Medium
15. One threat to the internal validity of the one-group posttest-only design is:
a. Testing
b. Instrumentation
c. Regression artifacts
d. History
Learning Objective: 5
Cognitive Domain: Analysis
Answer Location: Table 12.1
Difficulty Level: Hard
16. A researcher carries out a study of memory strategies. She has all participants receive all three strategy conditions. First they get strategy A, then they get strategy B, and then they receive strategy C. She notices that there is a steady increase in performance as the students move from A to C. She is concerned because although it might be that strategy C is better than strategy A, it is also possible that the participants might just improve because of familiarity with the task of memorizing lists. Her concern reflects the potential of:
a. Order effects
b. Random assignment
c. Carryover effects
d. Random sequencing effect
Learning Objective: 4
Cognitive Domain: Application
Answer Location: Counterbalancing
Difficulty Level: Medium
17. Angelique is conducting research in her classroom. She is interested in comparing the effectiveness of different instructional strategies on test scores. Her study is an example of a(n):
a. Laboratory experiment
b. Internet experiment
c. Qualitative experiment
d. Field experiment
Learning Objective: 3
Cognitive Domain: Application
Answer Location: Field Experiment
Difficulty Level: Medium
18. Additive and interactive effects are potential threats to validity in which design?
a. One-group posttest only design
b. One-group pretest-posttest design
c. Repeated measures design
d. Posttest only design with nonequivalent groups
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Table 12.1, Table 12.2
Difficulty Level: Hard
19. A major threat to validity to the posttest-only design with nonequivalent groups is:
a. History
b. Testing
c. Instrumentation
d. Differential selection
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Table 12.1
Difficulty Level: Medium
20. The posttest-only design with nonequivalent groups is likely to control for which of the following threats to internal validity:
a. History
b. Differential selection
c. Additive and interactive effects
d. Differential attrition
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Table 12.1
Difficulty Level: Medium
21. Inferences from group comparisons are made stronger when:
a. We use static groups
b. We use preexisting groups
c. We randomly assign participants to groups
d. We posttest groups
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Random Assignment
Difficulty Level: Medium
22. A researcher does a study where he examines the effects of a new reading program for teaching reading comprehension. He randomly assigns 30 students to an experimental group and 30 students to a control group. He then posttests the students after the program to see whether they are different in reading performance. The design used by the researcher is the:
a. Pretest-posttest control-group design
b. Posttest-only design with nonequivalent groups
c. One-group posttest-only design
d. Posttest-only control-group design
Learning Objective: 5
Cognitive Domain: Application
Answer Location: Posttest-only Control-group Design
Difficulty Level: Medium
23. A researcher studies a new mathematics program. At the beginning of the year, 100 students are randomly assigned to receive a new program and 100 students are randomly assigned to use the previously used mathematics program. The participants are pretested at the beginning of the year, and they are posttested at the end. What kind of experimental design did the researcher use?
a. Pretest-posttest control-group design
b. Posttest-only design with nonequivalent groups
c. One-group posttest-only design
d. Posttest-only control-group design
Learning Objective: 5
Cognitive Domain: Application
Answer Location: Pretest-posttest Control-group Design
Difficulty Level: Hard
24. When two or more independent variables are simultaneously studied in an experiment, this is known as:
a. A counterbalanced designed
b. A posttest-only control-group design
c. A factorial design
d. A posttest-only design with nonequivalent groups
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Medium
25. When the effect of one independent variable depends on the level of another independent variable, this is called:
a. A main effect
b. A cell
c. An interaction effect
d. Counterbalancing
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Medium
26. The effect of one independent variable in a factorial design is called:
a. A main effect
b. A cell
c. An interaction effect
d. Counterbalancing
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Easy
Use the following to answer Questions 27-29:
A researcher is looking at the effects of competition versus cooperation on mathematics learning. She theorizes that anxiety will interact with type of instruction to influence math learning. The dependent variable is the number of points on a 100 point mathematics test. The means for the study results are shown in the table below.
Competition | Cooperation | Overall | |
High anxiety | 25 | 75 | 50 |
Low anxiety | 65 | 75 | 70 |
Overall | 45 | 75 |
27. Which of the following pairs of means is indicative of the main effect of Instruction type?
a. 45 vs 75
b. 50 vs 70
c. 25 vs 65
d. 75 vs 75
Learning Objective: 6
Cognitive Domain: analysis
Answer Location: Factorial Designs
Difficulty Level: Medium
28. Which of the following is NOT likely to be true?
a. There is an interaction between Anxiety and Instruction.
b. There is a main effect of type of instruction.
c. There is a main effect of anxiety.
d. The manipulations did not have an effect.
Learning Objective: 6
Cognitive Domain: Analysis
Answer Location: Factorial Designs
Difficulty Level: Medium
29. Which of the following inferences is likely true based on the pattern of results?
a. Instructional effects are the same whether someone has high or low anxiety.
b. Instructional type has no impact on the effectiveness of instruction.
c. High anxiety individuals are influenced more by instructional type than low anxiety individuals.
d. Anxiety has no impact on the effectiveness of instruction.
Learning Objective: 6
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Medium
30. In a repeated measures design:
a. All participants participate in one condition only
b. Participants are randomly assigned to treatment groups
c. Participants participate in all conditions
d. Participants participate in either the experimental or the control condition but not both
Learning Objective: 6
Cognitive Domain: Comprehension
Difficulty Level: Repeated-measures Designs
31. A major problem for repeated measures designs is:
a. Interactions with selection
b. It requires more participants
c. Sequencing effects
d. Participants serve as their own controls
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Repeated-Measures Designs
Difficulty Level: Medium
32. A design that combines random assignment of research participants to groups with repeated measures is called a:
a. Between subjects factorial design
b. Factorial design based on a mixed model
c. Posttest-only control-group design
d. Posttest-only design with nonequivalent groups
Learning Objective: 6
Cognitive Domain: Knowledge
Answer Location: Factorial Designs Based on a Mixed Model
Difficulty Level: Easy
33. Which of the following is not a characteristic of an experiment?
a. Research attempts to objectively observe what happens
b. Variables are manipulated in a controlled environment
c. There is always a control group
d. One or more factors are varied while the rest are held constant
Learning Objective: 1
Cognitive Domain: Comprehension
Answer Location: The Experiment
Difficulty Level: Medium
34. The variable that the researcher manipulates in an experiment is called the:
a. Independent variable
b. Dependent variable
c. Consequent variable
d. Controlled variable
Learning Objective: 2
Cognitive Domain: Comprehension
Answer Location: Independent Variable Manipulation
Difficulty Level: Medium
35. To determine whether noise affects the ability to solve math problems, a researcher has one group solve math problems in a quiet room and another group solve math problems in a noisy room. The group solving problems in the noisy room completes 15 problems in one hour and the group solving problems in the quiet room completes 22 problems in one hour. In this experiment, the independent variable is ____________ and the dependent variable is _____________.
a. The number of problems solved; the difficulty of the problems
b. The number of problems solved; the noise level in the room
c. The noise level in the room; the number of problems solved
d. The noise level in the room; the difficulty of the problems
Learning Objective: 2
Cognitive Domain: Application
Answer Location: Independent Variable Manipulation
Difficulty Level: Medium
36. Which of the following is an example of “present versus absence” variation of the independent variable?
a. All participants’ reaction times are measured after ingesting two beers
b. In a study of distraction on reading comprehension, one group is distracted by noise, another by a flashing light, and a third by a bad odor
c. The control group gets no drug, one experimental group gets 5 mg/kg of a drug, and a second experimental group gets 10 mg/kg of the drug
d. An experimental group receives 5 mg/kg of a drug and the control group receives no drug (placebo)
Learning Objective: 2
Cognitive Domain: Application
Answer Location: Ways to Manipulate an Independent Variable
Difficulty Level: Medium
37. Which of the following is an example of “amount of variable” variation of the independent variable?
a. All participants’ response times are measured after eating sweets
b. In a study of distraction on problem-solving ability, one group is distracted by noise, another by a flashing light, and a third by a bad odor
c. The control group gets 1 minute to solve a problem, one experimental group gets 2 minutes, and a second experimental group gets 5 minutes to solve the problem.
d. An experimental group receives 5 mg/kg of a drug and the control group receives no drug.
Learning Objective: 2
Cognitive Domain: Application
Answer Location: Ways to Manipulate an Independent Variable
Difficulty Level: Medium
38. Which of the following is an example of “type technique” of variation of the independent variable?
a. All participants’ reaction times are measured after being given a drug
b. In a study of success in passing the bar, one group studied independently, another as a group, and a third paid for a review class
c. The control group got no study aids, one experimental group got a graphic organizer, and a second experimental group got copies of the teacher’s notes
d. An experimental group had a review session before taking a test and the control group took the test when the unit was complete
Learning Objective: 2
Cognitive Domain: Application
Answer Location: Ways to Manipulate an Independent Variable
Difficulty Level: Medium
39. Which of the control techniques has the most power to insure that extraneous variables do not have differential effects on the different groups in the experiment?
a. Random assignment
b. Matching
c. Counterbalancing
d. Precision matching
Learning Objective: 3
Cognitive Domain: Comprehension
Answer Location: Random Assignment
Difficulty Level: Easy
40. Often, we do not know at the start of an experiment what extraneous variables could affect our results. The best means of controlling for unknown sources of extraneous variables is:
a. Random selection
b. Random assignment
c. Sequencing
d. Analysis of covariance
Learning Objective: 3
Cognitive Domain: Comprehension
Answer Location: Random Assignment
Difficulty Level: Easy
41. If you were interested in determining whether a possible interaction effect existed between an extraneous variable and the independent variable, you should use what technique to control for the influence of the extraneous variable?
a. Hold the extraneous variable constant
b. Make the extraneous variable into another independent variable and include it in the study
c. Match the participants who will be in the study
d. Counterbalancing
Learning Objective: 3
Cognitive Domain: Application
Answer Location: Building the Extraneous Variable into the Research Design
Difficulty Level: Medium
42. A researcher did not think that gender influenced the amount of time it takes people to tie their shoes so he conducted his shoe tying study with girls. This is which type of control strategy?
a. Matching
b. Counterbalancing
c. Holding the extraneous variable constant
d. Including the extraneous variable in the research design.
Learning Objective: 4
Cognitive Domain: Application
Answer Location: Holding the Extraneous Variable Constant
Difficulty Level: Medium
43. Order and carryover effects differ in that:
a. For order effects it matters which particular treatment comes first, but not so for carryover effects
b. For carryover effects it does not matter which treatment occurs first, just how often it is repeated
c. For order effects it is the ordinal position of the treatment conditions that matters
d. For carryover effects it is only the ordinal position of the treatment conditions that matters
Learning Objective: 4
Cognitive Domain: Analysis
Answer Location: Counterbalancing
Difficulty Level: Medium
44. What is the best technique to use to control for sequencing effects?
a. Random assignment to treatment groups
b. Matching
c. Holding variables constant by building them into the design
d. Counterbalancing
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Counterbalancing
Difficulty Level: Medium
45. Analysis of covariance is:
a. A statistical technique that can be used to help equate groups on specific variables
b. A statistical technique that can be used to control sequencing effects
c. A statistical technique that substitutes for random assignment to groups
d. Adjusts scores on the independent variable to control for extraneous variables
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Analysis of Covariance
Difficulty Level: Medium
46. John has a new speed reading program he wants to test. He trains 10 people on the program and then measures their reading speed. John used which design?
a. One-group posttest-only design
b. One-group pretest-posttest design
c. Posttest-only design with nonequivalent groups
d. Nonequivalent posttest-only design
Learning Objective: 5
Cognitive Domain: Application
Answer Location: One-group Posttest-only Design
Difficulty Level: Easy
47. Two teachers who are friends teach math at different high schools. At a conference they learn about a new program for teaching trigonometry. They decide to test it by having one teacher use it in her class and the other use the traditional program. At the end of the school year they compare their students’ scores on the AP trigonometry test. This is an example of which research design?
a. One-group posttest-only design
b. One-group pretest-posttest design
c. Posttest-only design with nonequivalent groups
d. Nonequivalent posttest-only design
Learning Objective: 5
Cognitive Domain: Application
Answer Location: Posttest-only design with nonequivalent groups
Difficulty Level: Medium
AACSB Standard:
48. A group of physicians tests a new drug for treating Attention Deficit Disorder (ADD). They measure the amount of time a group of ADD students attend to a task during a specified hour one week prior to taking the new drug and for a specified hour one week after taking the new drug. The physicians used what type of design to test the drug?
a. One-group posttest-only design
b. One-group pretest-posttest design
c. Posttest-only design with nonequivalent groups
d. Nonequivalent posttest-only design
Learning Objective: 5
Cognitive Domain: Application
Answer Location: One-group Pretest-Posttest Design
Difficulty Level: Medium
49. The control group serves the function of:
a. Matching participants
b. Controlling for several rival hypotheses
c. Preventing order effects.
d. Assuring external validity
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Strong Experimental Research Designs
Difficulty Level: Medium
50. In a posttest-only control-group design:
a. Some participants are given a treatment and others are not
b. Each participant experiences all treatment conditions
c. Pairs of matched participants experience the same treatment conditions
d. There are always only two groups
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Posttest-only Control-group Design
Difficulty Level: Medium
51. What is the important difference between the posttest-only control-group design and the posttest-only design with nonequivalent groups?
a. The former uses random assignment of participants to groups
b. The former uses two groups of participants
c. The latter involves testing participants twice
d. The latter does not manipulate an independent variable
Learning Objective: 5
Cognitive Domain: Analysis
Answer Location: Posttest-only Control-group Design, Posttest-only Design
Difficulty Level: Hard
52. A group of physicians tests a new drug for treating Attention Deficit Disorder (ADD). They randomly assign 40 children with ADD to the experimental and control groups (20 per group). They then measure the amount of time each group of ADD students attend to a task during a specified hour one week prior to the treatment group taking the new drug and during a specified hour one week after the treatment group takes the new drug. The physicians used what type of design to test the drug?
a. One-group posttest-only design
b. Pretest-posttest control-group design
c. Posttest-only design with nonequivalent groups
d. Nonequivalent posttest-only design
Learning Objective: 5
Cognitive Domain: Application
Answer Location: Pretest-posttest Control-Group Design
Difficulty Level: Medium
53. An experimental design that incorporates more than one independent variable is called a(n)_________ design.
a. Complex
b. Interaction
c. Simple randomized
d. Factorial
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Medium
54. An experiment was conducted to determine whether gender of the teacher and the amount of eye contact by the teacher influenced students’ liking of the teacher. Students were randomly assigned to groups that had either a male or female teacher who made little, moderate, or sustained eye contact while giving students a lecture on career choices. At the end of the lecture, the students were asked to rate their liking of the teacher. This is a design with _________ cells.
a. 3
b. 6
c. 9
d. 10
Learning Objective: 6
Cognitive Domain: Analysis
Answer Location: Factorial Designs
Difficulty Level: Hard
55. An experiment was conducted to determine if gender of the teacher and the amount of eye contact by the teacher influenced students’ liking of the teacher. Students were randomly assigned to groups that had either a male or female teacher who made little, moderate, or sustained eye contact while giving students a lecture on career choices. At the end of the lecture the students were asked to rate their liking of the teacher. This is a design potentially with _________ main effects.
a. 1
b. 2
c. 3
d. 4
Learning Objective: 6
Cognitive Domain: Analysis
Answer Location: Factorial Designs
Difficulty Level: Hard
56. An experiment was conducted to determine if gender of the teacher and the amount of eye contact by the teacher influenced students’ liking of the teacher. Students were randomly assigned to groups that had either a male or female teacher who made little, moderate, or sustained eye contact while giving students a lecture on career choices. At the end of the lecture the students were asked to rate their liking of the teacher. In this design, which of the following outcomes would indicate an interaction effect?
a. Male and female teachers are liked more with longer eye contact.
b. Male and female teachers are liked less with longer eye contact
c. Male teachers are liked more with longer eye contact but duration of eye contact has no effect on the liking of female teachers
d. All of the above are interaction effects
Learning Objective: 7
Cognitive Domain: Analysis
Answer Location: Factorial Designs
Difficulty Level: Hard
57. Rhonda designs an experiment in which half of her students are randomly assigned to view a sad movie and half to view a comedy. All of the students then rate their liking for the school at one, two, and three weeks after viewing the movie. This design is:
a. An interaction design
b. A nonequivalent posttest-only design
c. A within-participants design
d. A factorial design based on a mixed model
Learning Objective: 6
Cognitive Domain: Analysis
Answer Location: Factorial Designs
Difficulty Level: Medium
58. Suppose that you are conducting a factorial study with variables A and B. Your results reveal an interaction effect. This means that:
a. Variable A is effective in changing performance only if variable B is also effective
b. The way participants’ responses to independent variable A depend on what level of independent variable B they experience
c. One of the variables, A or B, can have an effect on performance only if the other does not
d. The effects of variable A and of variable B cancel each other out
Learning Objective: 7
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Medium
59. One of the big advantages of a repeated-measures design is that:
a. The data are easier to interpret than are data from a design in which participants are randomly assigned to groups
b. It does not carry the risk of carryover or order effects
c. The experimenter does not have to worry about whether the groups of participants are equivalent to each other
d. It is not subject to the influence of expectancy effects
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Repeated-measures Designs
Difficulty Level: Medium
60. A field experiment is an experiment that is conducted:
a. Outside in an open space
b. In a real-life setting such as a teachers’ lounge
c. With the use of noncollege research participants
d. In a field setting that permits maximum control of extraneous variables
Learning Objective: 1
Cognitive Domain: Comprehension
Answer Location: Experimental Research Settings
Difficulty Level: Easy
61. If a study has been conducted in a controlled setting where all or nearly all extraneous variables are controlled, we have conducted a(n) __________ experiment.
a. Field
b. Laboratory
c. Internet
d. Web-based
Learning Objective: 1
Cognitive Domain: Comprehension
Answer Location: Experimental Research Settings
Difficulty Level: Easy
62. Which of the following is not one of the advantages of an Internet experiment?
a. Easy access to a diverse population of individuals
b. High statistical power
c. Cost savings
d. Self-selection into the study
Learning Objective: 1
Cognitive Domain: Comprehension
Answer Location: Experimental Research Settings
Difficulty Level: Easy
63. A design that combines a within-subjects independent variable and a between-subjects independent variable is called a:
a. Between-subjects factorial design
b. Factorial design based on a mixed model
c. Mixed posttest-only control-group design
d. Posttest-only design with mixed groups
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Medium
64. Which of the following is not a characteristic of an experiment?
a. Researcher attempts to objectively observe what happens
b. At least one independent variable is manipulated in a highly controlled environment
c. There is always a control group
d. One or more factors are varied and the others are kept constant
Learning Objective: 1
Cognitive Domain: Comprehension
Answer Location: The Experiment
Difficulty Level: Medium
65. When neither the experimenter nor the participants know if the participant is in the experimental or control group is a characteristic of:
a. One-group posttest-only design
b. Posttest-only design with nonequivalent groups
c. Single-blind procedure
d. Double-blind procedure
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Medium
66. Weak experimental research designs:
a. Should be used in educational settings
b. Control confounding extraneous variables
c. Always have a control group
d. Do not control for confounding extraneous variables
Learning Objective: 5
Cognitive Domain: Analysis
Answer Location: Weak Experimental Research Designs
Difficulty Level: Medium
67. The variable that is influenced by a treatment is known as the:
a. Independent variable
b. Dependent variable
c. Experimenter variable
Learning Objective: 1
Cognitive Domain: Application
Answer Location: Independent Variable Manipulation
Difficulty Level: Medium
68. Single-blind refers to:
a. The experimenter not knowing which group is the experimental group and which is the control group
b. The participants not knowing if they are in the experimental group or the control group
c. A procedure that should be implemented in education when possible
d. A way to control for sequencing effects
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Strong Experimental Research Designs
Difficulty Level: Medium
69. The experimental design which includes random assignment to experimental and control groups and the use of double-blind procedures is:
a. Posttest only
b. Randomized controlled trial
c. Repeated measures
d. Posttest only with nonequivalent groups
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Strong Experimental Research Designs
Difficulty Level: Medium
70. Equating the groups refers to groups that are similar:
a. In terms of the number of participants
b. On the posttest scores
c. On all extraneous variables
d. To other groups in previous studies
Learning Objective: 3, 4
Cognitive Domain: Comprehension
Answer Location: Control of Confounding Variables
Difficulty Level: Medium
71. The best way to equate groups in experimental research is through:
a. Matching
b. Holding extraneous variables constant
c. Using an analysis of covariance
d. Random assignment
Learning Objective: 4
Cognitive Domain: Comprehension
Difficulty Level: Medium
72. Dr. Smart has conducted a research study on a new reading strategy in two classrooms. She tested all students’ reading abilities, used the new reading strategy with the one of the classrooms for a quarter, and then tested the reading abilities of the students in both classrooms at the end of the quarter. She adjusted her posttest scores because the students in the control classroom (who were not taught with the new reading strategy) scored higher on their pretests. This is an example of:
a. A double-blind procedure
b. Analysis of covariance
c. Holding an extraneous variable constant
d. Counterbalancing
Learning Objective: 4
Cognitive Domain: Application
Answer Location: Analysis of Covariance
Difficulty Level: Hard
73. At Main Street Elementary School, the third grade teachers wanted to compare four different ways of teaching spelling. Each quarter all of the teachers used the same instructional strategy for teaching spelling and they used a different strategy each quarter. They recorded students’ grades in spelling each quarter. This is an example of a:
a. Repeated measures design
b. Posttest only design
c. Randomized controlled trial design
d. Posttest only control group design
Learning Objective: 6
Cognitive Domain: Application
Answer Location: Repeated-Measures Designs
Difficulty Level: Medium
74. The repeated measures variable is also known as:
a. Between-subjects variable
b. Within-subjects variable
c. Across-subjects variable
d. Matching subjects’ variable
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Repeated-Measures Designs
Difficulty Level: Medium
True-False
Use the following to answer questions 1-3:
The following table presents a set of cell means from a study that looks at the use of cooperative learning versus lecture in teaching science. The researcher believes that gender and type of teaching approach will interact. Below are the set of means from the study. The scores are from a mathematics test with a possible range from 0 to 100.
Cooperative learning | Lecture | Overall | |
Male | 80 | 100 | 90 |
Female | 50 | 70 | 60 |
Overall | 65 | 85 |
1. There is a main effect of Gender in this study.
a. True
b. False
Learning Objective: 6
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Hard
2. There is a main effect of Instructional Type.
a. True
b. False
Learning Objective: 6
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Hard
3. There is a disordinal interaction effect in this study. (You might want to plot the cell means to make this determination.)
a. True
Learning Objective: 6,7
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Hard
Use the following to answer questions 4-6:
A researcher is looking at the effects of competition versus cooperation on learning a foreign language. She theorizes that Ability level will interact with type of instruction to influence foreign language learning. The dependent variable is the number of points on a 100-point Spanish test. The means for the results are in the table below.
Competition | Cooperation | Overall | |
High ability | 50 | 80 | 65 |
Low ability | 80 | 50 | 65 |
Overall | 65 | 65 |
4. There is a main effect of Instruction.
a. True
b. False
Learning Objective: 6
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Hard
5. There is a main effect of Ability level.
a. True
b. False
Learning Objective: 6
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Hard
6. Ability level interacts with instruction type.
a. True
b. False
Learning Objective: : 6, 7
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Hard
7. When discussing a main effect in a factorial design, a researcher is discussing the effect of a single-independent variable.
a. True
b. False
Learning Objective: : 6
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Hard
8. When trying to determine the effect of a treatment, the control group provides the researcher with an estimate of how the treatment group participants would have performed if they had not received the treatment.
a. True
b. False
Learning Objective: 1,3
Cognitive Domain: Comprehension
Answer Location: Strong Experimental Research Designs
Difficulty Level: Easy
9. Ordinal interaction effects are indicated when graphs of the group means intersect each other.
a. True
b. False
Learning Objective: 7
Cognitive Domain: Application
Answer Location: Factorial Designs
Difficulty Level: Hard
10. An experimental research study that has random assignment to a control group and an experimental group is considered to be a “strong design.”
a. True
b. False
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Strong Experimental Research Designs
Difficulty Level: Medium
11. In Randomized Controlled Trials, there is random assignment and participants do not know if they are in the experimental or control group.
a. True
b. False
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Strong Experimental Research Designs
Difficulty Level: Easy
12. An interaction effect is present when the levels of one independent variable do not impact the other independent variables impact on the dependent variable.
a. True
b. False
Learning Objective: 7
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Hard
13. At least one of the “weak experimental designs” has random assignment to the groups.
a. True
b. False
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Weak Experimental Research Designs
Difficulty Level: Medium
14. The pretest-posttest control-group design, the posttest-only control-group design, and the posttest-only design with nonequivalent groups all have random assignment.
a. True
b. False
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Weak Experimental Research Designs
Difficulty Level: Medium
15. Matching is a way of controlling for order effects in repeated-measures designs.
a. True
b. False
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Matching, Counterbalancing
Difficulty Level: Medium
16. John’s performance on the second day of an experiment was influenced by his performance on the task the previous day. This is an example of a carryover effect.
a. True
b. False
Learning Objective: 4
Cognitive Domain: Application
Answer Location: Counterbalancing
Difficulty Level: Medium
17. Order effects result from the previous treatment influencing subsequent treatments.
a. True
b. False
Learning Objective: 4
Cognitive Domain: Application
Answer Location: Counterbalancing
Difficulty Level: Medium
18. A serious problem with the posttest-only design with nonequivalent groups design is differential selection.
a. True
b. False
Learning Objective: 5
Cognitive Domain: Comprehension
Answer Location: Posttest-only Design with Nonequivalent Groups
Difficulty Level: Medium
19. Random selection and random assignment are synonymous.
a. True
b. False
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Random Assignment
Difficulty Level: Easy
20. Counterbalancing is only used with repeated measures designs.
a. True
b. False
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Counterbalancing
Difficulty Level: Easy
21.Bill thought that height might be an extraneous variable in his study of the mechanics of making a basket in basketball, so he added the variable to his study. This is an example of an acceptable way to control for an extraneous variable.
a. True
b. False
Learning Objective: 4
Cognitive Domain: Analysis
Answer Location: Building the Extraneous Variable into the Research Design
Difficulty Level: Hard
22. In a factorial design, the mean scores in a row or column are called marginal means.
a. True
b. False
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Easy
23. Factorial designs involve the manipulation of at least three independent variables.
a. True
b. False
Learning Objective: 6
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Medium
24. Matching involves ensuring that groups are similar on variables correlated with the dependent variable.
a. True
b. False
Learning Objective: 4
Cognitive Domain: Comprehension
Answer Location: Matching
Difficulty Level: Easy
25. Giving groups different treatment conditions to the different comparison groups is using the type technique to manipulation the independent variables.
a. True
b. False
Learning Objective: 2
Cognitive Domain: Comprehension
Answer Location: Ways to Manipulate an Independent Variable
Difficulty Level: Easy
26. Experiments provide evidence of causality by controlling extraneous and confounding variables, varying other variables, and observing the impact on the dependent variable.
a. True
b. False
Learning Objective: 1
Cognitive Domain: Application
Answer Location: The Experiment
Difficulty Level: Medium
Essay Questions
1. Describe how experiments provide evidence of causality.
Learning Objective: 1
Cognitive Domain: Comprehension
Answer Location: The Experiment
Difficulty Level: Easy
2. Describe the three ways that researchers can manipulate an independent variable and give an example of each one.
Learning Objective: 2
Cognitive Domain: Application
Answer Location: Ways to Manipulate an Independent Variable
Difficulty Level: Medium
3. Explain the importance of control in experimental research.
Learning Objective: 3
Cognitive Domain: Comprehension
Answer Location: Control of Confounding Variables.
Difficulty Level: Medium
4. Compare and contrast weak and strong experimental designs.
Learning Objective: 5
Cognitive Domain: Analysis
Answer Location: Weak Experimental Research Designs, Strong Experimental Research Designs
Difficulty Level: Medium
5. What is an interaction effect?
Learning Objective: 7
Cognitive Domain: Comprehension
Answer Location: Factorial Designs
Difficulty Level: Hard
Document Information
Connected Book
Educational Research 6e Answer Key + Test Bank
By Robert Burke Johnson
Explore recommendations drawn directly from what you're reading
Chapter 10 Sampling in Quantitative, Qualitative, and Mixed Research
DOCX Ch. 10
Chapter 11 Research Validity – All Methods
DOCX Ch. 11
Chapter 12 Experimental Research Weak and Strong Designs
DOCX Ch. 12 Current
Chapter 13 Experimental Research Quasi and Single-Case Designs
DOCX Ch. 13
Chapter 14 Nonexperimental Quantitative Research
DOCX Ch. 14