Ch.7 – Validity Issues In Research The | Test Bank + Answers

CHAPTER 7: Validity Issues in Research: The Heart of It All

True/False Questions

1. In a research study, the degree to which inferences reflect how things actually are is referred to as validity of the research.

2. In statistical tests, an alternative hypothesis states that there is no relationship between the variables in the study.

3. Statistical power is 1 minus the Type II error rate.

4. Range restriction is one of the threats to statistical conclusion validity.

5. The threat of unreliable treatment implementation to statistical conclusion validity of a study is defined as the increase in error variance due to any aspect of the experimental setting that leads to variability in responding.

6. Instrumentation refers to changes in the measuring device or procedure over the course of a study.

7. In the context of threats to internal validity, differential regression is said to exist when more than one group is involved in a study and the attrition across the groups is not comparable.

8. In the context of threats to construct validity, mono-operation bias can be minimized by using a single exemplar or a single measure to assess a construct.

9. The threat of experimental expectations to the construct validity arises when experimenters consciously or unconsciously affect results through the way they communicate and interact with participants.

10. The threat of compensatory equalization of treatments to internal validity occurs when participants in a control group attempt to outperform participants in the treatment group.

Multiple Choice Questions

1. In a true experimental design:

1. every threat to the validity of the conclusions reached is eliminated.
2. treatments to different samples are implemented with significant variations.
3. the validity of a conclusion is confirmed if a threat is plausible.
4. an independent variable is manipulated by the researcher to assess the effect of the manipulation on a dependent variable.

2. Statistical conclusion validity refers to:

1. the degree of certainty with which one can make statements about the existence of a causal relationship between the variables in a study.
2. the degree to which the measured variables used in a study represent the hypothesized constructs.
3. the degree to which a researcher reaches the correct conclusion about the relationships among the variables in a research question.
4. the degree to which the causal relationship is generalizable across units, treatments, outcomes, and settings.

3. The construct validity of a study is concerned with:

1. how relevant the constructs of a study are to the general public.
2. the generalizability of the results of an experiment.
3. how well the variables chosen represent and capture the essence of a hypothetical construct.
4. the degree to which a researcher has come to the correct conclusion about the relationship between the variables.

4. Which of the following is an example of a threat to construct validity?

1. Regression
2. Resentful demoralization
3. Range restriction
4. Ambiguous temporal precedence

5. A Type II error is committed when:

1. results obtained with one set of measures do not generalize to outcomes that would be assessed by a different set of measures.
2. one incorrectly fails to reject the null hypothesis when in reality it should be rejected.
3. a researcher incorrectly concludes that a true relationship exists between the variables in a study.
4. a statistically significant result containing a sampling error is accepted.

6. The internal validity of a study refers to:

1. the confidence one can have in inferring a causal relationship among the variables.
2. the extent to which the variables represent what they were intended to measure.
3. the statistical accuracy of the constructs of the study.
4. the degree of meaning that can be placed upon a set of test results of the study.

7. In the context of threats to internal validity, history refers to:

1. the time between pretest and posttest results that may affect the results of a study.
2. an event that occurs during the administration of a treatment and that may affect a researcher’s observations.
3. the differences between groups that exist before the implementation of a treatment and that may indirectly affect the conclusion drawn by the researcher.
4. a developmental change in participants between the pretest and the posttest that might affect the results.

8. Regression toward the mean can occur when:

1. participants who score low on the pretest score higher on the posttest.
2. participants who score high on the pretest score higher on the posttest.
3. participants in the control group score higher than those in the treatment group.
4. participants in the treatment group score higher than those in the control group.

9. Identify a way to minimize the mono-method bias in a study.

1. By examining associations between the constructs and finding ways to neutralize them
2. By detecting the effects of novelty and disruptions on the constructs
3. By utilizing multiple exemplars to assess a construct
4. By using multiple ways to measure a construct

10. Construct underrepresentation occurs when:

1. test results show less correlation between variables than expected.
2. a construct plays less of a role in the correlation between variables than expected.
3. irrelevant aspects are included as part of a construct in designing a study.
4. all of the important aspects of a construct are not incorporated.