Confidence & Effect Size Exam Prep Chapter 12

Chapter 12

Test Bank

Type: true-false

Title: Chapter 12 Question 01

1. True or False: A single number that is used to predict another value is a point estimate.

Feedback: Page reference: p4

a) True

b) False

Type: true-false

Title: Chapter 12 Question 02

2. True or False: Confidence intervals that have higher % confidence are likely to encompass a wider range than one that has a lower % confidence.

Feedback: Page reference: p9, 10

a) True

b) False

Type: true-false

Title: Chapter 12 Question 03

3. True or False: Confidence Intervals are created for the sole purpose of estimating the true population mean.

Feedback: Page reference: p9, 10

a) True

b) False

Type: true-false

Title: Chapter 12 Question 04

4. True or False: Precision is best described as when the interval estimate captures the true estimated value.

Feedback: Page reference: p4

a) True

b) False

Type: true-false

Title: Chapter 12 Question 05

5. True or False: The null and alternate hypotheses generally are about different distributions.

Feedback: Page reference: p6, 7

a) True

b) False

Type: true-false

Title: Chapter 12 Question 06

6. True or false: If an IV has a significant effect on a DV, then the effect size must be large

Feedback: Page reference: p18, 19

a) True

b) False

Type: true-false

Title: Chapter 12 Question 07

7. True or false: Cohen’s d is an estimate of the true population mean.

Feedback: Page reference: p19

a) True

b) False

Type: true-false

Title: Chapter 12 Question 08

8. True or False: Cohen’s d can be used to estimate the size of a mean difference between two groups

Feedback: Page reference: p19

a) True

b) False

Type: true-false

Title: Chapter 12 Question 09

9. True or false: when using a two-way ANOVA, there are exactly 3 measurable partial –eta-squared.

Feedback: Page reference: p22, 23

a) True

b) False

Type: true-false

Title: Chapter 12 Question 10

10. True or False: With respect to the value of Cohen’s d, effects that are small are near 0, and effects that are considered large must be greater than 1.

Feedback: Page reference: p21

a) True

b) False

Type: true-false

Title: Chapter 12 Question 11

11. True or false: A t-test found a significant effect in which one condition had a detrimental effect on the outcome, making it significantly worse. In this case, one would expect that Cohen’s d would be negative.

Feedback: Page reference: p21

a) True

b) False

Type: true-false

Title: Chapter 12 Question 12

12. True or False: Eta-squared cannot be greater than 1.00.

Feedback: Page reference: p22, 23

a) True

b) False

Type: true-false

Title: Chapter 12 Question 13

13. True or False: eta-squared cannot be less than 0

Feedback: Page reference: p22, 23

a) True

b) False

Type: true-false

Title: Chapter 12 Question 14

14. True or False: Partial eta-squared are only used for factorial ANOVAs, and not one-way ANOVAs.

Feedback: Page reference: p23, 24

a) True

b) False

Type: true-false

Title: Chapter 12 Question 15

15. True or False: Like an inferential test, confidence intervals can be calculated on mean differences to test for statistical significance..

Feedback: Page reference: p24, 25

a) True

b) False

Type: true-false

Title: Chapter 12 Question 16

16. True or False: When the 95% confidence interval of the mean of one group does not include 0, it means that the difference between two groups is statistically significant at the .05 level

Feedback: Page reference: p24, 25

a) True

b) False

Type: true-false

Title: Chapter 12 Question 17

17. True or False: Effect sizes and confidence intervals becoming less and less frequently used in published research. They are more common for oral presentations.

Feedback: Page reference: p25

a) True

b) False

Type: true-false

Title: Chapter 12 Question 18

18. True or false: One reason why effect sizes are generally omitted is because it makes the statistics harder to understand and does not provide any additional information that significance testing doesn’t already tell us.

Feedback: Page reference: p25

a) True

b) False

Type: true-false

Title: Chapter 12 Question 19

19. True or False: The 99% confidence interval of a mean difference is from .04 to 1.49. This suggests that the mean difference is significant at the alpha = .05 level.

Feedback: Page reference: p15, 16

a) True

b) False

Type: true-false

Title: Chapter 12 Question 20

20. True or False: As confidence increases, precision generally decreases

Feedback: Page reference: p4, 5

a) True

b) False

Type: multiple choice question

Title: Chapter 12 Question 01

1. When one is certain that an interval is a good one, one likely has high ______________.

Feedback: Page reference: p4

a. confidence

b. validity

c. point estimate

d. none of the above

Type: multiple choice question

Title: Chapter 12 Question 02

2. How do point estimates compare to confidence intervals?

Feedback: Page reference: p4

a. Correct point estimates would signal high precision, but point estimates tend to have lower confidence levels than do confidence intervals

b. Point estimates are more accurate than confidence intervals.

c. Point estimates are better for interval and ratio scales, where as confidence intervals are only useful for interval scales.

d. All of the above are correct ways to compare the two.

Type: multiple choice question

Title: Chapter 12 Question 03

3. When calculating a confidence interval for a independent samples t-test instead of a one-sample t-test, which of the following best describes the difference in their calculations?

Feedback: Page reference: p11, 12

a. Instead of the population standard deviation, you use the sample standard deviation.

b. Instead of the population mean, you use the sample mean.

c. You use difference scores instead of the sample mean.

d. The critical values are different

Type: multiple choice question

Title: Chapter 12 Question 04

4. In the context of ANOVA, an eta-squared is used to portray which of the following?

Feedback: Page reference: p22

a. The degree of statistical significance of mean differences

b. The necessary sample size to obtain a statistically significant result

c. The proportion of error variability in the population the study failed to account for.

d. The proportion of variability explained by one variable on another variable.

Type: multiple choice question

Title: Chapter 12 Question 05

5. Use the data below for the following problem.

What is the eta-squared?

Feedback: Page reference: p22, 23

a. .16

b. .15

c. .17

d. .09

Type: multiple choice question

Title: Chapter 12 Question 05

5. A doctor is examining differences between two treatments. He calculated a 95% confidence interval on the mean difference between the two groups. The interval ranged from -1.2 to 3.48. What does this suggest?

Feedback: Page reference: p9, 10

a. The mean difference is not significant at the .05 level

b. The mean difference has a small effect size

c. The mean difference is significant at the .05 level, but not at the .01 level.

d. The mean difference is not significant at the .05 level, but could still be significant at the .01 level.

Type: multiple choice question

Title: Chapter 12 Question 06

6. In general, when you calculate a 95% confidence interval instead of a 90% confidence interval, which of the following changes?

Feedback: Page reference: p6-10

a. The width of the interval expands

b. The interval is more precise

c. The interval is more likely to capture the true value.

d. All of the above

Type: multiple choice question

Title: Chapter 12 Question 07

7. When calculating a Cohen’s d in a dependent samples t-test what does it tell us?

Feedback: Page reference: p19

a. The extent the two groups are correlated

b. The size of the difference in standard deviation units

c. The level of statistical significance

d. The probability the independent variable had a true effect on the dependent variable.

Type: multiple choice question

Title: Chapter 12 Question 08

8. What is the relationship between effect size and statistical significance?

Feedback: Page reference: p22, 23

a. Significant results have meaningful effect sizes. Effect sizes are meaningless without statistical significance.

b. Significance at alpha = .05 is always a smaller effect than significance at alpha = .01

c. There is no relationship between statistical significance and effect size whatsoever.

d. All else equal, larger effects are more likely to be significant.

Type: multiple choice question

Title: Chapter 12 Question 09

9. Point estimates can be used to estimate which of the following values?

Feedback: Page reference: p4

a. Population standard deviation

b. Population mean

c. The true effect size of a mean difference

d. All of the above

Type: multiple choice question

Title: Chapter 12 Question 10

10. Which of the following constitutes a medium effect for a Cohen’s d?

Feedback: Page reference: p21

a. .3

b. .1

c. .9

d. .5

Type: multiple choice question

Title: Chapter 12 Question 11

11. Which of the following most accurately describes A 95% confidence interval of a mean?

Feedback: Page reference: p25

a. the sample has a 95% probability of capturing the true mean.

b. 95% of all samples will capture the true mean

c. 95% of the time, the true mean will be in the sample statistic

d. 95% of the sample means will be statistically significant.

Type: multiple choice question

Title: Chapter 12 Question 12

12. A researcher is interested whether an intervention successfully decreases prejudice in majority populations. When conducting an independent samples t-test, a researcher calculates the t-statistic with an alpha level of .05, and a 95% confidence interval of the mean difference. Which of the following is most likely true?

Feedback: Page reference: p14, 15

a. both procedures will lead to the same conclusion regarding statistical significance

b. both procedures will lead to a point estimate

c. both procedures may lead to difference results regarding whether the difference is statistically significant. This is because the traditional t-statistic is a point estimate and the confidence interval is an interval estimate.

d. The t-statistic and confidence interval will tell us fundamentally different information. The t-statistic compares mean differences, whereas the confidence interval will estimate the true effect size of the difference.

Type: multiple choice question

Title: Chapter 12 Question 13

13. In a 3 x 4 ANOVA, how many partial eta-squared could one calculate?

Feedback: Page reference: p22, 23

a. 4

b. 3

c. 12

d. 2

Type: multiple choice question

Title: Chapter 12 Question 14

14.

How is this ANOVA best characterized and how many partial eta-squared are there for this factorial ANOVA?

Feedback: Page reference: p22, 23, 24

a. 3 x 2 ANOVA with 3 partial eta-squared

b. 3 x 2 ANOVA with 2 partial eta-squared

c. 4 x 3 ANOVA with 3 partial eta-squared.

d. 2 x 2 ANOVA with 3 partial eta-squared

Type: multiple choice question

Title: Chapter 12 Question 15

15.

What is the partial eta-squared for factor 1?

Feedback: Page reference: p22, 23, 24

a. .58

b. .37

c. .38

d. .13

Type: multiple choice question

Title: Chapter 12 Question 16

16. A researcher collects a sample of individuals’ productivity by measuring the number of words they typed in an hour during a writing session with 20 individuals. The sample mean is 1738.2 words this week. The individuals from last week’s 20 individuals only had a mean of 1553.7 words. The pooled variance is 11545.9.

calculate the Cohen’s d for this mean difference.

Feedback: Page reference: p18, 19

a. .02

b. 1.7

c. insufficient information

d. -.02

Type: multiple choice question

Title: Chapter 12 Question 17

17. The researcher calculates a 95% confidence interval for the mean difference. 0 is not captured in the interval. What would this suggest?

Feedback: Page reference: p24, 25

a. The mean difference is not significant

b. The mean difference is significant

c. The mean difference has little to no effect

d. The data is skewed because there are no negative values in the confidence interval of the mean difference.

Type: multiple choice question

Title: Chapter 12 Question 18

18. If you construct a 95% confidence interval around a sample mean and the 95% CI does not include the population mean, what would this suggest?

Feedback: Page reference: p25

a. the observed mean is significant larger than the population mean

b. the observed mean is significantly smaller than the population mean

c. the observed mean is significantly different from the population mean

d. the observed mean is not significantly different from the population mean.

Type: multiple choice question

Title: Chapter 12 Question 19

19. Cohen’s d is the effect size often reported for an independent samples t-test. How does the calculation for Cohen’s d compare to the calculation of a t-statistic?

Feedback: Page reference: p19, 20

a. Cohen’s d uses pooled standard error and the t-statistic does not

b. Cohen’s d is not directly influenced by the size of the sample, but the t-statistic is.

c. Cohen’s d uses the pooled standard deviation whereas the t-statistic does not require a measure of variability.

d. Cohen’s d is a measure of how likely the mean is to differ from a null population, whereas the t-statistic is a measure of how big the mean difference is in units of variability.

Type: multiple choice question

Title: Chapter 12 Question 20

20. Suppose that the population mean for IQ is 100 with a standard deviation of 15. A researcher is testing a group 25 of talented youth. His sample has a mean of 112 with a standard deviation of 14.

What is the 95% confidence interval of the mean?

Feedback: Page reference: p8, 9

a. 106.2 – 117.8

b. 82.6 – 141.4

c. 84.56 – 139.44

d. 104.7 – 119.3

Type: multiple choice question

Title: Chapter 12 Question 21

21. Suppose that the population mean for IQ is 100 with a standard deviation of 15. A researcher is testing a group 25 of talented youth. His sample has a mean of 112 with a standard deviation of 14.

What does the CI tell us about the sample of young talented youth?

Feedback: Page reference: p24, 25

a. The youth have IQs comparable to that of the population

b. There is no evidence that the youth’s IQ are higher than that of the general population

c. There is insufficient information to make any claims about the sample based on a 95% confidence interval.

d. The youth are indeed talented as their average IQ is significantly higher than that of the population at the alpha = .05 level

Type: multiple choice question

Title: Chapter 12 Question 22

22. If a one-way ANOVA has an eta squared of .24 means that…

Feedback: Page reference: p22

a. the mean difference is .24 standard deviations units large.

b. the independent variable accounts for 24% of the variance in the dependent variable

c. there is a 24% chance that the independent variable caused the dependent variable

d. the independent variable and dependent variable have more than 24% overlap

Type: multiple choice question

Title: Chapter 12 Question 23

23. Which of the following reasons best explains the value of effect sizes?

Feedback: Page reference: p19, 24, 25

a. Significant effects always have large effects

b. Significant effects don’t always have large effects. In fact, they can have very small effects

c. Large effects tend to be significant

d. Effect sizes communicate something different than significance testing. They inform the researcher or scientist whether or not the findings can generalize to the population or not.

Type: multiple choice question

Title: Chapter 12 Question 24

24. Which of the following partial eta-squared is the closest to the cut off of a large effect?

Feedback: Page reference: p23

a. .28

b. .40

c. .80

d. .10

Type: multiple choice question

Title: Chapter 12 Question 25

25. A 99% confidence interval is ____________ than a 95% confidence interval

Feedback: Page reference: p3, 4, 5

a. less precise

b. wider

c. more likely to capture the truth

d. all of the above

Type: essay/short answer question

Title: Chapter 12 Question 01

1. Below are the data of an course that prepares students for standardized testing. The data below show pretest (test on day 1) and a post test (test after taking the course) scores of students who enrolled. Use this data to answer the following questions.

Calculate the 95% confidence interval for the mean difference

Type: essay/short answer question

Title: Chapter 12 Question 02

2. Below are the data of an course that prepares students for standardized testing. The data below show pretest (test on day 1) and a post test (test after taking the course) scores of students who enrolled. Use this data to answer the following questions.

Calculate cohen’s d

Type: essay/short answer question

Title: Chapter 12 Question 03

3. A research team collects data from two groups, in one group, they administered a learning task that provided feedback (i.e., telling the participant if they were right or wrong) and in the other, the participants were not provided with feedback. The research team is interested in the number of trials the participants spent learning as a function of their independent variable. Below are the number of trials each participant spent. Use it to answer the following questions.

Calculate the 95% confidence interval of the mean difference

Type: essay/short answer question

Title: Chapter 12 Question 04

4. A research team collects data from two groups, in one group, they administered a learning task that provided feedback (i.e., telling the participant if they were right or wrong) and in the other, the participants were not provided with feedback. The research team is interested in the number of trials the participants spent learning as a function of their independent variable. Below are the number of trials each participant spent. Use it to answer the following questions.

What is the Cohen’s d?

Type: essay/short answer question

Title: Chapter 12 Question 05

5. A researcher is examining three different types of treatment on individuals who suffer from major depression. Below are the data, use it to answer the following questions

calculate the eta-squared

Type: essay/short answer question

Title: Chapter 12 Question 06

6. A researcher is examining three different types of treatment on individuals who suffer from major depression. Below are the data, use it to answer the following questions

Characterize the size of this effect

Type: essay/short answer question

Title: Chapter 12 Question 07

7. Use the source table below to answer the following questions

How many total eta-squared are there for this factorial ANOVA?

Type: essay/short answer question

Title: Chapter 12 Question 08

8. Use the source table below to answer the following questions

Calculate each eta-squared

Type: essay/short answer question

Title: Chapter 12 Question 09

9. The population average for number of children per household is 2.4 in a particular country with a standard deviation of 1.1. A research is conducting research in a neighborhood that has relatively low socioeconomic status. Her sample of 40 families averages at 3.3 children.

construct a 95% confidence interval around the sample mean.

Type: essay/short answer question

Title: Chapter 12 Question 10

10. The population average for number of children per household is 2.4 in a particular country with a standard deviation of 1.1. A research is conducting research in a neighborhood that has relatively low socioeconomic status. Her sample of 40 families averages at 3.3 children.

what does the confidence interval tell you?