Perrin Complete Test Bank Ch.5 Reliability And Validity

Chapter 5 Reliability and Validity

True or False

T/F In research, it is more important to be reliable than valid. (pg 67)

T/F From the standpoint of the researcher, unreliable tests lead to inaccurate conclusions. (pg 68)

T/F It is not possible for researchers to calculate reliability, they are only able to estimate it. (pg 68)

T/F It is possible for a scale to be valid and unreliable. (pg 69)

T/F Subject attrition refers to new individuals gained during a study. (pg 73)

T/F The best way to access generalizability in research is to repeat research in different populations. (pg 73)

T/F Threats to internal validity are more critical than threats to external validity. (pg 72)

T/F Systematic Errors occur by chance and are inconsistent across respondents. (pg 75)

T/F Systematic Errors can cause bias in data. (pg 76)

T/F Following the pilot testing and modification phase, researchers move forward with conducting the actual research. (pg 78)

Fill in the Blank

_________ is defined as the extent to which a test measures what it purports to measure. (pg 67)

Internal consistency is also called __________. (pg 68)

In Cronbach’s Alpha, values closer to _______ indicate higher levels of internal consistency, than values closer to ________. (pg 68)

When respondents perform well on pre-tests and poorly on post-tests or vice versa merely by chance, cancelling each other out when scores are averaged is called. (pg 72)

__________ effects occurs when individuals perform extremely well on both pre and post-tests, and _________ effects occurs when individuals performance starts out low and remains low. (pg 72)

___________ variables are fixed and not manipulated, whereas ___________ variables are those that researchers manipulate and control. (pg 73)

As research study inclusion becomes more ____________, the results become less ______________. (pg 74)

When a sample size is too ____________ significant differences among groups are statistically harder to determine. (pg 77)

An important strategy that can be used to reduce measurement errors is __________ testing. (pg 77)

Multiple Choice

If the results of a test are the same each time it is on the same individual over a period of time, the test is considered to be: (pg 3)

1. Valid
2. True
3. Reliable
4. Stable

When you give an individual a test multiple times over a certain period of time in order to test stability, this technique is called: (pg 68)

1. Test-retest
2. Standardization
3. Validating
4. Consistency

The extent to which each question on survey is related to the same topic is termed: (pg 68)

1. External Consistency
2. Internal Consistency
3. Stability
4. Qualitative research

A measurement of internal consistency that allows researchers to determine how well different items measure different aspects of the same topic is: (pg 68)

1. Observational reliability
2. Test-retest method
3. Cronbach’s Alpha
4. Checklists

When scoring of a test no matter who is doing it, it is termed: (pg 69)

1. Internal validity
2. Scoring consistency
3. Observational Data
4. Inter-observational reliability

Which of the following formulas do researchers use to calculate inter rater reliability? (pg 69)

1. Number of occurrences/number of opportunities for occurrence x 100
2. Number of opportunities for occurrence / number of occurrences x 100
3. Number of occurrences x number of opportunities for occurrences / 100
4. Number of occurrences / 100 x number of opportunities for occurrence

Those things that confuse test and survey results and research findings serve as a: (pg 72)

1. Threat to external validity
2. Threat to internal validity
3. Threat to external reliability
4. Threat to internal reliability

The threat to internal validity that is defined as the natural changes that occur over time with individuals is called: (pg 72)

1. Testing
2. History
3. Maturation
4. Instrumentation

Which threat to internal validity measures changes in respondent performance, such as fatique, which cannot be credited to the treatment or intervention? (pg 72)

1. Instrumentation
2. Regression
3. Testing
4. Maturation

The threat to internal validity that occurs when participating individuals have improved performance due to the knowledge that they are being watched is called: (pg 73)

1. Maturation
2. History
3. Regression
4. Hawthorne Effect

One strategy that can be used to decrease the likelihood of random errors is to: (pg 75)

1. Collect data from a similar set of individuals
2. Collect data from a smaller sample size
3. Collect data from a larger sample size
4. It’s impossible to reduce the chance of random error.

The gold standard of research designs are: (pg 77)

1. Adequate sample sizes
2. Randomized controlled trials
3. Free of known bias
4. Adequate pilot testing

Matching

Match the following types of validity with their corresponding definition: (pg 70-72)

Face Validity Measures the appearance of the test, does the test look reasonable and does the survey make logical sense?

Criterion-related Validity Measures one topic in two different ways.

Construct Validity Measures a concept that is not actually observable, established by exploring relationships with similar measures, and comparing scores among defined groups.

Content Validity How well the test measures the specific items that it is intended to measure.