Chapter 19: Development and Application of Program Evaluation Research

Test Bank

Multiple Choice

1. One example of the relevance of accountability was passage of the Government Performance and Results Modernization Act of ______.

A. 2001

B. 2004

C. 2009

D. 2010

Cognitive Domain: Knowledge

Answer Location: Development and Application of Program Evaluation Research

Difficulty Level: Easy

2. The standards for utility, according to Stufflebeam and Shinkfield (2007), concern ______.

A. whether the evaluation is reasonable to conduct

B. the extent to which an evaluation and its results are legally and ethically conducted

C. whether the information gained addresses the needs of the identified audience

D. all of these are true

Cognitive Domain: Knowledge

Answer Location: Definitions of Program Evaluation Research

Difficulty Level: Easy

3. Feasibility standards address ______.

A. whether the evaluation is reasonable to conduct

B. the extent to which an evaluation and its results are legally and ethically conducted

C. whether the information gained addresses the needs of the identified audience

D. the extent to which the information and data collected accurately reflect the program being assessed or evaluated

Cognitive Domain: Knowledge

Answer Location: Definitions of Program Evaluation Research

Difficulty Level: Easy

4. The propriety standard concerns ______.

A. whether the evaluation is reasonable to conduct

B. the extent to which an evaluation and its results are legally and ethically conducted

C. whether the information gained addresses the needs of the identified audience

D. none of these are true

Cognitive Domain: Knowledge

Answer Location: Definitions of Program Evaluation Research

Difficulty Level: Easy

5. Accuracy is the standard that concerns ______.

A. whether the information gained addresses the needs of the identified audience

B. the extent to which an evaluation and its results are legally and ethically conducted

C. the extent to which the information and data collected accurately reflect the program being assessed or evaluated

D. the evaluation is reasonable to conduct

Cognitive Domain: Knowledge

Answer Location: Definitions of Program Evaluation Research

Difficulty Level: Easy

6. ______ concerns the use of appropriate evaluation methods and clear communication of the results to appropriate stakeholders.

A. Competence

B. Integrity/honesty

C. Systematic inquiry

D. Respect for people

Cognitive Domain: Knowledge

Answer Location: Professional Standards and Guidelines for Program Evaluation

Difficulty Level: Easy

7. ______ refers to ensuring the evaluation team has the appropriate credentials and skills to conduct the evaluation, and they have awareness of cultural issues that may impact an evaluation.

A. Competence

B. Integrity/honesty

C. Systematic inquiry

D. Respect for people

Cognitive Domain: Knowledge

Answer Location: Professional Standards and Guidelines for Program Evaluation

Difficulty Level: Easy

8. Implementation of ______ principle in evaluation involves clearly disclosing conflicting relationships in roles regarding the evaluation and clearly stating the procedures used in the evaluation.

A. competence

B. integrity/honesty

C. systematic inquiry

D. respect for people

Cognitive Domain: Knowledge

Answer Location: Professional Standards and Guidelines for Program Evaluation

Difficulty Level: Easy

9. ______ principle includes communicating the importance of program participants and stakeholders in the evaluation process.

A. Competence

B. Integrity/honesty

C. Systematic inquiry

D. Respect for people

Cognitive Domain: Knowledge

Answer Location: Professional Standards and Guidelines for Program Evaluation

Difficulty Level: Easy

10. ______ principle involves ensuring a balance between a quality evaluation, sharing results with program stakeholders, and communicating the results to the general public as is appropriate.

A. Competence

B. Integrity/honesty

C. Systematic inquiry

D. Responsibilities for general and public

Cognitive Domain: Knowledge

Answer Location: Professional Standards and Guidelines for Program Evaluation

Difficulty Level: Easy

11. Assessments designed to identify the discrepancy between actual conditions and what is sought or desired represent ______ type of evaluation.

A. formative

B. summative

C. need

D. outcome

Cognitive Domain: Knowledge

Answer Location: Types of Evaluation

Difficulty Level: Easy

12. ______ type of evaluation concerns whether a program is implemented as designed.

A. Formative

B. Summative

C. Need

D. Outcome

Cognitive Domain: Knowledge

Answer Location: Types of Evaluation

Difficulty Level: Easy

13. ______ results are typically provided to policy makers such as politicians.

A. Formative

B. Summative

C. Need

D. Outcome

Cognitive Domain: Knowledge

Answer Location: Types of Evaluation

Difficulty Level: Easy

14. The use of checklists in evaluating programs is a key component of ______ model.

A. case study model

B. consumer-oriented model

C. product evaluation model

D. process evaluation model

Cognitive Domain: Knowledge

Answer Location: Evaluation Models

Difficulty Level: Easy

15. The use of an evaluation team provides more ______.

A. varied perspectives

B. objectivity

C. share of the volume of work

D. all of these

Cognitive Domain: Knowledge

Answer Location: Steps in an Evaluation

Difficulty Level: Easy

True/False

1. Our society, including political and social institutions, has increasingly required more accountability in social service and educational programs.

Cognitive Domain: Knowledge

Answer Location: Development and Application of Program Evaluation Research

Difficulty Level: Easy

2. The standards from the Joint Committee on Standards for Educational Evaluation were first developed in the early 1950s.

Cognitive Domain: Knowledge

Answer Location: Definitions of Program Evaluation Research

Difficulty Level: Easy

3. Evaluation results are generally given to those who are implementing the program.

Cognitive Domain: Knowledge

Answer Location: Types of Evaluation

Difficulty Level: Easy

4. There are no systematic steps in conducting program evaluation as there are with scientific research.

Cognitive Domain: Steps in an Evaluation

Answer Location: Evaluating the Purpose Statement and Hypothesis

Difficulty Level: Easy

5. An insider, someone who works for the organization, may have a good understanding of the issues confronting an organization.

Cognitive Domain: Knowledge

Answer Location: Steps in an Evaluation

Difficulty Level: Easy

6. Stakeholders are all those who may potentially be affected by the results of an evaluation.

Cognitive Domain: Knowledge

Answer Location: Steps in an Evaluation

Difficulty Level: Easy

7. Stufflebeam’s (2005) decision-making model uses case studies and interviews.

Cognitive Domain: Knowledge

Answer Location: Steps in an Evaluation

Difficulty Level: Easy

8. It is not unusual for evaluators to develop an instrument that is specific to the program being evaluated--reliability and validity may therefore be compromised to some degree.

Cognitive Domain: Knowledge

Answer Location: Steps in an Evaluation

Difficulty Level: Easy

9. For qualitative methods of evaluation, the researcher may also use methods of analysis similar to research approaches, such as using computer programs to analyze and search for common themes in interview transcripts.

Cognitive Domain: Knowledge

Answer Location: Steps in an Evaluation

Difficulty Level: Easy

10. An evaluation report will usually look similar to a journal article.

Cognitive Domain: Knowledge

Answer Location: Steps in an Evaluations

Difficulty Level: Easy

Short Answer

1. Define program evaluation.

Cognitive Domain: Comprehension

Answer Location: Development and Application of Program Evaluation Research

Difficulty Level: Easy

2. List the four general categories that the 30 standards of the Joint Committee on Standards for Educational Evaluation fall into.

Cognitive Domain: Comprehension

Answer Location: Professional Standards and Guidelines for Program Evaluation

Difficulty Level: Easy

3. List the five basic principles of The Guiding Principles of Evaluators.

Cognitive Domain: Comprehension

Answer Location: Professional Standards and Guidelines for Program Evaluation

Difficulty Level: Easy

4. List the three major types of evaluation.

Cognitive Domain: Comprehension

Answer Location: Types of Evaluation

Difficulty Level: Easy

5. Give an example of a needs assessment.

Cognitive Domain: Application

Answer Location: Types of Evaluation

Difficulty Level: Medium

6. List the steps in conducting a program evaluation.

Cognitive Domain: Comprehension

Answer Location: Steps in an Evaluation

Difficulty Level: Easy

7. Provide an example of a stakeholder.

Cognitive Domain: Application

Answer Location: Steps in an Evaluation

Difficulty Level: Medium

8. List two of the models of evaluation.

Cognitive Domain: Comprehension

Answer Location: Steps in an Evaluation

Difficulty Level: Medium

9. What are a few methods to reduce problems with reliability and validity when developing an instrument for program evaluation?

Cognitive Domain: Comprehension

Answer Location: Steps in an Evaluation

Difficulty Level: Easy

10. Briefly describe the CIPP evaluation model.

Cognitive Domain: Comprehension

Answer Location: Evaluation Models

Difficulty Level: Medium

Essay

1. Discuss the similarities and differences between research and program evaluation put forth by Gall et al. (2006).

Cognitive Domain: Analysis

Answer Location: Steps in an Evaluation

Difficulty Level: Hard

2. Compare and contrast the standards for utility, feasibility, propriety, and accuracy.

Cognitive Domain: Analysis

Answer Location: Professional Standards and Guidelines for Program Evaluation

Difficulty Level: Medium

3. Discuss the case study model of evaluation. Provide an example of when you would use this type of evaluation.

Cognitive Domain: Analysis

Answer Location: Evaluation Models

Difficulty Level: Hard

4. Discuss the consumer-oriented approach to evaluation. Provide an example of when you would use this type of evaluation.

Cognitive Domain: Application

Answer Location: Evaluation Models

Difficulty Level: Hard

5. What is typically included in an evaluation report?

Cognitive Domain: Application

Answer Location: Steps in an Evaluation

Difficulty Level: Hard