Chapter 11: Evaluation Research

Test Bank

Multiple Choice

1. Which of the following populations is considered to be the most vulnerable in evaluation research?

a. individuals administering the program

b. individuals conducting the evaluation

c. individuals responsible for the funding of the program

d. individuals receiving the benefits

2. The following are examples of stakeholders with the exception of ______.

a. evaluators

b. funders

c. program administrators

d. clients

3. Which of the following best illustrates the proper steps of evaluation research?

a. develop research question, design methodology, gather data/evidence, analyze data, identify findings and conclusions and justify recommendations, identify and engage stakeholders, communicate findings and recommendations, gather data/evidence, analyze data, identify findings and conclusions and justify recommendations, and communicate findings and recommendations

b. design methodology, develop research question, identify and engage stakeholders,

c. identify and engage stakeholders, develop research question, design methodology, gather data/evidence, analyze data, identify findings and conclusions and justify recommendations, and communicate findings and recommendations

d. develop research question, design methodology, identify and engage stakeholders, gather data/evidence, analyze data, identify findings and conclusions and justify recommendations, and communicate findings and recommendations

4. Principles, rules, and laws that guide a government, organization, or people are called ______.

a. interactions

b. politics

c. programs

d. policies

5. The following are policy cycle steps with the exception of ______.

a. agenda setting

b. policy formation

c. asking a research question

d. implementation

6. The design of multiple approaches, policies, or programs to address the problem of interest is referred to as ______.

a. agenda setting

b. policy implementation

c. policy formation

d. evaluation

7. Identifying the problem to be solved and then advocating for it to be considered by policymakers is referred to as ______.

a. policy formation

b. policy implementation

c. agenda setting

d. evaluation

8. Which of the following steps in the policy cycle leads to the legitimization of the policy?

a. implementation

b. adoption

c. evaluation

d. formation

9. Which of the following best illustrates the policy cycle?

a. agenda setting, policy formulation, policy adoption, policy implementation, policy evaluation

b. policy formulation, agenda setting, policy adoption, policy implementation, policy evaluation

c. policy adoption, policy formulation, policy implementation, agenda setting, policy evaluation

d. policy evaluation, policy implementation, policy adoption, policy formulation, agenda setting

10. Which of the following types of evaluation research is designed to offer insight about the implementation of a program?

a. needs assessment evaluation

b. summative evaluation

c. formative evaluation

d. process evaluation

11. Which of the following types of evaluation research is used to make a comprehensive assessment of a program after program implementation?

a. process evaluation

b. formative evaluation

c. summative evaluation

d. needs assessment evaluation

12. A ______ provides information about whether a program is reaching its objectives or not.

a. process evaluation

b. formative evaluation

c. summative evaluation

d. needs assessment evaluation

13. A ______ provides information about planning and improving the program.

a. process evaluation

b. formative evaluation

c. summative evaluation

d. needs assessment evaluation

14. Which of the following types of evaluation is used when the goal of the evaluation is to find out if there is a problem that could be served by a program, and how the target population might be best served?

a. needs assessment

b. formative evaluation

c. summative evaluation

d. process evaluation

15. When evaluators identify the size or extent of the problem needing attention, they are conducting a(n) ______.

a. blind review

b. analysis of quantitative information

c. analysis of qualitative information

d. gap analysis

16. A gap analysis is usually conducted as a part of a(n) ______ evaluation.

a. process

b. needs assessment

c. summative

d. outcome

17. Which of the following types of evaluation is used to understand if an existing program is changing over time?

a. process evaluation

b. needs assessment evaluation

c. summative evaluation

d. outcome evaluation

18. Which of the following types of evaluation is used to determine if a program should be continued or terminated?

a. process evaluation

b. needs assessment evaluation

c. summative evaluation

d. outcome evaluation

19. Which of the following types of evaluation measures the effectiveness of a program in regard to the target population?

a. process evaluation

b. needs assessment evaluation

c. outcome evaluation

d. impact evaluation

20. ______ evaluations assess whether a program is achieving its goals.

a. Outcome

b. Impact

c. Process

d. Summative

21. Graphic depictions that illustrate how a program will ideally be implemented and operate are called ______.

a. outputs

b. systematic information

c. logic models

d. inputs

22. Logic models play an important role in which of the following types of evaluation?

a. process evaluations

b. needs assessment evaluations

c. summative evaluations

d. formative evaluations

23. Logic models are used to ______.

a. engage stakeholders and help acquire funding

b. assess a program’s performance

c. demonstrate the research design of that particular evaluation

d. depict how the program is supposed to be implemented and operate

24. Training or education is part of which step of a logic model?

a. short-term outcomes

b. outputs

c. inputs

d. long-term outcomes

25. Changed attitudes or values is an example of which of the following logic model components?

a. short-term outcomes

b. outputs

c. inputs

d. long-term outcomes

26. Reduced recidivism is an example of which of the following logic model components?

a. inputs

b. outputs

c. long-term outcomes

d. short-term outcomes

27. Increased justice and safer communities are examples of which logic model components?

a. inputs

b. outputs

c. long-term outcomes

d. short-term outcomes

28. A(n) ______ is an accuracy standard highlighting the need for evaluation research to be judged on all accuracy standards as a way for stakeholders to examine its strengths and weaknesses.

a. metaevaluation

b. impact evaluation

c. summative evaluation

d. process evaluation

29. Which of the following feasibility standards for evaluators outlines the importance of securing the trust and maintaining the cooperation of stakeholders during all stages of the evaluation?

a. political viability

b. practical procedures

c. cost effectiveness

d. report clarity

30. The following are standards of an effective evaluation with the exception of ______.

a. utility

b. feasibility

c. propriety

d. ethics

31. Which standard of an effective evaluation includes the requirement to address significant research questions and provide clearly articulated findings and recommendations?

a. utility

b. feasibility

c. propriety

d. accuracy

32. Which of the following standards of an effective evaluation addresses the need that evaluation research be practical, reasonable, and affordable?

a. accuracy

b. utility

c. propriety

d. feasibility

33. Which of the following standards of an effective evaluation requires evaluations to be ethical and legal?

a. accuracy

b. utility

c. propriety

d. feasibility

34. Which of the following standards of an effective evaluation indicates the need that evaluations be free of biases and conducted using best research practices?

a. accuracy

b. utility

c. propriety

d. feasibility

35. Evaluator credibility is a criterion associated with which of the following standards of an effective evaluation?

a. feasibility

b. propriety

c. utility

d. accuracy

36. Report clarity is a criterion associated with which of the following standards of an effective evaluation?

a. utility

b. propriety

c. feasibility

d. accuracy

37. Evaluation impact is a criterion associated with which of the following standards of an effective evaluation?

a. accuracy

b. propriety

c. feasibility

d. utility

38. Political viability is a criterion associated with which of the following standards of an effective evaluation?

a. accuracy

b. propriety

c. feasibility

d. utility

39. Cost-effectiveness is a criterion associated with which of the following standards of an effective evaluation?

a. feasibility

b. utility

c. accuracy

d. propriety

40. ______ standards demonstrate that an evaluation was conducted ethically, legally and with regard for the welfare of those involved.

a. Feasibility

b. Utility

c. Accuracy

d. Propriety

41. The use of formal agreements is required by which of the following standards of an effective evaluation?

a. utility

b. propriety

c. feasibility

d. accuracy

42. Which of the following accuracy standards requires that care be taken to avoid distortion or bias in findings?

a. justified conclusions

b. impartial reporting

c. reliable information

d. valid information

43. Using funding in a justifiable, ethical, and prudent way is referred to as ______.

a. disclosure of findings

b. a conflict of interest

c. a complete and fair assessment

d. fiscal responsibility

44. Which of the following standards requires defensible information sources?

a. accuracy

b. propriety

c. feasibility

d. utility

45. Which of the following standards requires an analysis of quantitative information?

a. utility

b. feasibility

c. accuracy

d. propriety

1. Evaluation research is used to determine whether social programs are effective.

2. Knowledge from evaluation research can lead to the termination of programs that are not providing benefits as intended.

3. Although program evaluation is important, due to the cost of conducting an evaluation, few funded social programs have a required evaluation component.

4. Researchers should prepare for real world changes when conducting evaluation research.

5. Individuals or organizations with a direct interest in the program being evaluated are called stakeholders.

6. Research cannot be successful without the ongoing support of key stakeholders.

7. Evaluators are typically the individuals providing the research questions to stakeholders.

8. No universally agreed upon number of types of evaluation research exists, according to the principles presented in Chapter 11.

9. Process evaluations rely heavily on the gathering of quantitative methods.

10. Summative evaluations occur at the beginning of the policy process and are concerned with the output and impact of programs.

11. Logic models help the client or partner articulate their goals and focus on program expectations and how the program is expected to work.

12. The use of logic models makes evaluations research more lengthy and difficult.

13. Logic models are typically established at the end of an evaluation.

14. Cooperation among stakeholders can be assumed when conducting evaluation research.

15. As a researcher, establishing good rapport with stakeholders at the beginning of the evaluation process is crucial.

16. Reports written at the end of the evaluation process are written for the stakeholder audience.

17. Evaluation findings and recommendations should be submitted to stakeholders for consideration.

18. Evaluation reports should be written for outsider input.

19. Evaluation research is difficult to accomplish without stakeholder buy-in.

20. According to Melde, textbook evaluation designs typically work well outside the research environment.

21. Maintaining confidentiality in evaluation research is close to impossible.

22. Researchers should always provide fair and objective findings, including the strengths and weaknesses of the topic.

23. A possible consequence of disregarding evaluation research ethics is clients’ losing benefits provided by the program.

24. Individuals receiving benefits from research evaluation related programs are considered to be the most vulnerable population in evaluation research.

25. Summative evaluations can lead to the termination of a program.

1. Identify the five reasons to use evaluation research.

2. Define evaluation research.

3. Identify the five guiding principles of evaluation research.

4. Identify the steps of evaluation research.

5. Identify the two types of evaluation research.

6. Identify the steps that are taken when conducing a needs assessment evaluation.

7. Identify the components of a logic model, and discuss how they assist with process evaluation and assessing how a program is intended to work.

8. What is applied research?

9. Identify the four standards or characteristics of an effective evaluation.

10. What are the most common elements of ethics discussed in Chapter 11, and in the previous chapters, and why is heeding ethics integral to research?

1. What is evaluation research and why is it useful?

2. What are the benefits of using logic models evaluation research?

3. What is the difference between basic research and applied research?

4. Why are stakeholders so important to evaluation research?

5. What are the consequences that researchers can face when disregarding ethics in evaluation research?