Guiding Principles for Evaluators

Whichever approach fits a particular program, designing and implementing a high-quality evaluation is critically important to trusting the findings and making appropriate decisions. In 2004 the American Evaluation Association (AEA), the premier international organization of professional evaluators, developed a set of five guiding principles to promote ethical practice in the evaluation of programs, products, personnel, materials, and policies. As described in Table 13.1, these principles, with their corresponding standards, serve as a checklist for ensuring high-quality evaluation research.

As is evident from these principles, evaluators must embody a great number of technical skills, dispositions, and ethical values to work collaboratively with their clients to design and execute an evaluation that is valid, just, and useful.

Table 13.1 Guiding Principles for Evaluators

Principle Standards
Source: Adapted from AEA, 2004.
Systematic inquiry:
  Evaluators conduct systematic, data-based inquiries.
Ensure that clients adhere to the highest technical standards appropriate to the methods they use.
Explore with clients the shortcomings and strengths of evaluation questions and approaches.
Communicate the approaches, methods, and limitations of the evaluation accurately and in sufficient detail to allow others to understand, interpret, and critique their work.
Competence:
  Evaluators provide competent performance to stakeholders.
Ensure that the evaluation team collectively possesses the education, abilities, skills, and experience appropriate to the evaluation.
Ensure that the evaluation team collectively demonstrates cultural competence and uses appropriate evaluation strategies and skills to work with culturally different groups.
Practice within the limits of their competence, decline to conduct evaluations that fall substantially outside those limits, and make clear any limitations on the evaluation that might result if declining is not feasible.
Seek to maintain and improve their competencies in order to provide the highest level of performance in their evaluations.
Integrity and honesty:
  Evaluators display honesty and integrity in their own behavior, and they attempt to ensure the honesty and integrity of the entire evaluation process.
Negotiate honestly with clients and relevant stakeholders concerning the costs, tasks, limitations of methodology, scope of results, and uses of data.
Disclose any roles or relationships that might pose a real or apparent conflict of interest prior to accepting an assignment.
Record and report all changes to the original negotiated project plans, and the reasons for them, including any possible impacts that could result.
Be explicit about their own, their clients', and other stakeholders' interests and values related to the evaluation.
Represent accurately their procedures, data, and findings, and attempt to prevent or correct misuse of their work by others.
Work to resolve any concerns related to procedures or activities likely to produce misleading evaluative information, decline to conduct the evaluation if concerns cannot be resolved, and consult colleagues or relevant stakeholders about other ways to proceed if declining is not feasible.
Disclose all sources of financial support for an evaluation, and the source of the request for the evaluation.
Respect for people:
  Evaluators respect the security, dignity, and self-worth of respondents, program participants, clients, and other stakeholders.
Seek a comprehensive understanding of the contextual elements of the evaluation.
Abide by current professional ethics, standards, and regulations concerning confidentiality, informed consent, and potential risks or harms to participants.
Seek to maximize the benefits and reduce any unnecessary harm that might occur from an evaluation and carefully judge when the benefits from the evaluation or procedure should be foregone because of potential risks.
Conduct the evaluation and communicate its results in a way that respects stakeholders' dignity and self-worth.
Foster social equity in evaluation, when feasible, so that those who give to the evaluation may benefit in return.
Understand, respect, and take into account differences among stakeholders, such as culture, religion, disability, age, sexual orientation, and ethnicity.
Responsibilities for general and public welfare:
  Evaluations articulate and take into account the diversity of general and public interests and values.
Include relevant perspectives and interests of the full range of stakeholders.
Consider not only immediate operations and outcomes of the evaluation but also the broad assumptions, implications, and potential side effects.
Allow stakeholders access to, and actively disseminate, evaluative information, and present evaluation results in understandable forms that respect people and honor promises of confidentiality.
Maintain a balance between client and other stakeholder needs and interests.
Take into account the public interest and good, going beyond analysis of particular stakeholder interests to consider the welfare of society as a whole.

REFLECTION QUESTIONS

  1. Select one standard from each of the five principles. What scale or evidence could you use to determine how well an evaluator has met each standard?
  2. Under what conditions might evaluators find living up to these principles and standards problematic? How should they negotiate or resolve these conflicts?
..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset