Indikus is the metaevaluator for the Appalachia Regional Comprehensive Center (ARCC), a program that builds state education agencies’ capacity to support school districts. An internal evaluation provides formative and outcome reports. Indikus was hired to ensure the evaluation is conducted according to standards and plan, and that it adds value to ARCC’s stakeholders.
Indikus developed and, in collaboration with the ARCC director, published the Responsive Meta-Evaluation (RME), an eight-step model that directs both a comprehensive review and an organized process for improving the evaluation. Specifically, by combining constructive critiques and deliberative decision-making, the RME model is designed to strengthen the internal evaluation’s methods and instrumentation, build evaluation capacity, and ensure that its reporting and feedback are meeting the needs of technical assistance staff, sponsors, and ARCC leadership.
In its sixth year, the Indikus metaevaluation has helped the ARCC’s key stakeholders identify priority growth areas, negotiate the strategic purposes for the internal evaluation, gather and utilize input from all program stakeholders, and improve the clarity and usefulness of feedback reports.
Indikus’ meta-evaluation services have strengthened our internal evaluation considerably, from improving our overall design to helping us use evaluation findings meaningfully for program improvement. In addition, he’s a terrific colleague—insightful, articulate, responsive, conscientious, and always thinking deeply about the work at hand.
– Caitlin Howley, Ph.D., ARCC Director
Step 1: Identify Stakeholders and Reporting Needs
Step 2: Explore Stakeholder- Defined Issues
Step 3: Set Collective Expectations
Step 4: Formalize and Implement the Meta-Evaluation
Step 5: Collect Meta-Evaluation Data
Step 6: Analyze and Report Findings
Step 7: Facilitate Deliberation & Planning Process
Step 8: Refine the Evaluation
Source: Sturges, K.M. & Howley, C. (2016). Responsive Meta-evaluation: A Participatory Approach to Enhancing Evaluation Quality. American Journal of Evaluation.