You are here

Using Evaluation Findings for Program Improvement

When you get your evaluation results, it is often a good idea to revisit your logic model—and perhaps even your theory of change—to look at your activities and intended goals. If your evaluation results show that you did not have the effects you were hoping for or that your program quality is not where you want it, it may be time to change your activities or your program plan.

Sometimes, the findings from your evaluation are not entirely clear or not what you hoped for or expected. Other times, the findings can be overwhelming, and they may suggest dozens of things to fix and improve. When it is time to sit down with staff members to review the evaluation results and make decisions about improvements, it can be a good idea to have your evaluator (if you have one) or someone knowledgeable about the evaluation to sit with you to explain the findings, identify the key points, and help narrow down the planned reaction. Most likely you won’t be able to address everything that was derived from the evaluation. Begin with recognizing the strengths and positive findings; then work with your staff or advisory board to identify two or three short-term goals and two or three long-term goals to address and brainstorm potential solutions. Be concrete. For example, don’t just note that the evaluation showed program attendance was low in academic activities and high in sports programs. Discuss as a team why that might be the case, identify one or two specific steps to address that problem (e.g., allow young people to attend the sports program only if they have attended the academic program first) and assign specific staff members the task of implementing the action steps. Use Tool 92: Post-Evaluation Planning Tool to identify your short- and long-term goals and assign staff members and deadlines for each action step.

After you have developed an action plan based on your evaluation, don’t leave it at that. Revisit the plan every couple of months to make sure everyone is still on task with the short- and long-term goals. Identify any challenges that have come up. Determine whether new concerns or areas need attention in addition to the action steps you identified based on the evaluation. If possible, review your data to see if the short-term changes you have made are improving your targeted problem areas. If we take the previous example, for instance, you could collect data on attendance for your sports programs and academic programs after implementing your new attendance policy to see whether your change is having the intended effect. If it is, great! If it isn’t, revisit your strategy and determine whether new action needs to be taken.

Who to Involve in Reflecting and Using Data to Improve Your Program
 

It is important to involve a wide variety of people and roles as you use your evaluation findings to make program improvements and changes. Anyone who has a stake in your program will want some input and should have an opportunity to contribute thoughts and ideas on how to improve the program. Some people may need to have more input than others. For example, program staff members at all levels should be involved in not only hearing the evaluation results but also making decisions, testing solutions, and reflecting on their effectiveness. Others, such as community partners, may just need to be informed through a community forum but won't need key decision-making authority. Carefully consider the stake each type of person has in your program and involve them accordingly.

Remember the all-important role youth can play in your reflection process. Youth of all ages can and should be involved in making decisions about program improvements. If you run a program for elementary school youth, their involvement may be limited to answering questions with a staff member about what they like and don't like about the program or making suggestions for new kinds of activities. For programs serving high school youth, involve them in your overall advisory board or create a youth advisory board, have them conduct surveys of their peers about what is and isn't working, or hold a planning session with them to review the evaluation results and discuss suggested changes. The most important thing is to involve them in authentic and developmentally appropriate ways.

Finally, advisory boards are critical stakeholders in the improvement process. (See the management section for guidance on forming an advisory board.) Advisory boards are key partners when it comes to looking at evaluation findings and helping guide programs toward improvement planning and decision making. Advisory boards also may provide expert guidance that is not internally present in your program. For example, an advisory board member with expertise in research may be able to help with interpreting findings, or you may have a board member who is a key opinion leader in the community and can provide valuable insight on a finding of interest. Consider your advisory board as your inner circle when reviewing evaluation findings and making improvement strategies for your program. This promotes transparency and buy-in, and you are bound to get more great ideas and insights by including your local trusted experts.