March 21st, 2019
What does your program do? Answering this seemingly simple question is where the program evaluation planning process always starts.
To measure something, you first have to define it. When you apply an evaluative lens to a program, a new way of thinking about it emerges.
Take for example the work I recently completed with the Northwest Housing Alternatives (NHA) Resident Services Program.
The project goal was was simple: to improve how the team communicated with potential funders about the positive impact of their work in order to increase their chances for grant funding.
At the end of our 6-month project together, not only did the final concept paper lead to the NHA Resident Services Program securing two of their largest grants to date, but the process helped their staff develop the confidence and skills to gather data that’s relevant to their work AND to put that data to use to continually improve their programs.
To begin my work with them, I started with the NHA Resident Services program description: “Resident services provides ongoing coordination across 32 properties to promote housing stability.”
My evaluative brain was churning – How do these services promote housing stability? What are these services? How frequently did they occur? How did they decide what activities to implement?
Phase 1 was a personal fact-finding mission. My goal was to look more deeply at what their activities actually were. I completed a document analysis and had many informational interviews and discussions with their staff. From this work, I learned the following:
Next was Phase 2, which focused on group work. We all gathered for an evaluation planning session to dive deeper to answer the big question: what does this program do?
First, in small groups, the staff discussed the frequency of their activities as well as how each activity promoted housing stability. Each small group received a stack of 32 cards, each with one activity listed on it. The following table was put on a large wall, so each group could tape up each of the program’s 32 activities on where it fell in terms of frequency and the type of residents who received each service:
The figure below depicts the relationship between housing stability and the service activities that we identified during our work together.
Ultimately, what was most significant for the NHA Resident Services Program team’s experience going through the evaluation process was how they saw their work in a new way. The process helped them try new ways to answer the big questions about what their program does and why. It helped them uncover ways to improve and streamline their work to strengthen their program’s impact. Finally, it gave them a new way to more clearly and succinctly communicate how they approach their work to outside funders.
Click the image below to see the final concept paper:
Interested in learning more about how you and your team can benefit from program evaluation at your organization? Want to improve how you communicate the impact of your work to potential funders? Feel free to email me anytime – I’d love to help!
Chari accurately captured the fundamental goals and mission of our organization and transformed our input into a clear evaluation process that helps us assess the impact of our programs on the lives of the families that we serve. Now we have an amazing way to measure the physical, emotional, and mental effects of our programs and to guide change, ensuring that we are delivering services in the most effective way possible.Brandi Tuck, Executive Director, Portland Homeless Family Solutions
Get periodic emails with useful evaluation resources and industry updates.
We promise not to spam you!