For years, nonprofit leaders have been taught to believe that one number can tell the whole story.
The overhead ratio.
Spend less on administration.
Spend more on programs.
Keep the percentage low enough, and donors will trust you.
It became one of the most widely used measures of organizational performance, not because it measured impact, but because it was easy to understand.
Then something remarkable happened.
GuideStar, Charity Navigator, and the BBB Wise Giving Alliance publicly challenged the very metric they had helped popularize.
Together, they urged donors, funders, and nonprofit leaders to stop judging organizations primarily by overhead ratios.
Why?
Because the number was never measuring what people thought it measured.
An organization could maintain a remarkably low overhead ratio while underinvesting in staff, technology, evaluation, and learning.
Others felt pressured to reclassify expenses simply to appear more efficient.
Some even manipulated reporting practices because they knew donors were rewarding the wrong metric.
The number itself wasn’t inaccurate.
The interpretation was.
And that’s an important distinction.
A metric can be completely accurate while still leading decision-makers toward the wrong conclusion.
That’s the difference between measurement and evaluation.
Measurement tells you what happened.
Evaluation helps you understand what it means.
The Hidden Danger Of Proxy Metrics
Every organization uses proxy metrics.
→ Attendance.
→ Outputs delivered.
→ Beneficiaries reached.
→ Volunteer hours.
→ Distribution counts.
→ Compliance percentages.
None of these is inherently wrong.
In fact, they’re often necessary.
The problem begins when a proxy metric becomes the conclusion instead of the starting point.
Because every metric leaves something out.
→ A program can distribute thousands of learning materials without improving educational outcomes.
→ A health intervention can serve hundreds of patients without changing long-term health behaviors.
→ A workforce initiative can train participants without increasing employment.
The activity happened.
The impact remains unknown.
When organizations mistake outputs for outcomes, they create what I call impact leakage.
Not because the program failed.
Because the evidence failed to tell the complete story.
A Real Example From A Government Evaluation
Several years ago, I served as the contracted evaluator responsible for monitoring Crisis Intervention Team (CIT) compliance across Mississippi under engagements supported by SAMHSA and the Mississippi Department of Mental Health.
The compliance report showed something encouraging.
94% coverage.
On paper, it looked like success.
The number was accurate.
But evaluation doesn’t stop with accuracy.
It asks a second question:
What Does This Number Actually Tell Us?
Looking beyond the headline revealed a very different operational reality.
Out of Mississippi’s 82 counties, 77 had trained officers.
That also meant five counties had no trained officers at all: franklin, issaquena, lawrence, sharkey, amite.
The compliance percentage hadn’t lied.
It simply wasn’t telling the whole story.
A board reading only the 94% figure could reasonably conclude statewide access had been achieved.
An operational leader reviewing county-level coverage would immediately recognize that five communities remained completely unserved.
Those are two very different decisions based on the same dataset.
That’s impact leakage.
Why This Matters
This isn’t just a government evaluation problem.
It’s a nonprofit, CSR problem, philanthropy problem, and an executive leadership problem.
Every day, organizations present technically correct numbers.
→ Programs delivered.
→ Participants served.
→ Communities reached.
→ Funds distributed.
→ Events completed.
But leadership teams aren’t ultimately judged by whether activities occurred.
They’re judged by whether meaningful change occurred, and that’s where evaluation becomes indispensable.
Evaluation asks questions that measurement alone cannot answer.
→ Were the right indicators selected?
→ Was there a baseline?
→ Can the reported change reasonably be attributed to the intervention?
→ Does the evidence support the conclusion?
Without those answers, organizations risk making confident decisions based on incomplete evidence.
Three Questions Every Leadership Team Should Ask
Before presenting any performance metric to a board or funder, pause and ask three simple questions.
1. What does this metric actually measure?
Is it measuring activity? Or is it measuring change?
Those are not the same thing.
2. What does this metric leave out?
Every number has blind spots.
A good evaluation identifies them before someone else does.
3. Would the decision change if we looked one level deeper?
The Mississippi compliance figure illustrates exactly why this question matters.
The statewide percentage looked excellent.
The county-level view revealed a different operational reality.
Both statements were true; only one supported better decision-making.
Moving From Measurement To Evidence
Strong organizations don’t simply collect more data.
They collect better evidence.
That means building systems that connect activities to outcomes, indicators of intended change, baselines to progress, and evidence to decisions.
That’s what transforms reporting from a compliance exercise into a leadership tool.
Because the purpose of evaluation isn’t producing more reports.
It’s helping decision-makers see what the headline number cannot.
Join Us For The Full Breakdown.
The “Overhead Myth” taught us that one financial metric can distort how organizations are judged.
The Mississippi compliance case demonstrates that the same problem exists in program evaluation.
One number can be accurate.
One number can even be impressive.
And still leave decision-makers with an incomplete understanding of reality.
During Impact Leakage Live, I’ll unpack the full Mississippi case study, explain why the 94% figure changed once we examined county-level evidence, and walk through the three-question framework I use to identify hidden evidence gaps before reports reach boards, funders, and executive teams.
If your organization is responsible for program evaluation, grant reporting, CSR reporting, ESG reporting, or board reporting, I believe you’ll find the session valuable.
Reserve your place for Impact Leakage Live and learn how to spot evidence gaps before they become decision gaps.
Click here to reserve your spot: https://c2iwebinar.claritytoimpact.com/impact-leakage-live/?utm_source=linkedin&utm_medium=social&utm_campaign=impact_leakage_live
Evidence-led, impact-driven. The OLPADR way.