Stop Letting Impact Leak Away: Why Nonprofits Must Treat Analytics as Essential Infrastructure

For years, nonprofit leaders have heard the same message from funders: Show us your impact.

That expectation has pushed many organizations to collect more information about their programs, participants, services, and results. Nonprofits now maintain donor records, participant assessments, case notes, spreadsheets, program logs, surveys, financial reports, and grant reporting data.

Yet collecting information and using information are two very different capabilities.

In the Stanford Social Innovation Review article, “Closing the Data Utilization Gap,” author Gaurav Mittal describes a problem that affects organizations across the social sector:

“Many nonprofits are data rich but insight poor. That means they collect vast amounts of information, for compliance, in CRM systems, health records, or program logs, but lack the internal capability to turn that data into a road map for their mission.”

This observation captures one of the central challenges facing nonprofit organizations.

Many nonprofits already possess enough data to improve their programs, strengthen their operations, and tell more credible impact stories. The missing piece is often the capacity to organize, interpret, and act on that information.

The cost of that gap reaches far beyond reporting.

When an organization cannot see what is working, where participants are disengaging, or which program activities lead to better outcomes, it loses opportunities to improve its impact. Resources continue flowing into programs, yet leaders lack the insight required to make those programs stronger.

Mittal offers a useful and urgent way to describe this problem. He writes that a nonprofit receiving funding without the ability to examine its own data creates a “leaky bucket” effect:

“No matter how much money pours in, the impact leaks out because the organization is not learning or improving.”

That framing raises the stakes for nonprofit leaders, boards, and funders.

Impact measurement has often been presented as a way to satisfy funders, complete grant reports, and prove that an organization deserves continued support. Those goals still matter. Yet the strongest reason to measure impact sits much closer to the mission.

Nonprofits need data so they can learn.

They need insight so they can improve.

They need analytics so more people receive services that produce meaningful results.

The Real Cost of Unused Data

A nonprofit can have a full database and still lack a clear understanding of its performance.

Staff members may enter data every day. Program leaders may submit monthly reports. Development teams may track donations. Case managers may document participant activity. Executive teams may present totals to the board.

Activity totals can create a sense of progress. They can also conceal problems.

An organization may serve more people while participant outcomes remain unchanged.

A program may receive more referrals while many participants leave before receiving meaningful services.

A fundraising campaign may raise more revenue while donor retention continues to fall.

A digital program may attract thousands of users while only a small percentage remain engaged.

These figures tell very different stories. Leaders can see those differences only when they examine the full path from activity to outcome.

The examples in Mittal’s article make this risk clear.

Hegira Health, a community-based behavioral health provider in Michigan, operated a referral program that appeared successful when judged by its headline metric. Referrals were increasing by 35 percent each year.

A closer analysis revealed a major gap. Staff followed up with 76 percent of referrals, yet the engagement rate fell to 42 percent. For every 100 people contacted, 58 never became active participants.

The referral growth looked positive. The deeper analysis revealed a point where potential impact was being lost.

Once leaders could see the gap, they could ask sharper questions. Was the intake process too slow? Were communication methods creating barriers? Were participants receiving clear instructions? Did the program need different follow-up practices?

The data shifted the conversation from celebrating growth to improving engagement.

That shift represents the true value of analytics.

Reach and Impact Are Different Measures

Mittal also shares the example of AHADI, a youth mental health application developed by the East African nonprofit TAHMEF.

Downloads rose from 2,000 in January to more than 101,000 in June. That number could easily become the centerpiece of a grant report, donor presentation, or annual report.

Yet retention remained between 1 and 6 percent.

The organization was reaching people. Very few users were staying engaged.

The difference matters.

A download measures initial interest. Retention shows whether users continue finding value in the program. Conversations with a helpline may provide another indicator of meaningful engagement. Participant outcomes offer an even clearer view of whether the service is improving lives.

Each measure answers a different question:

• How many people encountered the program?

• How many participated?

• How many stayed engaged?

• How many achieved a meaningful result?

A nonprofit that tracks only the first question may report impressive reach while missing signs that the program needs improvement.

Impact measurement helps organizations move beyond counting activity. It connects services to the changes those services are intended to create.

Data Should Guide Program Decisions

Many nonprofit measurement systems are built around reporting deadlines.

Staff collect information throughout the grant period. At the end of the quarter or year, they compile the required numbers, submit the report, and move on to the next reporting cycle.

That process gives funders information. It may provide very little value to the people running the program.

A stronger approach places data inside the organization’s regular decision-making process.

Program teams can review results weekly or monthly. Leaders can compare outcomes across locations, participant groups, referral sources, or service models. Staff can identify unusual changes and discuss what may have caused them. Teams can test adjustments and examine whether outcomes improve.

This is the foundation of a culture of continuous learning.

In our previous SureImpact article, “Building Sustainable High Performing Nonprofits,” we discussed the role learning plays in long-term organizational strength.

High-performing nonprofits create systems that help them study their own work. They use data to identify patterns, question assumptions, and adapt their programs. They give staff access to information that helps them make better decisions.

Continuous learning turns measurement into an active management tool.

• A program director can see where participants are leaving a program.

• A case manager can identify which services are associated with stronger outcomes.

• An executive director can compare program performance with the organization’s strategic goals.

• A board can ask questions about participant progress rather than reviewing activity totals alone.

• A funder can understand how its investment contributed to measurable changes in people’s lives.

Each of these actions depends on reliable, accessible data.

Analytics Should Be Treated as Infrastructure

One of Mittal’s central recommendations is that nonprofits, boards, and funders should “treat analytics as infrastructure.”

This concept deserves serious attention.

Organizations recognize that certain systems are required for effective operations. They invest in financial management, secure technology, human resources, facilities, and compliance processes. These systems support every part of the organization’s work.

Analytics deserves the same status.

An organization needs a clear way to collect data, connect information from different sources, monitor key indicators, and share results with staff and stakeholders. It also needs people who understand what the data means and how to use it.

Analytics infrastructure may include:

• Clearly-defined outcomes

• Consistent data collection practices

• Shared definitions for key measures

• A central system for storing program information

• Dashboards that make results easy to understand

• Staff training and internal ownership

• Regular meetings where teams review findings

• Processes for turning insights into program changes

These capabilities help an organization learn from every participant interaction, program cycle, and funding period.

Without them, valuable information remains scattered across spreadsheets, software systems, and individual staff members.

Capacity Building Strengthens Direct Services

Organizational capacity directly affects mission performance. Capacity building includes investments in people, systems, leadership, technology, evaluation, and internal processes. These investments help staff deliver services more effectively and give organizations the stability required for long term impact.

Data capacity belongs at the center of that work.

Mittal points out that relatively small investments in internal data systems can produce meaningful gains. He cites the Waterford Community Coalition, a youth serving nonprofit in Michigan, which invested about 20 hours in developing a structured performance dashboard. The pro bono analytics support was valued at $4,324.

That investment gave leaders year over year comparisons and a clearer view of performance trends. It also improved the organization’s ability to communicate results to stakeholders.

The amount was modest compared with the potential value of the insight it created.

A well-structured measurement system can help an organization direct staff time more effectively, identify service gaps, improve participant engagement, strengthen donor retention, and allocate funding based on evidence.

Capacity building and direct service delivery support the same goal: better outcomes for people and communities.

Funders Can Help Close the Gap

Funders shape nonprofit priorities through their grant requirements and funding decisions.

When grants support programs without supporting the systems required to evaluate and improve those programs, nonprofits face a difficult challenge. They may be expected to produce detailed reports while receiving little support for the technology, staff time, training, or evaluation capacity required to create them.

Mittal calls on funders to view analytics as a legitimate and valuable investment.

That could mean funding impact management technology, data cleanup, staff training, dashboard development, evaluation planning, or dedicated measurement roles. It could also mean allowing grant recipients to include these expenses within program budgets.

A funder investing $150,000 in a program has a clear interest in helping the organization understand whether that program is working.

Data infrastructure protects the value of the larger investment.

Funders can also examine an organization’s learning capacity during due diligence. Mittal suggests three useful questions:

1. What are your three governing key performance indicators, and who owns them?

2. When did your data last lead you to change a program decision?

3. Can your staff maintain your reporting system without depending on the consultant who built it?

These questions reveal whether data is part of the organization’s management process or limited to external reporting.

They also signal that learning capacity matters.

Boards Must Govern Impact

Boards carry responsibility for the organization’s mission, strategy, financial health, and long-term sustainability. Effective governance should include a clear understanding of program performance.

A board that reviews financial statements without reviewing outcomes sees only part of the organization’s health.

Financial data shows how resources were spent.

Impact data shows what those resources accomplished.

Board members should know which outcomes matter most, how performance is changing, where programs face challenges, and what leadership is doing in response.

They should ask whether the organization’s measurement systems provide useful information. They should support investments that strengthen internal data capacity. They should encourage leadership to discuss weaknesses openly and use findings as opportunities for improvement.

This approach creates accountability without creating fear.

The goal is learning, not punishment.

When boards treat analytics as a governance discipline, they help protect the mission from preventable losses in impact.

Start With the Questions That Matter Most

Closing the data utilization gap does not require tracking every possible metric.

Mittal recommends a three KPI rule. Organizations should identify three measures that help leaders make important decisions each week.

The right measures will vary by program and mission. They may include:

• The percentage of eligible participants who enroll

• The percentage of enrolled participants who remain engaged

• The percentage of participants who achieve a defined outcome

• The time between referral and first service

• The percentage of donors who renew their support

• The number of participants completing a key program milestone

The strongest metrics connect directly to decisions.

Leaders should be able to explain what action they would take if a measure rises, falls, or remains unchanged.

A metric without a decision attached to it may offer little practical value.

From Reporting Impact to Improving Impact

The nonprofit sector has spent years building the case for impact measurement as a funding requirement.

The SSIR article adds greater urgency.

Organizations need impact data so they can see where results are being lost. They need analytics so they can learn from their operations. They need internal capacity so each program cycle becomes an opportunity to improve the next one.

A nonprofit that measures impact solely at reporting time misses much of the value its data can provide.

A nonprofit that reviews impact consistently can identify barriers sooner, test better approaches, use resources more effectively, and serve people more successfully.

That is the difference between collecting data and building a learning organization.

Most nonprofits already have valuable information. It may live in program logs, participant records, donor databases, intake forms, assessments, and spreadsheets.

The urgent task is turning that information into insight.

Treating analytics as infrastructure gives nonprofit leaders a clear path forward. Define the outcomes that matter. Organize the data already being collected. Select a small set of decision-focused measures. Give staff access to useful dashboards. Review results consistently. Use what you learn to improve programs.

Every insight offers a chance to close a gap, strengthen a service, and help more people achieve better outcomes.

When nonprofits build the capacity to learn from their data, they keep more impact from leaking away.

Build the Analytics Infrastructure Your Mission Deserves

If analytics should be treated as infrastructure, your organization needs more than spreadsheets and disconnected systems. SureImpact provides a centralized platform for case management, outcomes tracking, reporting, and analytics so you can collect consistent data, monitor results, and turn insights into action.

Take a self-guided interactive tour of SureImpact.