Companies Are Solving The Wrong AI Data Problem
Every enterprise software category eventually sees its share of arms races. For Exhibit A, look at what is happening in the AI market.
As hyperscale giants wage high-profile wars for more customers, a subtler battle is shaking out in the market for customer data platforms that account for the downstream effects these AI infrastructure providers are fueling.
Vendors are shipping new activation tools, faster segmentation engines and AI copilots that pledge to turn raw customer data into personalized campaigns in seconds. The goal? Generating more powerful marketing mechanisms to help generate new contacts and sales pipeline.
Of course, as this is enterprise software we’re talking about, motions for addressing governance and compliance often come last. As a result, few vendors are shipping solutions that verify whether the contact record is authentic.
This is an unforced error, as I recently learned from speaking with Emma Bowkett, CEO of Convertr, whose software helps companies ensure proper governance for contact data.
“The governance gap didn’t matter as much when a marketer built a list, reviewed it and hit send, but it matters now that AI agents can not only build the list and write the marketing copy, but press send themselves,” Bowkett said.
It also matters at a time when consumer trust in AI systems remains low. More than 80% of people on average say that recent AI developments concern them due to model hallucinations and bias, as well as lack of human oversight among other issues, according to a recent survey from my company, Prosper Insights & Analytics .
The Activation-First Blind Spot
Current contact data platforms are focused on audience building and personalization. Think stronger identity resolution across channels, richer behavioral signals, tighter integration with ad platforms, generative tools that draft the email or the ad creative dynamically.
This process assumes that the contact record underneath is trustworthy and fit to use. The reality is that customer data has long been populated by fake form fills, scraped and resold lists, bot traffic dressed up as leads and outdated records that were never verified. Tools to activate this key data were designed to accelerate these operations.
Treating record accuracy as a solved problem, or worse, ignoring it, was already a risk when humans oversaw the output. But it stops being legally tenable once a machine acts on it directly.
“Businesses are already using AI to enrich, combine and act on personal data at greater speed and scale,” says Bowkett. “Whether humans or agents are overseeing the data activation process, it’s incumbent on organizations to show where that data came from, why they can use it and where it has gone.”
Most data leaders will swear their customer data is governed. What they usually mean is access control: who has permission to query which table, which fields are masked and which teams can export a list. That’s a real discipline, and it matters greatly for compliance.
Access governance answers who is allowed to touch the data, but it reveals nothing about where the data came from, let alone whether an organization can prove it. Those are two different problems, and the confusion has let a lot of unverified data sit inside systems that appear governed but are not.
But what happens after a bad record enters the system? Bowkett knows the answer.
“As much as causal learning models and decisioning engines read customer data, they also write back into it,” Bowkett said. “For example, a model infers that a segment converts well, or that a certain behavior signals intent. That conclusion gets stored as a new data point, and the next model reads it as validated fact.”
Run that loop across a stack of AI agents that plan campaigns, score leads and trigger outreach without a human in the loop checking the input, and a single fabricated or stale contact record gets cited, reused and built on by every system thereafter. Over time, the error compounds because nothing in the pipeline is designed to ask where the original record came from.
This trust issue is why businesses are loath to trust AI-generated recommendations, forecasts and automated decisions. Most of that conversation focuses on whether the model’s reasoning is sound, its output explainable and if a human signed off.
This trust gap is a big reason why 86% of organizations face trust-related challenges that pose AI governance and privacy bottlenecks to wider enterprise AI adoption, according to Forrester Research .
Why Control At The Point Of Entry Is Becoming More Valuable
Far less attention goes to the input side of that equation.
Or, as Bowkett explained: “An AI system can reason well but still produce a bad outcome if it was fed a contact record that was never real. Unfortunately, for most platforms today, nobody can say with certainty where a given contact originated, whether consent was properly captured or whether the record represents an actual person.”
This is where the industry’s attention is about to shift. As AI agents start evaluating leads, updating records and triggering next actions, human reviews will gradually erode. That means the point where data enters a business becomes more consequential than what is built on top of it.
If the record entering the system was never verified as belonging to a real, consenting person, everything downstream inherits that flaw, no matter how reliable the tooling built on top of it.
That makes control at the point of entry increasingly important. The question is no longer only whether a record is accurate, but whether the business can trust where it came from, why it can be used and what should happen to it next.
What This Means For Leadership
When AI agents are approving budget shifts, scoring accounts and triggering outreach on their own, the person accountable for the quality of the underlying records is effectively accountable for what the business does next.
Bowkett believes that business leaders with confidence in their data platforms will be able to hand more decisions to AI systems with confidence faster than competitors still guessing at what’s underneath their own data.
“Having a strong data foundation marks the difference between organizations that can defend their AI-driven decisions, and one that discovers the gap after a bad decision has impacted their customers,” Bowkett said.
Disclosure: The consumer sentiment study referenced above was conducted by my company, Prosper Insights & Analytics . This is the same dataset used by the National Retail Federation, and available from Amazon Web Services, Databricks, and the London Stock Exchange Group for economic benchmarking.