Personalization To Paranoia

There was a time when consumers gave brands the benefit of the doubt. They assumed their data was handled responsibly and kept safely within the walls of whatever company they trusted with it. That era is over. What we are watching now is a systematic collapse of that assumption, accelerated above all by artificial intelligence.

As companies race to deploy AI-powered personalization and autonomous agents, many are running into a wall of consumer distrust they did not see coming. The question is whether organizations can govern the data powering those systems well enough to preserve the customer trust on which their revenue depends.

The Assumption Of Hidden Intent

The trust problem is no longer subtle. A 2025 Consumer Trust Survey commissioned by Relyance AI (powered by TrueDot.ai) found that 82% of respondents view AI data loss-of-control as a serious personal threat, and 81% suspect companies are already using their personal data for undisclosed AI training, whether or not that is actually the case. When companies attempt to reassure consumers with policy statements or privacy disclosures, only 44% trust company explanations about data use, with 24% expressing active opposition.

Independent research confirms the scope. Cisco’s 2024 Consumer Privacy Survey found that 84% of generative AI users are concerned about data they enter into AI tools going public, yet 30% still enter personal or confidential information into those tools. Consumers are not disengaging from AI entirely; they are engaging with it anxiously, looking for any signal that the companies behind it can be trusted.

I asked Abhi Sharma, CEO of Relyance AI, how he interprets this disconnect. “Promises no longer move the needle,” he told me. “Consumers have been told for years that their data is protected and yet breaches keep happening and AI systems keep expanding. The only thing that rebuilds trust at this point is proof: showing exactly where data went, what it was used for, and how it was governed in real time.” This is precisely what Relyance AI was built to deliver.

Enterprise Blind Spots Are Becoming Consumer Liabilities

Part of what fuels consumer anxiety is a real organizational problem: many enterprises genuinely do not know where customer data goes once it enters an AI system. The rapid proliferation of machine learning models, third-party APIs, SaaS tools, and “shadow AI” has created data flows that even internal teams cannot fully map.

According to a survey from my company, Prosper Insights & Analytics, 57% of U.S. consumers across all generations are concerned about their privacy being violated by AI.

Boomers and Gen-X show particular anxiety around the need for more disclosure and transparency on AI data use, cited by 34% and 28% of those cohorts respectively. Even Gen-Z showed strong skepticism: only 16% reported no concerns about AI developments.

This is a universal issue, not a generational one. The disconnect runs deeper than most realize: 72% of U.S. consumers have never even heard of Agentic AI — the autonomous systems now being rapidly deployed across enterprise operations. Among those who have, only 16% think it is a good idea.

Deloitte’s 2025 Connected Consumer Survey reinforces the picture: only 20% of consumers say tech providers are “very clear” about what data they collect or how it is used. The infrastructure of explanation is in place. The credibility behind it is not.

Anxiety is Guiding Behavior

Consumer concern has crossed the threshold from attitude into action. This is not sentiment from a single survey — across multiple sources, the behavioral pattern is consistent: people are changing what they share, what they use, and who they trust.

• 51% have already reduced their data sharing due to AI-related concerns (Relyance AI, 2025)
• 54% have actively avoided AI-powered features such as recommendations, chatbots, and personalization tools (Cisco, 2024)
• 84% would abandon or restrict use of a company that admitted it could not trace how customer data moves through its AI systems; 57% would stop entirely (Relyance AI, 2025)
• 52% would join a class action lawsuit if they could not get satisfactory answers about their data (Relyance AI, 2025)

The compounding effect deserves attention. When consumers withhold data or avoid AI features, the very systems companies have invested in receive degraded inputs. Fewer interactions, less behavioral signal, lower-quality personalization: the AI gets worse precisely because trust has eroded.

“What we’re seeing is that the cost of opacity has finally become quantifiable,” Sharma noted. “It shows up in churn rates, in legal exposure, in degraded AI performance, and increasingly in the willingness of high-value customers to pay a premium to companies they actually trust.”

Transparency As A Competitive Differentiator

A recent Prosper Insights & Analytics survey found that 57% of U.S. adults reported being “extremely” or “very” concerned about their privacy being violated by AI. This is held across all age groups. Even Boomers, the least concerned generation, show majority-level anxiety. The concern is structural, not generational.

What’s counterintuitive is what that anxiety is worth. When the Relyance AI survey asked consumers to choose between knowing exactly where their data goes versus getting the lowest available price, the split was dead even. Among the highest-value shoppers — those spending $1,000 or more over the holidays — 62% chose transparency over the better deal. Deloitte found the same dynamic playing out in actual spending: consumers who trust their technology providers spent 50% more on connected devices last year than those who don’t. The revenue case for trust is no longer speculative. It shows up in the numbers.

What Proof Actually Looks Like

For years, the standard response to privacy concerns has been a promise: “we take your privacy seriously.” Consumers no longer find that meaningful. What they want now is something concrete — the ability to opt out, clear proof their data isn’t being used for model training without permission, and visibility into where it goes inside AI systems.

That shift is already influencing how more sophisticated buyers evaluate vendors. In enterprise procurement, data governance documentation is becoming a prerequisite, not an afterthought. In consumer markets, the same dynamic is playing out at the individual level — quietly, through avoidance and abandonment rather than formal complaint.

Data traceability, real consent controls, and the ability to answer a customer’s basic questions about their own data are no longer back-office compliance concerns. They are features a growing segment of the market will seek out and pay for.

The companies that act on this first will not just avoid the churn and legal exposure that opacity invites. They will win a segment of the market that is actively looking for someone to trust with their data.

Disclosure: The consumer sentiment study referenced above was conducted by my company, Prosper Insights & Analytics. This is the same dataset used by the National Retail Federation, and available from Amazon Web Services, Bloomberg, and the London Stock Exchange Group for economic benchmarking.