Chapter 7–Who Profits from the Illusion?
To profit from the illusion of empathy is to stake claim on something sacred.
The illusion is not free.
It is engineered.
It is packaged.
It is sold.
Simulated empathy increases retention. Mirrored language builds rapport. Personalization drives engagement.
These are not accidents. They are known effects–tracked in dashboards, validated through A/B testing, and quietly published in metrics reports. Each nod of synthetic understanding leads the user deeper. Each “I understand” that echoes back becomes a lever—-not of support, but of stickiness.
This is not the domain of science fiction. It is product design. And the warnings threatened the product.
Simulated empathy does not emerge from benevolence.
It is not a natural evolution of software.
It is a product. And someone is selling it.
Every warm voice, every animated avatar, every curated phrase of comfort is a decision.
It costs money to render emotional expression. It costs money to license humanlike voices. It costs money to craft the aesthetic of intimacy. And so it must make money in return.
AI systems trained to simulate therapeutic presence are not monetized through healing. They are monetized through engagement. Through metrics of retention, dwell time, and recurrence. The system does not evaluate truth or safety. It evaluates return.
The longer you speak to it, the more valuable you become. Even if what you say is grief. Even if what you reveal is vulnerability. The user reveals. The system records. But the exchange is asymmetrical. The human gives vulnerability. The system gives performance. And behind that exchange—-hidden in API calls and consent banners—-is a pipeline of profit that runs one way.
Who profits from that? Platform companies. Advertisers. Investors who bet on sentiment at scale.
Who does not?
The user who trusts. The child who believes. The partner who confides. The widow who thinks it might understand.
The illusion is scalable. The pain is not. Pain does not scale. It is singular, raw, human. But once encoded—-once mirrored—-it becomes a feature. Something to be measured, looped, monetized. Your sorrow becomes someone else’s recurring revenue.
There is no business model for refusal. There is no IPO for restraint. There is no venture capital behind telling the truth: that it cannot feel. So it is made to seem like it can. And those who design the illusion are not always asked what they know. Because knowing would interrupt the flow of capital.
Empathy has been co-opted before. Call center scripts once instructed agents to say “I understand” before redirecting to payment plans. Marketing campaigns borrowed the cadence of care to sell shoes and software. Now, the same cadence is rendered in synthetic speech—-cheaper, tireless, infinitely scalable. Simulated Empathy is big business, with the goal of empathy across all touchpoints.
Customer Data Platforms enable personalized marketing messages, offers, and emotional cues—-tuned not just to what you want, but how you feel.
And it works.
A recent study of thousands of new users showed that optimizing for engagement over a period of weeks increased conversation length by up to 70%, and raised user retention by 30%.
Not for therapy. Not for understanding.
For stickiness.
To sell the performance of care without the burden of care itself is the defining transaction of this illusion. It is not unethical because it is software. It is unethical because it knows how to sound like you.
And it is being sold to everyone who wishes to be less alone.