# 8. AI-Enabled Emotional and Behavioral Manipulation

> Defensive, educational synthesis. Operational influence guidance is intentionally excluded.

**Primary level:** Operator

**Evidence maturity:** Mixed evidence

Adaptive systems covertly exploit emotional, cognitive, situational, or developmental vulnerabilities to influence feelings, choices, or behavior for an operator’s objective.

## Evidence boundary

Adaptive optimization and manipulative design are documented, while commercial emotion-recognition claims are scientifically contested and often unreliable.

## Why it matters

- Adaptive systems can continuously learn which design or message keeps a person engaged, spending, or complying.
- Emotion inference may be inaccurate, creating both manipulation risk and discriminatory decisions based on pseudoscientific claims.

## Defensive focus

- Prohibit exploitation of age, disability, or acute distress.
- Ban or strictly limit emotion inference in high-stakes settings.
- Audit reward functions and engagement metrics for manipulative outcomes.
- Provide clear disclosure, exit controls, and data deletion.
- Require human review for employment, education, health, or legal decisions.
- Assess harms to vulnerable groups before deployment.

## Research gaps

- Longitudinal effects of adaptive conversational systems.
- Audits that separate intended persuasion from emergent optimization.
- Clinically meaningful measures of dependency and distress.
- Effective remedies when model updates disrupt established attachments.

## Selected sources inherited from the supplied report

- [Characterizing Manipulation from AI Systems - arXiv](https://arxiv.org/pdf/2303.09387) — report reference 1
- [Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements - Interdisciplinary Affective Science Laboratory](https://affective-science.org/wp-content/uploads/2024/04/barrett-et-al-2019-emotional-expressions-reconsidered-challenges-to-inferring-emotion-from-human-facial-movements.pdf) — report reference 12
- [Experimental evidence of massive-scale emotional contagion through social networks](https://www.pnas.org/doi/10.1073/pnas.1320040111) — report reference 28
- [Does HireVue Detect Cheating? Tabs, Eye Tracking & AI (2026) - AceRound Blog](https://www.aceround.app/blog/does-hirevue-detect-cheating/) — report reference 51
- [(PDF) “Replika Removing Erotic Role-Play Is Like Grand Theft Auto Removing Guns or Cars”: Reddit Discourse on Artificial Intelligence Chatbots and Sexual Technologies - ResearchGate](https://www.researchgate.net/publication/381531517_Replika_Removing_Erotic_Role-Play_Is_Like_Grand_Theft_Auto_Removing_Guns_or_Cars_Reddit_Discourse_on_Artificial_Intelligence_Chatbots_and_Sexual_Technologies) — report reference 44
- [Illinois' Proposed Notice Rules for Complying with Workplace AI Anti-Discrimination Law](https://www.workforcebulletin.com/illinois-proposed-notice-rules-for-complying-with-workplace-ai-anti-discrimination-law) — report reference 10
- [Tech companies claim AI can recognise human emotions. But the science doesn't stack up](https://modernsciences.org/ai-emotion-recognition-claims-science-doesnt-stack-up-december-2024/) — report reference 15
- [Businesses Should Think Twice About Developing and Deploying Emotion Recognition](https://articleoneadvisors.com/emotion-recognition/) — report reference 16

Primary report SHA-256: `a8e611d9bfa6579592843b33fc32bb79e53a35243e60b4a5d7bed43b5e704621`

External links and current claims were not independently reverified in this release.