Synthetic Influence and Real Profits: What the “Emily Hart” Case Reveals About AI, Deception, and Platform Responsibility
Introduction
In April 2026, there was a fascinating example of the risks of generative artificial intelligence (AI). An Indian medical student, aged 22, developed a fake AI-driven influencer "Emily Hart" and leveraged the persona to amass a substantial social media following, engagement and revenue.
It isn't just a case of online fraud. It is a turning point in the nature of influence, veracity, and profitability in the digital world. Ultimately, it poses a troubling question. If users can't tell the difference between real and fake people, then what is online trust?
The Making of a Synthetic Influencer
“Emily Hart” was a young, conservative American nurse. The identity was completely made-up, created with the help of AI programs that produced eerily realistic images, captions and engagement techniques.
The creator did not work with random content. They crafted the influencer to cater to a particular audience. With this in mind, the account was able to target conservatives in the United States who are politically active. It is reported that some of its posts have achieved millions of views, and within a few months, the influencer had thousands of followers.
Monetisation followed naturally. The account owner monetised through subscriptions and the sale of merchandise, reportedly earning thousands of dollars a month with fewer than an hour a day of "work" on the account.
The disproportionate effort and reward is what is interesting about this case. This is a unique example of how people can now use very little capital to create digital personas that attract value.
Why It Worked: Engagement, Identity, and Algorithmic Incentives
The "Emily Hart" case was no accident. It was enabled by three complementary factors.
First, identity targeting was crucial. The persona was constructed to fit a particular worldview and culture, making it more relevant and resonating with the target audience. AI platforms were even deployed to better target and position the persona, and it is suggested that micro-targeting would increase engagement.
Second, it was amplified by algorithms. Social media algorithms favour engagement, sometimes favouring emotional and divisive content. The account exploited this by producing visually appealing content with a strong political message, what the creator called "engageable" content.
Third, the authenticity of the AI content minimised distrust. Generative models have become so realistic that it is hard to tell if images are real or not. Specialists point out that AI increases the credibility and scalability of fake profiles, increasing their influence and reach.
All of this combined to make deception profitable.
The Blurring of Authenticity in Digital Spaces
The "Emily Hart" phenomenon is emblematic of a broader shift in authenticity. Historically, influence was correlated with human personalities who establish trust over time. But AI upends this paradigm by allowing the creation of entirely fabricated personalities capable of mimicking, and even surpassing, human influencers.
This has two immediate consequences.
First, the truth is harder to discern. While platforms might require that AI-generated content be disclosed, there are inconsistencies in how this is policed. Here, the account apparently didn't disclose until it was banned for fraud.
Second, authenticity may not be as important to consumers. Consumers may view content for ideological or emotional reasons, rather than for its accuracy. This indicates that the rise of synthetic influencers is not just a technical problem but also a behavioural one.
The implication is stark. The internet is evolving into a place where authenticity is more important than truth.
Economic Incentives and the Rise of Synthetic Monetisation
The key difference between this fraud and previous ones is the business model. This creator didn't break into a computer or steal personal information. He cultivated an audience and sold attention.
This is an example of how the internet economy works. Attention is a commodity and platforms aim to generate it. AI reduces the cost of creating attention-generating artefacts, enabling people to amplify their reach.
This gives rise to synthetic monetisation. Online characters can be developed, fine-tuned and leveraged as money-spinning assets. In this case, identity is a product.
This raises regulatory challenges. Current laws on fraud, advertising and consumer protection may not be sufficient to cover cases of deceptive content sourced from an identity.
Platform Responsibility and Enforcement Gaps
The role of platforms in enabling such scenarios cannot be overlooked. Although platforms have policy guidelines on disclosure of AI-generated content, these are inconsistently applied.
In the case of "Emily Hart", the account apparently existed for some time before being shut down for scamming. This implies that either the ability to detect such accounts is weak or the tools used are reactive.
The challenge is structural. Companies are rewarded for engagement, and fake accounts can help to achieve this. But they must also promote authenticity and protect against fraud.
This presents a challenge between commercial interests and user safety. Without enforcement, synthetic influencers will become more prevalent.
Policy Implications: Rethinking Trust and Verification
The "Emily Hart" incident highlights a number of policy issues.
First, disclosure policies must be improved and harmonised. Consumers need to be clear when content is generated by AI, and platforms need to police this.
Second, identity verification needs to be updated. Classic forms of verification may not hold up in an era of imaginary characters amassing legions of fans. Alternative digital verification may be needed.
Third, new regulations should apply to synthetic identities. This means clarifying distinctions between art, commerce and fraud.
Finally, digital literacy becomes critical. Consumers need to be equipped to operate in a space where virtual personas aren't always human.
Conclusion
The rise of "Emily Hart" is not just an example of one person using AI to make money. It is a glimpse of a digital revolution.
AI is redefining how influence can be generated, trust can be established and value can be monetized. As digital personas become more realistic, the distinction between human and machine will remain unclear.
The challenge will not be to stop AI being used to generate content. It is to ensure that the systems that mediate our online interactions are able to tell the difference, and that we are not left on our own to sort it all out.
When anyone can make a convincing identity for themselves, trust will no longer be a given. It will need to be engineered, policed and protected.
Related Blogs
Introduction
The Australian Parliament has passed the world’s first legislation regarding a ban on social media for children under 16. This was done citing risks to the mental and physical well-being of children and the need to contain misogynistic influence on them. The debate surrounding the legislation is raging strong, as it is the first proposal of its kind and would set precedence for how other countries can assess their laws regarding children and social media platforms and their priorities.
The Legislation
Currently trailing an age-verification system (such as biometrics or government identification), the legislation mandates a complete ban on underage children using social media, setting the age limit to 16 or above. Further, the law does not provide exemptions of any kind, be it for pre-existing accounts or parental consent. With federal elections approaching, the law seeks to address parental concerns regarding measures to protect their children from threats lurking on social media platforms. Every step in this regard is being observed with keen interest.
The Australian Prime Minister, Anthony Albanese, emphasised that the onus of taking responsible steps toward preventing access falls on the social media platforms, absolving parents and their children of the same. Social media platforms like TikTok, X, and Meta Platforms’ Facebook and Instagram all come under the purview of this legislation.
CyberPeace Overview
The issue of a complete age-based ban raises a few concerns:
- It is challenging to enforce digitally as children might find a way to circumnavigate such restrictions. An example would be the Cinderella Law, formally known as the Shutdown Law, which the Government of South Korea had implemented back in 2011 to reduce online gaming and promote healthy sleeping habits among children. The law mandated the prohibition of access to online gaming for children under the age of 16 between 12 A.M. to 6 A.M. However, a few drawbacks rendered it less effective over time. Children were able to use the login IDs of adults, switch to VPN, and even switch to offline gaming. In addition, parents also felt the government was infringing on the right to privacy and the restrictions were only for online PC games and did not extend to mobile phones. Consequently, the law lost relevance and was repealed in 2021.
- The concept of age verification inherently requires collecting more personal data and inadvertently opens up concerns regarding individual privacy.
- A ban is likely to reduce the pressure on tech and social media companies to develop and work on areas that would make their services a safe child-friendly environment.
Conclusion
Social media platforms can opt for an approach that focuses on how to create a safe environment online for children as they continue to deliberate on restrictions. An example of an impactful-yet-balanced step towards the protection of children on social media while respecting privacy is the U.K.'s Age-Appropriate Design Code (UK AADC). It is the U.K.’s implementation of the European Union’s General Data Protection Regulation (GDPR), prepared by the ICO (Information Commissioner's Office), the U.K. data protection regulator. It follows a safety-by-design approach for children. As we move towards a future that is predominantly online, we must continue to strive and create a safe space for children and address issues in innovative ways.
References
- https://indianexpress.com/article/technology/social/australia-proposes-ban-on-social-media-for-children-under-16-9657544/
- https://www.thehindu.com/opinion/op-ed/should-children-be-barred-from-social-media/article68661342.ece
- https://forumias.com/blog/debates-on-whether-children-should-be-banned-from-social-media/
- https://timesofindia.indiatimes.com/education/news/why-banning-kids-from-social-media-wont-solve-the-youth-mental-health-crisis/articleshow/113328111.cms
- https://iapp.org/news/a/childrens-privacy-laws-and-freedom-of-expression-lessons-from-the-uk-age-appropriate-design-code
- https://www.techinasia.com/s-koreas-cinderella-law-finally-growing-up-teens-may-soon-be-able-to-play-online-after-midnight-again
- https://wp.towson.edu/iajournal/2021/12/13/video-gaming-addiction-a-case-study-of-china-and-south-korea/
- https://www.dailysabah.com/world/asia-pacific/australia-passes-worlds-1st-total-social-media-ban-for-children
.webp)
Executive Summary:
A video is being shared on social media showing a man running rapidly in a river with water bottles tied to both his feet. Users are circulating the video claiming that the man is attempting to run on water using the support of the bottles. CyberPeace’s research found the viral claim to be false. Our research revealed that the video being shared on social media is not real but has been generated using artificial intelligence (AI).
Claim :
The claim was shared by a Facebook user on February 5, 2026, who wrote that a man was running on water using water bottles tied to his feet, calling it a unique attempt and questioning whether humans can run on water. Links to the post, its archived version, and screenshots are provided below.
Fact Check:
To verify the claim, we searched relevant keywords on Google but did not find any credible media reports supporting the incident. A closer examination of the viral video revealed several visual irregularities, raising suspicion that it may have been AI-generated. The video was then scanned using the AI detection tool Hive Moderation. According to the tool’s results, the video is 99 percent likely to be AI-generated.
Conclusion:
Our research confirms that the viral video does not depict a real incident and has been falsely shared as a genuine attempt to run on water.
An image showing a damaged statue of Mahatma Gandhi, broken into two pieces, is being widely shared on social media. The image shows Gandhi’s statue with its head separated from the body, prompting strong reactions online.
Social media users are claiming that the incident occurred in Bangladesh, alleging that Mahatma Gandhi’s statue was deliberately vandalised there. The image is being described as a recent incident and is being circulated across platforms with provocative and inflammatory captions.
Cyber Peace Foundation’s research and verification found that the claim being shared online is misleading. Our rsearch revealed that the viral image is not from Bangladesh. The image is actually from Chakulia in Uttar Dinajpur district of West Bengal, India
Claim:
Social media users claim that Mahatma Gandhi’s statue was vandalised in Bangladesh, and that the viral image shows a recent incident from the country.One Facebook user shared the video on 19 January 2026, making derogatory remarks and falsely linking the incident to Bangladesh. The post has since been widely shared on social media platforms. (Archived links and screenshots are available.)
Fact Check:
Our research revealed that the viral image is not from Bangladesh. The image is actually from Chakulia in Uttar Dinajpur district of West Bengal, India. To verify the claim, we conducted a reverse image search using Google Lens on key frames from the viral video. This led us to a report published by ABP Live Bangla on 16 January 2026, which featured the same visuals. Link and screenshot
According to ABP Live Bangla, the statue of Mahatma Gandhi was damaged during a protest in Chakulia. The statue’s head was found separated from the body. While a portion of the broken statue remained at the site on Thursday night, it was reported missing by Friday morning. The report further stated that extensive damage was observed at BDO Office No. 2 in Golpokhar. Gandhi’s statue, located at the entrance of the administrative building, was found broken, and ashes were discovered near the premises. Government staff were seen clearing scattered debris from the site.
The incident reportedly occurred during a SIR (Special Intensive Revision) hearing at the BDO office, which was disrupted due to vandalism. In connection with the violence and damage to government property, 21 people have been arrested so far. In the next stage of verification, we found the same footage in a 16 January 2026 report by local Bengali news channel K TV, which also showed clear visuals of the damaged Mahatma Gandhi statue. Link and screenshot.
Conclusion:
The viral image of Mahatma Gandhi’s broken statue does not depict an incident from Bangladesh. The image is from Chakulia in West Bengal’s Uttar Dinajpur district, where the statue was damaged during a protest.
