The psychological impact of AI-powered harassment is uniquely insidious. The knowledge that one’s likeness or voice can be so easily co-opted and manipulated can lead to a pervasive sense of vulnerability and mistrust. Victims may feel a loss of control over their identities, constantly wondering if the content they see online is real or synthetic. This uncertainty can breed anxiety, paranoia and a reluctance to engage online at all.

As AI continues to evolve at a breakneck pace, the challenges posed by deepfakes and synthetic media will only intensify. More sophisticated deepfakes will become increasingly difficult to detect, while the AI systems designed to identify them often harbour biases that can further marginalise already vulnerable groups.

To combat this rising tide of AI-powered harassment, we must mobilise on multiple fronts. In the realm of technology, we need more advanced tools for detecting and flagging synthetic media, coupled with robust content moderation systems that can keep pace with the ever-evolving tactics of harassers. Legal frameworks must be updated to account for the unique challenges posed by AI, providing clear avenues for holding perpetrators accountable and safeguarding the rights of victims.

Education and public awareness will be critical in empowering individuals to navigate the treacherous waters of an AI-enhanced digital landscape. By promoting digital literacy skills, such as how to identify deepfakes and synthetic content, and advocating for best practices in online safety and privacy, we can help build resilience against the onslaught of AI-assisted harassment.

“Deepfakes are being weaponised against women – we need to take action”