AI-enabled gender-based violence is growing 

Artificial intelligence is increasingly being used to facilitate and scale gender-based violence in digital spaces. This includes non-consensual deepfake pornography, AI-generated sexual harassment, impersonation and identity manipulation, surveillance and coercive control, and the use of manipulative or exploitative chatbots and “AI companions”. 

Evidence suggests the scale and speed of these harms is accelerating. The vast majority of deepfake content is pornographic and disproportionately targets women, while exposure to sexualised AI-generated material is becoming more common among UK internet users. Research also indicates that women report higher levels of concern and perceived risk related to these technologies. 

These issues were highlighted at the AI&Gender conference organised by the Young Women’s Movement in Edinburgh earlier this year, where speakers discussed how rapidly the landscape is evolving. What began as experimental deepfake technology has developed into widely accessible generative AI tools capable of producing realistic sexualised imagery within seconds. The rise of “nudification” apps and similar tools was identified as particularly concerning, especially where safeguards are minimal or applied only after harm has already occurred. A key concern raised was that AI is lowering the barrier to abuse, enabling individuals with little technical expertise to generate and distribute highly realistic harmful content at scale.” apps and similar tools was identified as particularly concerning, especially where safeguards are minimal or applied only after harm has already occurred. A key concern raised was that AI is lowering the barrier to abuse, enabling individuals with little technical expertise to generate and distribute highly realistic harmful content at scale. 

Women are underrepresented in the UK AI sector – why it matters 

At the same time, the gender gap in AI remains persistent and well documented. Research from The Alan Turing Institute shows that a bit more than 20% of AI and data professionals in the UK are women, with representation declining further at senior and leadership levels. Women are significantly underrepresented in technical AI roles, research positions, and decision-making structures within the sector. 

This pattern is not unique to the UK. European research from Interface EU finds that women make up approximately 22% of AI professionals globally and fewer than 15% of senior AI leadership roles, highlighting systemic barriers across the field. Beyond workforce participation, the gender gap also extends to funding, visibility, and influence. Data consistently show that women are less likely to found or lead AI companies and less likely to shape the direction of AI research and product development. 

AI systems are not neutral; they reflect the assumptions, priorities, and experiences of those who design and use them. When women are underrepresented in AI development, this can lead to biased outcomes in real-world applications. For example, recruitment algorithms trained on historical hiring data have been shown to disadvantage women by replicating existing patterns of male-dominated hiring. 

Research and discussions at the AI&Gender conference highlight that this lack of diversity is not only an equality issue but also a structural safety concern. More diverse teams are better at identifying risks, challenging assumptions, and anticipating unintended consequences, while less diverse teams may fail to recognise harms that disproportionately affect underrepresented groups. 

In AI, this can contribute to what speakers described as an “algorithmic patriarchy for profit”, where commercial priorities such as scale and engagement outweigh considerations of safety, dignity, and harm prevention. As a result, gendered harms are more likely to be overlooked, normalised, or left unaddressed at the design stage. This has led to increasing calls for safety-by-design approaches, mandatory gender-based violence risk assessments for new technologies, stronger accountability for developers and platforms, and greater inclusion of women and marginalised groups in AI design and governance. 

AI governance and the gender equality challenge 

Policy responses to AI and gender-related harms are developing across the UK and Scotland, but remain uneven and largely reactive. In the UK, the Online Safety Act 2023 introduces new duties for platforms to address illegal and harmful online content, including forms of image-based abuse, with enforcement overseen by regulators such as Ofcom. In Scotland, the Scottish Government is also exploring approaches to tackle deepfake-related harms and strengthen protections against technology-facilitated abuse, alongside wider commitments to ethical AI and digital inclusion. However, research and practitioner perspectives increasingly suggest that regulation is struggling to keep pace with the rapid development of AI technologies. 

Alongside this, organisations such as Equate Scotland play an important role in addressing both the structural underrepresentation of women in AI and the wider harms emerging from these systems. This includes supporting women into STEM and AI careers, strengthening progression pathways, embedding digital safety and gender awareness into skills development, and advocating for more inclusive AI policy.  

Overall, this reflects a critical moment for AI and gender equality. AI systems are shaped by human decisions and existing power structures; without deliberate intervention, there is a risk that AI will reinforce inequality and amplify harm. It is obvious that women’s underrepresentation in AI and AI-enabled gender-based violence are closely connected challenges. Addressing them together through stronger regulation, inclusive workforce development, and safety-by-design approaches is essential if AI is to support more equitable digital futures.

Equate will be present at DataFest, Scotland’s flagship data and AI festival, where we will be engaging with attendees on the role of women in shaping AI in Scotland. This will be an opportunity for open conversation about how AI is being developed and experienced, and why questions of power, representation, and safety must sit alongside innovation. 

DataFest 2026 – Scotland’s Leading Data & AI Event
27th & 28th May 2026
The Assembly Rooms Edinburgh
Full Agenda & Programme