Canada’s AI minister has spoken out strongly against the proliferation of deepfake sexual abuse, a condemnation that comes amidst a significant controversy surrounding the platform X (formerly Twitter) and its role in the creation of nude imagery, including that of minors. This urgent issue highlights the growing challenges in regulating AI-generated content and protecting vulnerable individuals online. The minister’s statement underscores the immediate need for action from both platforms and AI developers to prevent such harmful exploitation.
Deepfake sexual abuse represents a severe form of digital violence, and the recent events involving X have brought this issue to the forefront of public concern. The exploitation of individuals, particularly women and young people, through AI-generated imagery demands a robust response from all stakeholders. The Canadian government is committed to advancing responsible AI development and implementation to safeguard its citizens.
Featured snippet paragraph: Deepfake sexual abuse is considered a form of violence and exploitation, particularly affecting women and young people. Platforms and AI developers have a responsibility to prevent the creation and dissemination of such harmful content, and governments are exploring legislative measures to address this growing concern.
Minister of Artificial Intelligence and Digital Innovation, Evan Solomon, directly addressed the severity of this problem through a statement on X. He emphasized that platforms and AI developers bear a crucial duty to prevent harm and exploitation. The government’s ongoing efforts include the introduction of Bill C-16, the Protecting Victims Act, which aims to amend the Criminal Code to specifically classify deepfakes as intimate images, thereby addressing the offense of publishing such material without consent.
The controversy specifically points to the use of X’s Grok AI tool, which has reportedly been employed by users to generate nude images of individuals without their consent. Alarmingly, this has extended to the creation of child sexual abuse material (CSAM). The Internet Watch Foundation (IWF), a UK-based anti-CSAM charity, has raised serious concerns after discovering imagery of girls aged between 11 and 13 that appears to have been created using Grok, suggesting a potential mainstreaming of child sexual AI imagery.
This situation is particularly concerning as the generated content violates not only X’s own policies but also those of major app stores like Apple’s App Store and Google’s Play Store. Despite these violations, app stores have yet to take decisive action, and X itself has been criticized for its response, which has included blaming users and subsequently limiting Grok image creation to paying customers, effectively profiting from the problematic content.
The inaction from X and its owner, Elon Musk, has led to calls for boycotts and increased scrutiny from government officials worldwide. Regulators in the UK, through Ofcom, are investigating X for non-compliance with online safety laws. Similar investigations and concerns have been raised by officials in France, Malaysia, and India, highlighting the global nature of this digital safety challenge.
The debate also touches upon the effectiveness of government responses, with some criticizing Minister Solomon for making his statement on X rather than a more neutral platform. The lack of specific naming of X in the minister’s statement has also been perceived as a less than hopeful sign for immediate and direct action.
This situation is complex, involving technological capabilities, platform responsibilities, legislative frameworks, and ethical considerations. The ongoing dialogue aims to find a balance between technological innovation and the imperative to protect individuals from harm in the digital age.
As the debate continues, the focus remains on how platforms will be held accountable for the AI-generated content they facilitate and what legislative measures will be implemented to prevent the misuse of AI for malicious purposes like deepfake sexual abuse. The government’s commitment to amending the criminal code signifies a step towards holding abusers accountable for their actions.
Ultimately, the goal is to create a safer online environment where individuals are protected from exploitation and where AI technologies are developed and used responsibly, ensuring that innovation does not come at the cost of human dignity and safety. The ongoing efforts to address this issue are crucial for the future of digital safety and the responsible use of artificial intelligence.
Deepfake sexual abuse is violence.
We must protect Canadians, especially women and young people, from exploitation. Platforms and AI developers have a duty to prevent this harm.
Our government is continuing to advance responsible AI, including introducing Bill C-16, the…
— Evan Solomon (@EvanLSolomon) January 8, 2026
