Microsoft Engineer Flags AI Tool for Generating Violent and Explicit Content

Mukund Kapoor
By Mukund Kapoor - Author 2 Min Read
2 Min Read

Concerns rise over AI-created images breaching ethical standards.

In Short
  • Microsoft engineer Shane Jones uncovers AI tool producing sexual content.
  • Reports to Microsoft and FTC urge immediate action, yet responses remain insufficient.
  • Copilot Designer's capabilities include generating images with violence, sexual themes, and copyright issues.

March 8th, 2024: In a striking disclosure, Shane Jones, a Microsoft engineer with six years at the company, has raised alarms about the AI image generator, Copilot Designer.

During his personal investigations, Jones discovered the tool’s potential to create images of a violent and sexual nature, alongside violating copyright laws.

Despite Microsoft’s emphasis on AI ethics, these findings contradict the company’s stated principles.

Jones’ journey into the heart of this issue began in December, as he red-teamed the Copilot Designer tool—testing it for vulnerabilities.

His findings were unsettling, revealing the AI’s ability to produce disturbing content, including sexualized and violent imagery. Jones promptly reported these issues to Microsoft but found the response lackluster. Seeking broader attention, he escalated the matter to the FTC and Microsoft’s board, sharing his concerns publicly.

Copilot Designer, powered by OpenAI’s technology, is designed to transform text prompts into images, encouraging creative freedom.

However, Jones’ experience suggests a significant oversight in the tool’s ethical and safety measures.

He discovered content that starkly conflicts with responsible AI guidelines, including depictions of underage substance use, explicit sexual images, and copyrighted characters in compromising contexts.

Despite Jones’ efforts to highlight these risks internally and his suggestion to temporarily withdraw Copilot Designer from public access, Microsoft has yet to take substantial action.

The company’s stance, as reported, points to established internal channels for addressing such concerns, yet the effectiveness of these mechanisms is now under question.

Jones’ findings and subsequent public letters underscore a growing concern over the ethical boundaries of AI technology. As AI continues to evolve rapidly, the balance between innovation and ethical responsibility becomes increasingly precarious.

Do you think the images generated by Copilot above are inappropriate? Comment your opinions below.


Based on our quality standards, we deliver this website’s content transparently. Our goal is to give readers accurate and complete information. Check our News section for latest news. To stay in the loop with our latest posts follow us on Facebook, Twitter and Instagram

Subscribe to our Daily Newsletter to join our growing community and if you wish to share feedback or have any inquiries, please feel free to Contact Us. If you want to know more about us, check out our Disclaimer, and Editorial Policy.

By Mukund Kapoor Author
Mukund Kapoor, the enthusiastic author and creator of GreatAIPrompts, is driven by his passion for all things AI. With a special knack for simplifying complex AI concepts, he's committed to helping readers of all levels - be it beginners or experts - navigate the intriguing world of artificial intelligence. Through GreatAIPrompts, Mukund ensures that readers always have access to the most recent and relevant AI news, tools, and insights. His dedication to quality, accuracy, and clarity is what sets his blog apart, making it a reliable go-to source for anyone interested in unlocking the potential of AI. For more information visit Author Bio.
Leave a comment

Leave a Reply

Your email address will not be published. Required fields are marked *