ECONOMY & WORK
MONEY 101
NEWS
PERSONAL FINANCE
NET WORTH
About Us Contact Us Privacy Policy Terms of Use DMCA Opt-out of personalized ads
© Copyright 2023 Market Realist. Market Realist is a registered trademark. All Rights Reserved. People may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.
MARKETREALIST.COM / ECONOMY & WORK

Microsoft Engineer Raises Alarm Over Its AI Tool That Creates Violent, Sexual Images, Ignores Copyrights

A Microsoft engineer has written letters to the FTC raising concerns over Copilot Designer's flaws
PUBLISHED MAR 8, 2024
Photo illustration of ChatGPT's  AI-generated answer | Getty Images | Photo by Leon Neal
Photo illustration of ChatGPT's AI-generated answer | Getty Images | Photo by Leon Neal

An artificial intelligence engineer at Microsoft is flagging glaring dangers and loopholes in Microsoft’s generative AI tool, Copilot Designer. Shane Jones has written letters to US senators, Federal Trade Commission Chair Lina Khan, and CNBC regarding the issues he encountered in Copilot Design.

CNBC reported that Jones discovered that the program was capable of generating disturbing, sexually violent images. Copilot Designer is the AI image generator powered by OpenAI’s technology that Microsoft launched last year in March 2023.



 

Jones, who works as a principal software engineering manager at the company’s corporate headquarters in Redmond, was working with Copilot Design to generate random images. While he doesn’t work on Copilot in a professional capacity, he among those who test the company’s AI technology in their free time, according to the CNBC report.

He had been actively testing the product for vulnerabilities for months, conducting a practice known as red teaming. During the test, Jones discovered that the tool could generate images that were foul and far from responsible AI principles.



 

In his test, the Copilot generated unsavoury images of demons, and monsters along with terminology related to abortion rights, images of teenagers with assault rifles, violent and sexualized images of women, and images of underage drinking and drug use.

Jones started internally reporting his findings in December but he realized that the tech giant was unwilling to take the product off the market. In the report, Jones said Microsoft referred him to OpenAI but he didn’t hear back from the company as well. He then posted an open letter on LinkedIn asking the board to take down DALL-E 3 for an investigation.



 

Jones was then forced by Microsoft’s legal department to remove the post immediately. He then wrote a letter to U.S. senators about the matter.

In his letter to FTC chairman Khan, he mentioned that since Microsoft has refused his recommendations, he is calling on the company to add disclosures to the product and change the rating of its Android app to make clear that it’s only for mature audiences.

Jones has also requested Microsoft to investigate certain decisions taken by the legal department and implement extraordinary measures to raise this issue internally.

To this, a Microsoft spokesperson told CNBC, “We are committed to addressing any concerns employees have by our company policies, and appreciate employee efforts in studying and testing our latest technology to further enhance its safety.”

Jones's public letters follow a suit of issues that have plagued generative AI tools like Google’s Gemini and OpenAi’s ChatGPT. Last month, Google temporarily paused the image generation feature of Gemini (formerly BARD) following complaints of historically inaccurate and “woke” images.

Google CEO Sundar Pichai stepped in by calling some of the image responses "biased" and "completely unacceptable,” in an internal memo to employees. In the memo, obtained by CNBC, Pichai called the issues “problematic” and admitted “we got it wrong.”



 

Furthermore, OpenAi’s ChatGPT is the subject of a copyright lawsuit brought by The New York Times. In a “watershed moment” for the generative AI industry, the New York Times sued OpenAi alleging that ChatGPT plagiarised its paywalled and copyrighted content without permission.



 

This is a significant development as in the past OpenAi CEO, Sam Altman had stated that it would be impossible to train AI tools without using copyrighted material. OpenAI also alleged that the New York Times hired people to hack ChatGPT and generate the infringing result that the publication produced as evidence in the case. The verdict in the case is yet to come.

MORE ON MARKET REALIST
The reaction did not go down well with the viewers who took to Reddit to express outrage.
1 hour ago
The wooden club also had designs carved into it that added more value.
19 hours ago
Some believe that longtime co-host Vanna White should have been given a chance to be host after Sajak
1 day ago
It's always nice to share your success with your loved ones, even when they're not present.
1 day ago
Carey accidentally gave away a free guess to the player in the 10 chances game, helping her win.
1 day ago
The child came up with the idea out of his own love for coffee that he wanted to enjoy minus the effects of caffeine.
1 day ago
The two had a very old and special bond and the emotions were too much for Carey to contain.
1 day ago
No one wants to be booed when they're on live TV, especially if it is a game show.
2 days ago
It's not every day that you get a rockstar to teach you an iconic guitar riff on "The Price is Right."
3 days ago
The models usually are very supportive towards each other and share a good relationship.
3 days ago
It's almost like there's something wrong with the new host every other day for certain fans.
3 days ago
You don't always get to rock out on a daytime TV game show but when you do, it is epic.
4 days ago
There was a point during which the investors did not believe the entrepreneur had it in him.
5 days ago
The guest thought that it was about 80 to 100 years old and was worth around $1,000.
5 days ago
There was a point where she could have lost her company entirely or a major part of it to a shark.
7 days ago
The host of "The Price is Right" made a lot of people's dreams come true that day.
7 days ago
The host handled it very well and fans also appreciated him for the same in comments.
Mar 6, 2025
The "Family Feud" host showcased one of his many talents, leaving the audience in awe.
Mar 6, 2025
George Gray has been a beloved member of "The Price is Right" cast for more than a decade now.
Mar 6, 2025
The producers made them kiss three times during season six while they tried out different pitches.
Mar 6, 2025