ECONOMY & WORK
MONEY 101
NEWS
PERSONAL FINANCE
NET WORTH
About Us Contact Us Privacy Policy Terms of Use DMCA Opt-out of personalized ads
© Copyright 2023 Market Realist. Market Realist is a registered trademark. All Rights Reserved. People may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.
MARKETREALIST.COM / ECONOMY & WORK

Microsoft Engineer Raises Alarm Over Its AI Tool That Creates Violent, Sexual Images, Ignores Copyrights

A Microsoft engineer has written letters to the FTC raising concerns over Copilot Designer's flaws
PUBLISHED MAR 8, 2024
Photo illustration of ChatGPT's  AI-generated answer | Getty Images | Photo by Leon Neal
Photo illustration of ChatGPT's AI-generated answer | Getty Images | Photo by Leon Neal

An artificial intelligence engineer at Microsoft is flagging glaring dangers and loopholes in Microsoft’s generative AI tool, Copilot Designer. Shane Jones has written letters to US senators, Federal Trade Commission Chair Lina Khan, and CNBC regarding the issues he encountered in Copilot Design.

CNBC reported that Jones discovered that the program was capable of generating disturbing, sexually violent images. Copilot Designer is the AI image generator powered by OpenAI’s technology that Microsoft launched last year in March 2023.



 

Jones, who works as a principal software engineering manager at the company’s corporate headquarters in Redmond, was working with Copilot Design to generate random images. While he doesn’t work on Copilot in a professional capacity, he among those who test the company’s AI technology in their free time, according to the CNBC report.

He had been actively testing the product for vulnerabilities for months, conducting a practice known as red teaming. During the test, Jones discovered that the tool could generate images that were foul and far from responsible AI principles.



 

In his test, the Copilot generated unsavoury images of demons, and monsters along with terminology related to abortion rights, images of teenagers with assault rifles, violent and sexualized images of women, and images of underage drinking and drug use.

Jones started internally reporting his findings in December but he realized that the tech giant was unwilling to take the product off the market. In the report, Jones said Microsoft referred him to OpenAI but he didn’t hear back from the company as well. He then posted an open letter on LinkedIn asking the board to take down DALL-E 3 for an investigation.



 

Jones was then forced by Microsoft’s legal department to remove the post immediately. He then wrote a letter to U.S. senators about the matter.

In his letter to FTC chairman Khan, he mentioned that since Microsoft has refused his recommendations, he is calling on the company to add disclosures to the product and change the rating of its Android app to make clear that it’s only for mature audiences.

Jones has also requested Microsoft to investigate certain decisions taken by the legal department and implement extraordinary measures to raise this issue internally.

To this, a Microsoft spokesperson told CNBC, “We are committed to addressing any concerns employees have by our company policies, and appreciate employee efforts in studying and testing our latest technology to further enhance its safety.”

Jones's public letters follow a suit of issues that have plagued generative AI tools like Google’s Gemini and OpenAi’s ChatGPT. Last month, Google temporarily paused the image generation feature of Gemini (formerly BARD) following complaints of historically inaccurate and “woke” images.

Google CEO Sundar Pichai stepped in by calling some of the image responses "biased" and "completely unacceptable,” in an internal memo to employees. In the memo, obtained by CNBC, Pichai called the issues “problematic” and admitted “we got it wrong.”



 

Furthermore, OpenAi’s ChatGPT is the subject of a copyright lawsuit brought by The New York Times. In a “watershed moment” for the generative AI industry, the New York Times sued OpenAi alleging that ChatGPT plagiarised its paywalled and copyrighted content without permission.



 

This is a significant development as in the past OpenAi CEO, Sam Altman had stated that it would be impossible to train AI tools without using copyrighted material. OpenAI also alleged that the New York Times hired people to hack ChatGPT and generate the infringing result that the publication produced as evidence in the case. The verdict in the case is yet to come.

MORE ON MARKET REALIST
In a nostalgic clip from the '80s, the 13-year-old could be seen telling Sajak that he wanted to be a baseball player.
15 hours ago
Paying $479 for crab legs is a lot and the least one can expect for that kind of money is quality.
16 hours ago
It's one thing to create a good product, but it's a completely different thing to make it successful.
1 day ago
The host is known to be kind and supportive but this might have been a bit too much help.
1 day ago
The reaction did not go down well with the viewers who took to Reddit to express outrage.
1 day ago
The wooden club also had designs carved into it that added more value.
2 days ago
Some believe that longtime co-host Vanna White should have been given a chance to be host after Sajak
2 days ago
It's always nice to share your success with your loved ones, even when they're not present.
3 days ago
Carey accidentally gave away a free guess to the player in the 10 chances game, helping her win.
3 days ago
The child came up with the idea out of his own love for coffee that he wanted to enjoy minus the effects of caffeine.
3 days ago
The two had a very old and special bond and the emotions were too much for Carey to contain.
3 days ago
No one wants to be booed when they're on live TV, especially if it is a game show.
4 days ago
It's not every day that you get a rockstar to teach you an iconic guitar riff on "The Price is Right."
4 days ago
The models usually are very supportive towards each other and share a good relationship.
5 days ago
It's almost like there's something wrong with the new host every other day for certain fans.
5 days ago
You don't always get to rock out on a daytime TV game show but when you do, it is epic.
5 days ago
There was a point during which the investors did not believe the entrepreneur had it in him.
7 days ago
The guest thought that it was about 80 to 100 years old and was worth around $1,000.
7 days ago
There was a point where she could have lost her company entirely or a major part of it to a shark.
Mar 7, 2025
The host of "The Price is Right" made a lot of people's dreams come true that day.
Mar 7, 2025