AI Gone Wrong: 5 Biggest AI Failures Of All Time

AI Failures

From Tesla’s fatal car crash to false facial recognition matches, here are five times AI failed to deliver.

AI has progressed remarkably in the last couple of decades. What was once deemed possible only in the realm of fiction such as Men in Black or The Matrix, is now a reality.

Today, from health, fashion, and property, to food and travel, AI is rampant across industries. Its popularity has surged so much that it has even given life to some unusual applications.

However, it’s not all peaches and cream. According to a survey of global organizations that are already using AI, a quarter of surveyed companies reported up to 50% failure rate of their AI projects.

Often, AI meant to solve problems can end up becoming the source of new problems. Here, we take a look at the biggest AI failures that made headlines for all the wrong reasons.

Tesla cars crash due to autopilot feature

Elon Musk’s Tesla found itself in trouble after a Tesla Model S crashed north of Houston, killing two people in April this year. The car had missed a slight curve in the road, leading it to ram into a tree.

As per preliminary investigations and witness statements, the driver’s seat was empty during the crash. As a result, it is believed that Tesla’s Autopilot or Full Self Driving (FSD) system was engaged during the crash.

Tesla’s AI-based Autopilot feature can control steering, acceleration, and in some cases, braking. According to Musk, the AI is designed to learn from drivers’ actions over time.

However, the feature has come under increased scrutiny in recent months due to several crashes involving the vehicle. Recently, in Michigan, a Tesla Model Y, which was on Autopilot, crashed into a police vehicle. Currently, U.S. safety regulators are investigating 30 Tesla crashes since 2016, where advanced driver assistance systems were believed to have been in use.

Several safety advocates have criticized Tesla for not doing enough to prevent drivers from relying heavily on its Autopilot features, or for using them in situations that the feature is not designed for.

Amazon’s AI recruiting tool showed bias against women

Amazon started building machine learning programs in 2014 to review job applicants’ resumes. However, the AI-based experimental hiring tool had a major flaw: it was biased against women.

The model was trained to assess applications by studying resumes submitted to the company over a span of 10 years. As most of these resumes were submitted by men, the system taught itself to favor male candidates. This meant that the AI downgraded resumes with words such as “women’s” (as in the case with “women’s chess club captain”). Similarly, graduates from two all-women’s colleges were also ranked lower.

By 2015, the company recognized the tool was not evaluating applicants for various roles in a gender-neutral way, and the program was eventually disbanded. The incident came to light in 2018 after Reuters reported it.

AI camera mistakes linesman’s head for a ball

In a hilarious incident, an AI-powered camera designed to automatically track the ball at a soccer game ended up tracking the bald head of a linesman instead.

The incident occurred during a match between Inverness Caledonian Thistle and Ayr United at the Caledonian Stadium in Scotland. Amid the pandemic last October, the Inverness club had resorted to using an automated camera instead of human camera operators.

However, according to reports, “the camera kept on mistaking the ball for the bald head on the sidelines, denying viewers of the real action while focusing on the linesman instead.”

Microsoft’s AI chatbot turns sexist, racist

In 2016, Microsoft launched an AI chatbot called Tay. Tay engaged with Twitter users through “casual and playful conversation.” However, in less than 24 hours, Twitter users manipulated the bot to make deeply sexist and racist remarks.

Tay leveraged AI to learn from its conversations with Twitter users. The more conversations it had, the “smarter” it became. Soon, the bot began repeating users’ inflammatory statements, including “Hitler was right,” “feminism is cancer,” and “9/11 was an inside job.”

As the debacle unfolded, Microsoft had to pull the plug on the bot within a day after its launch. Later, Peter Lee, Microsoft’s Vice President of research, issued an apology, stating, “We are deeply sorry for the unintended offensive and hurtful tweets from Tay, which do not represent who we are or what we stand for, nor how we designed Tay.”

False facial recognition match leads to Black man’s arrest

In February 2019, Nijeer Parks, a 31-year-old Black man living in Paterson, New Jersey, was accused of shoplifting and trying to hit a police officer with a car in Woodbridge, New Jersey. Although he was 30 miles away at the time of the incident, the police identified him using facial recognition software.

Parks was later arrested for charges including aggravated assault, unlawful possession of weapons, shoplifting, and possession of marijuana, among others, and spent 11 days in jail. According to a police report, the officers arrested Parks following a “high profile comparison” from a facial recognition scan of a fake ID left at the crime scene.

The case was dismissed in November 2019 for lack of evidence. Parks is now suing those involved in his arrest for violation of his civil rights, false arrest, and false imprisonment.

Facial recognition technology, which uses machine learning algorithms to identify a person based on their facial features, is known to have many flaws. In fact, a 2019 study found that facial recognition algorithms are “far less accurate” in identifying Black and Asian faces.

Parks is the third known person to be arrested due to false facial recognition matches. In all cases, the individuals wrongly identified were Black men.

Ultimately, while AI has grown in leaps and bounds in recent years, it is far from perfect. Going forward, it will be crucial to address its many vulnerabilities for it to truly emerge as a technological driving force for the world.

Header image by Rock’n Roll Monkey on Unsplash

SHARE THIS STORY

Share on facebook
Share on twitter
Share on linkedin
Share on email
Reethu Ravi
Reethu is a Staff Writer at Jumpstart.

RELATED POSTS

OpenSea-Bans-Insider-Trading

OpenSea Bans Insider Trading after Employee Defrauds Buyers

On September 14, 2021, OpenSea, a popular NFT (Non-Fungible Tokens) marketplace startup, admitted to insider trading on their website. Insider trading happens when people—employees or otherwise—use a company’s non-public knowledge to their financial advantage. OpenSea did not reveal the employee’s name; however, Twitter users took advantage of blockchain’s public access and transparency to ascertain who did it.

Traditional vs Influencer Marketing

Traditional vs Influencer Marketing: Influencer Culture in Entrepreneurship

In a day and age when the average person spends more time scrolling through social media than reading a newspaper, influencers, also known as internet celebrities, have become household names. The fact that their massive followings trust their opinions on various topics, from beauty products to online courses, is constantly transforming the dynamic landscape of marketing and entrepreneurship.

Chinese Crypto Crackdown

Understanding the Chinese Crypto Crackdown

In the latest addition to China’s cryptocurrency crackdown, the government of Sichuan province halted all crypto mining activities in the region. The efforts to restrict cryptocurrency mining have also spread to China’s northwestern province of Hebei. The cyberspace commission of Hebei announced on September 14, 2021 that it will cooperate with the central government’s efforts to curb crypto mining and trading.

Turning Rocks into Notebooks

Turning Rocks into Notebooks: A Look at Karst’s No-Tree Paper

Around 42% of wood harvest across the world goes into making paper. The paper industry is a significant contributor to deforestation and consumes 4% of the world’s energy reserve. To mitigate the environmental impact of the paper industry, the Australia-based company Karst has come up with an eco-friendly solution to the world’s paper needs.

How Did Civilians Prepare for the SpaceX Mission

How Did Civilians Prepare for the SpaceX Mission?

Imagine this: you’ve won the lottery and you are going to space, accompanied by a billionaire, in Elon Musk’s aircraft. It sounds like a dream. However, it became a reality for air force veteran Chris Sembroski who won this trip to space in a lottery. Inspiration4”—was launched from Florida and represents the first all-civilian crew heading to space. The journey aims to raise funds for St. Jude Children’s Research Hospital.

What Causes Inflation and Are Banks Worried about It Post-COVID

What Causes Inflation and Are Banks Worried about It Post COVID?

The global inflation rate in 2020 reached 3.2%, well above the acceptable rate of 2%. This rise in prices is known as inflation, and this was an issue heavily discussed at the Central Bank Jamboree Conference 2021. It indicates that the prices of most everyday products and services, such as food, clothing and housing, increased, as did their demand due to the pandemic.