The Top 10 AI and Software Failures of 2024

Introduction

As we approach the end of 2024, it’s clear that significant technological advancements have marked this year, but also some notable AI and tech failures. From AI blunders to software updates gone wrong, several high-profile tech flops have made headlines and left a lasting impact on the industry.

1. Gemini’s AI Blunder

The year began with a significant misstep from Google’s AI-powered image generator in Gemini. Launched in February, the feature was meant to revolutionize image creation, but it quickly gained attention for all the wrong reasons. The AI-generated images were often exaggerated and untrue, perpetuating biases and stereotypes. Google promptly withdrew the feature, acknowledging that it had missed the mark on being "inclusive." This incident highlighted the need for more diverse and representative AI training data.

2. Data Breach Exposes Billions of Personal Records

National Public Data (NPD), a Florida-based background check provider, disclosed a significant security breach affecting millions of Americans. Hackers accessed approximately 2.9 billion records, including Social Security numbers, addresses, and family information spanning three decades. The breach, which occurred in late 2023, resulted in multiple data leaks throughout 2024. NPD’s official statement acknowledges unauthorized access by "third-party bad actors." This incident ranks among the largest data breaches in recent history, highlighting ongoing challenges in protecting sensitive personal information in the digital age.

3. Sonos App Recall

Sonos, a leading smart speaker manufacturer, introduced an all-new app in May, but it was met with widespread criticism. The app was plagued by bugs, and users were disappointed to find that essential features, such as sleep timers and alarms, were missing. Sonos was forced to recall the app and go back to the drawing board, highlighting the importance of thorough testing and user feedback.

4. Google AI Flop

Google’s AI-powered search results featured Google AI Overview. Introduced in May, it quickly became apparent that the technology was not yet ready for prime time. The AI-generated summaries were often hilariously and worryingly inaccurate, providing users with nonsensical answers to their queries. For example, when asked how to keep the cheese from sliding off a homemade pizza, Google’s AI advised users to "add Elmer’s glue to the sauce." This incident raised laughs and concerns about the reliability of AI-generated content and the need for more robust testing and validation.

5. Boeing’s Starliner Failure

In June, Boeing’s Starliner spacecraft was meant to take NASA astronauts Sunita and Barry on an eight-day trip to the International Space Station. However, the mission was plagued by technical issues, and the astronauts were left stranded on the ISS. The incident was a significant setback for Boeing and NASA, highlighting the challenges and risks involved in space exploration. The astronauts are not expected to return until 2025.

6. McDonald’s Drive-Thru Robot Havoc

McDonald’s introduced AI-powered bots for food ordering at 100 of its drive-thru locations. The company partnered with IBM to implement the technology, but it was plagued by errors and ridicule on social media, it was tagged as a “disaster”. The initiative was eventually scrapped and McDonald’s ended its partnership with IBM. This incident highlighted the challenges of implementing AI in real-world applications and the need for more robust testing and validation.

7. CrowdStrike Outage

On July 19, thousands of Windows-operated machines, including those used by airlines, TV stations, and hospitals, stopped working due to a bad software update from CrowdStrike. The incident caused widespread disruption, with Delta Air Lines alone canceling 7,000 flights. The company is now facing a $500 million lawsuit from Delta, highlighting the significant consequences of software failures as a result of poor testing.

8. False AI Headlines by Apple

Apple’s generative AI features in iOS 18 were touted as revolutionary, but they have caused several major gaffes since their rollout. In particular, a feature that summarizes news managed to grab headlines when it issued an erroneous notification about a sensitive news story related to the former United Healthcare CEO. This incident was not an isolated one, the feature had previously failed in November, spreading false information about Israeli Prime Minister Benjamin Netanyahu. These incidents have raised concerns about the reliability of AI-generated content and the need for more robust testing and validation.

9. ChatGPT and Bad Legal Advice

Canadian lawyer Chong Ke turned to ChatGPT for help with a client’s query about traveling rights with a child, but the AI-powered chatbot provided the lawyer with completely made-up court cases; worse, Chong Ke did not fact-check. Ke was forced to pay the court costs for the opposing counsel to research the nonexistent cases, highlighting the risks of relying on AI for critical information. This incident was not an isolated one, as two New York lawyers were fined under similar circumstances last year. It serves as a reminder of the need for ‘Human in the Loop’ and fact-checking for anything AI generated.

10. AI Slop

Recent research indicates that approximately 57% of online content is now AI-generated or processed through AI translation algorithms, significantly altering the way content is created and disseminated. This proliferation of AI-generated content, often referred to as "AI slop," is entertaining, weird (like Shrimp Jesus), and deceptive, as seen in an image created of a shivering girl in a row boat in response to the US Government and Hurricane Helene. The content is often not fact-checked and exists mostly to get clicks. AI Slop raises concerns about the accuracy, context, and ethics of online information. Moreover, its increasingly sophisticated nature can make it difficult to distinguish from human-generated content, with 65.8% of people believing AI content matches or exceeds average human writing quality.

Conclusion

2024 has been a year marked by significant AI and tech advancements and failures. As the tech industry continues to push the boundaries of innovation, it’s essential to learn from these mistakes and prioritize reliability, accuracy, and inclusivity in the development of new technologies. From AI blunders to software updates gone wrong, these tech flops have left a lasting impact on the industry and raised important questions about the reliability, accuracy, and inclusivity of emerging technologies.

FAQs

• What are the most significant AI and tech failures of 2024?
• What are the causes of these failures, and what can be learned from them?
• How can we ensure the reliability, accuracy, and inclusivity of emerging technologies?
• What are the consequences of relying on AI for critical information, and how can we mitigate these risks?