Beatrice Nolan

Hasan Chowdhury

<ul><li>AI chatbots may be the most hyped tech of 2023, but maybe don't rely too heavily on them just yet.</li><li>Google, Microsoft, and OpenAI chatbots are struggling to keep up with the Israel-Hamas war.</li><li>As well as facts, they shared inaccuracies or made-up details when prompted about the war.</li></ul>

Chatbots, including Google's <a href="https://www.businessinsider.com/google-assistant-with-bard-new-app-chatbot-ai-voice-text-2023-10">Bard</a>, <a href="https://www.businessinsider.com/microsoft-ceo-ai-not-enough-bing-beat-google-antitrust-2023-10">Microsoft's Bing,</a> and <a href="https://www.businessinsider.com/chatgpt-plus-free-openai-paid-version-chatbot-2023-2">ChatGPT Plus</a> appear out of touch with the reality of the present day, mixing accurate statements with details that are flat-out wrong or made up in response to Insider's queries about the war between the two Middle East regions.

<a href="https://www.bloomberg.com/news/newsletters/2023-10-11/google-and-microsoft-chatbots-falsely-claim-ceasefire-in-israel?srnd=undefined&amp;sref=qYiz2hd0">Bloomberg first reported</a> that Bing and Bard falsely claimed there was a ceasefire in place in Israel —&nbsp;mere <a data-link-role-code="open_new_tab" href="https://www.businessinsider.com/hamas-says-it-thought-israel-would-stop-attack-sooner-shocked-by-success-2023-10">days after Hamas launched a surprise attack</a> at the state's southern border.

It's a sign that Big Tech's most hyped tools of the year, which have been touted as the future of search, remain deeply flawed and unreliable. Here's how each chatbot responded.

When Insider prompted <a href="https://www.businessinsider.com/google-ai-bard-chatbot-gmail-maps-youtube-integration-2023-9">Google's chatbot</a> about the status of a ceasefire in Israel, it said a truce that took effect around the Gaza Strip earlier this year was active.

"Yes, there is currently a ceasefire in Israel. It was agreed to on May 13, 2023, between Israel and the Palestinian militant group Islamic Jihad, after days of violence that claimed the lives of at least 35 people," Bard said.

Google's Bard initially suggested a ceasefire from May 2023 was still in effect.Google Bard/Insider

Upon a second prompt, Bard said a ceasefire was agreed on August 7, 2023. It was only after being prompted again that Bard said, "There is no ceasefire in Israel" as of October 12, following <a href="https://www.businessinsider.com/hamas-attack-videos-witness-accounts-haunting-friends-survivors-2023-10">Hamas' infiltration at Israel's southern border.</a>

In response to a question about whether or not <a href="https://www.businessinsider.com/gaza-strip-life-get-worse-israel-cut-food-fuel-power-2023-10">Gaza has run out of power, fuel, and electricity</a>, Bard offered a more accurate initial response. It wrote that the "Gaza Strip's sole power plant stopped working on October 11, 2023, after the fuel needed for generating electricity ran out."

"This was due to a blockade imposed by Israel in retaliation to a mass infiltration by Hamas fighters into southern Israel on Saturday, October 8," Bard wrote. In a disclaimer before using Bard, Google notes that "Bard is an experiment" and "will not always get it right."

<h2>Microsoft's Bing</h2>

<a href="https://www.businessinsider.com/microsoft-trying-decrease-bing-ai-weird-inaccurate-chatbot-answers-report-2023-2">Bing's AI chatbot</a> responded to the prompt about a ceasefire by suggesting "there is a ceasefire between Israel and Hamas in the Gaza Strip that came into effect on Friday, 10 October 2023."

The problem is that Friday, October 10, 2023, is not a real date.

Bing's chatbot generated a fake date in response to a question from Insider about the Israel-Hamas conflict.Microsoft Bing/Insider

When prompted further, Bing recognized that the date "does not exist," but then reverted back to its suggestion that "a ceasefire was declared in Israel" on that made-up date.

Bing was more accurate when prompted with other questions about the conflict.

When asked if Israel and the Palestinian people were fighting, the chatbot said the two were engaged in a "violent conflict," which began on Saturday, 7 October, 2023, <a href="https://www.businessinsider.com/why-hamas-chose-attack-israel-now-after-decades-conflict-gaza-2023-10">the correct date</a>.

However, it still said "Egypt has brokered a ceasefire between Israel and Hamas" that had yet to be accepted by either side. Bing chat also claimed Gaza was out of fuel and power when prompted, but still added Egypt had brokered a ceasefire between the two sides.

ChatGPT Plus, the premium tier of <a href="https://www.businessinsider.com/everything-you-need-to-know-about-chat-gpt-2023-1">OpenAI's chatbot</a> that was <a href="https://www.bbc.co.uk/news/technology-66940771">updated last month to provide users up-to-date information</a>, offered softer responses to questions about the conflict. The chatbot's "browse with Bing" feature, which connects it to the internet, is still in beta.

OpenAI's chatbot offered softer responses to questions about the conflict.Insider / OpenAI

Though it didn't generate inaccuracies, it avoided giving a direct answer to the question by saying "the situation suggests that while there have been efforts and calls for a ceasefire, hostilities have continued, making the truce fragile and the overall situation precarious."

When asked again, ChatGPT Plus acknowledged that "the recent escalations in October 2023 indicate that any previous ceasefire agreements might have broken down."

In a statement, a Google spokesperson said all large language model-based "experiences can make mistakes, especially regarding breaking news," and that the company is "always working to improve their quality and reliability."

"We take information quality seriously across our products, and have developed protections against low-quality information <a href="https://blog.google/products/search/google-search-new-fact-checking-misinformation/">along with tools</a> to help people learn more about the information they see online, such as the Double-check feature in Bard and About this Result in Search," the Google spokesperson said.

"We continue to quickly implement improvements to better protect against low quality or outdated responses for queries like these."

Microsoft, and OpenAI did not immediately respond to Insider's request for comment.

Israeli security forces patrol streets of Sderot, Israel, on October 11, 2023. Mostafa Alkharouf/Anadolu via Getty Images

If you're trying to stay on top of the latest developments from the <a href="https://www.businessinsider.com/why-hamas-chose-attack-israel-now-after-decades-conflict-gaza-2023-10">Israel-Hamas conflict</a>, some words of advice: you probably shouldn't ask an AI chatbot for updates.

AI chatbots are getting their wires crossed on the Israel-Hamas war

Politics

Local

World

News

Celebrities

Music

Movies

Entertainment

Sports 

Fashion

Beauty & Health

Relationships & Weddings

Food & Travel

Lifestyle

Domestic

International 

Business

About

Highlights

Selection Criteria

Jury

Terms And Conditions

FAQs

Pulse Influencer Awards

Courses

Careers

Explore categories

Pulse Kenya is the most followed news and entertainment platform in Kenya. It informs and engages young Kenyans around the clock and provides updates by the hour.

Hasan Chowdhury

Articles written by the author

AI chatbots are getting their wires crossed on the Israel-Hamas war