A new study from Forum AI found that ChatGPT, Gemini, Claude, and Grok provide inaccurate answers when asked about elections and geopolitical topics. The findings raise concerns about AI reliability on critical information.
Four major chatbots—OpenAI's ChatGPT, Google's Gemini, Anthropic's Claude, and xAI's Grok—struggle to deliver fair and accurate responses on elections and news-related questions, according to research by Forum AI.
The startup's survey revealed a pattern of unreliable outputs across the industry's leading AI models when handling sensitive topics like geopolitics and electoral information. This comes as these chatbots gain widespread adoption for news consumption and information retrieval.
Forum AI CEO Campbell Brown attributed the problem to a systemic issue within the AI industry: companies are essentially "grading their own homework" when it comes to evaluating their models' performance. She argued this self-assessment approach lacks the necessary external oversight to catch and correct accuracy problems before deployment.
The findings underscore growing tensions between AI capabilities and real-world reliability. As chatbots become increasingly integrated into how people access news and political information, their propensity for inaccurate answers poses potential risks to informed decision-making, particularly during election cycles.
The study does not specify the exact nature of the inaccuracies—whether chatbots hallucinate entirely false information, present biased perspectives, or conflate multiple events. However, the broad finding suggests all four major models share common accuracy gaps on these high-stakes topics.
Industry observers point to the challenges of training large language models on complex, contextual information with multiple valid interpretations. News and election coverage inherently involves nuance, and chatbots have historically struggled with topics requiring real-time updates or detailed factual precision.
Brown's call for independent evaluation reflects a broader push for third-party auditing of AI systems before public release. As regulators worldwide consider AI governance frameworks, transparency in model performance—particularly on societal topics—has become a key regulatory concern.
The research highlights a critical gap between public perception of chatbot reliability and their actual performance on consequential subjects.
Prime Minister Anthony Albanese will frame artificial intelligence as a pivotal societal moment comparable to the renewable energy transition in a speech this week. The address will address AI safety concerns but will not include updates on copyright protections for artists.
Finnish AI lab NestAI Oy is deploying an AI engine for the Finnish and Estonian militaries to build independent models for military operations and autonomous systems.
A coalition of 200 economists and AI leaders has issued a stark warning about artificial intelligence's impact on employment. The group signals consensus that significant disruption to the labor market is coming.
Apple has released the first public betas of iOS 27, iPadOS 27, macOS 27 Golden Gate, watchOS 27, and tvOS 27. The rollout marks the public debut of Apple's redesigned Siri AI across its entire ecosystem.