Use of artificial
intelligence can be tricky for journalists. While AI is useful
in mining information and analysis, the very information and
analysis it fetches needs to be scrutinised.Examples of AI going awry:
- AI may not be up to date on local matters. Nearly two months after the Kerala Ministry led by V. D. Satheesan assumed office, AI was asked who the Chief Minister of Kerala is. It replied Pinarayi Vijayan. When pointed out that Pinarayi Vijayan had been voted out in the elections, the AI corrected itself. Few days later, when asked who the Opposition Leader was, it named Pinarayi Vijayan with a caveat that the status may change with frequent elections! But there was no caveat when asked who the US president is.
- Chatgpt and Gemini could not compile correct data from Election Commission of India during the recent Kerala elections. In fact, the initial data was fetched by the AIs from somewhere else and was grossly erroneous. When this was pointed out, they wrote scripts to scrap data which too did not work because of misconfiguration or blocks at the ECI servers. Grok did better but erred in fetching certain totals from result sheets.
- Co-pilot was asked to analyse pros and cons of a recent demerger proposal of Kitex group of companies from the shareholders' perspective. It came up an analysis which was general and in uncertain terms. On further prompting, it admitted that it could not access the specified notice from company from Onedrive. When the file was uploaded, it could not handle it because the file size exceeded the limit of 150 MB. Gemini gave wrong analysis regarding share allocations but corrected it on further prompting. In both cases, reliability was absent on first round and improved when specific queries were made.
- AI can fail even with simple prompts for comparison of phones. Gemini claimed Samsung Galaxy S25 was value for money compared to Samsung Galaxy S26; at the same time, fetching lower quotes for S26 which had better features. When this was pointed out, the AI corrected itself. Asking AI for validation of its own output could help, but only to some extent. The advice for journalists as well as others is to verify everything that is of consequence independently.
Roy Mathew/August 2026