Microsoft's new AI tool wants to find and fix AI-generated text that's factually wrong
Experts warn hallucinations are here to stay, but Microsoft has a fix
· TechRadarNews By Ellen Jennings-Trace published 25 September 2024
Microsoft has unveiled a new tool which looks to stop AI models from generating content that is not factually correct - more commonly known as hallucinations.
The new Correction feature builds on Microsoft's existing ‘groundedness detection’, which essentially cross-references AI text to a supporting document input by the user. The tool will be available as part of Microsoft’s Azure AI Safety API and can be used with any text generating AI model, like OpenAI’s GPT-4o and Meta’s Llama.
The service will flag anything that might be an error, then fact check this by comparing the text to a source of truth via a grounding document (i.e. uploaded transcripts). This means users can tell AI what to view as fact in the form of grounding documents.
A stop gap measure
Experts warn that whilst the existing state of play may be useful, it doesn’t address the cause of hallucinations. AI doesn't actually ‘know’ anything, it only predicts what comes next based on the examples it is trained on.
"Empowering our customers to both understand and take action on ungrounded content and hallucinations is crucial, especially as the demand for reliability and accuracy in AI-generated content continues to rise," Microsoft noted in its blog post.
"Building on our existing Groundedness Detection feature, this groundbreaking capability allows Azure AI Content Safety to both identify and correct hallucinations in real-time before users of generative AI applications encounter them."
The launch, available in preview now, comes as part of wider Microsoft efforts to make AI more trustworthy. Generative AI has struggled so far to gain the trust of the public, with deepfakes and misinformation damaging its image, so updated efforts to make the service more secure will be welcomed.
Are you a pro? Subscribe to our newsletter
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
Contact me with news and offers from other Future brandsReceive email from us on behalf of our trusted partners or sponsors