This is why generative AI is a mistake.
If they're just automatically giving incorrect answers how is that any better than the correct answers Google used to give? If something is experimental then you shouldn't be putting it out there unless you know it works perfectly. The question is are they experimenting on AI or are they experimenting on us to see if we're dumb enough to fall for it?