There are thousands of papers on the color of the sun, its trivial to google a paper, if you need an LLM to do this, that’s on you. But if you ask it valve clearances for an indonesian motorbike in english, it will make it up, even though the service manual is available in Indonesian. If you ask it how to synthesize a chemical that nobody bothers to write about because its uninteresting or impossible, it will straight up lie.
OK, instead of “lie”, I should have said it produces incorrect information any time the answer isn’t obvious from a cursory google search, and does so in a way that deceives anyone who isn’t already familiar enough with the subject that they didn’t need to ask in the first place.
It’s fine for asking it to generate answers you could have typed out yourself, such as boilerplate code and “what color is the sun”.
There are thousands of papers on the color of the sun, its trivial to google a paper, if you need an LLM to do this, that’s on you. But if you ask it valve clearances for an indonesian motorbike in english, it will make it up, even though the service manual is available in Indonesian. If you ask it how to synthesize a chemical that nobody bothers to write about because its uninteresting or impossible, it will straight up lie.
i think that learning to prompt AI is somthing people lack as a skill and then call it bad and a liar like its some intelligence when it isn’t
OK, instead of “lie”, I should have said it produces incorrect information any time the answer isn’t obvious from a cursory google search, and does so in a way that deceives anyone who isn’t already familiar enough with the subject that they didn’t need to ask in the first place.
It’s fine for asking it to generate answers you could have typed out yourself, such as boilerplate code and “what color is the sun”.
IMHO, the real problem is that it sounds just as “confident” whether the answer is accurate or not.