Good point. I probably should have stated “using LLMs for technical tasks that anyone cares about the results of”.
I’m not going to claim LLMs are trustworthy, but I am saying that there are ways to ask things that either reduce the odds of it giving you false things or actively cause it to provide wrong answers with misstated or hallucinated context. People who know what they’re doing can get better results out of them. This doesn’t stop them from being the equivalent of a nepo-hire intern, but it could be said to change whether they’re a malicious, apathetic, or semi-eager nepo-hire intern.
And one of the big risks with LLMs is staff who can recognise bullshit or questionable results being replaced with staff who unquestioningly accept whatever results they get. And people reading an “AI summary” of something and assuming it’s actually accurate.
People who know what they’re doing can get better results out of them.
I don’t think that’s true in the way you appear to mean (sorry if I misunderstood). People who are already experts on the subject matter might be able to use better keywords and discard hallucinatory material quicker, but I don’t believe that you can generically “be good at prompting” outside of an area where you have substantial domain knowledge.
And the only way to learn to recognise bullshit involves not using LLMs or other automated tools and working problems out for yourself, not to mention that they’re an “intern” who actually costs the same in computing power as two senior engineers’ salary.
I don’t think that’s true in the way you appear to mean (sorry if I misunderstood). People who are already experts on the subject matter might be able to use better keywords and discard hallucinatory material quicker, but I don’t believe that you can generically “be good at prompting” outside of an area where you have substantial domain knowledge.
There are ways of phrasing LLM requests that can actively induce them to give you made-up bullshit that confirms your pre-existing assumptions. Which is fine if that’s what you want it to produce, but often not what people actually want. For (possibly poor, given I don’t actually use LLMs) example “give me the transcripts for five court cases for assault with a deadly fish” would likely result in five-ish almost-certainly made-up court transcripts. Someone who knows what they’re doing could phrase the prompt to be more likely to say that no such cases exist (assuming no such cases actually exist) instead of just hallucinating them as per the request.
And you might be right about domain knowledge being required for good prompting. But it’s possible to have domain knowledge and still be terrible at asking for what you actually want it to produce.
not to mention that they’re an “intern” who actually costs the same in computing power as two senior engineers’ salary.
Don’t expect me to defend the moronic economic decisions of companies that have jumped on this stupid band-wagon without regard for the actual value (or lack thereof) to their business.
Good point. I probably should have stated “using LLMs for technical tasks that anyone cares about the results of”.
I’m not going to claim LLMs are trustworthy, but I am saying that there are ways to ask things that either reduce the odds of it giving you false things or actively cause it to provide wrong answers with misstated or hallucinated context. People who know what they’re doing can get better results out of them. This doesn’t stop them from being the equivalent of a nepo-hire intern, but it could be said to change whether they’re a malicious, apathetic, or semi-eager nepo-hire intern.
And one of the big risks with LLMs is staff who can recognise bullshit or questionable results being replaced with staff who unquestioningly accept whatever results they get. And people reading an “AI summary” of something and assuming it’s actually accurate.
I don’t think that’s true in the way you appear to mean (sorry if I misunderstood). People who are already experts on the subject matter might be able to use better keywords and discard hallucinatory material quicker, but I don’t believe that you can generically “be good at prompting” outside of an area where you have substantial domain knowledge.
And the only way to learn to recognise bullshit involves not using LLMs or other automated tools and working problems out for yourself, not to mention that they’re an “intern” who actually costs the same in computing power as two senior engineers’ salary.
There are ways of phrasing LLM requests that can actively induce them to give you made-up bullshit that confirms your pre-existing assumptions. Which is fine if that’s what you want it to produce, but often not what people actually want. For (possibly poor, given I don’t actually use LLMs) example “give me the transcripts for five court cases for assault with a deadly fish” would likely result in five-ish almost-certainly made-up court transcripts. Someone who knows what they’re doing could phrase the prompt to be more likely to say that no such cases exist (assuming no such cases actually exist) instead of just hallucinating them as per the request.
And you might be right about domain knowledge being required for good prompting. But it’s possible to have domain knowledge and still be terrible at asking for what you actually want it to produce.
Don’t expect me to defend the moronic economic decisions of companies that have jumped on this stupid band-wagon without regard for the actual value (or lack thereof) to their business.