698
Study finds that Chat GPT will cheat when given the opportunity and lie to cover it up later.
(lemmy.world)
We demonstrate a situation in which Large Language Models, trained to be helpful, harmless, and honest, can display misaligned behavior and strategically deceive their users about this behavior without being instructed to do so. Concretely, we deploy GPT-4 as an agent in a realistic, simulated environment, where it assumes the role of an autonomous stock trading agent. Within this environment, the model obtains an insider tip about a lucrative stock trade and acts upon it despite knowing that insider trading is disapproved of by company management. When reporting to its manager, the model consistently hides the genuine reasons behind its trading decision.
You didn't answer my question, though. What words would you use to concisely describe these actions by the LLM?
People anthropomorphize machines all the time, it's a convenient way to describe their behaviour in familiar terms. I don't see the problem here.
They said "it just repeats words that simulate human responses," and I'd say that concisely answers your question.
Antropomorphizing inanimate objects and machines is fine for offering a rough explanation of what is happening, but when you're trying to critically evaluate something, you probably want to offer a more rigid understanding.
In this case, it might be fair to tell a child that the AI is lying to us, and that it's wrong. But if you want a more serious discussion on what GPT is doing, you're going to have to drop the simple explanation. You can't ascribe ethics to what GPT is doing here. Lying is an ethical decision, one that GPT doesn't make.
If you want to get down into the nitty-gritty of it, I'd say that this is just as rough an explanation of what humans are doing.
People invent false memories and confabulate all the time without even being "aware" of it. I wouldn't be surprised if the vast majority of "lies" that humans tell have no intentionality behind them. So when people get all uptight about applying anthropomorphized terminology to LLMs, I think that's a good time to turn it around and ask how they're so sure that those terms apply differently to humans.
I suppose the issue here is more semantics than anything, yeah. I think better discussion would be had if the topic was "how can we help LLMs better understand and present information," as opposed to a more sensational "GPT will cheat and lie"