User avatar
Fi 🏳️‍⚧️ @munin@infosec.exchange
5mo
So, something that's been bugging the shit out of me?

These fucking assholes who let LLMs run rampant and delete prod?

They query the LLM for "why" it did that.

This is delusional behavior.

LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

LLMs do not have the ability to have motivation. It is a machine.

LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

It cannot have a why;
It cannot have a self to have motivations;
And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

Touch some grass and get a fucking therapist.
6
8
0
0
User avatar
🪨 @Varpie@peculiar.florist
5mo
@munin Well... As you mentioned, each generation "reads the prompt and any cache, if they exist, from prior session", and since they were trained on "explaining" their previous outputs to sound like a relevant discussion, asking why a model gave a specific output isn't as stupid as you make it out to be, as it can give some input on the "thinking" part of the previous output that is usually not directly visible. That can then be used to tweak prompts and add some guardrails (even though there is a fairly long list of examples of guardrails not being fully effective). Of course, the first problem is giving access to prod to an unreliable system...
⭐1
2
0
0
1
User avatar
Landa ​:graz:​ @Landa@graz.social
4mo
@Varpie
What kind of usually not directly information do you mean?

@munin
1
0
0
0
User avatar
🪨 @Varpie@peculiar.florist
4mo
@Landa @munin AI tools like Claude Code use "reasoning" models that go through extra steps of "reasoning" that is basically just models trained to mimic human reasoning and split the problem into sub-problems, before a last processing phase with that extra context. This "reasoning" phase is usually hidden from the interface, where for instance Claude Code has a spinner and some verbs like "Thinking", "Crafting", etc. that are shown, but it may still be in the context of the discussion, making subsequent queries asking for information about it relevant.
⭐1
0
0
0
1