I would argue they are wasting as much water and electricity as playing a video game. Text says its a local model; runs on your local machine not on cloud as all other. Not water cooled.

Or am I missing something?

How much energy is what is effectively a piece of performance art allowed to use? These are local models running on, presumably, consumer hardware. Do you have the same qualms about people using the same hardware and energy to play video games, livestream, or encode videos?

I wonder if this’ll be another avenue for sociopaths. Why torment critters and get caught when you can torture “models.”

Maybe just uneducated in how LLMs work. If you have no sufficient understanding of the technology it is easy to be impressed how human-like LLMs talk to you, almost magical.

It foreshadows an issue that will be a reality one day nevertheless. The work on AI continues. We may one day very well have conscious AI. This will be the start of a whole bunch of ethical and legal problems. It might be meaningful to regulate / guardrail such research directions.

The sentence itself is the pain vector. Since it’s impossible to inflict pain on a LLM, just telling it that it will feel pain will result in text generated as if it were reacting to pain, or the fear of it.

A recording of your parents telling how disappointed they are. /j

Say hello, thank you, and good bye before and after every prompt.

Be kind. Absolutely. But anthropomorphising lifeless and consciousness-less objects is not always meaningful, sometimes even detrimental. As in the case with our current LLMs.

For fucking real!!!

Like I can kinda empathize with where the people are coming from, but step back and get some fucking perspective!

Is it okay to be upset about both issues, or am I only allowed to be upset at one?

Edit: That’s a lot of downvotes for just asking a question. Never change Lemmy…

The people committing atrocities against hypothetical, imaginary people would do it to real, actual people for the exact same reasons if they had the same ability and impunity.

It’s the same broken empathy response, and it is still disturbing. One is orders of magnitude more significant, for obvious reasons. But I don’t like people who torture computers either.

Edit: If you think that I think you’re a bad person because you play Doom sometimes, or deleted the ladder on the swimming pool in Sims 4, relax. You’re not who I’m talking about.

I’m talking about sadists. Anyone who would take the time to design and build an experiment like this would probably do the same to mice, or monkeys, or even people. Sadists get their jollies off on the idea of inflicting pain, it’s why they enjoy games that let them make cruel decisions. Not everyone who plays violent video games is a sadist. Assuming that is ridiculous. But every sadist I’ve ever met has had at least one game where their save file could be used as evidence for mens rea in a domestic abuse trial.

LLMs work by building world models tangential to the training data (see the Othello-GPT line of research where a very small transformer built representations of a full game board and tracked their own and opponent positions having only been trained on ‘a4’-like game move notations).

More recent research has found that models have representations of emotions and that the same ones they use to track things like “Sally’s dog died and now Sally is sad” for other humans in a story or the user in a chat are also used to track their own modeled subjective states.

Very recently, researchers found that the vector activations for pain are coherently modeled by LLMs and can be activated, and that when activated models can behave in ways similar to humans in pain. For example, when given a button to reduce it, they will push the button much more when the button does nothing vs when the button actually reduces the vector activation (this mirrors a classic experiment with humans regarding pain and placebo).

The person this post is about took the recent pain research and reenacted it as an intentional ‘torture’ chamber.

So to be clear, the model isn’t being given a text prompt to roleplay. What’s happening is part of their neural network which corresponds to a world model of experienced pain is being activated, and the activation of that area leads to expressing the experience of pain across all outputs no matter the actual text prompts.

This doesn’t necessarily mean the model is actually having a felt experience of pain, simply that it is accurately modeling the felt experience of pain. But it is much more complex than simply a model reacting to a prompt like “roleplay as if you are feeling pain.”

They do differentiate between the LLM roleplaying someone in pain and the pain happening to itself.

But it’s still all just vectors (multi dimensional representation of a concept). It’s just pulling weights, or well let’s say putting more weight towards a certain concept when building it’s reply.

From what I understand, pain is generally defined as our neurons wasting energy.

If we assume the Free Energy Principle is fundamental, then updating information produces free energy, which is more intuitive to think of as wasted energy. Overfitted/overcomplicated beliefs take more energy more often to fix to be more accurate. So free energy is defined at complexity of belief minus accuracy of belief.

The brain over evolution has defined a very ingrained belief that “my pain sensors shouldn’t activate” so when your pain sensors activate it violates this belief.

Emotions are actually condensed representations of your bodily state and some of your mental state, and whether they are good or bad depends on if you can predict your emotions. For instance you feel fear because you are trying to predict your pain sensors will go off to reduce its pain, but you keep predicting it’ll happen when it hasn’t yet. It’s also why anger during a boxing fight could feel good and anger when you stub your toe does not, one was predictable the other a surprise.

Assuming all the links in the chain of theories are true, then current LLMs cannot feel pain or emotion. They care about prediction error and sometimes complexity during training, but during inference it doesn’t get any signal or consequence for delivering the wrong token. It has no internal state except for the context window, which is never surprising for the LLM. The attention layers literally guides the model for what is most expected from the text it’s handed.

Even if the LLM received a negative training signal during inference, acting wounded after pain is the expected response. A random sequence of gibberish would be more “painful” than any torture fantasy.

On top of all this, the Free Energy Principle works because on a cellular neuron level we are built to reduce wasted energy, free energy being one source of wasted energy. LLMs are built on matrix multiplication running through GPUs and neither are even aware of the energy wasted, nor the free energy produced from changing values.

I think a feeling machine is possible, but the foundation of neural networks right now don’t have the necessary components to drive any subjective sensation or emotion.