So far I tested deepseek r1:7b and llama3.2 post on the fediverse and on detecting AI content (I have no shortage of AI content). Seems like llama3.2 takes preforms worse at detecting AI content compared to deepseek but works quicker. I’m not working with any graphics cards. Deepseek model be really good at generating replies with the right prompt, but it does take several minutes to run. No one has said anything about AI text I submitted other than reply I made to the wrong person and people are even sharing and liking the AI produced text
Doing this research transparently is a good idea, it will only be a matter of time before other actors will try and use LLMs to influence lemmy. Like spam, bots and farms, this is a reality the fediverse will have to deal with eventually. Better start preparing now.
It’s interesting that the deepseek AI can blend in. It made a post like it really visited a waterfall. It didn’t say anything too specific as to make it obvious it wasn’t there(maybe that the weather was good in this time of year in March). So it will require looking at multiple posts or maybe even interacting to spot the bot.
These boys can definitely blend in and then run script that can push an ideology. I won’t make more than 1 since I don’t have the resources
How does generating engagement using AI do anything but add to the noise that actual people have to filter though?
With technology like this, it’s only a matter of time before big players start using it all over the internet, whether for commerce, propaganda, or pushing their agenda. So it’s interesting to observe an amateur trying it right now and sharing their findings. If anything, it might give us a glimpse of what the future holds.
I’ll give you some advice. It’s better to state why you don’t want me to test so at all. Asking questions just comes off as standoffish. Plus the way you phrases your question exposes that you have no intention of understanding me
I don’t want it as it makes posts feel hollow and evaporates any desire to engage. Since the Ai is not going to have a real option i value. So it just adds to noise and just looks like more sophisticated spam.
Don’t engage with the troll. Just block them ;)
Yeah you are right, i blocked them . thanks I guess I lost my head there for a second.
You can’t know any of that since you most likely haven’t interacted with the bot. Plus I don’t know “real option” is supposed to mean
I don’t care however convincing the bot is. I go to the fediverse to interact with genuine thoughts from genuine people, not just fancy autocompletion machines.
Do you generate replies in a custom way every time, adjusting the prompt and supervising the result, or do you have fully-automatic system? If you do use any sort of manual intervention on per post basis, whatever you’re doing is not going to work as a bot.
Rn I’m supervising the response and iterating the prompt. I haven’t even implemented a scraper or api. I haven’t fully botted it yet because I don’t know the architecture I want. Like do I even want ai detector or a script that puts in grammar mistakes or an basic algorithm to pick prompts