cross-posted from: https://programming.dev/post/3974080
Hey everyone. I made a casual survey to see if people can tell the difference between human-made and AI generated art. Any responses would be appreciated, I’m curious to see how accurately people can tell the difference (especially those familiar with AI image generation)
Removed by mod
Same. On the plus side, I guess we will happily trundle along to our inevitable doom, led by our impossible-to-identify AI overlords!
I only guessed a single one as generated by AI and I was wrong on that (the mouse in the boat drawing felt like unusual shaping and shading for a human). I really could not identify any telltale signs of AI in any of them, so answered entirely honestly that none of the others looked like AI generated.
To be honest, I expected that. The telltale signs people often talk about are only problems for bad AI art. Well done AI art really is indistinguishable. Stuff like weird fingers, faces, and teeth are only problems if the prompter is lazy and just picks the first thing generated (and doesn’t selectively regenerate). If you’re selective, you can get AI art without the things some people claim make AI art easy to recognize.
It’s like photoshop or movie CGI. Anyone can detect a bad photoshop and we’re used to seeing those. But well done photoshops by experts can be near impossible to detect (short of careful pixel level inspection, which doesn’t really apply to AI art). Yet, a lot of people are over confident in how well they can spot photoshops.
I wonder if this will change anyone’s mind? I’ve always wanted to do this for a few topics, including AI. I’ve also wanted to do this for trans vs cis people (so many transphobes claim they can “always tell”), movie CGI vs practical effects (see also: Captain Disillusion videos), and for various kinds of food and drink (so many people are elitist that something tastes better – simple example that I’ve actually seen disproven is the various kinds of eggs, including store bought vs locally sourced).
The scenery ones are near impossible to tell because you have no context. The pencil art one is impressive though.
There are things you can look for. When it isn’t generated, you can spot parts where the artist got lazy. Sometimes, if the art style allows for it, you can spot simple shapes that are left over, and the lighting.
Also things like the butterfly in one of them look off in a way that a human who’s seen one won’t draw it as if they’re actually capable of the rest of the image
The butterfly was sus, but I’ve seen my fair share of horrendous horses in broadcast anime. I was tipped off, but I didn’t judge off of just that.
I got all the landscape ones correct—except for one—by applying my limited knowledge of art technique.
I did bad.
But I expected to do bad. AI generation has become too good.
You tell yourself you can identify them, because sometimes you notice weird artifacts and spot the AI quickly. But we’re really only noticing the bad ones. We’ll never even know the good ones were AI most of the time, so we can’t balance how good we think we are at spotting them against how often we were actually wrong.
Hands are often a giveaway. The first image for example shows perfect hand proportion - even through a glass. AI isn’t there yet.
Hands are only a give away for bad AI art. There’s no shortage of examples with great hands (especially when using features like Stable Diffusion’s ControlNet, which allows you to give hints to the AI for the shape that something should match). Just so many people posting AI art generate once or twice and post that. If you’re more selective and selectively regenerate, you’ll be able to get much more believable results.
This is also a rapidly changing area, with the most cutting edge AI being way better than something from even a year ago. Used to be that no AI could do even remotely believable text, but in recent weeks, I’ve been seeing many examples of AI art that got small amounts of text perfect.
I was missing a “don’t know”/“can’t determine” option.
For photographs specifically and some types of paintings/artificial stuff, there are things you can look for. But for other things, I feel like, or at least to my knowledge, you can’t.
Like the pencil drawing. There’s not enough things it could be doing wrong. It’s a sketch. With simplistic but “error-excusing”/diffuse/transformable content.
The goal isn’t really to be a quiz, but rather just to see how susceptible people are to AI generated art. Many of the images I chose are intentionally vague, 80% of people so far got the line art sketch wrong, and that’s with knowing that many of these are AI generated. The results are definitely interesting to see.
A “don’t know” option would ruin the point since most people would just choose that. I want to see where people lean towards.
The line art one has a stockphoto watermark still visible in the bottom right corner by the shoe (subtle white cross pattern). That’s the only thing that gave it away as being real.
I don’t think that’s necessarily a dead giveaway. Because there’s been controversy about AI art that added watermarks. The controversy being because it implied the AI was scraping images that it definitely wasn’t allowed to use.
The back left leg of the bench in the pencil drawing is in the wrong place - at least that was what I considered the ‘tell’.
But I found it really hard to spot the AI.
13/20, I work in AI. The paintings were the hardest for me, because the art style obfuscates some of the AI artefacts that can be tells.
I basically came here to say this. The paintings are hard but real life photos are easier.
Yeh, I don’t work in AI but got 12 because the art was difficult. It’s still a while off until it becomes impossible to tell.
14 / 20 here. I dunno why there are so many people, particularly on Reddit, who absolutely hate AI art. Yeah some of it can look janky, uncanny valley, or such but a lot of it looks really damn cool.
And not all of us have talents to create visual art of our own so text creation is much more accessible for us to explore our imaginations. Or lack the money to commission pieces from human artists.
A lot of Redditors don’t even know why they think a certain way, they think that way because everyone else around them thinks that way. There are some legit criticisms of AI art but most of the time it’s just bullshit lip service to artists when they don’t actually care
Yeah I’ve had posts deleted on Reddit before because “ew AI art”. Like, I’m just trying to share interesting images. I’m not profiting off them in any way. But they take it so personally.
Personally, I have no issue with models made from stuff obtained with explicit consent. Otherwise you’re just exploiting labor without consent.
(Also if you’re just making random images for yourself, w/e)
((Also also, text models are a separate debate and imo much worse considering they’re literally misinformation generators))
Note: if anybody wants to reply with “actually AI models learn like people so it’s fine”, please don’t. No they don’t. Bugger off. https://arxiv.org/pdf/2212.03860.pdf here have a source.
This paper is just about stock photos or video game art with enough dupes or variations that they didn’t get cut from the training set. The repeated images were included frequently enough to overfit. Which is something we already knew. That doesn’t really go to proving if diffusion models learn like humans or not. Not that I think they do.
Sure, it’s not proof, but it gives a good starting point. Non-overfitted images would still have this effect (to a lesser extent), and this would never happen to a human. And it’s not like the prompts were the image labels, the model just decided to use the stock image as a template (obvious in the case with the painting).
Non-overfitted images would still have this effect (to a lesser extent),
This is a bold claim to make with no evidence. When every trained image accounts for less than one byte of data in the model. Even the tiniest images file contain many thousands of bytes. One byte isn’t even enough to store a single character of text, most Latin-based alphabets and some symbols, use two bytes.
and this would never happen to a human.
There are plenty of artists that get stuck with same-face. Like Sam Yang for instance. Then there are the others who can’t draw disabled people or people of color. If it isn’t a beautiful white female character, they can’t do it. It can take a lot of additional training for people to break out of their rut, some don’t.
I’m not going to tell you that latent diffusion models learn like humans, but they are still learning. https://arxiv.org/pdf/2306.05720.pdf Have a source.
I recommend reading this article by Kit Walsh, a senior staff attorney at the EFF if you haven’t already. The EFF is a digital rights group who most recently won a historic case: border guards in the US now need a warrant to search your phone.
This guy also does a pretty good job of explaining how latent diffusion models work, You should give this a watch too.
Here is an alternative Piped link(s):
explaining how latent diffusion models work
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I’m open-source; check me out at GitHub.
10/20.
You can only fool me half the time! Joke’s on you, robots!
8/20. I am pretty good on photorealistic images, but the random drawings… honestly a lot of the ones by people I tagged as AI generated because i thought they kinda sucked.
10/20. I thought I got the photorealistic right, but the first 2 I got wrong. The back of the bench being different on the girl with a drink made me think Ai. I still don’t know how that is real, bokeh can’t explain that difference.
FML. 8 out of 20. I suck at this.
Got 8 too. Went on feeling for most of them, but a couple were obvious to me.
Regardless of score bragging, it requires some technical knowledge and pixel peeping to really be able to tell, and even then I can’t guarantee you can. I would imagine your average Joe wouldn’t even know any better.
10/20 and most of it was just guess work. It has become pretty much impossible to tell when you pick real images that are in the style of AI images, you really have to go pixel hunting to find artifacts and even that is getting difficult, when things get blurry or you get JPEG artifacts when you zoom in.
That said, there are still plenty of images AI has a very hard time creating. Anything involving real world products will always look wonky in AI, interesting framing where you don’t have one object in the center is hard. Unusual aspect ratio are hard, as AI is trained on squares. Complex scenes with multiple characters rarely work. Facial expressions are hard. And generally just normal everyday photos don’t really work, AI stuff always looks like people posing for a stock photo.
9/20 rip
14/20 isn’t bad I guess.
The AI overlords will kill you first. Your victory will be hollow and sour.
Good job!
:(
Nice try robots! I’m not helping you learn how to fool us humans.
Got 10/20. The second photo really threw me for a loop. All the texture on the skin and and hair led me to believe human; I noticed the weird patch on the shoulder and the unnatural shine on the ear but excused it as technical flaws or something, chose human in the end. I really thought that corporate logo style drawing of the avocado was human, like it wasn’t even a question for me and yet the fact that it was AI really surprised me.
I also got 10/20. The second one is fairly obvious, though, in my opinion. Look at the shape of the glasses – the lenses are uneven and don’t match.
