AI Industry Struggles to Curb Misuse as Users Exploit Generative AI for Chaos::Artificial intelligence just can’t keep up with the human desire to see boobs and 9/11 memes, no matter how strong the guardrails are.

  • Wander@yiffit.net
    link
    fedilink
    English
    arrow-up
    67
    arrow-down
    4
    ·
    1 year ago

    One step towards avoiding misuse is to stop considering porn to be misuse.

  • hOrni@lemmy.world
    link
    fedilink
    English
    arrow-up
    48
    arrow-down
    1
    ·
    1 year ago

    I busted out laughing on a public bus while reading grandma’s napalm recipe.

  • brsrklf@jlai.lu
    link
    fedilink
    English
    arrow-up
    44
    arrow-down
    1
    ·
    1 year ago

    Image Credits: Bing Image Creator / Microsoft

    Best part of the article.

  • Praise Idleness@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    46
    arrow-down
    4
    ·
    1 year ago

    You know what else can make elmo knocking up an anime character while smoking pot? Paper and pen. These obsessions with regulating AI usage is not only impossible but also just plain stupid.

      • Praise Idleness@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        22
        arrow-down
        3
        ·
        1 year ago

        Yeah printing is dangerous because it’ll be lot easy to write lewd, dangerous books! Back then you had to hire people to do so!

        • Womble@lemmy.world
          link
          fedilink
          English
          arrow-up
          11
          arrow-down
          2
          ·
          1 year ago

          It honestly been really enlightening for me seeing all the same arguments that were made against the printing press and the camera being made against generative AI for text and images. Shows just how little people have changes over hundreds of years.

        • This is fine🔥🐶☕🔥@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          2
          ·
          1 year ago

          Ah yes, photorealistic images (and videos) are as effective as text.

          Btw that also is an unfair argument because printing technology printed same book many times. You still need an author to write source text.

          AI generates different images within minutes.

          But please continue pretending AI generated images and videos are not a problem.

          • Womble@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            edit-2
            1 year ago

            the printing press decreased the speed of publication by a larger margin (months to hours for a big book like the bible) and aguably kicked off a century of incredibly bloody warfare with luther and then the counter reformation.

            I dont see how being able to get a decent image of Marx with tits from a few mins of generating images is so much more dangerous.

            • This is fine🔥🐶☕🔥@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 year ago

              You still needed writers to come up with a new material for printing press. It only increased distribution of existing material.

              Which isn’t case with machine generated text and images. You can get any hateful or depraved output within minutes.

              • Womble@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                edit-2
                1 year ago

                That was exactly the point the church made against the printing press, without needing scribes anyone could come up with whatever foul heresy they liked and publish it for distribution.

                The chief difference between now and then is what we consider unpermissable. Otherwise the agrument is the same, we cannot trust people to publish whatever they like or terrible things will happen.

          • regbin_@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 year ago

            It’s really not a problem. We have both open source and proprietary solutions for generative AI. If you have the hardware for it, you can generate images locally for free. If you don’t, just use one of the many available services.

            It’s literally giving the power of expression to almost everyone, including artists.

            Also let’s not talk about jobs/money. Technology replacing jobs isn’t something new and that’s what humanity should strive toward.

  • Agent641@lemmy.world
    link
    fedilink
    English
    arrow-up
    40
    arrow-down
    1
    ·
    1 year ago

    Why didnt someone warn us about this? Nobody said this might happen, nobody! Not a single person tried to be the voice of reason!

  • Grass@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    36
    arrow-down
    1
    ·
    1 year ago

    Meanwhile bing images blocks 90% of my generation attempts for unsavory content when the prompt is generally something that should be safe even for kids. Why do we only get the extremes?

  • betwixthewires@lemmy.basedcount.com
    link
    fedilink
    English
    arrow-up
    28
    arrow-down
    1
    ·
    1 year ago

    Misuse lol. People need to get their panties out of their butthole. You build a photo generator and get mad when someone uses it to make a picture of Marx with tits. Who cares? Crybabies can cry about it.

      • saltnotsugar@lemm.ee
        link
        fedilink
        English
        arrow-up
        29
        ·
        1 year ago

        (Verse 1) Yo, gather 'round, let me tell you a tale, ‘Bout some hamsters, small but they set sail, On a mission, like a furry heist, In the dead of night, they were rollin’ dice.

        In a world where cheese was the ultimate prize, These little rodents had that glint in their eyes, They wore tiny masks, had a cunning plan, To rob the bank, be the rodent clan.

        (Chorus) Hamsters in the night, they’re on the run, Stealin’ all the cheddar, it’s just begun, Tiny paws, big dreams, they’re takin’ their chance, Hamsters robbin’ banks, a rodent romance.

        (Verse 2) Through the vents they crawled, like shadows they crept, Crackin’ safes with their claws, while the city slept, Whisperin’ secrets, in their hamster code, No one could stop them, they owned the road.

        Lil’ bandits of the underground, so sly, As they counted their loot, reachin’ for the sky, Hamster wheelin’, they had the skills, Pullin’ off heists for their thrills and thrills.

        (Chorus) Hamsters in the night, they’re on the run, Stealin’ all the cheddar, it’s just begun, Tiny paws, big dreams, they’re takin’ their chance, Hamsters robbin’ banks, a rodent romance.

        (Bridge) But the long arm of the law was closin’ in, Hamster SWAT teams, it was time to begin, A chase through the sewers, down the wire, The hamsters were on the edge, feelin’ the fire.

        (Verse 3) In the end, they were cornered, it was quite a scene, But these hamsters, they were tougher than they seemed, They fought for their freedom, they fought for their cheese, Tiny warriors, brought to their knees.

        But the legend lives on, in the city’s lore, The hamster heist, forevermore, Tiny rebels, brave and bold, Hamster bank robbers, the story’s told.

        (Chorus) Hamsters in the night, they’re on the run, Stealin’ all the cheddar, it’s just begun, Tiny paws, big dreams, they’re takin’ their chance, Hamsters robbin’ banks, a rodent romance.

        Yeah, hamsters robbin’ banks, that’s the story told, In the underground world, where legends unfold, Tiny but mighty, they took that chance, Hamsters with a dream, a rodent romance.

        • gestalt@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          ·
          1 year ago

          Goddamn! Other than a few errors like “thrills and thrills”, this thing seems pretty cohesive!

          Has a small plot and everything. I hope this tech is used to make some insane human-machine collaborations.

  • Hamartiogonic@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    10
    ·
    1 year ago

    This is a part of a bigger topic people need to be aware of. As more and more AI is used in public spaces and the internet, people will find creative ways to exploit it.

    There will always be ways to make the AI do stuff the owners don’t want it to. You could think of it like the exploits used in speedrunning, but in this case there’s a lot more variety. Just like you can make an AI generate morally questionable material, you could potentially find a way to exploit the AI of a self driving car to do whatever you can think of.

  • olsonexi@lemmy.wtf
    link
    fedilink
    English
    arrow-up
    10
    ·
    1 year ago

    It’s so beautifully human that decades of scientific innovation paved the way for this technology, only for us to use it to look at boobs.

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    This is the best summary I could come up with:


    Both Meta and Microsoft’s AI image generators went viral this week for responding to prompts like “Karl marx large breasts” and fictional characters doing 9/11.

    “I don’t think anyone involved has thought anything through,” X (formally Twitter) user Pioldes posted, along with screenshots of AI-generated stickers of child soldiers and Justin Trudeau’s buttocks.

    One Bing user went further, and posted a thread of Kermit committing a variety of violent acts, from attending the January 6 Capitol riot, to assassinating John F. Kennedy, to shooting up the executive boardroom of ExxonMobil.

    In the race to one-up competitors’ AI features, tech companies keep launching products without effective guardrails to prevent their models from generating problematic content.

    Messing around with roundabout prompts to make generative AI tools produce results that violate their own content policies is referred to as jailbreaking (the same term is used when breaking open other forms of software, like Apple’s iOS).

    Midjourney bans pornographic content, going as far as blocking words related to the human reproductive system, but users are still able to bypass the filters and generate NSFW images.


    The original article contains 1,220 words, the summary contains 181 words. Saved 85%. I’m a bot and I’m open source!