A Florida man is facing 20 counts of obscenity for allegedly creating and distributing AI-generated child pornography, highlighting the danger and ubiquity of generative AI being used for nefarious reasons.

Phillip Michael McCorkle was arrested last week while he was working at a movie theater in Vero Beach, Florida, according to TV station CBS 12 News. A crew from the TV station captured the arrest, which made for dramatic video footage due to law enforcement leading away the uniform-wearing McCorkle from the theater in handcuffs.

  • ReallyActuallyFrankenstein@lemmynsfw.com
    link
    fedilink
    English
    arrow-up
    110
    arrow-down
    3
    ·
    edit-2
    4 months ago

    It’s hard to have a nuanced discussion because the article is so vague. It’s not clear what he’s specifically been charged with (beyond “obscenity,” not a specific child abuse statute?). Because any simulated CSAM laws have been, to my knowledge, all struck down when challenged.

    I completely get the “lock them all up and throw away the key” visceral reaction - I feel that too, for sure - but this is a much more difficult question. There are porn actors over 18 who look younger, do the laws outlaw them from work that would be legal for others who just look older? If AI was trained exclusively on those over-18 people, would outputs then not be CSAM even if the images produced features that looked under 18?

    I’m at least all for a “fruit of the poisoned tree” theory - if AI model training data sets include actual CSAM then they can and should be made illegal. Deepfaking intentionally real under 18 people is also not black and white (looking again to the harm factor), but also I think it can be justifiably prohibited. I also think distribution of completely fake CSAM can be arguably outlawed (the situation here), since it’s going to be impossible to tell AI from real imagery soon and allowing that would undermine enforcement of vital anti-real-CSAM laws.

    The real hard case is producing and retaining fully fake people and without real CSAM in training data, solely locally (possession crimes). That’s really tough. Because not only does it not directly hurt anyone in its creation, there’s a possible benefit in that it diminishes the market for real CSAM (potentially saving unrelated children from the abuse flowing from that demand), and could also divert the impulse of the producer from preying on children around them due to unfulfilled desire.

    Could, because I don’t think there’s studies that answers whether those are true.

    • mpa92643@lemmy.world
      link
      fedilink
      arrow-up
      37
      arrow-down
      9
      ·
      4 months ago

      I mostly agree with you, but a counterpoint:

      Downloading and possession of CSAM seems to be a common first step in a person initiating communication with a minor with the intent to meet up and abuse them. I’ve read many articles over the years about men getting arrested for trying to meet up with minors, and one thing that shows up pretty often in these articles is the perpetrator admitting to downloading CSAM for years until deciding the fantasy wasn’t enough anymore. They become comfortable enough with it that it loses its taboo and they feel emboldened to take the next step.

      CSAM possession is illegal because possession directly supports creation, and creation is inherently abusive and exploitative of real people, and generating it from a model that was trained on non-abusive content probably isn’t exploitative, but there’s a legitimate question as to whether we as a society decide it’s associated closely enough with real world harms that it should be banned.

      Not an easy question for sure, and it’s one that deserves to be answered using empirical data, but I imagine the vast majority of Americans would flatly reject a nuanced view on this issue.

      • MagicShel@programming.dev
        link
        fedilink
        arrow-up
        36
        arrow-down
        6
        ·
        edit-2
        4 months ago

        The problem is empirical data cannot be morally or ethically found. You can’t show a bunch of people porn and then make a statistical observation of whether those shown child porn are more likely to assault children. So we have to go forward without that data.

        I will anecdotally observe anal sex, oral sex, and facials have gone up between partners as prevalence in porn has gone up. That suggests but does not prove a direct statistical harm caused by even “ethically produced CSAM.”

        • usualsuspect191@lemmy.ca
          link
          fedilink
          arrow-up
          29
          arrow-down
          2
          ·
          4 months ago

          I will anecdotally observe anal sex, oral sex, and facials have gone up between partners as prevalence in porn has gone up. That suggests but does not prove a direct statistical harm caused by even "ethically produced CSAM

          Can we look at trends between consenting adults (who are likely watching porn of real people by the way) as an indicator of what pedophiles will do? I’m not so sure. It’s not like step sibling sex is suddenly through the roof now with it being the “trend” in porn.

          Looking specifically at fake rape porn maybe and seeing if it increases rates of rape in the real world might be a better indicator.

          • MagicShel@programming.dev
            link
            fedilink
            arrow-up
            13
            arrow-down
            1
            ·
            edit-2
            4 months ago

            That’s fair. I tried to make clear that my interpretation is not in any way scientific or authoritative. Better correlations are probably possible.

            ETA on further thought: I wonder if prevalence of incest porn has had an effect on actual incest rates. That might be a much closer correlation due to the similar social taboo. But I’m not sure we have good data on that, either.

          • LustyArgonian@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            4 months ago

            Do you think people like Andrew Tate have caused more rapes to occur? Like do you think his rhetoric encourages a rapist mindset in his listeners?

        • mpa92643@lemmy.world
          link
          fedilink
          arrow-up
          10
          arrow-down
          2
          ·
          edit-2
          4 months ago

          True, it wouldn’t be ethical to conduct an experiment, but we can (and probably do) collect lots of observational data that can provide meaningful insight. People are arrested at all stages of CSAM related offenses from just possession, distribution, solicitation, and active abuse.

          While observation and correlations are inherently weaker than experimental data, they can at least provide some insight. For example, “what percentage of those only in possession of artificially generated CSAM for at least one year go on to solicit minors” vs. “real” CSAM.

          If it seems that artificial CSAM is associated with a lower rate of solicitation, or if it ends up decreasing overall demand for “real” CSAM, then keeping it legal might provide a real net benefit to society and its most vulnerable even if it’s pretty icky.

          That said, I have a nagging suspicion that the thing many abusers like most about CSAM is that it’s a real person and that the artificial stuff won’t do it for them at all. There’s also the risk that artificial CSAM reduces the taboo of CSAM and can be an on-ramp to more harmful materials for those with pedophilic tendencies that they otherwise are able to suppress. But it’s still way too early to know either way.

          • HelixDab2@lemm.ee
            link
            fedilink
            arrow-up
            7
            arrow-down
            1
            ·
            4 months ago

            the thing many abusers like most about CSAM is that it’s a real person and that the artificial stuff won’t do it for them at all.

            Perhaps. But what about when they can’t tell the difference between real and virtual? It seems like the allure of all pornography is the fantasy, rather than the reality. That is, you may enjoy extreme BDSM pornography, and enjoy seeing a person flogged until they’re bleeding, or see needles slowly forced through their penis, but do you really care that it’s a real person that’s going to end the scene, take a shower, and go watch a few episodes of “The Good Place” with their dog before bed? Or is it about the power fantasy that you’re constructing in your head about that scene? How important is the reality of the scene, versus being able to suspend your disbelief long enough to get sexual gratification from it? If the whole scene was done with really good practical effects and CG, would your experience, as a user–even if you were aware–be different?

          • Cryophilia@lemmy.world
            link
            fedilink
            arrow-up
            2
            ·
            4 months ago

            True, it wouldn’t be ethical to conduct an experiment

            I think it would be ethical for researchers to go onto the boards of these already-existing CP distribution forums and conduct surveys. But then the surveyors would be morally obligated to report that board to the authorities to get it shut down. Which means that no one would ever answer surveyor questions because they knew the board would be shut down soon so they’d just find a new site ugh…

            Yeah nvm I don’t see any way around this one

      • HelixDab2@lemm.ee
        link
        fedilink
        arrow-up
        19
        arrow-down
        2
        ·
        4 months ago

        CSAM possession is illegal because possession directly supports creation

        To expound on this: prior to this point, the creation of CSAM requires that children be sexually exploited. You could not have CSAM without children being harmed. But what about when no direct harms have occurred? Is lolicon hentai ‘obscene’? Well, according to the law and case law, yes, but it’s not usually enforced. If we agree that drawings of children engaged in sexual acts aren’t causing direct harm–that is, children are not being sexually abused in order to create the drawings–then how much different is a computer-generated image that isn’t based off any specific person or event? It seem to me that, whether or not a pedophile might decide that they eventually want more than LLM-generated images is not relevant. Treating a future possibility as a foregone conclusion is exactly the rationale behind Reefer Madness and the idea of ‘gateway’ drugs.

        Allow me to float a second possibility that will certainly be less popular.

        Start with two premises: first, pedophilia is a characteristic that appears to be an orientation. That is, a true pedophile–a person exclusively sexually attracted to pre-pubescent children–does not choose to be a pedophile, any more than a person chooses to be gay. (My understanding is that very few pedophiles are exclusively pedophilic though, and that many child molesters are opportunistic sexual predators rather than being pedophiles.) Secondly, the rates of sexual assault appear to have decreased as pornography availability has increased. So the question I would have is, would wide availability of LLM-generated CSAM–CSAM that didn’t cause any real, direct harm to children–actually decrease rates of child sexual assault?

        • RandomlyNice@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          4 months ago

          With regards to your last paragraph: Pedophiles can indeed by straight, gay or bi. Pedophiles may also not become molesters, and molesters of children may not at all be pedophilic. It’s seems you understand this. I mentioned ITT that I read a newspaper article many years ago that was commissioned to show the access to cp would increase child abuse, it seemed to show the opposite.
          If persons could use AI to generate their own porn of their own personal fantasies (whatever those might be) and NOT share that content what then? Canada allows this for text (maybe certain visuals? Audio? IDK). I don’t know about current ‘obscene’ laws in the USA, however, I do recall reading about an art exhibit in NY which featured an upside down urinal that was deemed obscene, than later deemed a work or art. I also recall seeing (via an internet image) a sculpture of what seemed to be a circle of children with penises as noses. Porn? Art? Comedy?

          • HelixDab2@lemm.ee
            link
            fedilink
            arrow-up
            6
            ·
            4 months ago

            My understanding was that ‘pure’ pedophiles–ones that have no interest at all in post-pubescent children or any adults whatsoever–tend to be less concerned with sex/gender, particularly because children don’t have defined secondary sex characteristics. I don’t know if this is actually correct though. I’m not even sure how you could ethically research that kind of thing and end up with valid results.

            And honestly, not being able to do solid research that has valid results makes it really fuckin’ hard to find solutions that work to prevent as many children from being harmed as possible. In the US at least research about sex and sexuality in general-much less deviant sexualities–seems to be taboo, and very difficult to get funding for.

        • 2xsaiko@discuss.tchncs.de
          link
          fedilink
          arrow-up
          5
          arrow-down
          1
          ·
          edit-2
          4 months ago

          Hard to say. I generally agree with what you’ve said though. Also, lots of people have other fantasies that they would never enact in real life for various reasons (e.g. it’s unsafe, illegal, or both; edit: I should also absolutely list non-consensual here). I feel like pedophilia isn’t necessarily different.

          However part of the reason loli/whatever is also illegal to distribute (it is, right? I assume it is at least somewhere) is that otherwise it helps people facilitate/organize distribution of real CSAM, which increases demand for it. That’s what I’ve heard at least and it makes sense to me. And I feel like that would apply to AI generated as well.

          • HelixDab2@lemm.ee
            link
            fedilink
            arrow-up
            7
            ·
            4 months ago

            It’s obvs. very hard to get accounts of what pedophiles are doing; the only ones that you can survey are ones that have been caught, which isn’t necessarily a representative sample. I don’t think that there are any good estimates on the rate of pedophilic tendencies.

            the reason loli/whatever is also illegal to distribute

            From a cursory reading, it looks like possession and distribution are both felonies. Lolicon hentai is pretty widely available online, and prosecutions appear to be very uncommon when compared to the availability. (Low priority for enforcement, probably?)

            I’m not sure that increasing the supply of CSAM would necessarily increase demand for CSAM in people that aren’t already pedophiles though. To put it another way, I’m sure that increasing the supply of gay porn would increase consumption of gay porn, but I am pretty sure that it’s not going to make more people gay. And people that aren’t gay (or at least bi-) aren’t going to be interested in gay porn, regardless of how hard up (heh) they might be for porn, as long as they have any choices at all. There’s a distinction between fetishes/paraphilia, and orientations, and my impression has been that pedophilia is much more similar to an orientation than a paraphilia.

            • 2xsaiko@discuss.tchncs.de
              link
              fedilink
              arrow-up
              2
              arrow-down
              2
              ·
              4 months ago

              I’m not sure that increasing the supply of CSAM would necessarily increase demand for CSAM in people that aren’t already pedophiles though.

              No, but allowing people to organize increases demand because then those who would want CSAM have a place to look for it and ask for it where it’s safe for them to do so, and maybe even pay for it to be created. It’s rather the other way around, the demand increases the supply if you want to put it like that. I’m not saying lolicon being freely available turns people into pedophiles or something like that, at all.

              • HelixDab2@lemm.ee
                link
                fedilink
                arrow-up
                5
                ·
                4 months ago

                I guess where I come down is that, as long as no real people are being harmed–either directly, or because their likeness is being used–then I’d rather see it out in the open than hidden. At least if it’s open you can have a better chance of knowing who is immediately unsafe around children, and easily using that to exclude people from positions where they’d have ready access to children (teachers, priests, etc.).

                Unfortunately, there’s also a risk of pedophilia being ‘normalized’ to the point where people let their guard down around them.

      • ObjectivityIncarnate@lemmy.world
        link
        fedilink
        arrow-up
        12
        ·
        edit-2
        4 months ago

        Downloading and possession of CSAM seems to be a common first step in a person initiating communication with a minor with the intent to meet up and abuse them.

        But this is like the arguments used to say that weed is a “gateway drug” by talking about how people strung out on harder drugs almost always have done weed as well, ignoring everyone who uses only weed. But this is even hazier because we literally have no real idea how many people consume that stuff but don’t ‘escalate’.

        I remember reading once in some research out of Japan that child molesters consume less porn overall than the average citizen, which seems counter-intuitive, but may not be, if you consider the possibility that maybe it (in this case, they were talking primarily about manga with anime-style drawings of kids in sexual situations) is actually curbing the incidence of the ‘real thing’, since the ones actually touching kids in the real world are reading those mangas less.

        I’m also reminded of people talking about sex dolls that look like kids, and if that’s a possible ‘solution’ for pedophiles, or if it would ‘egg on’ actual molestation.

        I think I lean on the side of ‘satiation’, from the limited bits of idle research I’ve done here and there. And if that IS in fact the case, then regardless of if it grosses me out, I can’t in good conscience oppose something that actually reduces the number of children who actually get abused, you know?

        • LustyArgonian@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          4
          ·
          edit-2
          4 months ago

          It’s less that these materials are like a “gateway” drug and more like these materials could be considered akin to advertising. We already have laws about advertising because it’s so effective, including around cigarettes and prescriptions.

          Second, the role that CP plays in most countries is difficult. It is used for blackmail. It is also used to generate money for countries. And it’s used as advertising for actual human trafficking organizations. And similar organizations exist for snuff and gore btw. And ofc animals. And any combination of those 3. Or did you all forget about those monkey torture videos, or the orangutan who was being sex trafficked? Or Daisy’s Destruction and Peter Scully?

          So it’s important to not allow these advertisers to combine their most famous monkey torture video with enough AI that they can say it’s AI generated, but it’s really just an ad for their monkey torture productions. And they do that with CP, rape, gore, etc, too.

          • tamal3@lemmy.world
            link
            fedilink
            arrow-up
            3
            arrow-down
            1
            ·
            4 months ago

            People, please don’t just downvote with no comment. Why is this being downloaded? The comparisons to advertisements have validity. And, if you disagree, be productive and tell us why.

            • LustyArgonian@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              2
              ·
              4 months ago

              Because a huge percentage of Lemmy is sexist and I am openly a woman. You’ll know because this comment will get nuked also.

      • Cryophilia@lemmy.world
        link
        fedilink
        arrow-up
        5
        arrow-down
        1
        ·
        4 months ago

        but there’s a legitimate question as to whether we as a society decide it’s associated closely enough with real world harms that it should be banned.

        Why should that be a question at all? If it causes harm, ban it. If not, don’t. Being “associated with” should never be grounds for a legal statute.

      • 9bananas@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        4 months ago

        generally a very good point, however i feel it’s important to point out some important context here:

        the pedophiles you’re talking about in your comment are almost always members of tight knit communities that share CSAM, organize distribution, share sources, and most importantly, indulge their fantasies/desires together.

        i would think that the correlation that leads to molestation is not primarily driven by the CSAM itself, but rather the community around it.

        we clearly see this happening in other similarly structured and similarly isolated communities: nazis, incels, mass shooters, religious fanatics, etc.

        the common factor in radicalization and development of extreme views in all these groups is always isolation and the community they end up joining as a result, forming a sort of parallel society with it’s own rules and ideals, separate from general society. over time people in these parallel societies get used to seeing the world in a way that aligns with the ideals of the group.

        nazis start to see anyone not part of their group as enemies, incels start to see “females” instead of women, religious fanatics see sinners…and pedophiles see objects that exist solely for their gratification instead of kids…

        I don’t see why molesters should be any different in this aspect, and would therefore argue that it’s the communal aspect that should probably be the target of the law, i.e.: distribution and organization (forums, chatrooms, etc.)

        the harder it is for them to organize, the less likely these groups are to produce predators that cause real harm!

        if on top of that there is a legally available outlet where they can indulge themselves in a safe manner without harming anyone, I’d expect rates of child molestation to drop significantly, because, again, there’s precedence from similar situations (overdoses in drug addicts, for example)

        i think it is a potentially fatal mistake to think of pedophiles as “special” cases, rather than just another group of outcasts, because in nearly all cases of such pariahs the solutions that prove to work best in the real world are the ones that make these groups feel less like outcasts, which limits avenues of radicalization.

        i thought these parallels are something worth pointing out.

    • snooggums@midwest.social
      link
      fedilink
      English
      arrow-up
      22
      arrow-down
      2
      ·
      4 months ago

      Even worse, you don’t need CSAM to start with. If a learning model has regular porn and nude reference model photography of people under 18 that are used for drawing anatomy, then they have enough information to combine the two. Hell, it probably doesn’t even need the people under 18 to actually be nude.

      Hell, society tends to assume any nudity inder 18 to be CSAM anyway, because someone could see it that way.

    • ObjectivityIncarnate@lemmy.world
      link
      fedilink
      arrow-up
      14
      ·
      4 months ago

      I don’t know if it’s still a thing, but I’m reminded of some law or regulation that was passed a while back in Australia, iirc, that barred women with A-cup busts from working in porn, the “reasoning” being that their flatter chests made them look too similar to prepubescent girls, lol…

      Not only stupid but also quite insulting to women, imo.

    • HelixDab2@lemm.ee
      link
      fedilink
      arrow-up
      13
      ·
      4 months ago

      Because any simulated CSAM laws have been, to my knowledge, all struck down when challenged.

      To the best of my knowledge, calling drawn works obscene has been upheld in courts, most often because the artist(s) lack the financial ability to fight the charges effectively. The artist for the underground comic “Boiled Angel” had his conviction for obscenity upheld–most CSAM work falls under obscenity laws–and ended up giving up the fight to clear his name.

      • ReallyActuallyFrankenstein@lemmynsfw.com
        link
        fedilink
        English
        arrow-up
        6
        ·
        edit-2
        4 months ago

        Oh, for sure. I’m talking about laws specifically targeted to minors. “Obscenity” is a catch-all that is well-established, but if you are trying to protect children from abuse, it’s a very blunt instrument and not as effective as targeted abuse and trafficking statutes. The statutory schemes used to outlaw virtual CSAM have failed to my knowledge.

        For example: https://en.wikipedia.org/wiki/Ashcroft_v._Free_Speech_Coalition

        That case was statutorily superseded in part by the PROTECT Act, which attempted to differentiate itself by…relying on an obscenity standard. So it’s a bit illusory that it does anything new.

        • HelixDab2@lemm.ee
          link
          fedilink
          arrow-up
          4
          ·
          4 months ago

          The PROTECT Act has been, so far, found to be constitutional, since it relies on the obscenity standard in regards to lolicon hentai. Which is quite worrisome. It seems like it’s a circular argument/tautology; it’s obscene for drawn art to depict child sexual abuse because drawings of child sexual abuse are obscene.

    • brbposting@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      simulated CSAM

      When I used this phrase, someone told me it described a nonexistent concept, and that the CSAM term existed in part to differentiate between content where children were harmed to make it versus not. I didn’t wanna muddy any waters but do you have an opposing perspective?

      Deepfaking intentionally real under 18 people is also not black and white

      Interesting. Sounds real bad. See what you mean about harm factor though.

    • Cryophilia@lemmy.world
      link
      fedilink
      arrow-up
      2
      arrow-down
      3
      ·
      4 months ago

      I’m at least all for a “fruit of the poisoned tree” theory - if AI model training data sets include actual CSAM then they can and should be made illegal.

      Now all AI is illegal. It’s trained via scraping the internet, which will include CP as well as every other image.

  • Nollij@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    91
    arrow-down
    6
    ·
    4 months ago

    This creates a significant legal issue - AI generated images have no age, nor is there consent.

    The difference in appearance between age 16 and 18 is minimal, but the legal difference is immense. This is based entirely on a concept that cannot apply.

    How do you define what’s depicting a fictional child? Especially without including real adults? I’ve met people who believe that preferring a shaved pubic area is pedophilia. This is even though the vast majority of adult women do so. On the flip side, teenagers from the 70s and 80s would be mistaken for 40+ today.

    Even the extremes aren’t clear. Adult star “Little Lupe”, who was 18+ in every single appearance, lacked most secondary sex characteristics. Experts testified in court that she could not possibly be an adult. Except she was, and there’s full documentation to prove it. Would AI trained exclusively on her work be producing CSAM?

    • CeruleanRuin@lemmings.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      32
      ·
      edit-2
      4 months ago

      To paraphrase someone smarter than me, “I’ll know it when I see it.”

      But naturally I don’t want to see it. One of the things I miss the least about reddit is the constant image posts of anime characters, who may be whatever age they say but which are clearly representative of very young girls with big tiddies bolted on. It’s gross, but it is also a problem thatsl’s more widespread and nebulous than most people are willing to admit.

      • Xatolos@reddthat.com
        link
        fedilink
        arrow-up
        103
        arrow-down
        1
        ·
        4 months ago

        “I’ll know it when I see it.”

        I can’t think of anything scarier than that when dealing with the legality of anything.

      • Nollij@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        18
        arrow-down
        1
        ·
        4 months ago

        Just when trying to guess someone’s age (we’ll assume completely family-friendly and above board), think back to high school. How old did you and your peers look? Now go take a look at high schoolers today. They probably seem a lot younger than you did. The longer it’s been (i.e. the older you are), the younger they look. Which means, “when I see it” depends entirely on the age of the viewer.

        This isn’t even just about perception and memory- modern style is based on/influenced heavily by youth. It’s also continuing to move in the direction. This is why actors in their 30s - with carefully managed hair, skin, makeup, and wardrobe - have been able to convincingly portray high schoolers. This means that it’s not just you - teens really are looking younger each year. But they’re still the same age.

        • LustyArgonian@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          4 months ago

          Wtf. Style is what makes kids look young or old to us because we have been heavily marketed to and follow trends. That’s why when the mullet/porn stache style came back, those Dahmer kids looked in their 40s.

          You’re getting older each year so teens look younger to you.

          Name even one actor in their thirties who convincingly played a high schooler. Literally who

  • macniel@feddit.org
    link
    fedilink
    arrow-up
    102
    arrow-down
    25
    ·
    4 months ago

    I don’t see how children were abused in this case? It’s just AI imagery.

    It’s the same as saying that people get killed when you play first person shooter games.

    Or that you commit crimes when you play GTA.

        • timestatic@feddit.org
          link
          fedilink
          English
          arrow-up
          20
          arrow-down
          1
          ·
          4 months ago

          But this is the US… and its kind of a double standard if you’re not arrested for drawing but for generating it.

            • ContrarianTrail@lemm.ee
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              4 months ago

              The core reason CSAM is illegal is not because we don’t want people to watch it but because we don’t want them to create it which is synonymous with child abuse. Jailing someone for drawing a picture like that is absurd. While it might be of bad taste, there is no victim there. No one was harmed. Using generative AI is the same thing. No matter how much simulated CSAM you create with it, not a single child is harmed in doing so. Jailing people for that is the very definition of a moral panic.

              Now, if actual CSAM was used in the training of that AI, then it’s a more complex question. However it is a fact that such content doesn’t need to be in the training data in order for it to create simulated CSAM and as long as that is the case it is immoral to punish people for creating something that only looks like it but isn’t.

                • ContrarianTrail@lemm.ee
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  4 months ago

                  Sure, but same argument could be made of violent movies / games / books … It’s a rather slippery slope and as far as I know there doesn’t seem to be correlation between violent games and real life violence, in fact I believe the correlation is negative.

            • puppycat@lemmy.blahaj.zone
              link
              fedilink
              arrow-up
              1
              arrow-down
              1
              ·
              4 months ago

              I don’t advocate for either but it should NOT be treated the same. one doesn’t involve a child being involved and traumatized, id rather a necrophiliac make ai generated pics instead of… you know.

    • CeruleanRuin@lemmings.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      14
      ·
      edit-2
      4 months ago

      Not a great comparison, because unlike withh violent games or movies, you can’t say that there is no danger to anyone in allowing these images to be created or distributed. If they are indistinguishable from the real thing, it then becomes impossible to identify actual human victims.

      There’s also a strong argument that the availability of imagery like this only encourages behavioral escalation in people who suffer from the affliction of being a sick fucking pervert pedophile. It’s not methadone for them, as some would argue. It’s just fueling their addiction, not replacing it.

    • Leraje@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      26
      ·
      4 months ago

      The difference is intent. When you’re playing a FPS, the intent is to play a game. When you play GTA the intent is to play a game.

      The intent with AI generated CSAM is to watch kids being abused.

        • Leraje@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          11
          ·
          4 months ago

          There may well be the odd weirdo playing Call of Duty to watch people die.

          But everyone who watches CSAM is watching it to watch kids being abused.

      • ContrarianTrail@lemm.ee
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 months ago

        Punishing people for intending to do something is punishing them for thought crimes. That is not the world I want to live in.

            • Leraje@lemmy.blahaj.zone
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              2
              ·
              4 months ago

              Intent is defined as intention or purpose. So I’ll rephrase for you: the purpose of playing a FPS is to play a game. The purpose of playing GTA is to play a game.

              The purpose of AI generated CSAM is to watch children being abused.

              • ContrarianTrail@lemm.ee
                link
                fedilink
                English
                arrow-up
                3
                ·
                4 months ago

                I don’t think that’s fair. It could just as well be said that the purpose of violent games is to simulate real life violence.

                Even if I grant you that the purpose of viewing CSAM is to see child abuse, it’s still less bad than actually abusing them just like playing violent games is less bad than participating in real violence. Also, despite the massive increase in violent games and movies, the actual number of violence is going down so implying that viewing such content would increase the cases of child abuse is an assumption I’m not willing to make either.

                • Leraje@lemmy.blahaj.zone
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  2
                  ·
                  4 months ago

                  The purpose of a game is to play a game through a series of objectives and challenges.

                  Even if I grant you that the purpose of viewing CSAM is to see child abuse

                  Very curious to hear what else you think the purpose of watching CSAM might be.

                  it’s still less bad than actually abusing them

                  “less bad” is relative. A bad thing is still bad. If we go by length of sentencing then rape is ‘less bad’ than murder. that doesn’t make it ‘not bad’.

                  so implying that viewing such content would increase the cases of child abuse is an assumption I’m not willing to make either.

                  OK?

                  I didn’t claim that AI CSAM increased anything at all. Literally all I’ve said is that the purpose of AI generated CSAM is to watch kids being abused.

                  Neither did I claim that violent games lead to violence. You invented that strawman all by yourself.

    • Samvega@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      16
      arrow-down
      51
      ·
      4 months ago

      It’s just AI imagery.

      Fantasising about sexual contact with children indicates that this person might groom children for real, because they have a sexual interest in doing so. As someone who was sexually assaulted as a child, it’s really not something that needs to happen.

      • HelixDab2@lemm.ee
        link
        fedilink
        arrow-up
        87
        arrow-down
        3
        ·
        4 months ago

        indicates that this person might groom children for real

        But unless they have already done it, that’s not a crime. People are prosecuted for actions they commit, not their thoughts.

        • Chozo@fedia.io
          link
          fedilink
          arrow-up
          68
          arrow-down
          1
          ·
          4 months ago

          I agree, this line of thinking quickly spirals into Minority Report territory.

          • CeruleanRuin@lemmings.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            7
            ·
            4 months ago

            It will always be a gray area, and should be, but there are practical and pragmatic reasons to ban this imagery no matter its source.

      • HubertManne@moist.catsweat.com
        link
        fedilink
        arrow-up
        24
        arrow-down
        2
        ·
        4 months ago

        Seems like then fantasizing about shooting people or carjacking or such indcates that person might do that activity for real to. There are a lot of car jackings nowadays and you know gta is real popular. mmmm. /s but seriously im not sure your first statement has merit. Especially when you look at where to draw the line. anime. manga. oil paintings. books. thoughts in ones head.

        • CeruleanRuin@lemmings.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          13
          ·
          4 months ago

          If you’re asking whether anime, manga, oil paintings, and books glorifying the sexualization of children should also be banned, well, yes.

          This is not comparable to glorifying violence, because real children are victimized in order to create some of these images, and the fact that it’s impossible to tell makes it even more imperative that all such imagery is banned, because the existence of fakes makes it even harder to identify real victims.

          It’s like you know there’s an armed bomb on a street, but somebody else filled the street with fake bombs, because they get off on it or whatever. Maybe you’d say making fake bombs shouldn’t be illegal because they can’t harm anyone. But now suddenly they have made the job of law enforcement exponentially more difficult.

          • Cryophilia@lemmy.world
            link
            fedilink
            arrow-up
            6
            arrow-down
            1
            ·
            4 months ago

            Sucks to be law enforcement then. I’m not giving up my rights to make their jobs easier. I hate hate HATE the trend towards loss of privacy and the “if you didn’t do anything wrong then you have nothing to hide” mindset. Fuck that.

        • Samvega@lemmy.blahaj.zone
          link
          fedilink
          arrow-up
          1
          arrow-down
          16
          ·
          4 months ago

          If you want to keep people who fantasise about sexually exploiting children around your family, be my guest. My family tried that, and I was raped. I didn’t like that, and I have drawn my own conclusions.

          • HubertManne@moist.catsweat.com
            link
            fedilink
            arrow-up
            15
            ·
            4 months ago

            yeah and if you want to keep people who fantasize about murdering folk. you can’t say one thing is a thing without saying the other is. Im sorry you were raped but I doubt it would be stopped by banning lolita.

            • Samvega@lemmy.blahaj.zone
              link
              fedilink
              arrow-up
              1
              arrow-down
              10
              ·
              edit-2
              4 months ago

              I don’t recall Nabokov’s novel Lolita saying that sexualising minors was an acceptable act.

              Thanks for the strawman, though, I’ll save it to burn in the colder months.

              • HubertManne@moist.catsweat.com
                link
                fedilink
                arrow-up
                10
                ·
                4 months ago

                You can call it a strawman but doing something evil if its killing folks or raping folks the effect should be the same when discussing non actual and actual. You can say this thing is a special case but when it comes to freedom of speech, which is anything that is not based in actual events. writing, speaking, thinking, art. Special circumstances becomes a real slippery slope (which can also be brought up as a fallacy which like all “fallacies” depend a lot on what else backs them up on how they are being presented)

    • TallonMetroid@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      49
      ·
      4 months ago

      Well, the image generator had to be trained on something first in order to spit out child porn. While it may be that the training set was solely drawn/rendered images, we don’t know that, and even if the output were in that style, it might very well be photorealistic images generated from real child porn and run through a filter.

      • MagicShel@programming.dev
        link
        fedilink
        arrow-up
        51
        arrow-down
        3
        ·
        4 months ago

        An AI that is trained on children and nude adults can infer what a nude child looks like without ever being trained specifically with those images.

              • Cryophilia@lemmy.world
                link
                fedilink
                arrow-up
                3
                arrow-down
                1
                ·
                4 months ago

                No, I’m admitting they’re stupid for even bringing it up.

                Unless their argument is that all AI should be illegal, in which case they’re stupid in a different way.

                • LustyArgonian@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  2
                  ·
                  edit-2
                  4 months ago

                  Do you think regular child porn should be illegal? If so, why?

                  Generally it’s because kids were harmed in the making of those images. Since we know that AI is using images of children being harmed to make these images, as the other posters has repeatedly sourced (but also if you’ve looked up deepfakes, most deepfakes are of an existing porn and the face just changed over top. They do this with CP as well and must use CP videos to seed it, because the adult model would be too large)… why does AI get a pass for using children’s bodies in this way? Why isn’t it immoral when AI is used as a middle man to abuse kids?

          • LustyArgonian@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            3
            ·
            edit-2
            4 months ago

            Yes exactly. That people are then excusing this with “well it was trained on all.public images,” are just admitting you’re right and that there is a level of harm here since real materials are used. Even if they weren’t being used or if it was just a cartoon, the morality is still shaky because of the role porn plays in advertising. We already have laws about advertising because it’s so effective, including around cigarettes and prescriptions. Most porn, ESPECIALLY FREE PORN, is an ad to get you to buy other services. CP is not excluded from this rule - no one gets free lunch, so to speak. These materials are made and hosted for a reason.

            The role that CP plays in most countries is difficult. It is used for blackmail. It is also used to generate money for countries (intelligence groups around the world host illegal porn ostensibly “to catch a predator,” but then why is it morally okay for them to distribute these images but no one else?). And it’s used as advertising for actual human trafficking organizations. And similar organizations exist for snuff and gore btw. And ofc animals. And any combination of those 3. Or did you all forget about those monkey torture videos, or the orangutan who was being sex trafficked? Or Daisy’s Destruction and Peter Scully?

            So it’s important to not allow these advertisers to combine their most famous monkey torture video with enough AI that they can say it’s AI generated, but it’s really just an ad for their monkey torture productions. And even if NONE of the footage was from illegal or similar events and was 100% thought of by AI - it can still be used as an ad for these groups if they host it. Cartoons can be ads ofc.

        • Saledovil@sh.itjust.works
          link
          fedilink
          arrow-up
          6
          ·
          4 months ago

          Wild corn dogs are an outright plague where I live. When I was younger, me and my buddies would lay snares to catch to corn dogs. When we caught one, we’d roast it over a fire to make popcorn. Corn dog cutlets served with popcorn from the same corn dog is popular meal, especially among the less fortunate. Even though some of the affluent consider it the equivalent to eating rat meat. When me pa got me first rifle when I turned 14, I spent a few days just shooting corn dogs.

        • emmy67@lemmy.world
          link
          fedilink
          arrow-up
          1
          arrow-down
          2
          ·
          edit-2
          4 months ago

          It didn’t generate what we expect and know a corn dog is.

          Hence it missed because it doesn’t know what a “corn dog” is

          You have proven the point that it couldn’t generate csam without some being present in the training data

          • ContrarianTrail@lemm.ee
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            2
            ·
            edit-2
            4 months ago

            I hope you didn’t seriously think the prompt for that image was “corn dog” because if your understanding of generative AI is on that level you probably should refrain from commenting on it.

            Prompt: Photograph of a hybrid creature that is a cross between corn and a dog

            • emmy67@lemmy.world
              link
              fedilink
              arrow-up
              1
              arrow-down
              2
              ·
              4 months ago

              Then if your question is “how many Photograph of a hybrid creature that is a cross between corn and a dog were in the training data?”

              I’d honestly say, i don’t know.

              And if you’re honest, you’ll say the same.

              • ContrarianTrail@lemm.ee
                link
                fedilink
                English
                arrow-up
                3
                arrow-down
                1
                ·
                4 months ago

                But you do know because corn dogs as depicted in the picture do not exists so there couldn’t have been photos of them in the training data, yet it was still able to create one when asked.

                This is because it doesn’t need to have been seen one before. It knows what corn looks like and it knows what a dog looks like so when you ask it to combine the two it will gladly do so.

                • emmy67@lemmy.world
                  link
                  fedilink
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  edit-2
                  4 months ago

                  But you do know because corn dogs as depicted in the picture do not exists so there couldn’t have been photos of them in the training data, yet it was still able to create one when asked.

                  Yeah, except photoshop and artists exist. And a quick google image search will find them. 🙄

      • lunarul@lemmy.world
        link
        fedilink
        arrow-up
        17
        arrow-down
        1
        ·
        edit-2
        4 months ago

        we don’t know that

        might

        Unless you’re operating under “guilty until proven innocent”, those are not reasons to accuse someone.

    • KillerTofu@lemmy.world
      link
      fedilink
      arrow-up
      16
      arrow-down
      54
      ·
      4 months ago

      How was the model trained? Probably using existing CSAM images. Those children are victims. Making derivative images of “imaginary” children doesn’t negate its exploitation of children all the way down.

      So no, you are making false equivalence with your video game metaphors.

      • fernlike3923@sh.itjust.works
        link
        fedilink
        arrow-up
        60
        arrow-down
        1
        ·
        4 months ago

        A generative AI model doesn’t require the exact thing it creates in its datasets. It most likely just combined regular nudity with a picture of a child.

        • finley@lemm.ee
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          22
          ·
          4 months ago

          In that case, the images of children were still used without their permission to create the child porn in question

          • MagicShel@programming.dev
            link
            fedilink
            arrow-up
            33
            arrow-down
            4
            ·
            4 months ago

            That’s not really a nuanced take on what is going on. A bunch of images of children are studied so that the AI can learn how to draw children in general. The more children in the dataset, the less any one of them influences or resembles the output.

            Ironically, you might have to train an AI specifically on CSAM in order for it to identify the kinds of images it should not produce.

            • finley@lemm.ee
              link
              fedilink
              English
              arrow-up
              7
              arrow-down
              19
              ·
              4 months ago

              Why does it need to be “ nuanced” to be valid or correct?

              • TheRealKuni@lemmy.world
                link
                fedilink
                English
                arrow-up
                34
                arrow-down
                2
                ·
                4 months ago

                Because the world we live in is complex, and rejecting complexity for a simple view of the world is dangerous.

                See You Can’t Get Snakes from Chicken Eggs from the Alt-Right Playbook.

                (Note I’m not accusing you of being alt-right. I’m saying we cannot ignore nuance in the world because the world is nuanced.)

                • finley@lemm.ee
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  16
                  ·
                  4 months ago

                  We’re not talking about snakes or chicken eggs, but thanks for the strawman

          • fernlike3923@sh.itjust.works
            link
            fedilink
            arrow-up
            7
            arrow-down
            2
            ·
            4 months ago

            That’s a whole other thing than the AI model being trained on CSAM. I’m currently neutral on this topic so I’d recommend you replying to the main thread.

              • fernlike3923@sh.itjust.works
                link
                fedilink
                arrow-up
                16
                arrow-down
                2
                ·
                edit-2
                4 months ago

                It’s not CSAM in the training dataset, it’s just pictures of children/people that are already publicly available. This goes on to the copyright side of things of AI instead of illegal training material.

                • finley@lemm.ee
                  link
                  fedilink
                  English
                  arrow-up
                  4
                  arrow-down
                  29
                  ·
                  edit-2
                  4 months ago

                  It’s images of children used to make CSAM. No matter of your mental gymnastics can change that, nor the fact that those children’s consent was not obtained.

                  Why are you trying so hard to rationalize the creation of CSAM? Do you actually believe there is a context in which CSAM is OK? Are you that sick and perverted?

                  Because it really sounds like that’s what you’re trying to say, using copyright law as an excuse.

          • CeruleanRuin@lemmings.world
            link
            fedilink
            English
            arrow-up
            8
            arrow-down
            6
            ·
            4 months ago

            Good luck convincing the AI advocates of this. They have already decided that all imagery everywhere is theirs to use however they like.

      • macniel@feddit.org
        link
        fedilink
        arrow-up
        28
        arrow-down
        1
        ·
        4 months ago

        Can you or anyone verify that the model was trained on CSAM?

        Besides a LLM doesn’t need to have explicit content to derive from to create a naked child.

        • KillerTofu@lemmy.world
          link
          fedilink
          arrow-up
          5
          arrow-down
          29
          ·
          4 months ago

          You’re defending the generation of CSAM pretty hard here in some vaguely “but no child we know of” being involved as a defense.

          • macniel@feddit.org
            link
            fedilink
            arrow-up
            15
            arrow-down
            2
            ·
            4 months ago

            I just hope that the Models aren’t trained on CSAM. Making generating stuff they can fap on ““ethical reasonable”” as no children would be involved. And I hope that those who have those tendancies can be helped one way or another that doesn’t involve chemical castration or incarceration.

      • Diplomjodler@lemmy.world
        link
        fedilink
        arrow-up
        13
        arrow-down
        1
        ·
        4 months ago

        While i wouldn’t put it past Meta&Co. to explicitly seek out CSAM to train their models on, I don’t think that is how this stuff works.

      • grue@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        8
        ·
        4 months ago

        But the AI companies insist the outputs of these models aren’t derivative works in any other circumstances!

  • JaggedRobotPubes@lemmy.world
    link
    fedilink
    English
    arrow-up
    74
    arrow-down
    11
    ·
    4 months ago

    Do we know that AI child porn is bad? I could believe it would get them in the mood for the real thing and make them do it more, and I could believe it would make them go “ok, itch scratched”, and tank the demand for the real stuff.

    Depending on which way it goes, it could be massively helpful for protecting kids. I just don’t have a sense for what the effect would be, and I’ve never seen any experts weigh in.

    • ObjectivityIncarnate@lemmy.world
      link
      fedilink
      arrow-up
      35
      arrow-down
      2
      ·
      4 months ago

      Do we know that AI child porn is bad? I could believe it would get them in the mood for the real thing and make them do it more, and I could believe it would make them go “ok, itch scratched”, and tank the demand for the real stuff.

      From bits/articles I’ve seen here and there over the years about other things that are kind of in the same category (porn comics with child characters in them, child-shaped sex dolls), the latter seems to be more the case.

      I’m reminded of when people were arguing that when Internet porn became widespread, the incidence of rape would go through the roof. And then literally the opposite happened. So…that pushes me toward hypothesizing that the latter is more likely to be the case, as well.

    • PhilMcGraw@lemmy.world
      link
      fedilink
      English
      arrow-up
      22
      ·
      4 months ago

      In Australia cartoon child porn is enforced in the same way as actual child porn. Not that it answers your question but it’s interesting.

      I’d imagine for your question “it depends”, some people who would have acted on their urges may get their jollies from AI child porn, others who have never considered being pedophiles might find the AI child porn (assuming legal) and realise it’s something they were into.

      I guess it may lower the production of real child porn which feels like a good thing. I’d hazard a guess that there are way more child porn viewers than child abusers.

      • redfellow@sopuli.xyz
        link
        fedilink
        arrow-up
        10
        ·
        4 months ago

        In Australia a 30 year old woman cannot be in the porn industry if she has small breasts. That, and the cartoon ban both seem like overcompensating.

        • Queue@lemmy.blahaj.zone
          link
          fedilink
          arrow-up
          12
          ·
          4 months ago

          Nothing says “we’re protecting children” like regulating what adult women can do with their bodies.

          Conservatives are morons, every time.

          • Cryophilia@lemmy.world
            link
            fedilink
            arrow-up
            7
            ·
            4 months ago

            They’re not morons.

            Any time anyone ever says they want to do anything “to protect the children” you should assume it’s about control. No one actually gives a shit about children.

    • Thespiralsong@lemmy.world
      link
      fedilink
      arrow-up
      16
      ·
      4 months ago

      I seem to remember Sweden did a study on this, but I don’t really want to google around to find it for you. Good luck!

    • barsquid@lemmy.world
      link
      fedilink
      arrow-up
      19
      arrow-down
      6
      ·
      4 months ago

      I’d like to know what psychologists think about it. My assumption is the former, it escalates their fantasizing about it and makes them more likely to attack a child.

      There seems to be no way to conduct that experiment ethically, though.

    • Cryophilia@lemmy.world
      link
      fedilink
      arrow-up
      16
      arrow-down
      3
      ·
      4 months ago

      Real question: “do we care if AI child porn is bad?” Based on most countries’ laws, no.

    • ZILtoid1991@lemmy.world
      link
      fedilink
      arrow-up
      12
      ·
      4 months ago

      There’s like a lot of layers to it.

      • For some, it might actually work in the opposite direction, especially if paried with the wrong kind of community around it. I used to moderate anime communities, the amount of loli fans wanting to lower the age of consent to 12 or even lower was way too high, but they only called people opposed to loli as “real predators”, because they liked their middle-school tier arguments (which just further polarized the fandom when the culture wars started).
      • Even worse might be the more realistic depictions might actually work against that goal, while with (most) loli stuff, at least it’s obvious it’s drawn.
      • An often overseen issue is, data laundering. Just call your real CP AI generated, or add some GAI artifacts to your collection. Hungary bans too realistic drawings and paintings of that kind, because people even did that with traditional means, by creating as realistic tracings as possible (the calling CP “artistic nudes” didn’t work out here at least).
    • Maggoty@lemmy.world
      link
      fedilink
      arrow-up
      15
      arrow-down
      10
      ·
      4 months ago

      You’re missing the point. They don’t care what’s more or less effective for helping kids. They want to punish people who are different. In this case nobody is really going to step up to defend the guy for obvious reasons. But the motivating concept is the same for conservatives.

    • mckean@programming.dev
      link
      fedilink
      arrow-up
      4
      ·
      4 months ago

      There definitively is opportunity in controlled treatment. But I believe outside of that there are too many unknowns.

    • 31337@sh.itjust.works
      link
      fedilink
      arrow-up
      4
      ·
      4 months ago

      Wikipedia seems to suggest research is inconclusive whether consuming CSAM increases the likelihood of committing abuse.

    • Todd Bonzalez@lemm.ee
      link
      fedilink
      arrow-up
      6
      arrow-down
      3
      ·
      4 months ago

      There are literally mountains of evidence that suggest that normalizing child abuse in any fashion increases the rate at which children are actually abused, but it never stops there from being a highly upvoted comment suggesting that jacking it to simulated kids is some how a “release valve” for actual pedophilia, which makes absolutely no fucking sense given everything we know about human sexuality.

      If this concept were true, hentai fans would likely be some of the most sexually well-adjusted people around, having tons of experience releasing their real-world sexual desires via a virtual medium. Instead, we find that these people objectify the living shit out of women, because they’ve adopted an insanely overidealized caricature of what a woman should look and act like that is completely divorced from reality.

    • Pankkake@lemmy.world
      link
      fedilink
      arrow-up
      6
      arrow-down
      25
      ·
      4 months ago

      Depending on which way it goes, it could be massively helpful for protecting kids

      Weeeelll, only until the AI model needs more training material…

      • Saledovil@sh.itjust.works
        link
        fedilink
        arrow-up
        6
        arrow-down
        1
        ·
        4 months ago

        You need more training material to train a new AI. Once the AI is there, it produce as many pictures as you want. And you can get good results even with models that can be run locally on a regular computer.

      • JaggedRobotPubes@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        6
        ·
        4 months ago

        I’m not sure if that is how it would work? But this is exactly the kind of thinking we need. Effects: intended plus unintended equals ???

  • BonesOfTheMoon@lemmy.world
    link
    fedilink
    arrow-up
    58
    arrow-down
    2
    ·
    4 months ago

    Could this be considered a harm reduction strategy?

    Not that I think CSAM is good in any way, but if it saves a child would it be worthwhile? Like if these pedos were to use AI images instead of actual CSAM would that be any better?

    I’ve read that CSAM sites on the dark web number into the hundreds of thousands. I just wonder if it would be a less harmful thing since it’s such a problem.

    • RandomlyNice@lemmy.world
      link
      fedilink
      English
      arrow-up
      41
      arrow-down
      3
      ·
      4 months ago

      Many years ago (about 25) I read an article in a newspaper (idk the name, but it may have been the The Computer Paper, which is archived on line someplace}. This article noted that a study had been commissioned to show that cp access increases child abuse. The study seemed to show the opposite.

      Here’s the problem with even AI generated cp: It might lower abuse in the beginning, but with increased access it would ‘normalise’ the perception of such conduct. This would likely increase abuse over time, even involving persons who may not have been so inclined otherwise.

      This is all a very complex. A solution isn’t simple. Shunning things in anyway won’t help though, and that seems to be the current most popular way to deal with the issue.

      • Facebones@reddthat.com
        link
        fedilink
        arrow-up
        27
        arrow-down
        2
        ·
        4 months ago

        Actual pedophiles (a lot of CSA is abuse of power, not pedophilia - though to be clear fuck abusers either way) have a high rate of suicidal ideation because they think its as fucked up as everyone else. Of course we can’t just say “sure AI material is legal now” but I could imagine a regulated system accessed via doctors akin to how controlled substances work.

        People take this firm “kill em all” stance but these people just feel the way they do same as I do towards women or a gay man feels toward men. It just is what it is - we all generally agree gay isnt a choice and this is no different. As long as they dont act on it, I think we should be sympathetic and be open to helping them live a less tortured life.

        I’m not 100% saying this is how we do it, but we should be open to exploring the issue instead of full stop demonization.

        • HonorableScythe@lemm.ee
          link
          fedilink
          arrow-up
          12
          arrow-down
          1
          ·
          4 months ago

          Dan Savage coined the term “gold star pedophile” in a column years ago, referring to people who acknowledge their attraction to children but never act on it by harming a child or accessing CSAM. I do feel bad for these people because there are no resources to help them. The only way they can access actual therapeutic resources for their condition is by offending and going to jail. If the pedophile goes to a therapist and confesses attraction to children, therapists are mandated reporters and will assume they’re going to act on it. An article I read a few years back interviewed members of an online community of non-offending pedophiles who essentially made their own support group since no one else will help them, and nearly all research on them is from a forensic (criminal) context.

          There’s a pretty good article by James Cantor talking about dealing with pedophiles in a therapeutic context here.

          Don’t get me wrong - I think offenders need to be punished for what they do. I unfortunately have a former best friend who has offended. He’s no longer in my life and never will be again. But I think we could prevent offenders from reaching that point and hurting someone if we did more research and found ways to stop them before it happened.

          • Liz@midwest.social
            link
            fedilink
            English
            arrow-up
            11
            arrow-down
            3
            ·
            4 months ago

            We really gotta flip the standard and make therapist sessions 100% confidential. We should encouraging people to seek help in stopping their bad behavior, no matter what it is, and they’re less likely to do that if they think a therapist could report them.

            • LustyArgonian@lemmy.world
              link
              fedilink
              English
              arrow-up
              5
              arrow-down
              2
              ·
              edit-2
              4 months ago

              You’re asking therapists to live with that information. It’s not so easy to hear that a child is being actively raped and not legally being allowed to report it.

              We already lose tons of social workers in CPS because they can’t help those kids much or save them. Most normal adults can’t really mentally handle child torture without doing something about it. How many unreported child abuse cases before a therapist kills themselves?

              Let alone that you’re sentencing a child to live in a rape nightmare, something most adults can’t tolerate, all so their abuser can get some help maybe. Wonder how many kids will kill themselves. What the actual fuck. Here’s a hint: kids are slaves, so passing laws that disempower them even more is really fucked up.

              • Liz@midwest.social
                link
                fedilink
                English
                arrow-up
                2
                ·
                4 months ago

                I mean, how many children get abused because people are too afraid to seek help? It’s not an area with an easy answer, and I don’t have hard numbers on how much harm either scenario would produce.

                • LustyArgonian@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  4 months ago

                  Well, if all the therapists kill themselves, then that system will be worse than the current one because no one will be getting help

        • fine_sandy_bottom@lemmy.federate.cc
          link
          fedilink
          arrow-up
          6
          ·
          4 months ago

          I agree for the most part, particularly that we should be open minded.

          Obviously we don’t have much reliable data, which I think is critically important.

          The only thing I world add is that, I’m not sure treating a desire for CSAM would be the same as substance abuse. Like “weaning an addict off CSAM” seems like a strange proposition to me.

          • Facebones@reddthat.com
            link
            fedilink
            arrow-up
            3
            ·
            4 months ago

            Maybe I was unclear, when I relate potential generated material to controlled substances, I mean in relation to how you obtain it.

            You go see a psych, probably go through some therapy or something, and if they feel it would be beneficial you would be able to get material via strictly controlled avenues like how you need a prescription for xanax and its a crime to sell or share it.

            (and I imagine… Some sort of stamping whether in the imagery or in the files to trace any leaked material back to the person who shared it, but thats a different conversation)

      • Cryophilia@lemmy.world
        link
        fedilink
        arrow-up
        18
        ·
        4 months ago

        “Normalized” violent media doesn’t seem to have increased the prevalence of real world violence.

        • Spacehooks@reddthat.com
          link
          fedilink
          English
          arrow-up
          4
          ·
          4 months ago

          I actually think video games reduce crime in general. Bad kids are now indoors getting thier thrills.

    • pregnantwithrage@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      4 months ago

      You would think so but you basically are making a patch work version of the illicit actual media so it’s a dark dark gray area for sure.

        • medgremlin@midwest.social
          link
          fedilink
          arrow-up
          8
          arrow-down
          4
          ·
          4 months ago

          Generative AI is basically just really overpowered text/image prediction. It fills in the words or pixels that make the most sense based on the data it has been fed, so to get AI generated CSAM…it had to have been fed some amount of CSAM at some point or it had to be heavily manipulated to generate the images in question.

          • CommanderCloon@lemmy.ml
            link
            fedilink
            arrow-up
            9
            arrow-down
            1
            ·
            edit-2
            4 months ago

            so to get AI generated CSAM…it had to have been fed some amount of CSAM

            No actually, it can combine concepts that aren’t present together in the dataset. Does it know what a child looks like? Does it know what porn looks like? Then it can generate child porn without having ever had CSAM in its dataset. See the corn dog comment as an argument

            Edit: corn dog

            • medgremlin@midwest.social
              link
              fedilink
              arrow-up
              4
              ·
              4 months ago

              Some of the image generators have attempted to put up guard rails to prevent generating pictures of nude children, but the creators/managers haven’t been able to eradicate it. There was also an investigation by Stanford University that showed that most of the really popular image generators had a not insignificant amount of CSAM in their training data and could be fairly easily manipulated into making more.

              The creators and managers of these generative “AIs” have done slim to none in the way of curation and have routinely been trying to fob off responsibility to their users the same way Tesla has been doing for their “full self driving”.

            • emmy67@lemmy.world
              link
              fedilink
              arrow-up
              1
              arrow-down
              2
              ·
              4 months ago

              A dumb argument. Corn and dog were. But that’s not a corn dog like what we expect when we think corn dog.

              Hence it can’t get what we know a corn dog is.

              You have proved the point for us since it didn’t generate a corn dog.

          • BonesOfTheMoon@lemmy.world
            link
            fedilink
            arrow-up
            3
            ·
            4 months ago

            Ok makes sense. Yuck my skin crawls. I got exposed to CSAM via Twitter years ago, thankfully it was just a shot of nude children I saw and not the actual deed, but I was haunted.

    • JovialMicrobial@lemm.ee
      link
      fedilink
      arrow-up
      7
      ·
      edit-2
      4 months ago

      I guess my question is does access to regular porn make people not want to have real sex with another person? Does it ‘scratch the itch’ so to speak? Could they go the rest of their life with only porn to satisfy them?

      It depends on the person. I feel like most people would be unsatisfied with only porn, but that’s just anecdotal.

      I honestly think ai generated csam isn’t something the world needs to be produced. It’s not contributing to society in any meaningful ways and pedophiles who don’t offend or hurt children need therapy, and the ones who do need jailtime(and therapy, but Im in the US so thats a whole other thing). They don’t ‘need’ porn.

      My own personal take is that giving pedophiles csam that’s AI generated is like showing alcohol ads to alcoholics. Or going to the strip club if you’re a sex addict. It’s probably not going to lead to good outcomes.

    • Todd Bonzalez@lemm.ee
      link
      fedilink
      arrow-up
      3
      arrow-down
      1
      ·
      4 months ago

      Think of it this way - what if the government said one day: “All child porn made in the before this date is legal, all child porn made after this date is illegal”.

      You would end up with a huge corpus of “legal” child porn that pedophiles could use as a release, but you could become draconian about the manufacture of new child porn. This would, theoretically, discourage new child porn from being created, because the risk is too high compared to the legal stuff.

      Can you see the problem? That’s right, in this scenario, child porn is legal. That’s fucked up, and we shouldn’t do that, even if it is “simulated”, because fuck that.

    • xta@lemmy.world
      link
      fedilink
      arrow-up
      3
      arrow-down
      3
      ·
      4 months ago

      by the same metric, i wonder why not let convicts murderers and psichopaths work at Slaughterhouses

    • Phoenixz@lemmy.ca
      link
      fedilink
      arrow-up
      1
      ·
      4 months ago

      If from now on all child porn would be created artificially instead of by abusing children, wouldn’t that maybe be a good thing?

      Not trying to defend anything here, but where there is a want in the world, there is a market, you can’t stop that. If artificial material makes it that even one less child is abused, I think it’s worth having a discussion at least

  • hexdream@lemmy.world
    link
    fedilink
    arrow-up
    26
    ·
    4 months ago

    If this thread (and others like it) have taught me aulnything is that facts be damned, people are opinionated either way. Nuance means nothing and it’s basically impossible to have a proper discussion when it comes to wedge issues or anything that can be used to divide people. Even if every study 100% said Ai generated csam always led to a reduction in actual child harm and reduced recidivism and never needed any actual real children to be used as training material, the comments would still pretty much look the same. If the studies showed the exact opposite, the comments would also be the same. Welcome to the internet. I hope you brought aspirin.

    • Eezyville@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      1
      ·
      4 months ago

      My man. Go touch some grass. This place is no good. Not trying to insult you but it’s for your mental health. These Redditors aren’t worth it.

      • SynopsisTantilize@lemm.ee
        link
        fedilink
        arrow-up
        3
        ·
        4 months ago

        A lot of the places I’ve been to start conversation have been hostile and painful. If there is one thing that stands out that’s holding Lemmy back it’s the shitty culture this place can breed.

        • NauticalNoodle@lemmy.ml
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          4 months ago

          I’m convinced that a lot can be inferred from the type of reactions and the level of hostility one might receive by trying to present a calm and nuanced argument to a wedge topic. Even if it’s not always enjoyable. At the very least it also shows others that they may not be interacting rational actors when one gets their opponents to go full mask-off.

          • SynopsisTantilize@lemm.ee
            link
            fedilink
            arrow-up
            2
            ·
            4 months ago

            Agreed. And I’ve had my share of “being a dick” on the Internet here. But by the end of the interaction I try to at least jest. Or find a middle ground…I commented on a Hexbear instance by accident once…

          • SynopsisTantilize@lemm.ee
            link
            fedilink
            arrow-up
            1
            ·
            4 months ago

            I accidentally went to Hexbear the other day… But yea I guess. Just wish there was more participation and less negativity

    • NauticalNoodle@lemmy.ml
      link
      fedilink
      arrow-up
      4
      ·
      edit-2
      4 months ago

      I was hoping to comment on this post multiple times today after I initially lost track of It and now I see you’ve covered about 75% of what I wanted to say. I’ll post the rest elsewhere out of politeness. Thank you

  • recapitated@lemmy.world
    link
    fedilink
    arrow-up
    30
    arrow-down
    6
    ·
    edit-2
    4 months ago

    To be clear, I am happy to see a pedo contained and isolated from society.

    At the same time, this direction of law is something that I don’t feel I have the sophistication to truly weigh in on, even though it invokes so many thoughts for me.

    I hope we as a society get this one right.

  • Mubelotix@jlai.lu
    link
    fedilink
    arrow-up
    29
    arrow-down
    10
    ·
    4 months ago

    It’s not really children on these pics. We can’t condemn people for things that are not illegal yet

    • Microw@lemm.ee
      link
      fedilink
      arrow-up
      16
      arrow-down
      1
      ·
      4 months ago

      It’s Florida. They will simply book him and then present him a deal for “only x years prison”, which he’ll take and therefore prevent this from going to court and actually be ruled upon.

    • Nuke_the_whales@lemmy.world
      link
      fedilink
      arrow-up
      10
      ·
      4 months ago

      I’ve always wondered the same when an adult cop pretends to be a kid only to catch pedos. Couldn’t a lawyer argue that because there actually wasn’t a child, there wasn’t a crime?

    • Todd Bonzalez@lemm.ee
      link
      fedilink
      arrow-up
      4
      arrow-down
      3
      ·
      4 months ago

      It’s not really children on these pics.

      You are certain about this? If so, where are you getting that info, because it’s not in the article?

      Generative image models frequently are used for the “infill” capabilities, which is how nudifying apps work.

      If he was nudifying pictures of real kids, the nudity may be simulated, but the children are absolutely real, and should be considered victims of child pornography.

  • hightrix@lemmy.world
    link
    fedilink
    arrow-up
    17
    arrow-down
    3
    ·
    4 months ago

    He wasn’t arrested for creating it, but for distribution.

    If dude just made it and kept it privately, he’d be fine.

    I’m not defending child porn with this comment.

    • Todd Bonzalez@lemm.ee
      link
      fedilink
      arrow-up
      4
      arrow-down
      17
      ·
      4 months ago

      I’m not defending child porn with this comment.

      This is one of those cases where, even if you’re technically correct, you probably shouldn’t say out loud how you personally would get away with manufacturing child porn, because it puts people in the position of imagining you manufacturing child porn.

  • NauticalNoodle@lemmy.ml
    link
    fedilink
    arrow-up
    12
    arrow-down
    1
    ·
    4 months ago

    Show me multiple (let’s say 3+) small-scale independent academic studies or 1-2 comprehensive & large academic studies that support one side or another and I may be swayed, Otherwise I think all that is being accomplished is that one guys life is getting completely ruined for now and potentially forever over some fabrications and as a result he may or may not get help, but I doubt he’ll be better off.

    —My understanding was that csam has it’s legal status specifically because there are victims that are hurt by these crimes and possession supports a broader market that faciltates said harm to these victims. It’s not as easy to make a morality argument (especially a good one) for laws that effect everybody when there are no known victims.

    • emmy67@lemmy.world
      link
      fedilink
      arrow-up
      5
      arrow-down
      7
      ·
      4 months ago

      Are you stupid? Something has to be in the training model for any generation to be possible. This is just a new way to revitalise kids

      • NauticalNoodle@lemmy.ml
        link
        fedilink
        arrow-up
        4
        arrow-down
        1
        ·
        edit-2
        4 months ago

        So are you suggesting they can get an unaltered facial I.D. of the kids in the images? —Because that makes it regular csam with a specific victim (as mentioned), not an ai generative illustration.

        • emmy67@lemmy.world
          link
          fedilink
          arrow-up
          1
          arrow-down
          6
          ·
          4 months ago

          No, I am telling you csam images can’t be generated by an algorithm that hasn’t trained on csam

          • NauticalNoodle@lemmy.ml
            link
            fedilink
            arrow-up
            7
            arrow-down
            2
            ·
            edit-2
            4 months ago

            That’s patently false.

            I’m not going to continue to entertain this discussion but instead I’m just going to direct you to the multiple other people who have already effectively disproven this argument and similar arguments elsewhere in this post’s discusion. Enjoy.

      • ameancow@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 months ago

        Not necessarily, AI can do wild things with combined attributes.

        That said, I do feel very uncomfortable with the amount of defense of this guy, he was distributing this to people. If he was just generating fake images of fake people using legal training data in his own house for his own viewing, that would be a different story. The amount of people jumping in front of the bullet for this guy when we don’t really know the details is the larger problem.

  • spicystraw@lemmy.world
    link
    fedilink
    arrow-up
    25
    arrow-down
    16
    ·
    4 months ago

    I must admit, amount of comments that are defending AI images as not child porn is truly shocking.

    In my book, sexual images of children are not okay, AI generated or otherwise. Pedophiles need help, counseling and therapy. Not images that enable something I think is not acceptable in society.

    I truly do believe that AI images should be subject to same standards as regular images in what content we deem appropriate or not.

    Yes, this can be used to wrongfully prosecute innocent people, but it does not mean that we should freely allow AI-CP.

    • 31337@sh.itjust.works
      link
      fedilink
      arrow-up
      13
      ·
      4 months ago

      I generally think if something is not causing harm to others, it shouldn’t be illegal. I don’t know if “generated” CSAM causes harm to others though. I looked it up and it appears the research on whether CSAM consumption increases the likelihood of a person committing child abuse is inconclusive.

    • filcuk
      link
      fedilink
      arrow-up
      9
      arrow-down
      3
      ·
      edit-2
      4 months ago

      Agreed, especially considering it will eventually become indistinguishable.

    • OutsizedWalrus@lemmy.world
      link
      fedilink
      arrow-up
      5
      arrow-down
      4
      ·
      4 months ago

      You’re not kidding.

      The only possible way I could see a defense if it were something like “AI CSAM results in a proven reduction of actual CSAM”.

      But. The defenses aren’t even that!

      They’re literally saying that CSAM is okay. I’m guessing a lot of these same comments would argue that deepfakes are okay as well. Just a completely fucked up perspective.

    • tron@midwest.social
      link
      fedilink
      arrow-up
      14
      arrow-down
      13
      ·
      4 months ago

      Pedophiles need help, counseling and therapy. Not images that enable something I think is not acceptable in society.

      I mean 30-40 years ago you could replace the word pedophile with homosexual and a vast majority of people would agree. I’m not defending pedophilia here but it’s important to remember these people are born the way they are. Nothing is going to change that, new pedophiles are born every day. They will never go away. The same way you can’t change gay or transgender people. Repressing sexual desire never works look at the priests in the Catholic Church. A healthy outlet such as AI generated porn could save a lot of actual children from harm. I think that should be looked into.

      • spicystraw@lemmy.world
        link
        fedilink
        arrow-up
        5
        arrow-down
        1
        ·
        4 months ago

        Look, I get what you are saying and I do agree. However, I don’t think that comparing pedophilic relations to LGBTQ struggles is fair. One is consented relationship between consenting adults, other is exploitation and high probability of setup for lifelong mental struggles from young age.

      • nickiwest@lemmy.world
        link
        fedilink
        arrow-up
        1
        arrow-down
        2
        ·
        4 months ago

        I would like to know what source you have for claiming that pedophiles are “born the way they are.”

        We understand some of the genetic and intrauterine developmental reasons for homosexuality, being trans, etc. That has scientific backing, and our understanding continues to grow and expand.

        Lumping child predators in with consenting adults smacks of the evangelical slippery slope argument against all forms of what they consider to be “sexual deviance.” I’m not buying it.

    • Landless2029@lemmy.world
      link
      fedilink
      arrow-up
      6
      arrow-down
      6
      ·
      4 months ago

      Cant speak for others but I agree that AI-CP should be illegal.

      The question is how do we define the crime with our current laws? It does seem like we need a new law to address AI images. Both for things like AI-CP, revenge porn, and slanderous/misleading photos. (The Communist Harris and Trump with black people photos)

      Where do we draw the line?
      How do we regulate it?
      Forced watermarks/labels on all tools?
      Jail time? Fines?
      Forced correction notices? (Doesn’t work for the news!)

      This is all a slippery slope but what I can say is I hope this goes to court. He looses. Appeals. Then it goes all the way up to federal so we can have a standard to point to.

      The shit wrong.
      Step one in fixing shit.

    • WormFood@lemmy.world
      link
      fedilink
      arrow-up
      9
      arrow-down
      13
      ·
      4 months ago

      the number of people willing to bat for this on Lemmy is truly disturbing. what do they think these ai models are trained on?

      • ZeroHora@lemmy.ml
        link
        fedilink
        English
        arrow-up
        12
        arrow-down
        1
        ·
        4 months ago

        No necessarily is trained on CP, could be trained with images of children (already fuck up, who gave them that permission?) and pornography.

        • kaffiene@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          2
          ·
          4 months ago

          The article pointed out that stable diffusion was trained using a dataset containing CSAM

  • BilboBargains@lemmy.world
    link
    fedilink
    arrow-up
    18
    arrow-down
    10
    ·
    4 months ago

    If no children were involved in the production of porn, how is it pedophilic? That’s like claiming a picture of water has the same properties as water.

    • derpgon@programming.dev
      link
      fedilink
      arrow-up
      7
      arrow-down
      1
      ·
      4 months ago

      However, a picture of water makes me thirsty. But then again, there is no substitute for water.

      I am not defending pedos, or defending Florida for doing something like that.

      • Sarmyth@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        4 months ago

        That might be a you thing. Pictures of water dont make me thirsty. I get the metaphor you are attempting to make though.

    • Revan343@lemmy.ca
      link
      fedilink
      arrow-up
      2
      arrow-down
      1
      ·
      edit-2
      4 months ago

      It’s pedophillic because it’s sexual images of children; fake or not does not change that. Drawn images of child pornography are still pedophillic.

      The more important question is, is it CSAM? Whether drawn images that represent no real child are or not depends on the legal jurisdiction. Should drawn and AI generated child porn be legal or banned? I think the actual answer to that would require significant research into whether its existence acts as an outlet to prevent pedophiles from harming actual children, or whether it encourages their proclivities and makes them more likely to hurt actual children.

      Preventing harm to children should be the goal, but actual research of the effects of simulated child porn vis-a-vis pedophiles harming actual children is as unlikely to happen as any other research into pedophilia

    • Jimmyeatsausage@lemmy.world
      link
      fedilink
      arrow-up
      16
      arrow-down
      1
      ·
      4 months ago

      Even unrealistic depictions of children in a sexual context is considered CSAM.

      In the United States, the U.S. Supreme Court has defined child pornography as material that “visually depicts sexual conduct by children below a specified age”

      See New York v Ferber for more details

    • Cryophilia@lemmy.world
      link
      fedilink
      arrow-up
      10
      ·
      4 months ago

      Iirc it was for Florida “obscenity” laws, which covers literally anything the state government finds objectionable.

    • NotMyOldRedditName@lemmy.world
      link
      fedilink
      arrow-up
      4
      ·
      edit-2
      4 months ago

      I looked into this awhile back during a similar discussion.

      Creating the content itself is not necessarily illegal if its ficticious.

      Transmitting it over a public medium is very illegal, though.

      So if you create your own ficticious child porn locally and it never gets transmitted over the internet, you’d maybe be okay legally speaking from a federal perspective anyway.

      This guy transmitted it and broke the law.