this post was submitted on 23 Sep 2023
312 points (92.9% liked)

Technology

58061 readers
31 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

A very NSFW website called Pornpen.ai is churning out an endless stream of graphic, AI-generated porn. We have mixed feelings.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 8 points 1 year ago (9 children)

I am a little surprised that no one had created a site like this for child pornography.

I am not a legal expert, but my layman's understanding of Ashcroft v Free Speech Coalition https://en.wikipedia.org/wiki/Ashcroft_v._Free_Speech_Coalition is that as long as there is no person being harmed by it CSAM is legal.

Maybe later rulings have changed this. One can hope.

[–] [email protected] 6 points 1 year ago* (last edited 1 year ago)

Hentai maybe. But realistic shit is 100% illegal, even just making such an AI is illegal as you'd have to use real CSAM to train it.

[–] [email protected] 6 points 1 year ago (1 children)

CivitAI is a pretty perverted site at the best of times. But there's a disturbing amount of age adjustment plugins to make images of children on the same site they have plugins to make sex acts. It's clear some people definitely are.

[–] [email protected] 4 points 1 year ago (1 children)

Some models also prefer children for some reason and then you have to put mature/adult in positive prompt and child in negative

[–] [email protected] 3 points 1 year ago

I think part of the problem is that there is a lot of anime in the models and when you don't filter that out with negative prompts it can distort the proportions of realistic images. In general models are always heavily biased towards what they were trained on, and when you use a prompt or LORA that worked well on one model on another, you can get weird results. There is always a lot of nudging involved with keywords and weights to get the images to were you want it.

[–] [email protected] 5 points 1 year ago

There was an article the other day about underage girls in France having AI nudes spread around based on photos as young as 12. Definitely harm there.

[–] [email protected] 5 points 1 year ago (1 children)

I remember reading that this may be already happening to some extent, eg people sharing tips on creating it on the deep web, maybe through prompt engineer, fine tuning or pretraining.

I don’t know how those models are made, but I do wonder the ones that need retraining/finetuning by using real csam can be classified as breaking the law.

[–] [email protected] 3 points 1 year ago (1 children)

Well, to develop such a service, you need training data, i.e. lots of real child pornography in your possession.

Legality for your viewers will also differ massively around the world, so your target audience may not be very big.

And you probably need investors, which likely have less risky projects to invest into.

Well, and then there's also the factor of some humans just not wanting to work on disgusting, legal grey area stuff.

[–] [email protected] 5 points 1 year ago

Unfortunately, no, you just need training data on children in general and training data with legal porn, and these tools can combine it.

It's already being done, which is disgusting but not surprising.

People have worried about this for a long time. I remember a subplot of a sci-fi series that got into this. (I think it was The Lost Fleet, 15 years ago).

[–] [email protected] 2 points 1 year ago

You haven't been to 4chan lately because that's exactly what it's being used for

[–] [email protected] 2 points 1 year ago (1 children)

Surely we should know, right? Cartoons or hentai or whatever must have gone through this at some point?

[–] [email protected] 3 points 1 year ago (1 children)

Typically, the laws get amended so that anything that looks like CSAM is now CSAM. Expect porn generators tuned for minor characters to get outlawed very quickly.

[–] [email protected] 1 points 1 year ago

I'm sure they're out there on the deep web.

[–] [email protected] 0 points 1 year ago

You'd also have to convince them that it's not real. It'll probably end up creating laws tbh. Then there are weird things like Japan where lolis are legal, but uncensored genitals aren't, even drawn.