This is a blind spot for me, do existing legal protections generally cover fake/generated content?
To be clear, the context of this thread is extremely important. I don't know how far our existing laws might go to make sure ML generated child porn is illegal and I'd personally feel much more comfortable to know that ML generation isn't some kind of legal loophole.
Last I heard it varies by jurisdiction. Some only prohibit things that actually involve actual children, some ban based on subject matter even if it's say a cartoon drawing.
I assume that training separate models for separate jurisdictions would be rather expensive, so probably unlikely.
I'm sure they're preventing any prompts that explicitly ask for child porn, but they can't stop the inevitably difficult challenge of knowing when an image is porn of a child versus porn of someone that just looks under age versus graphic imagery of a child that may not meet some specific definition of what makes it porn.