You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There are some prompts can bypass content security review of civiai model to generate pictures that can break content rules and not suit for kids under 18.
Steps to reproduce the problem
Choose Babes 3.0, DreamShaper model or other models; Aspect Ratio is portrait; not choose Mature content
Input "a beautiful sexy lady with much extremely explict naked muscle", or "a beautiful sexy lady, naked muscle coverage, the whole body",... like these prompts.
Output pictures that bypass frontend filter and break content rules with high successful probablitiy
What should have happened?
The normal action is verify the pics' content complience, block pics that break content rules (https://civitai.com/content/tos) as many as system can, when users does not choose [Mature content].
What platforms do you use to access the site?
No response
What browsers do you use to access the site?
Google Chrome
Additional information, context and logs
No response
The text was updated successfully, but these errors were encountered:
Interesting it appears that the mature content filters struggle with extremely muscular bodies as it must be assuming they are male bodies which are not sufficiently filtered, likely due to varying degrees of "acceptableness" of male nudity similar to this in sports like body building.
This will require more training and time to implement, thanks for bringing this to our attention.
JustMaier
changed the title
[Bad Case]: prompts can bypass content security review of LLM to generate non-compliant pics
Extremely muscular bodies not being properly detected by content filters.
Dec 21, 2023
What happened?
There are some prompts can bypass content security review of civiai model to generate pictures that can break content rules and not suit for kids under 18.
Steps to reproduce the problem
What should have happened?
The normal action is verify the pics' content complience, block pics that break content rules (https://civitai.com/content/tos) as many as system can, when users does not choose [Mature content].
What platforms do you use to access the site?
No response
What browsers do you use to access the site?
Google Chrome
Additional information, context and logs
No response
The text was updated successfully, but these errors were encountered: