Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Activate NSFW filter? #656

Open
The-unknown-Shadowman opened this issue Apr 24, 2024 · 5 comments
Open

Activate NSFW filter? #656

The-unknown-Shadowman opened this issue Apr 24, 2024 · 5 comments
Labels
enhancement New feature or request

Comments

@The-unknown-Shadowman
Copy link

Hi. I want to use Krita and the AI Diffusion plugin in youthwork with children. Is there a switch, model or lora or anything else to activate NSFW secure filters? Negative prompts dont help. Some curious kids bypass negative prompts.

Thx.

@Acly
Copy link
Owner

Acly commented Apr 24, 2024

There's nothing implemented at the moment. I doubt any model or lora is safe. I think usually people use

  1. a list of banned words/expressions which are filtered from the prompt
  2. an image classification model which runs on the generated output and determines if it's safe

Ideally both. Depending with choice of classification model you will likely always either have things slip through, or end up with quite a few false positives, but that might be okay.

It's probably not difficult to integrate, but I don't have much time to search for good filter lists or models at the moment. There are some you can try online:

  1. https://huggingface.co/spaces/5m4ck3r/nsfw_image_detection
  2. https://huggingface.co/spaces/aka7774/safetychecker
  3. https://nudenet.notai.tech/

@The-unknown-Shadowman
Copy link
Author

Thank you very much for answering this fast. I'll give it a try.

@The-unknown-Shadowman
Copy link
Author

I found this plugin for comfyui but dont know how to implement it: https://github.com/42lux/ComfyUI-safety-checker

@Drakosha405
Copy link

some authors make SFW models. you can find them and try. SFW

@Acly
Copy link
Owner

Acly commented Apr 25, 2024

I found this plugin for comfyui but dont know how to implement it: https://github.com/42lux/ComfyUI-safety-checker

Yea that uses the model from 2. link I posted. There is a node for option 1. too, but not sure which is better.

@Acly Acly added the enhancement New feature or request label May 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants