Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Perturbed-Attention Guidance toggle. #622

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

FeepingCreature
Copy link
Contributor

@FeepingCreature FeepingCreature commented Apr 16, 2024

See https://ku-cvlab.github.io/Perturbed-Attention-Guidance/

I worry this is following a bad precedent with the SAG PR, of which it is a copypaste. The issue is that, in testing, once again it didn't really make images look unconditionally better for me, so much as different - but different in a different fashion than SAG!

(This raises fun questions, such as "what is the correct node order between PAG and SAG". I shall not answer them.)

I mostly want to have this PR out here in case people want to play around with it.

@Acly
Copy link
Owner

Acly commented Apr 17, 2024

I tried it out some. This one is a bit more interesting. It can give some dramatic changes for the better when you don't use a prompt. Usually that's not super useful, but at lower denoise strength it can be used as a sort of "repair" to fix & clean up images without having to describe them. The question is how to integrate that in way it can be discovered rather than hidden toggle.

For regular prompted workflows it just sort of changes them a bit... more impact than SAG but yes, not always better. Still costs 30% performance too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants