Aesthetic scoring doesn't seem to work at clip-front ui.

[SharDi0]

I am using clip front ui in web and I'm trying to make use of aesthetic scoring option but it doesn't change results at all. I've read it worked before and showed results I need, but not anymore. Is there anything I could do to make it work?

[rom1504]

Works only with L/14 ; you can switch to it

We could make it work for H i guess @nousr

[SharDi0]

still no changes after switching to L-14. I also must note that this issue appears for other people too.

[nousr]

@rom1504 it seems @SharDi0 is correct -- i wasn't able to get aesthetic weighting to work with the L/14 model ... maybe i accidentally disabled it in the config? checking now

regarding creating aesthetic embeddings for h/14 -- i guess its possible, we an discuss in DM about what that would entail

[nousr]

@SharDi0 it should work now with the L/14 and B/32 indices

[SharDi0]

thank you very much for fixing it, while we're on this topic about aesthetic weighting, is there anywhere where I could learn what exactly does score and weight do and how it works works with images?

[rom1504]

I computed prediction by Laion aesthetic V1 in buckets from 0 to 10 Then i averaged the laion2B L/14 embeddings for each bucket That gave a 0 embedding, a 1 one, etc What the UI does is take your query embedding (eg image or text embedding) and do a weighted average with it The score is the bucket. The weight is the weight given to the aesthetic embedding in this average

…

On Tue, Feb 7, 2023, 20:52 SharDi0 ***@***.***> wrote: thank you very much for fixing it, while we're on this topic about aesthetic weighting, is there anywhere where I could learn what exactly does score and weight do and how it works works with images? — Reply to this email directly, view it on GitHub <#243 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAR437TDV2FQV5HPG5BBFBDWWKRX3ANCNFSM6AAAAAAUT2UFMI> . You are receiving this because you were mentioned.Message ID: ***@***.***>