Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[laion5B is down] Create indices of other datasets to make the demo work #324

Open
yzou2 opened this issue Jan 5, 2024 · 8 comments
Open

Comments

@yzou2
Copy link

yzou2 commented Jan 5, 2024

Thanks for the great work on the OpenCLIP search index interface in https://rom1504.github.io/clip-retrieval/?back=https%3A%2F%2Fknn.laion.ai&index=laion5B-H-14&useMclip=false

But the host is down and we cannot search anything in that host. Would you kindly tell when the server will be back to normal status?

@rom1504
Copy link
Owner

rom1504 commented Jan 5, 2024 via email

@yzou2
Copy link
Author

yzou2 commented Jan 5, 2024

Thanks, is there an ETA for the search interface to get back to normal?

@rom1504
Copy link
Owner

rom1504 commented Jan 5, 2024

For laion5B to come back sadly I cannot really give an ETA, there's a lot of stuff going on there, with some not depending on us.

For any index to be available in this demo, there are some alternatives. We could create a few indices for:

  • cc3m
  • cc12m
  • datacomp1b
  • coyo700m

I guess that would help people.

What do you think?

@yzou2
Copy link
Author

yzou2 commented Jan 5, 2024

Thanks! If we can have some indices for datacomp1b (including people images), or the coyo700m, they will be definitely really helpful for many people.

@rom1504 rom1504 changed the title The clip front is down Create indices of other datasets to make the demo work Jan 7, 2024
@rom1504 rom1504 pinned this issue Jan 7, 2024
@helblazer811
Copy link

Is there another index that can be used as an alternative in the mean time?

@rom1504
Copy link
Owner

rom1504 commented Jan 8, 2024

No not yet

@rom1504 rom1504 changed the title Create indices of other datasets to make the demo work [laion5B is down] Create indices of other datasets to make the demo work Jan 23, 2024
@rom1504 rom1504 mentioned this issue Feb 21, 2024
@RobbeSneyders
Copy link

We created an index for the datacomp-12.8M dataset using Fondant and published it on the huggingface hub. You can find more details and info on how to use it in this short post.

@vpvsankar
Copy link

Any updates on datacomp1b and coyo700 indexing?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants