Video-CLIP-Indexer

A GUI short-video 'clip' indexer in 60 lines.

Basic Usage

1. Install requirements

pip install -r requirements.txt

2. Run the streamlit GUI

streamlit run app.py

3. Extract the key frames from video

Click the extract after uploading your video, the key frames will be extracted and stored in DocumentArray

4. Search for what you want

After extracting key frame, input your text query and click search, and then you will get the related clips

Notice: remember to click extract when you want to search for another video after you uploading it.

Parameters

Text Query

You can use a prompt to describe the scene you want to search for. The indexer will return several clips related to it.

Top N

The number of video clips you want to be returned.

Similarity Threshold

The results with the similarity score lower than the threshold will not be returned.

CLIP-as-service Server

The url of CLIP-as-service Server. The default value is a demo server loaded with ViT-L/14-336px provided by Jina.ai. You can also run your own CLIP-as-service server.

Token

The token for accessing CLIP-as-service Server. More details for this can be found here