Polish Massive Text Embedding Benchmark

💻 Installation

git clone https://github.com/rafalposwiata/pl-mteb
cd pl-mteb
pip install -r requirements.txt

🔨 Usage

python run_evaluation.py --models_config <PATH_TO_MODELS_CONFIG_FILE>

Example:
python run_evaluation.py --models_config configs/sentence_transformers.json

📜 Citation

@article{poswiata2024plmteb,
    title={PL-MTEB: Polish Massive Text Embedding Benchmark},
    author={Rafał Poświata and Sławomir Dadas and Michał Perełkiewicz},
    journal={arXiv preprint arXiv:2405.10138},
    year={2024}
}