MTEB: Massive Text Embedding Benchmark

Crosslingual Generalization through Multitask Finetuning

This repo supports various cross-lingual transfer learning & multilingual NLP models.

This repository contains the code, data, and models of the paper titled "CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs" published in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), July 9-14, 2023.

[EMNLP 2023] The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation

Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".

EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural language processing. Stay updated on the latest in machine learning, deep learning, and natural language processing with code included. ⭐ support NLP!

Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages (ACL 2023)

On Bilingual Lexicon Induction with Large Language Models (EMNLP 2023). Keywords: Bilingual Lexicon Induction, Word Translation, Large Language Models, LLMs.

Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.

Whisper is an automatic speech recognition (ASR) system trained on 680,000 hours of multilingual and multitask supervised data collected from the web. We show that the use of such a large and diverse dataset leads to improved robustness to accents, background noise and technical language. Moreover, it enables transcription in multiple languages, as

[EMNLP 2022] Discovering Language-neutral Sub-networks in Multilingual Language Models.

R library for Harmony

Solutions of the CMU Multilingual Natural Language Processing Course

IITK at SemEval Task 1: Semantic Textual Relatedness for African and Asian Languages

A collection of codes in a NMT series of Geultto 8th

The Harmony project

MaLA-500: Massive Language Adaptation of Large Language Models

Multilingual sarcasm detector for detecting sarcasm from news article titles

Winning Solution for the Bangla Complex Named Entity Recognition Challenge - BDOSN NLP Hackathon 2023