Try out your own prompts here.
Set up a python environment and run
pip install -r requirements.txt
papermill Translation.ipynb out.ipynb -p input_lang fr -p target_lang zh
papermill Cloze.ipynb out.ipynb -p target_lang fr
For your convenience, we also provide some precomputed latents on huggingface. Here are some preliminary steering experiments using the precomputed latents.
Starting point of this repo was Nina Rimsky's Llama-2 wrapper.
@article{wendler2024llamas,
title={Do Llamas Work in English? On the Latent Language of Multilingual Transformers},
author={Wendler, Chris and Veselovsky, Veniamin and Monea, Giovanni and West, Robert},
journal={arXiv preprint arXiv:2402.10588},
year={2024}
}