Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
.gitignore		.gitignore
Falcon_fine_tune.ipynb		Falcon_fine_tune.ipynb
LICENSE		LICENSE
README.md		README.md

Repository files navigation

falcon-7b-lora-fine-tuning

use google colab for the training

Dataset

https://huggingface.co/datasets/Atom007/mc4-japanese-data

Base falcon model

https://huggingface.co/ybelkada/falcon-7b-sharded-bf16

About

falcon-7b-lora-fine-tuning

japanese pytorch falcon transformer peft huggingface llm

Apache-2.0 license

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%