Skip to content

Releases: zetavg/LLaMA-LoRA-Tuner

v0.0.20230421

21 Apr 21:18
d2eef14
Compare
Choose a tag to compare

New Features

Fine-tuning

  • "Continue from model" now supports using a remote model from Hugging Face Hub.
  • New advanced fine-tune arg: lora_modules_to_save
  • New advanced fine-tune arg: 8bit, FP16, BF16, gradient_checkpointing
  • Support passing additional LoraConfig and TrainingArguments.
  • "Load training parameters from selected model" will now also load the prompt template and dataset.
  • Model trainalbe% will be logged to wandb under config model.trainable%, model.all_params and model.trainable_params.

Initial Release

21 Apr 18:10
dd931be
Compare
Choose a tag to compare
v0.0.20230420

fix