#

low-rank-adaptation

Here are 11 public repositories matching this topic...

serp-ai / LLaMA-8bit-LoRA

Repository for Chat LLaMA - training a LoRA for the LLaMA (1 or 2) models on HuggingFace with 8-bit or 4-bit quantization. Research only.

lora large-language-models llm large-language-model chatllama chat-llama low-rank-adaptation

Updated Aug 25, 2023
Python

liuqidong07 / MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

multi-task peft multitask-learning mixture-of-experts large-language-models chatglm low-rank-adaptation parameter-efficient-fine-tuning peft-fine-tuning-llm

Updated May 16, 2024
Python

hkproj / pytorch-lora

LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch

pytorch lora paper-implementations low-rank-adaptation

Updated Jul 24, 2023
Jupyter Notebook

garyfanhku / Galore-pytorch

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

pytorch lora low-rank-approximation peft large-language-models llm low-rank-adaptation finetuning-llms galore

Updated Mar 7, 2024
Python

alinourian / Fine-tuning-Mistral-7b-QA

Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans)

lora fine-tuning peft puffin multi-turn-dialogue wandb hugging-face gpt-4 large-language-models llm low-rank-adaptation parameter-efficient-fine-tuning mistral-7b

Updated Nov 23, 2023
Jupyter Notebook

monk1337 / NanoPeft

The simplest repository & Neat implementation of different Lora methods for training/fine-tuning Transformer-based models (i.e., BERT, GPTs). [ Research purpose ]

llama lora quantization mistral peft huggingface llm low-rank-adaptation qlora

Updated Apr 2, 2024
Jupyter Notebook

rochitasundar / Generative-AI-with-Large-Language-Models

This repository contains the lab work for Coursera course on "Generative AI with Large Language Models".

reinforcement-learning transformer kl-divergence proximal-policy-optimization large-language-models prompt-engineering flan-t5 instruction-finetuning low-rank-adaptation reward-model parameter-efficient-fine-tuning llm-evaluation

Updated Dec 1, 2023
Jupyter Notebook

Amelie-Schreiber / esm2_loras

Trying to train LoRAs for ESM-2

lora esm low-rank-adaptation

Updated Aug 6, 2023
Jupyter Notebook

VaradhKaushik / AI-Character-Forge

Advanced AI-driven tool for generating unique video game characters using Stable Diffusion, DreamBooth, and LoRa adaptations. Enhances creativity with customizable, high-quality character designs, tailored specifically for game developers and artists.

machine-learning deep-learning neural-network artificial-intelligence digital-art image-generation lora game-art video-game-development creative-ai ai-art character-design stable-diffusion dreambooth low-rank-adaptation

Updated May 18, 2024
Jupyter Notebook

bmaag90 / mtg-sd-lora

Stability AI SD-Turbo model fine-tuned using LoRA on Magic The Gathering artwork

magic-the-gathering lora stable-diffusion low-rank-adaptation

Updated Jan 18, 2024
Python

FranciscoRMendes / tensor-rank

Low Rank Approximation (Adaptation) Methods in Neural Networks

lora low-rank-factorization low-rank-approximation svd-matrix-factorisation low-rank-adaptation

Updated Apr 24, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the low-rank-adaptation topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the low-rank-adaptation topic, visit your repo's landing page and select "manage topics."