Custom phi2 use

Custom use of Phi2 model wich is an open source LLM. We use 2B version.

Objectives

• POC : use Phi2 model and prove it's sufficient for our use (tips for creating dishes from various ingredients)
• Model quantization for performances improvement
• Offline use with acceptables performances

Requirements

You need to install right transformers version :

python -m pip install git+https://github.com/huggingface/transformers

Usage

Launch POC

python main.py

Results

TODO

• First Phi-2 use
• Try custom prompt
• Improve prompt
• Offline use
• Model quantization

Resources

• HuggingFace documentation
• LLM courses