add llama3's prompt template to conversation.py

[KazutoshiShinoda]

No description provided.

[KazutoshiShinoda]

#1426

[awzhgw]

@KazutoshiShinoda can add preprocess_llama_3 func code? i will test it on prepare stage

[Jayantverma2]

what about prepocess during LazySupervisedDataset

[mmaaz60]

Hi @KazutoshiShinoda, @awzhgw , @Jayantverma2 ,

I hope you are doing well. We have just released our project LLaVA++: Extending Visual Capabilities with LLaMA-3 and Phi-3, which features LLaMA-3 and Phi-3-Mini based LLaVA models. Please have a look at this at LLaVA++.

• We have released the codes required to support both LLaMA-3 & Phi-3-Mini models in LLaVA framework. The chat formats and corresponding preprocess methods are available at our GitHub repo.
• We released all the checkpoints on Hugging Face
• On our GitHub repository we have provided .py files that needs to be replaced/added to official LLaVA repository to train and infer LLaMA-3 & Phi-3-Mini based models.

I hope this would be helpful. Please let me know if you have any questions. Thanks