New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Does it support llama3? #785
Comments
Thanks for your interest in LMFlow! We currently support single-gpu training of LLaMA-3-7b with LISA. We are working on the multi-gpu model-parallelism version, hopefully in 1-2 weeks, please stay tuned. Thanks for your understanding 😄 |
Do you support llama 2-7b? Or llama 3-8B? llama3-7b does not exist. |
Yes we support both models as long as the access is granted from huggingface repo for your huggingface account. |
Which parameter is used to configure authorized account related information? |
You may first switch to lmflow conda env using conda activate YOUR_ENV_NAME then use huggingface-cli login and follow the instructions. |
Does it support multi-gpu raining llama3 with lisa ?
The text was updated successfully, but these errors were encountered: