mlx-community/Meta-Llama-3-8B-Instruct-4bit #1013
-
|
Any ideas how much VRAM is required for this? |
Beta Was this translation helpful? Give feedback.
Answered by
awni
Apr 19, 2024
Replies: 2 comments
-
|
Just ran it on an 8GB M2 mini at 18.5 toks-per-sec. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
aPaleBlueDot
-
|
Found out, |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Just ran it on an 8GB M2 mini at 18.5 toks-per-sec.