New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

llama2 - FP16 - IR generation #1946

Draft

PhaneeshB wants to merge 1 commit into nod-ai:main from PhaneeshB:llama2_val

Contributor

PhaneeshB commented Nov 8, 2023

fix combine mlir for llama2 for fp16 IR generation by keeping deduplicating constant variable names using appropriate suffix for first llama and second llama
needs to be tested for IR generation with int4 to see it doesn't break the generation flow for quantised IRs

PhaneeshB force-pushed the llama2_val branch from 20b370b to 7c1ce66 Compare

November 8, 2023 12:24

PhaneeshB marked this pull request as draft

November 8, 2023 12:24

Contributor Author

PhaneeshB commented Nov 8, 2023

Converted to draft till sanity check is done for int4 IR generation.

PhaneeshB requested a review from dan-garvey

November 8, 2023 12:28


          fix combine mlir for llama2

a53e714

PhaneeshB force-pushed the llama2_val branch from 7c1ce66 to a53e714 Compare

November 20, 2023 08:37

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment