Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Cannot find global function vm.builtin.apply_presence_and_frequency_penalty #315

Open
DavidGOrtega opened this issue Feb 27, 2024 · 4 comments

Comments

@DavidGOrtega
Copy link
Contributor

I have updated to latest version and my models are throwing this error:

Init error, Error: Cannot find global function vm.builtin.apply_presence_and_frequency_penalty

Last known version that worked for me was v0.2.18

@CharlieFRuan
Copy link
Contributor

CharlieFRuan commented Feb 27, 2024

Hi! Are the models from https://github.com/mlc-ai/binary-mlc-llm-libs or did you compile the models yourself? If it is the latter case, you'd have to recompile them like here mlc-ai/binary-mlc-llm-libs#90. If it is the former case, you'd need to delete the cached model library from cache (there is a new API for this #314; or you could do it in browser's console) so that the new model library could be downloaded.

@DavidGOrtega
Copy link
Contributor Author

@CharlieFRuan if I try to use the version v0.2.18 that was working for me previously I have the same error!!!
Should not TVMjs be pinned?

@CharlieFRuan
Copy link
Contributor

Hmm this is not really expected as I only added apply_presence_and_frequency_penalty in #299.

@DavidGOrtega
Copy link
Contributor Author

@CharlieFRuan my fault. I was not pinning exactly and was downloading .23 : 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants