You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Llama.dll that can be downloaded from this repo is suitable mostly for programming languages that have abilities to work with rather difficult (for novice coder) concepts like pointers, structures etc. Does anybody know any simplified implementation of llama.dll? For example, it would be wonderful if it will be possible to work with this dll in such way:
CONSOLE
Dim LLama_DLL as Integer
Load "llama.dll" as LLama_DLL
Call function Load_Local_Gguf ("Llama-2-7b-q8.0.gguf") from LLama_DLL
Call function Set_Context_Size_For_Loaded_Gguf (4096) from LLama_DLL
Dim Answer$ As String
Dim Question$ As String
Label #Begin
Input Question$
Answer$ = Call function SentPromptToLoadedGguf (Question$) from LLama_DLL
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Llama.dll that can be downloaded from this repo is suitable mostly for programming languages that have abilities to work with rather difficult (for novice coder) concepts like pointers, structures etc. Does anybody know any simplified implementation of llama.dll? For example, it would be wonderful if it will be possible to work with this dll in such way:
CONSOLE
Dim LLama_DLL as Integer
Load "llama.dll" as LLama_DLL
Call function Load_Local_Gguf ("Llama-2-7b-q8.0.gguf") from LLama_DLL
Call function Set_Context_Size_For_Loaded_Gguf (4096) from LLama_DLL
Dim Answer$ As String
Dim Question$ As String
Label #Begin
Input Question$
Answer$ = Call function SentPromptToLoadedGguf (Question$) from LLama_DLL
Print Answer$
Goto #Begin
Beta Was this translation helpful? Give feedback.
All reactions