You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for your interest in LMFlow! You may check speculative_inference.py, where you can replace SpeculativeInferencer with Inferencer (along with their arguments) in examples/chatbot.py. Please feel free to contact us again if there is any problem during the usage. Thanks very much 😄
Hi, is there any example of python code that can run inference instead of using the command line? If so can you kindly share
The text was updated successfully, but these errors were encountered: