It would be good if Executors did not at [end of text] or \n> at the end of the inference #581
clovisribeiro
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
It would be great if LLamaInteractExecutor and LLamaInstructExecutors did not add extra stuff at the end of the inference's result. (They currently add "[end of text]" and "\n> " respectively. I believe many applications using those executors will be doing something else with the result, so having the plain text without any extra stuff is better.
I guess the demos showing how to use those executors could add the extra stuff.
Beta Was this translation helpful? Give feedback.
All reactions