Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train Models Within Kalosm #44

Open
ealmloff opened this issue Aug 20, 2023 · 1 comment
Open

Train Models Within Kalosm #44

ealmloff opened this issue Aug 20, 2023 · 1 comment
Labels
enhancement New feature or request

Comments

@ealmloff
Copy link
Collaborator

You should be able to train some models based off of a workflow in Floneum using either burn or candle.

This can be useful to "flatten" a workflow into a model. For example, you could have a workflow that does classification on reddit posts. Initially you build that workflow to use llama2 to recognize certain posts. After you get the workflow working, you can hook up a classifier to learn the task the language model is doing. After running it overnight, you should be able to replace the language model with a much faster, smaller classifier

Initially I would like to just support classifiers because you can train them quickly without a GPU, but in the future we could add fine tuning language models, or image models.

@ealmloff ealmloff added the enhancement New feature or request label Aug 20, 2023
@ealmloff ealmloff changed the title Train Models Within Floneum Train Models Within Kalosm Dec 5, 2023
@ealmloff
Copy link
Collaborator Author

ealmloff commented Dec 5, 2023

You can now train a classifier in Kalosm. We should support fine tuning models in Kalosm first before we provide an interface in Floneum

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant