Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Waiting for embedding & rerank models #2848

Open
hkwz2023 opened this issue Apr 29, 2024 · 1 comment
Open

feat: Waiting for embedding & rerank models #2848

hkwz2023 opened this issue Apr 29, 2024 · 1 comment
Labels
Cortex Cortex, Cortex llama cpp, core extensions type: feature request A new feature

Comments

@hkwz2023
Copy link

It would be perfect if server could add embedding and reRank model loading and corresponding api, looking forward to it.
@hkwz2023 hkwz2023 added the type: feature request A new feature label Apr 29, 2024
@Van-QA Van-QA added the Cortex Cortex, Cortex llama cpp, core extensions label May 2, 2024
@BradKML
Copy link

BradKML commented May 6, 2024

Seconding this as currently places like LocalAI and Xinterface has them, and Ollama+LiteLLM might integrate Rerank models as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Cortex Cortex, Cortex llama cpp, core extensions type: feature request A new feature
Projects
Jan
Status: No status
Milestone
No milestone
Development

No branches or pull requests
3 participants
@BradKML @Van-QA @hkwz2023