Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve RAG debugging in backend #176

Open
anada10 opened this issue Apr 22, 2024 · 0 comments
Open

Improve RAG debugging in backend #176

anada10 opened this issue Apr 22, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@anada10
Copy link
Contributor

anada10 commented Apr 22, 2024

Currently backend logs are not good for RAG retrievals. Need to show it more like this

6/k payloads were retrieved
{chunkId: 1232143213213432
  parentName: elon_tweets
  chunkText: "i love bears"
  chunkRank: 1
  chunkStrategy: semantic/character/message
  chunkCosineScore: 0.92
  chunkTokens: 8
  chunkCreatedDate: utc timestamp
  topK: 10
   embeddingModel: bge/small   
     metadata {
       dateTweeted: 12/12/22
       length: 123232
       ...
     }
}

Users should also be able to see retrieval stats at a chunk level

@anada10 anada10 added the enhancement New feature or request label Apr 22, 2024
tomlynchRNA added a commit that referenced this issue Apr 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Backlog Q2 2024
Development

No branches or pull requests

3 participants