Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Solar power in India topic no longer differentiated by RAG #8

Open
2 tasks done
zackproser opened this issue Jan 11, 2024 · 2 comments
Open
2 tasks done
Labels
bug Something isn't working

Comments

@zackproser
Copy link
Collaborator

Is this a new bug?

  • I believe this is a new bug
  • I have searched the existing issues, and I could not find an existing issue for this bug

Current Behavior

Relates to #7

If you click Embed and Upsert on the India topic and then ask a simple question like what is going on with Solar Power in India?

Both the RAG and Non-RAG pipeline to illustrate the original point we're trying to.

Expected Behavior

The Non-RAG pipeline should underperform relative to the RAG pipeline.

Steps To Reproduce

Ask simple questions on the app after embedding the Solar in India topic

Relevant log output

No response

Environment

- **OS**:
- **Language version**:
- **Pinecone client version**:

Additional Context

No response

@zackproser zackproser added the bug Something isn't working label Jan 11, 2024
@ellebythesea
Copy link
Collaborator

Why doesn't the non-rag underperform?

@athrael-soju
Copy link

Why doesn't the non-rag underperform?

It's likely due to the gpt model already having been trained in that data and can retrieve the answer without needing RAG based context.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants