Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accessing Langsmith or phoenix #304

Open
Undertone0809 opened this issue Jan 3, 2024 · 0 comments
Open

Accessing Langsmith or phoenix #304

Undertone0809 opened this issue Jan 3, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@Undertone0809
Copy link
Owner

Undertone0809 commented Jan 3, 2024

馃殌 Feature Request

https://smith.langchain.com/ LangSmith is a great prompt engineering developement tool. LangSmith provide the ability to evaluate prompt, trace prompt record ...

I hope pne can use LangSmith to develop prompt engineering, we can use hook system to connect LangSmith, like LangChain.

Why need it?

For developers, trace can reduce the burden of data monitoring and provide the possibility of secondary analysis of data. For complex LLM projects, trace is necessary

LangSmith or Phoenix?

LangSmith is currently in beta testing, so we can integrate Phoenix and PNE's hook system to enable non-invasive integration of traces.

References

There are some LLM traces framework we can try to integration.

@Undertone0809 Undertone0809 added the enhancement New feature or request label Jan 3, 2024
@Undertone0809 Undertone0809 self-assigned this Jan 3, 2024
@Undertone0809 Undertone0809 changed the title Accessing Langsmith Accessing Langsmith or phoenix Jan 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Ready
Development

No branches or pull requests

1 participant