You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If developer want to use openai provider by pne.chat(). They can use pne.chat(messages="hello", model="openai/custom-model", model_config={"base_url": "xxxx", "api_key": "xxx"}) to chat with custom model. Model name use openai prefix.
Why?
There are lots of providers use OpenAI SDK to proxy their model, eg:
fromopenaiimportOpenAIfromosimportgetenv# gets API Key from environment variable OPENAI_API_KEYclient=OpenAI(
base_url="https://openrouter.ai/api/v1",
api_key=getenv("OPENROUTER_API_KEY"),
)
completion=client.chat.completions.create(
extra_headers={
"HTTP-Referer": $YOUR_SITE_URL, # Optional, for including your app on openrouter.ai rankings."X-Title": $YOUR_APP_NAME, # Optional. Shows in rankings on openrouter.ai.
},
model="openai/gpt-3.5-turbo",
messages=[
{
"role": "user",
"content": "Say this is a test",
},
],
)
print(completion.choices[0].message.content)
zhipu
What to do?
Optimize pne.chat() core code.
Add unit test
Add docs and notebook to show how to use custom model by openai in pne.chat()
Attention
In openrouter, openai need to add extra_headers. It's a question to consider.
The text was updated successfully, but these errors were encountered:
馃殌 Feature Request
Add pne.chat() use openai provider to proxy some specified model, eg:
If developer want to use openai provider by pne.chat(). They can use
pne.chat(messages="hello", model="openai/custom-model", model_config={"base_url": "xxxx", "api_key": "xxx"})
to chat with custom model. Model name useopenai
prefix.Why?
There are lots of providers use OpenAI SDK to proxy their model, eg:
Original:
Expect:
2.https://openrouter.ai/docs#principles
What to do?
pne.chat()
core code.pne.chat()
Attention
In openrouter, openai need to add extra_headers. It's a question to consider.
The text was updated successfully, but these errors were encountered: