You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When replacing OpenAI() with AzureOpenAI() in backend/app/chat/engine.py, chat responses are empty. The frontend will display "Sorry, I either wasn't able to understand your question or I don't have an answer for it.".
I have confirmed that the AzureOpenAI parameters are correct, as I have gotten valid embeddings and chat completion responses back while debugging with the same objects passed to the chat_engine.
I have added those Azure specific values to config.py and have confirmed the parameters are correct by getting valid completions and embeddings via the debugger. They are also set via set -a; source .env before running.
I've also explicitly set AZURE_OPENAI_ENDPOINT.
Has anyone else had success getting this project to work correctly with Azure Open AI?
The text was updated successfully, but these errors were encountered:
There is an issue with openai_agent.astream_chat method when the llm is AzureOpenAI instead of parent OpenAI class instance. You can reproduce it like this: run-llama/llama_index#9219
When replacing
OpenAI()
withAzureOpenAI()
inbackend/app/chat/engine.py
, chat responses are empty. The frontend will display "Sorry, I either wasn't able to understand your question or I don't have an answer for it.".I have confirmed that the AzureOpenAI parameters are correct, as I have gotten valid embeddings and chat completion responses back while debugging with the same objects passed to the
chat_engine
.This is how I am constructing the chat_llm:
I have added those Azure specific values to config.py and have confirmed the parameters are correct by getting valid completions and embeddings via the debugger. They are also set via
set -a; source .env
before running.I've also explicitly set
AZURE_OPENAI_ENDPOINT
.Has anyone else had success getting this project to work correctly with Azure Open AI?
The text was updated successfully, but these errors were encountered: