Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Response data not available in Sequential chats, except for the first response #2644

Open
krishnashed opened this issue May 10, 2024 · 4 comments · May be fixed by #2677
Open

[Bug]: Response data not available in Sequential chats, except for the first response #2644

krishnashed opened this issue May 10, 2024 · 4 comments · May be fixed by #2677
Assignees
Labels
bug Something isn't working openai-assistant Issues related to assistants from OpenAI

Comments

@krishnashed
Copy link
Collaborator

krishnashed commented May 10, 2024

Describe the bug

After enabling the logging using:
logging_session_id = autogen.runtime_logging.start(config={"dbname": "execution_logs.db"})

we are only able to see the first response message,
image

rather than having a response for each chat message in request. Gist

Steps to reproduce

This is my code of Sequential chats:
https://gist.github.com/krishnashed/4ee198028895c0828158889a711b30f0

It creates a file called execution_logs.db

The response values for each message in request is missing, only the first response has a message. Also the cost calculation for entire groupchat is wrong.

Also the start_time and end_time dont seem to be correct, i think even that is start and end time for the first request call, not for the entire chat.
ex:
start_time 2024-05-10 10:00:25.214893
end_time 2024-05-10 10:00:30.203927

just has difference of 5s, the step in sequential chat doesnt end in 5seconds

Expected Behavior

It is expected that we get response objects of reach request, and the cost calculation happens accordingly

@krishnashed krishnashed added the bug Something isn't working label May 10, 2024
@krishnashed krishnashed self-assigned this May 10, 2024
@ekzhu
Copy link
Collaborator

ekzhu commented May 10, 2024

Thanks! @krishnashed can you check if it is caused by GPTAssistantAgent is not currently logged? If that's the case we can change this issue to be about logging and GTPAssistantAgent

@krishnashed
Copy link
Collaborator Author

@ekzhu i confirm this issue only happens with GPTAssistant

@krishnashed
Copy link
Collaborator Author

@ekzhu I had a doubt, while using when using ConversableAgent, Gist

for the logs generated in the .db file i.e
image

why do the entries from 1-5, donot have "Write tests for add todo functionality. Add all the code in structured format in /workspaces/autogen/project. \nMake sure to write the tests completely, donot leave the tests empty or incomplete\n" which is the task message for GroupChat, but they have the system_message of ConversableAgent as their first entry. Dont we pass the task message of GroupChat to the openai call being made, atleast in the first call (1st entry), but it doesnt get included.

@ekzhu ekzhu added the openai-assistant Issues related to assistants from OpenAI label May 11, 2024
@ekzhu
Copy link
Collaborator

ekzhu commented May 11, 2024

Dont we pass the task message of GroupChat to the openai call being made, atleast in the first call (1st entry), but it doesnt get included.

The group chat manager uses the task message when selecting the next speaker.

@krishnashed krishnashed linked a pull request May 14, 2024 that will close this issue
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working openai-assistant Issues related to assistants from OpenAI
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants