Improve: Research Agent Regex Parsing

[hjamet]

Description

Improvements

• Resolves numerous infinite loop issues caused by LLM response format errors, especially for OLLAMA models like LLAMA3.
• Significantly simplifies agent code and avoids duplication by introducing a new parent class that enables automatic response validation.

Resolved Issues

• Not working with LLM #396
• when building app with OLLAMA response returns Invalid response from the model, trying again... #347

The list may not be exhaustive.

Related Pull Requests

• Update prompt.jinja2 with an example for more consistent format reply (https://github.com/stitionai/devika/issues/429) #438 : Both pull requests are compatible. They aim to solve the same issue but with different approaches that can be combined.

Explanations

1. The current version of Devika expects to receive a specific JSON or MARKDOWN response format from LLMs in order to parse them correctly. Unfortunately, LLMs (especially smaller models like LLAMA3) do not always manage to respond perfectly to this task and bury their JSON between explanations, making their response impossible to parse. This pull request aims to use REGEX for better extraction of responses from LLMs.

2. Furthermore, in order to simplify this method and generalize it to all agents easily and without duplicating code, I propose in this pull request a new parent class for agents AgentTemplate which offers generic render & parse_answer methods that automatically extract the expected format from prompt.jinja2 and perform the expected validations. This modification significantly simplifies the code by reducing about 2/3 of the code for each agent, while avoiding repetition and limiting errors of the type "Invalid response from the model, trying again..."

For now, and as an example and test, I have only modified the RESEARCH agent, which now works perfectly with all LLMs I have tested: GPT4, CLAUDE OPUS, MISTRAL 8x7B, LLAMA3, and GEMMA. Once this pull request is validated, I am committed to adapting all the other agents in the same way.

[hjamet]

ONLY BETTER FORMATTING : NO MODIFICATIONS

[hjamet]

JUST ADD THE NEW FILES

[hjamet]

IGNORE VSCODE & REORGANIZE A BIT

[hjamet]

THE MAIN MODIFICATION

The parent class of all agents uses regex to efficiently parse LLM responses

[hjamet]

ONLY FORMATING

[hjamet]

SMALL PROMPT MODIFICATION

To avoid getting more than 3 web search

[hjamet]

ADAPT AGENT TO NEW MOTHER CLASS

Adaptation of the Research Agent to the changes made in the pull request

[darrassi1]

#469 and #438 works very well

[odeemi]

This is a big improvement when using ollama. Hopefully it's merged soon 👍

[ARajgor]

can you do this for all the agents?

[hjamet]

can you do this for all the agents?

Of course ! I will fix the conflicts and extend the idea to all agents :)

[epem]

Thanx! Good job!

[mirek190]

still waiting to merge ....