Proposal: Implement a Prompt Manager for OpenDevin

[marikan114]

Dear OpenDevin team,

I propose implementing a prompt manager to streamline the prompt development process and enhance group collaboration.

The benefits include prompt versioning, evaluation, curation, sharing, and security (access controls and permissions).

Please share your thoughts and feedback on this proposal.

Thank you!

[tonyppe]

how would access controls and permissions work do you think?

What would prompts consist of? How would the prompts control the LLM responses and retries?

[marikan114]

Thanks for your questions @tonyppe!

For example, a prompt gallery or library on the tab list helps users record or reuse their prompts. Users can access the prompts based on their privileges to reuse a prompt, clone it, make edits, and save it for a specific LLM.

For the moment, different LLMs require slightly different prompts, and keeping track of this is becoming a hassle. This will become more of an issue in a collaborative environment.

What do you think?

[tonyppe]

I like your idea and intent and I do this myself very basically.

However this is negated when the LLM response is controlled. Does opendevin implement any LLM response control or is it done through litellm perhaps.

This is the problem I'm seeing across all of the open source projects. And across all of the projects, I don't see LLM response control being implemented in such a way that allows us to utilise it. Then only thing close I've found is CrewAI.