Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Settings to set tokens for message history used #909

Open
3 tasks
dartpain opened this issue Apr 8, 2024 · 1 comment
Open
3 tasks

[FEATURE] Settings to set tokens for message history used #909

dartpain opened this issue Apr 8, 2024 · 1 comment
Assignees
Labels
application Application enhancement New feature or request frontend

Comments

@dartpain
Copy link
Contributor

dartpain commented Apr 8, 2024

This PR consists of 2 parts:

  1. Frontend: Create UI in settings general menu to allow users to explicitly set amount of last characters used in current conversation to set how many will be used to process a new answer. Basically a little input field. Add it to the API keys dropdown too.
  2. Backend: add parameters to /api/answer and /stream to include those limits for history of messages. Also add it to the /create api key endpoint.

Acceptance Criteria

  • Scenario: User can set token length for message history in settings

    • Given the user is in the settings general menu
    • When the user inputs a value for the token length
    • Then the token length is saved and used for processing new answers
  • Scenario: Backend API endpoints accept token length parameters

    • Given the user is using the API endpoints for answering and streaming messages
    • When the user includes the token length parameter in the request
    • Then the backend processes the request with the specified token length
  • Scenario: Token length is applied to API key creation

    • Given the user is creating a new API key
    • When the user inputs the desired token length
    • Then the API key is generated with the specified token length for message history processing
@dartpain dartpain added application Application enhancement New feature or request frontend labels Apr 8, 2024
@adi790uu
Copy link

@dartpain can you assign me this issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
application Application enhancement New feature or request frontend
Projects
Status: In Progress
Development

No branches or pull requests

3 participants