chat persistence breaks and chat deletion not working offline

[weipienlee]

What happened?

using the app offline i.e. disconnected from network/internet. Although, chatting with a ollama model works, switching between chats and/or creating a new one shows no/wrong content. deleting a chat is not possible.

It all seems to recover in a while when network/internet connection is available again.

potential cause: chat title uses another llm, likely a cloud service version/openai, since it is not generated when off-line. Not sure why this would be related to deleting

Steps to Reproduce

1. Assure you have a local llm inference service
2. disconnect network/internet
3. create a chat/thread (simple, just a model without tools) => get answer, chat title remain "New Chat"
4. create a new chat => content in chat pane remains, but you can just chat
5. switch back to previous chat => no chat content visible
6. delete chat => chat

main commit: f0e8cca
docker install on macos

What browsers are you seeing the problem on?

Firefox

Relevant log output

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

You can chat completely offline, I do it often.

Use this config for ollama

    - name: "Ollama"
      apiKey: "ollama"
      baseURL: "http://localhost:11434/v1/" # adjust as needed
# baseURL: "http://host.docker.internal:11434/v1/" # <-- usual value needed for docker
      models:
        default: [
          "llama3:latest",
          "command-r",
          "mixtral",
          "phi3",
          ]
        fetch: true
      dropParams: ["presence_penalty"]
      titleConvo: true
      titleModel: "current_model"

[danny-avila]

@weipienlee try making your both your SESSION_EXPIRY and REFRESH_TOKEN_EXPIRY longer durations.

for a completely local setup, it's fine to set this a longer value like this

SESSION_EXPIRY=(1000 * 60 * 60 * 24) * 7 # 7 days
REFRESH_TOKEN_EXPIRY=(1000 * 60 * 60 * 24) * 14 # 14 days

[weipienlee]

did that and cleared the cookies but no behaviour change. I think it's fair to assume that it is an auth problem for me. Will try re-install from scratch later.

Is this docker install guide still correct?

[fuegovic]

Is this docker install guide still correct?

yes this is correct

[weipienlee]

1. deleted all containers, images, and volumes
2. git clone https://github.com/danny-avila/LibreChat.git
3. cd LibreChat
4. cp .env.example .env and only filled in OPENAI_API_KEY
5. disconnect network and delete all cookies for http://localhost:3080
6. opened url in browser => get stuck before refresh
7. only after network connection the page continue to load

[weipienlee]

by the way, in any case, the login and new pages always show a 404 as shown above