You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
BAAI/bge-reranker-v2-minicpm-layerwise could not be used in RAG doucment setting
but BAAI/bge-reranker-v2-m3 is ok and no problem
Description
failed as attached
Bug Summary:
equires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error.
Steps to Reproduce:
[Outline the steps to reproduce the bug. Be as detailed as possible.]
copy the BAAI/bge-reranker-v2-minicpm-layerwise in to Reranking Model
Expected Behavior:
[Describe what you expected to happen.]
Actual Behavior:
[Describe what actually happened.]
Environment
Open WebUI Version: v0.1.124
Ollama (if applicable): 0.1.34
Operating System: wsl2 win11 docker for desktop
Browser (if applicable): chrome
Reproduction Details
Confirmation:
I have read and followed all the instructions provided in the README.md.
I am on the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
Logs and Screenshots
Browser Console Logs:
[Include relevant browser console logs, if applicable]
Docker Container Logs:
[Include relevant Docker container logs, if applicable]
2024-05-09 18:23:12 Traceback (most recent call last):
2024-05-09 18:23:12 File "/app/backend/apps/rag/main.py", line 298, in update_reranking_config
2024-05-09 18:23:12 update_reranking_model(app.state.RAG_RERANKING_MODEL, True)
2024-05-09 18:23:12 File "/app/backend/apps/rag/main.py", line 151, in update_reranking_model
2024-05-09 18:23:12 app.state.sentence_transformer_rf = sentence_transformers.CrossEncoder(
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 66, in init
2024-05-09 18:23:12 self.config = AutoConfig.from_pretrained(model_name, trust_remote_code=trust_remote_code, revision=revision)
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1141, in from_pretrained
2024-05-09 18:23:12 trust_remote_code = resolve_trust_remote_code(
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 622, in resolve_trust_remote_code
2024-05-09 18:23:12 raise ValueError(
2024-05-09 18:23:12 ValueError: Loading /app/backend/data/cache/embedding/models/models--BAAI--bge-reranker-v2-minicpm-layerwise/snapshots/47b5332b296c4d8cb6ee2c60502cc62a0d708881 requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error.
Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]
Installation Method
[Describe the method you used to install the project, e.g., manual installation, Docker, package manager, etc.]
Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
This discussion was converted from issue #2137 on May 09, 2024 15:21.
Heading
Bold
Italic
Quote
Code
Link
Numbered list
Unordered list
Task list
Attach files
Mention
Reference
Menu
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Bug Report
BAAI/bge-reranker-v2-minicpm-layerwise could not be used in RAG doucment setting
but BAAI/bge-reranker-v2-m3 is ok and no problem
Description
failed as attached
Bug Summary:
equires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option
trust_remote_code=True
to remove this error.Steps to Reproduce:
[Outline the steps to reproduce the bug. Be as detailed as possible.]
copy the BAAI/bge-reranker-v2-minicpm-layerwise in to Reranking Model
Expected Behavior:
[Describe what you expected to happen.]
Actual Behavior:
[Describe what actually happened.]
Environment
Open WebUI Version: v0.1.124
Ollama (if applicable): 0.1.34
Operating System: wsl2 win11 docker for desktop
Browser (if applicable): chrome
Reproduction Details
Confirmation:
Logs and Screenshots
Browser Console Logs:
[Include relevant browser console logs, if applicable]
Docker Container Logs:
[Include relevant Docker container logs, if applicable]
2024-05-09 18:23:12 Traceback (most recent call last):
2024-05-09 18:23:12 File "/app/backend/apps/rag/main.py", line 298, in update_reranking_config
2024-05-09 18:23:12 update_reranking_model(app.state.RAG_RERANKING_MODEL, True)
2024-05-09 18:23:12 File "/app/backend/apps/rag/main.py", line 151, in update_reranking_model
2024-05-09 18:23:12 app.state.sentence_transformer_rf = sentence_transformers.CrossEncoder(
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 66, in init
2024-05-09 18:23:12 self.config = AutoConfig.from_pretrained(model_name, trust_remote_code=trust_remote_code, revision=revision)
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1141, in from_pretrained
2024-05-09 18:23:12 trust_remote_code = resolve_trust_remote_code(
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 622, in resolve_trust_remote_code
2024-05-09 18:23:12 raise ValueError(
2024-05-09 18:23:12 ValueError: Loading /app/backend/data/cache/embedding/models/models--BAAI--bge-reranker-v2-minicpm-layerwise/snapshots/47b5332b296c4d8cb6ee2c60502cc62a0d708881 requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option
trust_remote_code=True
to remove this error.Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]
Installation Method
[Describe the method you used to install the project, e.g., manual installation, Docker, package manager, etc.]
Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
Beta Was this translation helpful? Give feedback.
All reactions