You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Bug Summary:
After fetching and processing files, the reranking model does not function as expected. Weights from the DebertaV2ForSequenceClassification are not properly initialized, leading to ineffective reranking outcomes. Additionally, there seems to be a lack of interaction from the reranker with the documents, suggesting it cannot interpret or process document content effectively.
Steps to Reproduce:
Run start_windows.bat with the following environment variables set:
Ensure that the RAG_RERANKING_MODEL variable points to a functional model.
Observe the system logs for errors or warnings related to model initialization and embedding generation.
Note the behavior of the reranking model during document processing.
Expected Behavior:
The reranking model should successfully initialize with pre-trained weights and effectively interpret and process documents to enhance search and retrieval outcomes.
Actual Behavior:
Initialization errors occur due to some weights not being loaded from the checkpoint.
The reranker does not interact effectively with document content, leading to no meaningful enhancements in search or document retrieval functionality as no results used.
Environment
Open WebUI Version: v0.1.124
Operating System: Windows 10, manual install, CUDA support
Browser: Chrome
Reproduction Details
Confirmation:
I have read and followed all the instructions provided in the README.md.
I am on the latest version of Open WebUI.
I have included the browser console logs.
I have included the CMD logs.
Additional Notes:
The issues occur consistently across multiple attempts with varying document types and contents.
Potential compatibility issues with the mightbe/Better-PairRM model could be a contributing factor to the initialization problems.
Other Reranking models with same issue.
Logs and Screenshots
WARNING:models.DebertaV2:Some weights of DebertaV2ForSequenceClassification were not initialized from the model checkpoint at C:\Users\Chris\.cache\huggingface\hub\models--mightbe--Better-PairRM\snapshots\c26058437c327e56e878163f74b345b4fb75ce98 and are newly initialized
INFO:apps.rag.main:file.content_type: application/pdf
INFO:apps.rag.main:store_data_in_vector_db
INFO:apps.ollama.main:generate_ollama_embeddings model='snowflake-arctic-embed:latest' prompt='[details of prompt not fully captured]'
INFO: 192.168.1.224:61610 - "GET /_app/immutable/nodes/5.9117d953.js HTTP/1.1" 304 Not Modified
INFO:apps.ollama.main:generate_ollama_embeddings
tjbck
changed the title
RAG_RERANKING not functional with manual Win10 install
bug: RAG_RERANKING not functional with manual Win10 install
May 18, 2024
Bug Report
Description
Bug Summary:
After fetching and processing files, the reranking model does not function as expected. Weights from the DebertaV2ForSequenceClassification are not properly initialized, leading to ineffective reranking outcomes. Additionally, there seems to be a lack of interaction from the reranker with the documents, suggesting it cannot interpret or process document content effectively.
Steps to Reproduce:
start_windows.bat
with the following environment variables set:RAG_RERANKING_MODEL
variable points to a functional model.Expected Behavior:
The reranking model should successfully initialize with pre-trained weights and effectively interpret and process documents to enhance search and retrieval outcomes.
Actual Behavior:
Environment
Reproduction Details
Confirmation:
Additional Notes:
mightbe/Better-PairRM
model could be a contributing factor to the initialization problems.Logs and Screenshots
Effectively it uses:
and then does
INFO:apps.ollama.main:generate_ollama_embeddings
where is reranking seen there?
The text was updated successfully, but these errors were encountered: