Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add model sentencetransformers/multi-qa-MiniLM-L6-cos-v1 #41

Open
msj121 opened this issue Oct 23, 2023 · 1 comment
Open

Add model sentencetransformers/multi-qa-MiniLM-L6-cos-v1 #41

msj121 opened this issue Oct 23, 2023 · 1 comment
Labels
enhancement New feature or request model request request for supporting new models

Comments

@msj121
Copy link

msj121 commented Oct 23, 2023

Hi is there a way to support "sentencetransformers/multi-qa-MiniLM-L6-cos-v1". It is similar to sentencetransformers/AllMiniLML6V2.

Hopefully nothing changes to produce this version, just it was trained on questions and answers and might be more relevant for databases when I am trying to match specific queries which are submitted as questions?

@NirantK
Copy link
Collaborator

NirantK commented Oct 30, 2023

Will consider adding the model. Thanks for the suggestion!

Since you're interested in question-answer aware embedding: The default embedding is also aware of the question and answer split using prefixes. Here is how'd you that:

Add "query:" for questions:

"query: Who is Maharaja Shivaji?"

Add "passage:" to the documents that you index

"passage: This is an example passage."

This is also the behaviour in Qdrant's integration with FastEmbed. This model does much better on Retrieval than the multi-qa model to the best of my knowledge. Can check the latest on MTEB

@NirantK NirantK added the enhancement New feature or request label Oct 30, 2023
@NirantK NirantK changed the title Model Type support Add model sentencetransformers/multi-qa-MiniLM-L6-cos-v1 Jan 3, 2024
@generall generall added the model request request for supporting new models label Jan 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request model request request for supporting new models
Projects
None yet
Development

No branches or pull requests

3 participants