You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I downloaded mMiniLMv2. The compressed package only contains the model file and no tokenizer information. However, from the shape of the embedding, it seems that mMiniLMv2 and mMiniLMv2 may use the same tokenizer.
like this:
from transformers import XLMRobertaTokenizer
tokenizer = XLMRobertaTokenizer.from_pretrained("microsoft/Multilingual-MiniLM-L12-H384")
The text was updated successfully, but these errors were encountered:
I downloaded mMiniLMv2. The compressed package only contains the model file and no tokenizer information. However, from the shape of the embedding, it seems that mMiniLMv2 and mMiniLMv2 may use the same tokenizer.
like this:
The text was updated successfully, but these errors were encountered: