You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
When indexing multimodal data with images into a text model (hf/all_datasets_v4_MiniLM-L6) raises a 500 internal error.
Marqo output:
image_vectors = s2_inference.vectorise(
File "/app/src/marqo/s2_inference/s2_inference.py", line 74, in vectorise
vector_batches.append(_convert_tensor_to_numpy(available_models[model_cache_key][AvailableModelsKey.model].encode(batch, normalize=normalize_embeddings, **kwargs)))
File "/app/src/marqo/s2_inference/hf_utils.py", line 138, in encode
inputs = self.tokenizer(sentence, padding=True, truncation=True, max_length=self.max_seq_length,
File "/usr/local/lib/python3.8/dist-packages/transformers/tokenization_utils_base.py", line 2548, in __call__
encodings = self._call_one(text=text, text_pair=text_pair, **all_kwargs)
File "/usr/local/lib/python3.8/dist-packages/transformers/tokenization_utils_base.py", line 2606, in _call_one
raise ValueError(
ValueError: text input must of type `str` (single example), `List[str]` (batch or single pretokenized example) or `List[List[str]]` (batch of pretokenized examples).
To Reproduce
Steps to reproduce the behavior:
Create a marqo index with model hf/all_datasets_v4_MiniLM-L6
Index documents in multimodal form with images
Observe error in marqo and client
Expected behavior
Marqo should return a 400 with a better message explaining why the error happened.
Screenshots
Client error:
Marqo error:
Desktop (please complete the following information):
SageMaker notebook client
The text was updated successfully, but these errors were encountered:
Describe the bug
When indexing multimodal data with images into a text model (
hf/all_datasets_v4_MiniLM-L6
) raises a 500 internal error.Marqo output:
To Reproduce
Steps to reproduce the behavior:
hf/all_datasets_v4_MiniLM-L6
Expected behavior
Marqo should return a 400 with a better message explaining why the error happened.
Screenshots
Client error:
Marqo error:
Desktop (please complete the following information):
The text was updated successfully, but these errors were encountered: