🚀Create a Search Engine within an Image use SAM(Segment Anything) and CLIP (Constrastive Language Image Pretraining) model.
Follow the Colab Notebook for full code.
- Load the model.
- Create the Segmentation mask of any Image.
- Get the Embeddings of each extracted Segmentation masks as an seperate image.
- Embed the User Query.
- Index the Image embeddings into LanceDB.
- Use Search method to find the closest match of Image Embedding (particular Segmentation Mask) and User Query.
- Output the Highlighted closest object present.
Read the Full blog post