Add support for EVA-CLIP-18B

[lab176344]

Search before asking

• I have searched the Autodistill issues and found no similar feature requests.

Description

I want to add support for https://github.com/baaivision/EVA/tree/master/EVA-CLIP-18B#summary-of-eva-clip-performance. It vastly outperforms open clip and openai' CLIP

Use case

For classification and combination models

Additional

I want to make sure somebody from the community is not working on this. Please comment here and give a go ahead

Are you willing to submit a PR?

• Yes I'd like to help by submitting a PR!

[lab176344]

@capjamesg if you can confirm this that will be great

[capjamesg]

Thank you for creating this Issue! We don't currently support EVA-CLIP. Feel free to create this module!

[capjamesg]

@lab176344 Following up to see if you are still interested in working on this!

[lab176344]

@capjamesg I think we already added this I guess. we can close this I guess.

[capjamesg]

Ah, of course! In that case, I will close this issue. Thank you for your contribution!

Link for reference to anyone reading: https://github.com/lab176344/autodistill-evaclip

[lab176344]

@capjamesg Is any one working on PaliGemma? Would like to add support

[capjamesg]

We have a PaliGemma repository in the works that will be released on Monday :D

We will have support as a base model on Monday, and fine-tuning likely later in the week.

We would also love support for Gemini Flash for classification (https://deepmind.google/technologies/gemini/flash/), but we aren't actively working on that. If that interests you, feel free to file a PR!

[lab176344]

okay cool will take it up

…

On Fri, May 17, 2024 at 8:01 PM James ***@***.***> wrote: We have a PaliGemma repository in the works that will be released on Monday :D We will have support as a base model on Monday, and fine-tuning likely later in the week. We would also love support for Gemini Flash for classification ( https://deepmind.google/technologies/gemini/flash/), but we aren't actively working on that. If that interests you, feel free to file a PR! — Reply to this email directly, view it on GitHub <#136 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AFUJPTI3WSWP5SE67D45V33ZCZAX7AVCNFSM6AAAAABDSPHMY6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMJYGEZTAOBXGM> . You are receiving this because you were mentioned.Message ID: ***@***.***>