Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO NOT MERGE YET] wip: CLIP Vision becomes its own thing #6161

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

blessedcoolant
Copy link
Collaborator

@blessedcoolant blessedcoolant commented Apr 5, 2024

Summary

CLIP Vision is currently a sub part of IP Adapter. There are other uses for CLIP Vision. Better to have it extracted now rather than later. This PR will try to accomplish that.

DONE

  • CLIP Vision Model Loader Node - Used for loading the available CLIP Vision Models

opera_USzyVeLX4B

  • IP Adapter Node updated to use a plugged in CLIP Vision rather than a drop down
  • CLIP Vision Models now display in the Model Manager

opera_Zt3m9Nk5i9

  • CLIP Vision Models added to Starter Models

opera_dOOyS36N3w

  • Linear UI works now with the new CLIP Vision setup. (But the CLIP Vision Models need be manually set each model) --- We'll most likely make this a user config that they can set in the model editor.
  • New Field For CLIP Vision
  • [MAJOR] Implement CLIP Vision Safetensors support

TODO

  • Update models.invoke.com to actually use the right CLIP Vision names.

@github-actions github-actions bot added python PRs that change python files invocations PRs that change invocations backend PRs that change backend files frontend PRs that change frontend files labels Apr 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend PRs that change backend files DO NOT MERGE frontend PRs that change frontend files invocations PRs that change invocations python PRs that change python files
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants