How to use newer models like llama3 and phi3? #704
-
|
First of all thank you for this fantastic app. Works very smoothly. I was curious if there is a way to use newer models like llama3 or phi3 or if you are planning to add them sometime in the future? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
The field for LLM Backbone is a free typing field. The dropdown is to get a few defaults already. Apart from that, basically all LLMs from huggingface can be used. For very exotic LLMs that are not in the transformers package (yet), activate The two models you were mentioning are already fully supported. backbone-2024-05-10_12.13.49.mp4
|
Beta Was this translation helpful? Give feedback.
-
|
Brilliant thank you! |
Beta Was this translation helpful? Give feedback.
The field for LLM Backbone is a free typing field. The dropdown is to get a few defaults already. Apart from that, basically all LLMs from huggingface can be used. For very exotic LLMs that are not in the transformers package (yet), activate
trust_remote_code)The two models you were mentioning are already fully supported.
backbone-2024-05-10_12.13.49.mp4