Where are models stored?

[nathanielastudillo]

Poked around the code but couldn't find where the directory where models are stored. I'd like to keep everything on an external drive and cloned the repo onto one for this purpose, but I can't find the models anywhere.

[ameicler]

on Mac it downloads in ~/.cache/huggingface/hub/

[deep-diver]

The downloaded path could be modified if you set HF_HOME environment variable

Check this out

https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables#xdgcachehome

[deep-diver]

You are right, but that is not supported feature yet.
However, I think you can always use BYOM feature for that purpose.

The reason why I didn't have such feature is that I always want people to use the right weights to reproduce good quality outputs so that open source LLMs are not underrated.

[linuxmagic-mp]

You are correct, which is why I deleted my comment after I posted ;) I saw the BYOM. A quick attempt though led me to an error, probably related to the settings, but need to figure out how to get more details on the error condition, will have to do more crawling through the code. Be back at this later in the week. Thanks for your contributions.