You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The generated tokenizer_config.json has add_bos_token=true while H2O LLM Studio is training with add_special_tokens=False.
Using the default AutoTokenizer, this leads to different behaviors.
We should be explicit/correct about it and set add_bos_token=false
馃悰 Bug
The generated
tokenizer_config.json
hasadd_bos_token=true
while H2O LLM Studio is training withadd_special_tokens=False
.Using the default AutoTokenizer, this leads to different behaviors.
We should be explicit/correct about it and set
add_bos_token=false
To Reproduce
Fine tune a model and download / push to HF
LLM Studio version
<=1.4.1, b70b04f
The text was updated successfully, but these errors were encountered: