Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge #15

Open
kwikik opened this issue Apr 13, 2024 · 5 comments

Comments

@kwikik
Copy link

kwikik commented Apr 13, 2024

i install everything correctly and when i want to run an inference , i get this error.
People on the net with the same error told me that it can be corrupted file so i download everything again ( multiple time and i keep getting this error) here the full error message

Traceback (most recent call last):
File "/home/azureuser/localfiles/MagicTime/inference_magictime.py", line 249, in
main(args)
File "/anaconda/envs/magictime/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/home/azureuser/localfiles/MagicTime/inference_magictime.py", line 61, in main
text_encoder = CLIPTextModel.from_pretrained(model_config.pretrained_model_path, subfolder="text_encoder").cuda()
File "/anaconda/envs/magictime/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3284, in from_pretrained
with safe_open(resolved_archive_file, framework="pt") as f:
safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge

@SHYuanBest
Copy link
Member

Thank you for your interest. I have never encountered this error. Maybe you can confirm whether the version information of the package is consistent with ours, or try to reconfigure the environment.

@SHYuanBest
Copy link
Member

It seems that there is a problem with your torch or transformers library. You can try to reinstall the same version as ours.

@kwikik
Copy link
Author

kwikik commented Apr 15, 2024

It seems that there is a problem with your torch or transformers library. You can try to reinstall the same version as ours.

I already check the environnement but i will reinstall it from scratch i come home from work thx for your reply

@lckj2009
Copy link

My server is already running MagicTime normally, but there is no model called "safetendersorust.Safetensor" on my server. Please check when this model was installed during the installation process

@truedat101
Copy link
Contributor

Maybe a duplicate of #21 . Sorry I posted a dup! Try making sure git-lfs is installed. Then redo your installation. Easiest way is to do "git checkout ckpts" to restore order. Note, issues with these scripts #23 .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants