Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multi-part Uploads capability #1895

Open
kayvanaarssen opened this issue Feb 16, 2024 · 2 comments
Open

Multi-part Uploads capability #1895

kayvanaarssen opened this issue Feb 16, 2024 · 2 comments

Comments

@kayvanaarssen
Copy link

kayvanaarssen commented Feb 16, 2024

When needing to Push 5+ GB Files.
You would want Multi-Part uploads
Its also recommended to do this with files larger than 100MB

Wasabi:

What are the minimum and maximum object sizes that can be stored in Wasabi.
Individual objects stored in Wasabi can range in size from a minimum of zero bytes to a maximum of 5 terabytes. The largest object that can be uploaded in a single HTTP PUT is 5 gigabytes. For objects larger than 100 megabytes, Wasabi recommends customers consider using the multi-part upload capability.
The total volume of data and number of objects you can store with Wasabi is unlimited (note that the free trial is capped at 1 TB).

DigitalOcean:

Object and File Size Limits
Buckets have the following file size limits:

PUT requests can be at most 5 GB.

Each part of a multi-part upload can be at most 5 GB.

Each part of a multi-part upload must be at least 5 MiB, except for the final part.

Multi-part uploads can have at most 10,000 parts.

The maximum supported total size of a multi-part upload is 5 TB.

PUT requests and individual parts of multi-part uploads sent to the Spaces CDN using pre-signed URLs have a maximum payload of 8,100 KiB, or 7.91 MiB.

https://docs.digitalocean.com/products/spaces/details/limits/#:~:text=The%20maximum%20supported%20total%20size,8%2C100%20KiB%2C%20or%207.91%20MiB.

@pglombardo
Copy link
Owner

pglombardo commented Feb 22, 2024

I think the problem pwpush has in ActiveStorage. It seems to have multipart support which means the issue maybe in the ActiveStorage JS library.

This is on my list to investigate/resolve.

I agree though - this needs to be added/fixed.

@kayvanaarssen
Copy link
Author

Thanks, let me know if I need to test something!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants