Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Splitting large files into chunks #534

Open
manwe-pl opened this issue Feb 17, 2017 · 3 comments
Open

Splitting large files into chunks #534

manwe-pl opened this issue Feb 17, 2017 · 3 comments

Comments

@manwe-pl
Copy link

manwe-pl commented Feb 17, 2017

Just a wild thought. If files >10GB are problematic, and >50GB are impossible to upload, maybe acd_cli could split them into 8GB chunks? So for example file movie.mkv (30GB) could be sliced into ##part000##movie.mkv up to ##part003##movie.mkv. Of course in fuse those files would be visible as one. Finding the offset and proper part is quite easy. If parts are 8GB in size (8,589,934,592 bytes) and we want for example byte number 10,000,000,000, part number is 10000000000 // 8589934592 = 1, position in that part is 10000000000 % 8589934592 = 1410065408.

I think there are people (including me) that would consider a donation/bounty for such feature :)

@odarriba
Copy link

But, theorically, that will make that files difficult to use in computers that doesn't make use of acd_cli for syncing, doesn't it?

I'm noy saying it is a bad idea, but if done, maybe it should be configurable 😄

@manwe-pl
Copy link
Author

There's nothing wrong with it being an option.

@bgemmill
Copy link

Have a look at duplicity if this is a concern; it may be more straightforward to layer a chunking system over top of acdcli than to build it in.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants