Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

very bad write performances #42

Open
Julio-Guerra opened this issue Jul 29, 2017 · 4 comments
Open

very bad write performances #42

Julio-Guerra opened this issue Jul 29, 2017 · 4 comments

Comments

@Julio-Guerra
Copy link

I went through the getting started documentation, both on macOS and linux. I end up with the same problem on both: unusable for write-intensive operations.

I reduced the case to a subset of the "get started" doc: one user, one volume, one network (replication = 2), one silo, and everything locally:

I then use any write-intensive program. My favorite simple stress test is using Keynote on a packaged presentation (i.e. it's a package of files instead of a single monolithic one) which modifies a lot of files as soon as you move a single byte in the presentation. In my case, editing a keynote presentation stored in a volume is almost impossible since. Same thing on linux untaring gcc sources (10 minutes for 1.8 GiB) or compiling then (stopped before the end). It's always ~3 MiB/second.

I can provide detailed logs if required.

@tarlano
Copy link

tarlano commented Aug 7, 2017

What is your volume block_size?

@Julio-Guerra
Copy link
Author

I haven't set it (I'm just following your getting started commands), so the default value, I guess.

@Dimrok
Copy link

Dimrok commented Aug 8, 2017

Hi @Julio-Guerra. Can you paste the infinit volume mount/run command you run pls?

If the cache is not activated, this can justify the bad write performance, because the root of the filesystem is updated a lot and without cache, it has to be fetched for every single write.

We also have the --async that queue edit and propagate them as fast as it can, giving way better performance. However, this is risky and can cause conflicts in certain situations. Use at your own risks.

For the record, the default block size is 1MiB.

@tarlano
Copy link

tarlano commented Aug 9, 2017

If you are using my config then change the infinit.volume to have a block_size of 1048576. This will increase your performance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants