Copy Objects to minio is unusually slow

[deekoder]

Copy objects to minio is unusual slow

Expected Behavior

Faster?

Current Behavior

./mc cp --recursive folder/ local/bucket/ is running around 4.5 MB/s

dd if=/dev/zero of=bigfile bs=1m count=1024

./mc cp bigfile minio/test is running 128MB/s

Context

The read speed is around 50-70 MB/s . Files under the bucket are something like BucketName/MediaID/Quality/MovieName/Files

Your Environment

Version: 2017-05-05T01:14:51Z
Supermicro SuperStorage 6028R-E1CR12L
CPU : model name : Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
CORE : 40
Memory : 512 GB
Disks : 12 * 4TB
Ubuntu 16.04

[deekoder]

Filing for minio/minio#4580

[curantes]

I would also like this to be fixed for the mirror command as well. I see low performance when running mirror to sync from a minio cluster to a filesystem.

[vadmeste]

ETA: Oct 13

[jonaz]

Status on this one? Im moving 1TB of data at 1MB/s speed with mc mirror command :(
Will take 9.25 days :(

[harshavardhana]

Status on this one? Im moving 1TB of data at 1MB/s speed with mc mirror command :(
Will take 9.25 days :(

what your client to server bandwidth? @jonaz

[harshavardhana]

what your client to server bandwidth? @jonaz

Also can you perform iperf -s on and iperf -c to test the effective bandwidth?

[jonaz]

@harshavardhana
iperf client log

------------------------------------------------------------
Client connecting to prod-s3stor01, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[  3] local 10.XX.XX.XX port 60796 connected with 10.XX.XX.XX port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec  9.74 GBytes  8.37 Gbits/sec

iperf server log

------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 85.3 KByte (default)
------------------------------------------------------------
[  4] local 10.XX.XX.XX port 5001 connected with 10.XX.XX.XX port 60796
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-10.0 sec  9.74 GBytes  8.36 Gbits/sec

[harshavardhana]

[ 4] local 10.XX.XX.XX port 5001 connected with 10.XX.XX.XX port 60796
[ ID] Interval Transfer Bandwidth
[ 4] 0.0-10.0 sec 9.74 GBytes 8.36 Gbits/sec

@jonaz are these 1TiB files really small like image files?

[curantes]

@harshavardhana yes these files are small mostly images and pdf documents.

[jonaz]

@harshavardhana yes as @curantes said. We work together.

[vadmeste]

@jonaz, @curantes, I wrote this PR, #2289, which not merged/official yet.. but you can test it. It should accelerate mirroring or copying multiple times. I would be happy to assist you.

[harshavardhana]

This is going to be fixed by #2289

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.