Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azcopy is consuming more time than usual for incremental sync azcopy_linux_amd64_10.23.0 #2596

Open
challaswamy097 opened this issue Feb 29, 2024 · 1 comment

Comments

@challaswamy097
Copy link

Which version of the AzCopy was used? 10.23.0

Note: The version is visible when running AzCopy without any argument

Which platform are you using? Linux

What command did you run? time /conf/share/ms-azure/azcopy_linux_amd64_10.23.0/azcopy sync --recursive --delete-destination=true --log-level=ERROR /conf/homebackup29feb24/confluence/attachments/ "https://xxx.windows.net/confprodnfs/shared-home/attachments/$SASTOKEN"

Note: Please remove the SAS to avoid exposing your credentials. If you cannot remember the exact command, please retrieve it from the beginning of the log file.

What problem was encountered?

Once we run the command we see the below output
3386290 Files Scanned at Source, 3374267 Files Scanned at Destination, 2-sec Throughput (Mb/s): 0

Later after some time, it shows below
0.0 %, 13455 Done, 0 Failed, 6476766 Pending, 6490221 Total, 2-sec Throughput (Mb/s): 0

How come 3386290 became 6490221 for incremental sync. We have an 8GB difference for source and destination but the time consumption is more than expected this didn't happen in earlier versions of Azcopy.

How can we reproduce the problem in the simplest way?

Just do an incremental sync, and you will notice this issue.

Have you found a mitigation/solution? No

@siminsavani-msft
Copy link
Member

Hi @challaswamy097 ! Thank you for reporting this. We are taking on an investigation for performance and will keep this thread posted with details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants