apt-get update/upgrade/install downloads packages at unacceptably slow speeds. #2477

RalphORama · 2017-09-08T03:57:38Z

Your Windows build number: Microsoft Windows [Version 10.0.15063]
What you're doing and what's happening: sudo apt-get update && sudo apt-get upgrade -y downloads packages at less that 100 kB/s.
What's wrong / what should be happening instead: apt should fetch packages much faster. My internet speed is 100 down / 10 up, on a bare-metal Linux installation or VirtualBox instance, apt is blazing fast. Packages are downloaded at upwards of 1024 kB/s.
Strace of the failing command, if applicable: n/a

The text was updated successfully, but these errors were encountered:

gravcat · 2017-09-08T20:08:55Z

If there is nothing meaningful in the environment and you don't mind completely destroying it, try the following in an elevated command prompt:

lxrun /uninstall /full /y
lxrun /install

See if the problem persists if you completely redeploy the environment.

sunilmut · 2017-09-08T20:40:46Z

@RalphORama - Thanks for your post. We are aware that WSL networking perf is not at par with native Linux, but should not be unbearable. There are plans to improve the WSL n/w perf. I am not sure if uninstall/reinstalling will change much here for you.

gravcat · 2017-09-08T20:44:28Z

my network speeds are fine and maxing out my link speed on Microsoft Windows [Version 10.0.15063]

therealkenc · 2017-09-08T22:03:41Z

We are aware that WSL networking perf is not at par with native Linux

Yeah WSL might not be on par with Real Linux, but we're talking Phoronix-style quibbling not mass degradation. I get awful apt-get speeds like the OP sometimes too (measured kbs/sec on a mbps link), but best evidence seems to be it is on Canonical's end (or something in between). I get the same thing in my Ubunutu VM from time to time. I am not sure why this is, but I think (speculating) that sometimes you just get a redirect to an unlucky server.

@RalphORama
Best thing to do would be take Ubuntu out as a variable. Use speedtest from WSL CLI like @gravcat suggests and then visit their website on Windows, and see if there is a serious gap in performance.

$ sudo apt install speedtest-cli
$ speedtest-cli
Retrieving speedtest.net configuration...
Retrieving speedtest.net server list...
Testing from Skyway West (69.50.175.134)...
Selecting best server based on latency...
Hosted by Shaw Communications (Vancouver, BC) [28.08 km]: 28.778 ms
Testing download speed........................................
Download: 34.39 Mbit/s
Testing upload speed..................................................
Upload: 5.22 Mbit/s

If you see an orders-of-magnitude difference between Windows and WSL, report back because that would be good to know; it is always possible there is something unique going on with your setup.

Aerocatia · 2017-09-09T04:03:02Z

I found that Windows Defender absolutely murders performance in WSL, especially tools like apt-get.
Try temporally disabling it and see if that improves it or not.

heldchen · 2017-09-09T13:08:35Z

I found that Windows Defender absolutely murders performance in WSL, especially tools like apt-get.
Try temporally disabling it and see if that improves it or not.

this. Windows Defender really messes with I/O actions in WSL, not just with apt-get... adding scan exemptions does not seem to help much.

therealkenc · 2017-09-09T22:32:43Z

this. Windows Defender really messes with I/O actions in WSL

It does. But keep in mind, in the OP this was the 'Get' phase, which is literally just a curl of a .deb. 46.6 kilobytes per second on a 100Mbit/s downlink. Install phase I understand, sure. Windows Defender gets upset when thousands of little untrusted files start appearing from nowhere (from Defender's perspective) though its filesystem filter driver. But if it were Defender you should see the same slowdown on a bog standard curl from a fast server, and you don't; at least not to this degree. Couple that with the fact that turning Defender off doesn't help. So, something else. I could be wrong, because Defender is a ginormous black box that does who knows what, on or off. But I'm not seeing the causality here.

RalphORama · 2017-09-09T23:59:31Z

I reinstalled WSL as @gravcat suggested, and installed speedtest-cli. After running speedtest-cli and visiting the speedtest website, it appears WSL only uses 5% of my available bandwidth, maximum (1.6 Mbit/s vs 36 Mbit/s). I believe I have Windows Defender disabled, and I don't think I have any other programs that interfere with I/O on my machine. I use Malwarebytes as my antivirus, which doesn't run in the background. I'll try creating a firewall rule for bash.exe and report back.

Update: Creating a firewall rule and switching to OpenDNS had no effect on apt's download speeds.

ghost · 2017-09-17T03:10:27Z

benhillis · 2017-10-05T00:15:16Z

@therealkenc - Thanks for the repro steps. I tracked this down to a directory rename failing due something that has a handle open to one of the directory's children. Unfortunately this is an NTFS limitation that I can't think of a workaround without NTFS supporting posix-style rename. I know they were looking at that at some point, but I'm not sure of the status.

DarkIlluminatus · 2018-01-27T06:40:52Z

I am also experiencing this issue, did the solution suggested by @gravcat work for anyone?
I would hate to have to download the entire distro again at these below 100 kB/s speeds, so am reticent about attempting it.

leandrocrs · 2018-01-27T16:25:02Z

Just turn off Windows Defender Real-time protection.

Add WSL folder and apt process in exclusion list will not work.

You should to completely disable real-time protection, reboot and will see how fast it will be

DarkIlluminatus · 2018-01-28T04:22:38Z

I no longer have this issue, it appears that I just lost the repo mirror lotto when I did the dist-upgrade

…

On Sat, Jan 27, 2018 at 9:25 AM, leandrw ***@***.***> wrote: Just turn off Windows Defender Real-time protection. Add WSL folder and apt process in exclusion list will not work. You should to completely disable real-time protection, reboot and will see how fast it will be — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#2477 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ARdVlnwMEBb5_joxJ8evpNNunyCRSYR8ks5tO03pgaJpZM4PQqnc> .

Garry050 · 2018-02-22T13:40:14Z

same here.
speedtest: both good speed (download: 70-90Mbps)
apt: always 30-300kb/s (ftp.jaist.ac.jp)

Using ESET Internet Security 11. no help disable anti-virus.
16299.214

benhillis · 2018-02-22T15:13:39Z

@DarthSpock - unfortunately I think the posix-style rename work the ntfs team did doesn't handle the case where a directory has children with open handles. Adding @SvenGroot to confirm.

therealkenc · 2018-02-22T18:22:27Z

@benhillis
Your "this is an NTFS limitation that I can't think of a workaround" comment was posted to the wrong thread at the time (you thank me for repro steps that don't exist here). That is #640 aka #1529, which is unrelated to "apt-get update/upgrade/install downloads packages at unacceptably slow speeds".

Adding SvenGroot to confirm.

Like this

sewashinobi · 2018-02-28T10:59:17Z

I can confirm, this is slow as hell. For me the speed is 219 B/s, while my internet speed on windows is 24mbps

mskd12 · 2018-03-03T02:15:38Z

I can confirm as well, the speed has dropped down significantly especially when downloading many things

Wingmore · 2018-03-07T06:05:21Z

Has anyone found a fix? getting speeds of 40 kB/s

rondi74 · 2018-03-07T19:54:13Z

I'm having the same problem! >_<

SvenGroot · 2018-03-07T21:08:55Z

Ubuntu on WSL uses the Ubuntu's main archive mirror, which may not be the fastest option depending on your location. Could those who are having this issue try choosing a local mirror from https://launchpad.net/ubuntu/+archivemirrors (tip: most countries have a mirror like us.archive.ubuntu.com, so you can try that for your country before scouring the list), updating /etc/apt/sources.list to use that mirror instead of archive.ubuntu.com, and see if that improves your download speed?

Make sure you run sudo apt update after editing sources.list.

You can use sed to make the change. For example, to change from archive.ubuntu.com to us.archive.ubuntu.com:
sudo sed -i "s/archive.ubuntu.com/us.archive.ubuntu.com/" /etc/apt/sources.list

WSLUser · 2018-03-07T22:33:17Z

Running Synaptic on Kali goes rather fast. Faster than normal apt surprisingly. But even apt on Kali runs faster than Ubuntu. Which seems to point to agreement with what's said above.

therealkenc · 2018-03-08T02:33:49Z

You can confirm whether the variable is your Ubuntu mirror by testing against speedtest.net from within WSL with speedtest-cli.

sudo apt install python-pip
pip install speedtest-cli   # installs in ~/.local/bin which is in your default path
speedtest-cli

brunoeustaquio · 2018-03-08T02:57:39Z

@SvenGroot tks man, it´s way better now

doomsbuster · 2018-03-24T15:14:52Z

Turning off Windows Defender Realtime protection did the trick. All other options did not work.

navneethc · 2018-03-30T20:03:25Z

I'm having the same problems as well. Installed WSL only a month or so ago, and any time I try to install/update using apt-get I first get abysmal speeds (100s of Bps to KBps on a 75 Mbps connection) and then everything comes to a screeching halt, at which point I kill it.

Windows 10.0.16299 (and Defender is turned off).

prakharbitspilani · 2020-05-25T16:40:57Z

I tested by using wifi from mobile hotspots using 2 different network connections. Both having a speed of above 600kbps. However in one it works fine (even with windows defender turned on), and in other it doesn't work (even after disabling defender)

noodlehaus · 2020-06-10T01:46:36Z

Following THIS LINK, I created an exception on Windows Defender and it worked like a charm(!!!).

TL;DR

Get the UbuntuOnLinux (or your distro of choice) installation path: %USERPROFILE%\AppData\Local\Packages and lookup for something like CanonicalGroupLimited.UbuntuonWindows_79rhkp1fndgsc. Copy the path of that folder.

Open up your Windows Defender & add an exception of that folder. Follow:
Settings > Update & Security > Windows Defender > Open Windows Defender Secutiry Central > Protection Against Viruses & Threats > Advanced Config… > Exclusions > Add or Remove > Add > Folder and then select the folder. Or you can also paste that folder's path.

You should also check that article as it has other methods as well.

Tried this comment by @aqeebimtiaz a few days back, and this has certainly made things significantly better, though still not as fast as if i was outside WSL. But for code editing, the speed performance makes no difference, only when needing to download huge files.

BeaudanBrown · 2020-06-21T12:12:23Z

Haven't read all the responses to see how many people have tried this but the mirrors generated from this tool fixed the issue for me

idamachmadfaizin · 2020-06-23T16:07:43Z

Just turn off windows defender real-time protection.
or
Add WSL folder in windows defender exclusion list.
i'm using Ubuntu 20.04. and path is "C:\Users%username%\AppData\Local\Packages\CanonicalGroupLimited.Ubuntu20.04onWindows_79rhkp1fndgsc"

It's work for me.

anvillasoto · 2020-08-14T14:55:28Z

I fixed it by running this to PowerShell Admin:

New-NetFirewallRule -DisplayName "WSL" -Direction Inbound -InterfaceAlias "vEthernet (WSL)" -Action Allow

This basically opens the interface for WSL per this issue comment: #4585#issuecomment-610061194_

No turning off of windows defender necessary.

pcgeek86 · 2020-08-14T17:08:59Z

@anvillasoto Wow, thank you! That actually works for me! I just tested it on an outdated instance of WSL. It's downloading packages at full speed now. 👍🏻

New-NetFirewallRule -DisplayName WSL -Direction Inbound -InterfaceAlias "vEthernet (WSL)" -Action Allow

NoelJacob · 2020-09-09T10:35:19Z

Building on what Sven said, here is a quick and easy command to change apt to automatically point to a mirror inside your country. sed -i -e 's/http:\/\/archive/mirror:\/\/mirrors/' -e 's/\/ubuntu\//\/mirrors.txt/' /etc/apt/sources.list

#2477 (comment) by @Austin76016 worked, I guess.

Can anyone tell me this equalent for Kali-Linux? or how does this work?

giosal · 2020-11-09T19:59:55Z

Same issue here - all network related operations running very slowly on WSL 2 Ubuntu 20.04 running on Windows 10 x64 Insider Build 20241.

Whereas from Chrome on Windows:

And another computer it's working perfectly (Windows 10 20H2):

I mean, seriosuly? 0.01 Mbps?..

waqasaliBSSe-F17-58 · 2020-11-10T17:15:59Z

here is website you can use find internnet speed https://www.internetmeter.net/,if you want to find your ping them go to this link
https://www.internetmeter.net/ping.html if you want to find your jitter speed then simple click on this link https://www.internetmeter.net/jitter.html
best internet speed finder website https://www.internetmeter.net/

waqasaliBSSe-F17-58 · 2020-11-10T17:16:13Z

here is website you can use find internnet speed https://www.internetmeter.net/,if you want to find your ping them go to this link
https://www.internetmeter.net/ping.html if you want to find your jitter speed then simple click on this link https://www.internetmeter.net/jitter.html
best internet speed finder website https://www.internetmeter.net/

chuanqisun · 2020-11-24T17:37:16Z

Same issue. WSL 2, Ubuntu 20.04 LTS on Windows 10 Pro 19041.630

It's definitely not caused by a slow mirror.

Aymane11 · 2020-12-03T23:51:13Z

Following THIS LINK, I created an exception on Windows Defender and it worked like a charm(!!!).

TL;DR

1. Get the UbuntuOnLinux (or your distro of choice) installation path: `%USERPROFILE%\AppData\Local\Packages` and lookup for something like **CanonicalGroupLimited.UbuntuonWindows_79rhkp1fndgsc**. Copy the path of that folder.

2. Open up your Windows Defender & add an exception of that folder. Follow:
   `Settings > Update & Security > Windows Defender > Open Windows Defender Secutiry Central > Protection Against Viruses & Threats > Advanced Config… > Exclusions > Add or Remove > Add > Folder` and then select the folder. Or you can also paste that folder's path.

You should also check that article as it has other methods as well.

Excluding the CanonicalGroupLimited..... folder from my antivirus solved the problem for me.

danieliser · 2021-01-31T10:21:48Z

@Aymane11 I actually have a PowerShell script I use to do this automatically for all WSL instances. You will need an escalated PowerShell instance (Run as Admin).

############
# This script will add your WSL environments to the Windows Defender exclusion list so that
# realtime protection does not have an adverse effect on performance.
#
# You should be aware that this could make your system less secure. Use at your own risk.
# Note: This should be run from an administrative PowerShell prompt
############

# Find registered WSL environments
$wslPaths = (Get-ChildItem HKCU:\Software\Microsoft\Windows\CurrentVersion\Lxss | ForEach-Object { Get-ItemProperty $_.PSPath}).BasePath

# Get the current Windows Defender exclusion paths
$currentExclusions = $(Get-MpPreference).ExclusionPath
if (!$currentExclusions) {
  $currentExclusions = ''
}

# Find the WSL paths that are not excluded
$exclusionsToAdd = ((Compare-Object $wslPaths $currentExclusions) | Where-Object SideIndicator -eq "<=").InputObject

# List of paths inside the Linux distro to exclude (https://github.com/Microsoft/WSL/issues/1932#issuecomment-407855346)
$dirs = @("\bin", "\sbin", "\usr\bin", "\usr\sbin", "\usr\local\bin", "\usr\local\go\bin")

# Add the missing entries to Windows Defender
if ($exclusionsToAdd.Length -gt 0) {
  $exclusionsToAdd | ForEach-Object { 
    
    # Exclude paths from the root of the WSL install
    Add-MpPreference -ExclusionPath $_
    Write-Output "Added exclusion for $_"

    # Exclude processes contained inside WSL
    $rootfs = $_ + "\rootfs"
    $dirs | ForEach-Object {
        $exclusion = $rootfs + $_ + "\*"
        Add-MpPreference -ExclusionProcess $exclusion
        Write-Output "Added exclusion for $exclusion"
    }
  }
}

danieliser · 2021-01-31T10:56:01Z

Hope this part helps everyone, though I had the above for I/O performance improvements, it had no impact on connection speeds.

However what I did find, and my tests are below, is that disabling Windows Defender Firewall (Internet rules) does resolve it for the speed test, fixes downloading files directly as well.

BUT I'm still not getting good speed in docker containers running tensorflow projects in Jupyter notebooks. 24M files are taking minutes, where they take seconds if I try them via WSL terminal directly or on Windows

I should clarify this is using Docker CLI as NVidia CUDA support on WSL as you know isn't supported via Docker Desktop containers. So I'm not sure how or if that plays into it.

Baseline: Speedtest from Windows)

WSL Before & After disabling Firewall

Next I need to figure out what needs to be unblocked to ensure this doesn't happen without leaving firewall off entirely.

Any thoughts on specifically what to unblock? Can't imagine port based rules will do. Not sure which application you could select to unblock either.

danieliser · 2021-01-31T22:41:14Z

I have narrowed the docker issue as well now. Seems to be a bottleneck due to using a WiFi connection.

Switching to a wired connection and WSL2 -> Docker CE containers for tensorflow with GPU support will now download using the entire connection.

No idea why that is. Haven't been able to find any info on why docker has issues with wifi.

SanderElias · 2021-06-18T09:50:08Z

I'm wired to a 600Mb connection. This is the only thing that is slow:

I already switched connections, removed code-insiders completely, and reinstalled them.
The first reinstallation goes quick then, but with every upgrade I'm back to slowness?

Arian8j2 · 2021-08-20T10:50:41Z

@SvenGroot Solution works for me, Also remember to change security mirrors too, So completed command will be like:
mirror="us.archive.ubuntu.com" && sudo sed -i "s/archive.ubuntu.com/$mirror/; s/security.ubuntu.com/$mirror/" /etc/apt/sources.list, Also not sure that is it good idea to change security mirrors or not.

sbin-github · 2021-10-12T04:26:51Z

I just installed WSL2 on my desktop.
I've completely turned off the windows defender and real-time protection, and tried several mirror servers in my country.
However, it never goes over 50kB/s.
What is the problem, seriously?

j0e1an · 2021-10-18T21:21:56Z

I fixed it by running this to PowerShell Admin:

New-NetFirewallRule -DisplayName "WSL" -Direction Inbound -InterfaceAlias "vEthernet (WSL)" -Action Allow

This basically opens the interface for WSL per this issue comment: #4585#issuecomment-610061194_

No turning off of windows defender necessary.

Work like a charm. Hate firewall just doing this.

emadha · 2022-02-20T17:57:40Z

i copied the /etc/resolve.conf from ubuntu to kali's resolv.conf and it solved the problem

# [network]
# generateResolvConf = false
nameserver 192.x.x.184
nameserver xxxx:0:0:ffff::1
nameserver xxxx:0:0:ffff::2

this solved my kali issue, I had to wsl --showdown from powershell and restart kali for this to work.

now I dunno how the ubuntu got generated, ubuntu was doing the same issue as kali, probably wsl --shutdown solved it?
anyway, that's the only change I did to my wsl, oh and I moved to WSL 1 as well

## Update
Apparently it's windows defender related issue, after putting it back on and restarting wsl downloads became very slow, so I had to deactivate realtime protection then wsl --shutdown for it to work.

jhagege · 2023-02-25T18:09:53Z

I realized the issue for me was that antivirus ESET was blocking the traffic for WSL Ubuntu.
Unblocked by going to Setup --> Network --> Troubleshooting Wizard --> Unblock.

craigloewen-msft · 2023-09-19T21:35:03Z

Hi folks, we have put out a new update that aims to address networking issues in WSL. In your .wslconfig file you can set experimental.networkingMode=mirrored, as well as some other key settings that should improve your network compatibility! Please try them out and let us know what you think.

More info on this release and the changes can be found here in the blog post.

Please note: You need to be on a Windows Insiders version to use the new networking settings (Any channel of Windows Insiders will do, including release preview). If you see the "These are not supported" messages it means that your current Windows version doesn't have support, and you will need to upgrade. These features will eventually be coming to Windows 11 22H2.

meydiwahendra · 2023-09-24T20:19:36Z

until now 2023, its still happening, this is servers relative issues !!

if you're an Asian, its easy to fix that problem, just copy and paste

sudo sed -i "s/archive.ubuntu.com/sg.archive.ubuntu.com/" /etc/apt/sources.list &&
sudo apt update

see the different

mine running on 30mbps speed

DrorDvash · 2024-01-01T20:08:47Z

I realized the issue for me was that antivirus ESET was blocking the traffic for WSL Ubuntu. Unblocked by going to Setup --> Network --> Troubleshooting Wizard --> Unblock.

Thanks! helped me too with ESET Internet Security

OneBlue · 2024-05-14T21:15:28Z

Hi ! Please try the latest networking features that we've added in WSL. Those should greatly improve performance.

If the issue still remains, please reopen this issue.

therealkenc mentioned this issue Sep 17, 2017

Slow connection in apt-get #2502

Closed

therealkenc mentioned this issue Oct 8, 2017

etcd: renameat syscall returns EACCES #2243

Closed

microsoft deleted a comment from therealkenc Oct 10, 2017

therealkenc mentioned this issue Jan 21, 2018

Internet connection extremely slow #2864

Closed

NetzwergX mentioned this issue May 26, 2020

apt is slow, and possibly also other stuff that fetches things (like ruby gems) NetzwergX/netzwergx.github.io#16

Open

therealkenc mentioned this issue Jul 20, 2020

unable to get speed on apt #5619

Closed

therealkenc added network and removed discussion labels Sep 6, 2020

OneBlue closed this as completed May 14, 2024

apt-get update/upgrade/install downloads packages at unacceptably slow speeds. #2477

apt-get update/upgrade/install downloads packages at unacceptably slow speeds. #2477

Comments

RalphORama commented Sep 8, 2017

gravcat commented Sep 8, 2017

sunilmut commented Sep 8, 2017

gravcat commented Sep 8, 2017

therealkenc commented Sep 8, 2017 • edited

Aerocatia commented Sep 9, 2017

heldchen commented Sep 9, 2017

therealkenc commented Sep 9, 2017 • edited

RalphORama commented Sep 9, 2017 • edited

ghost commented Sep 17, 2017

benhillis commented Oct 5, 2017

DarkIlluminatus commented Jan 27, 2018 • edited

leandrocrs commented Jan 27, 2018

DarkIlluminatus commented Jan 28, 2018 via email

Garry050 commented Feb 22, 2018 • edited

benhillis commented Feb 22, 2018

therealkenc commented Feb 22, 2018

sewashinobi commented Feb 28, 2018

mskd12 commented Mar 3, 2018

Wingmore commented Mar 7, 2018

rondi74 commented Mar 7, 2018

SvenGroot commented Mar 7, 2018 • edited

WSLUser commented Mar 7, 2018

therealkenc commented Mar 8, 2018

brunoeustaquio commented Mar 8, 2018

doomsbuster commented Mar 24, 2018

navneethc commented Mar 30, 2018

prakharbitspilani commented May 25, 2020

noodlehaus commented Jun 10, 2020 • edited

BeaudanBrown commented Jun 21, 2020

idamachmadfaizin commented Jun 23, 2020 • edited

anvillasoto commented Aug 14, 2020 • edited

pcgeek86 commented Aug 14, 2020

NoelJacob commented Sep 9, 2020

giosal commented Nov 9, 2020 • edited

waqasaliBSSe-F17-58 commented Nov 10, 2020

waqasaliBSSe-F17-58 commented Nov 10, 2020

chuanqisun commented Nov 24, 2020 • edited

Aymane11 commented Dec 3, 2020

danieliser commented Jan 31, 2021 • edited

danieliser commented Jan 31, 2021 • edited

danieliser commented Jan 31, 2021

SanderElias commented Jun 18, 2021

Arian8j2 commented Aug 20, 2021

sbin-github commented Oct 12, 2021

j0e1an commented Oct 18, 2021

emadha commented Feb 20, 2022 • edited

jhagege commented Feb 25, 2023

craigloewen-msft commented Sep 19, 2023

meydiwahendra commented Sep 24, 2023 • edited

if you're an Asian, its easy to fix that problem, just copy and paste

see the different

DrorDvash commented Jan 1, 2024

OneBlue commented May 14, 2024

therealkenc commented Sep 8, 2017 •

edited

therealkenc commented Sep 9, 2017 •

edited

RalphORama commented Sep 9, 2017 •

edited

DarkIlluminatus commented Jan 27, 2018 •

edited

Garry050 commented Feb 22, 2018 •

edited

SvenGroot commented Mar 7, 2018 •

edited

noodlehaus commented Jun 10, 2020 •

edited

idamachmadfaizin commented Jun 23, 2020 •

edited

anvillasoto commented Aug 14, 2020 •

edited

giosal commented Nov 9, 2020 •

edited

chuanqisun commented Nov 24, 2020 •

edited

danieliser commented Jan 31, 2021 •

edited

danieliser commented Jan 31, 2021 •

edited

emadha commented Feb 20, 2022 •

edited

meydiwahendra commented Sep 24, 2023 •

edited