Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Subject: Bug Report: Slow Download Speed for PowerShellGet from PowerShell Gallery #253

Open
3 tasks done
Exitus02 opened this issue May 31, 2023 · 12 comments
Open
3 tasks done

Comments

@Exitus02
Copy link

Prerequisites

  • Write a descriptive title.
  • Make sure you are able to repro it on the latest version
  • Search the existing issues.

Steps to reproduce

Dear PowerShell Team,

I am writing to report a significant issue regarding the download speed of PowerShellGet from the PowerShell Gallery. I have observed that the download speed has been unacceptably slow, causing considerable delays and inconvenience for users attempting to install or update PowerShellGet.

Bug Description:
When attempting to download PowerShellGet from the PowerShell Gallery, the download speed is consistently slow, resulting in excessive wait times. This issue affects both new installations and updates of PowerShellGet.

Steps to Reproduce:

Open a PowerShell session.
Run the following command: Install-Module -Name PowerShellGet -Force

Expected Result:
The PowerShellGet module should be downloaded and installed within a reasonable timeframe, typically a few seconds or minutes, depending on the user's internet connection.

Actual Result:
The download process for PowerShellGet takes an unreasonably long time, sometimes exceeding several minutes or more.

Additional Information:

The slow download speed issue is not limited to a specific version of PowerShellGet.
It has been observed across multiple versions, including the latest available at the time of writing.
Other modules from the PowerShell Gallery do not exhibit the same slow download speed issue. The problem appears to be specific to PowerShellGet.
The issue persists even when downloading from different mirrors or repositories within the PowerShell Gallery.

Please let me know if you require any further information or assistance in investigating and resolving this issue. Thank you for your attention to this matter.

Expected behavior

-

Actual behavior

-

Error details

-

Environment data

-

Version

3.0.17 beta

Visuals

No response

@JohnLudlow
Copy link

We're seeing intermittent timeouts installing the AWS powershell modules on Azure Agents - could be related?

@LMCruzDev
Copy link

LMCruzDev commented May 31, 2023

We're having the same issue using azure pipelines when it tries to retrieve these packages:

  • AWS.Tools.Common
  • AWS.Tools.S3
  • AWS.Tools.CloudFront
  • AWS.Tools.SecretsManager

@fluffy-cakes
Copy link

We're also seeing issues on Azure DevOps agents on multiple organisations. Set-PSRepository fails with No repository with the name 'PSGallery' was found.

Hugely annoying, it's halted production and development completely.

@Exitus02
Copy link
Author

Exitus02 commented May 31, 2023

Switching from MS-hosted agents to self-hosted Windows agents did a temporary fix and the installs happen in a normal amount of time instead of timeouts and 15 minutes and opened up a ticket with MS.

In the meantime somebody also updated that they are having issues with the ubuntu images in Azure Devops which might be related.
@fluffy-cakes @LMCruzDev @JohnLudlow

@alerickson
Copy link
Member

Hi all, more environment details would be extremely helpful here. Any image details, whether you're running on a local dev box, etc. Another helpful piece of information would be if it was transitory or lasting and if it was the former around when (and for how long) the issue was occurring).

@Jono20201
Copy link

@alerickson

ubuntu-22.04 image
Hosted Azure DevOps agent (fine locally)

Started on the 30th May around Midday London time for us.

Originally quite transient, but became more frequent as time has gone on.

@Steveiwonder
Copy link

Steveiwonder commented Jun 1, 2023

It's also an issue for us, our first failure was Tuesday 30th May as well and becoming more frequent.
We use ubuntu-latest image.
Hosted Azure DevOps agent

@JohnLudlow
Copy link

JohnLudlow commented Jun 1, 2023

2023-06-01T08:02:44.1830814Z ##[section]Starting: Initialize job
2023-06-01T08:02:44.1836129Z Agent name: 'Azure Pipelines 3'
2023-06-01T08:02:44.1836527Z Agent machine name: 'fv-az511-920'
2023-06-01T08:02:44.1836688Z Current agent version: '3.220.2'
2023-06-01T08:02:44.1887089Z ##[group]Operating System
2023-06-01T08:02:44.1887296Z Ubuntu
2023-06-01T08:02:44.1887374Z 22.04.2
2023-06-01T08:02:44.1887444Z LTS
2023-06-01T08:02:44.1887522Z ##[endgroup]
2023-06-01T08:02:44.1887630Z ##[group]Runner Image
2023-06-01T08:02:44.1887734Z Image: ubuntu-22.04
2023-06-01T08:02:44.1887831Z Version: 20230517.1
2023-06-01T08:02:44.1888020Z Included Software: https://github.com/actions/runner-images/blob/ubuntu22/20230517.1/images/linux/Ubuntu2204-Readme.md
2023-06-01T08:02:44.1888302Z Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu22%2F20230517.1
2023-06-01T08:02:44.1888486Z ##[endgroup]
2023-06-01T08:02:44.1888583Z ##[group]Runner Image Provisioner
2023-06-01T08:02:44.1888854Z 2.0.171.1
2023-06-01T08:02:44.1888932Z ##[endgroup]
2023-06-01T08:02:44.1890079Z Current image version: '20230517.1'
2023-06-01T08:02:44.1891451Z Agent running as: 'vsts'
2023-06-01T08:02:44.1946741Z Prepare build directory.
2023-06-01T08:02:44.2280602Z Set build variables.
2023-06-01T08:02:44.2319978Z Download all required tasks.
2023-06-01T08:02:44.2498664Z Downloading task: PowerShell (2.220.0)
2023-06-01T08:02:44.5549314Z Downloading task: PublishBuildArtifacts (1.211.0)
2023-06-01T08:02:44.7714633Z Checking job knob settings.
2023-06-01T08:02:44.7727295Z    Knob: DockerActionRetries = true Source: $(VSTSAGENT_DOCKER_ACTION_RETRIES) 
2023-06-01T08:02:44.7728188Z    Knob: AgentToolsDirectory = /opt/hostedtoolcache Source: ${AGENT_TOOLSDIRECTORY} 
2023-06-01T08:02:44.7729377Z    Knob: AgentPerflog = /home/vsts/perflog Source: ${VSTS_AGENT_PERFLOG} 
2023-06-01T08:02:44.7732065Z    Knob: ContinueAfterCancelProcessTreeKillAttempt = true Source: $(VSTSAGENT_CONTINUE_AFTER_CANCEL_PROCESSTREEKILL_ATTEMPT) 
2023-06-01T08:02:44.7732529Z Finished checking job knob settings.
2023-06-01T08:02:44.8137521Z Start tracking orphan processes.
2023-06-01T08:02:44.8371741Z ##[section]Finishing: Initialize job

We use ubuntu-22.04 as the spec.

Started on the 30th May around Midday London time for us.

And for us as well

@liam-witterick
Copy link

liam-witterick commented Jun 1, 2023

We're also seeing this issue for our Azure DevOps pipelines, our self-hosted Windows Server agents are experiencing intermittent issues when trying to connect to the PowerShell Gallery, resulting in the inability to find modules using the Find-Module cmdlet. When troubleshooting this, I also noticed that the issue also occurs when browsing to the Gallery API via a browser, where the connection occasionally drops.

Here's some issues I've seen:

Find-Module AWSPowershell
No match was found for the specified search criteria and module name 'AWSPowerShell'. Try Get-PSRepository to see all available registered module repositories.

Get-PSRepository
WARNING: Unable to find module repositories.

Also:
Could not get response from query 'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='AWSPowerShell'&$skip=0&$top=40'.

@eco-iati
Copy link

eco-iati commented Jun 1, 2023

Been having exactly the same issue since yesterday afternoon, it might have started the day before but has become worse.

Using Windows Server agents in a "MSBuild" agent pool (VMs). Using an Azure Pipelines agent pool doesn't seem to be affected.

@Jono20201
Copy link

It might be useful if those effected could also post in https://developercommunity.visualstudio.com/t/Pipelines-Agents-failing-to-install-Powe/10380317 to drum up support on a fix.

@JohnLudlow
Copy link

It might be useful if those effected could also post in https://developercommunity.visualstudio.com/t/Pipelines-Agents-failing-to-install-Powe/10380317 to drum up support on a fix.

Also this one:

actions/runner-images#7643 (reply in thread)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants