Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indexers issue after update #1992

Open
2 tasks done
Dukobpa3 opened this issue Jan 20, 2024 · 29 comments
Open
2 tasks done

Indexers issue after update #1992

Dukobpa3 opened this issue Jan 20, 2024 · 29 comments
Labels
Status: Investigating We're looking in to it Type: Bug Issue is a bug

Comments

@Dukobpa3
Copy link
Contributor

Is there an existing issue for this?

  • I have searched the existing open and closed issues

Current Behavior

Last few days indexers unavailable from prowlarr. And also randomly drops and up again.
At the same time everything is ok when I go to the trackers site myself. And also jacket works well.
Screenshot 2024-01-20 at 14 34 23
Screenshot 2024-01-20 at 14 34 31

Expected Behavior

Should work :)

Steps To Reproduce

I'm not sure about steps. Maybe configure same list of trackers as my own.
Everything was ok for a long time and became broken last few days.

Environment

- OS: Win 10
- Prowlarr: 1.12.2.4211
- Docker Install: – 
- Using Reverse Proxy: – 
- Browser: Chrome

What branch are you running?

Master

Trace Logs?

Here is last logs after "Test all indexers" click
`2024-01-20 14:24:12.5|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:24:12.6|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:24:12.6|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:24:12.6|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:24:13.1|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:25:21.3|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:25:57.9|Warn|Cardigann|Unable to connect to indexer.

[v1.12.2.4211] System.Net.WebException: Http request timed out
at NzbDrone.Common.Http.Dispatchers.ManagedHttpDispatcher.GetResponseAsync(HttpRequest request, CookieContainer cookies) in ./Prowlarr.Common/Http/Dispatchers/ManagedHttpDispatcher.cs:line 162
at NzbDrone.Common.Http.HttpClient.ExecuteRequestAsync(HttpRequest request, CookieContainer cookieContainer) in ./Prowlarr.Common/Http/HttpClient.cs:line 171
at NzbDrone.Common.Http.HttpClient.ExecuteAsync(HttpRequest request) in ./Prowlarr.Common/Http/HttpClient.cs:line 70
at NzbDrone.Core.Indexers.IndexerHttpClient.ExecuteProxiedAsync(HttpRequest request, ProviderDefinition definition) in ./Prowlarr.Core/Indexers/IndexerHttpClient.cs:line 42
at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchIndexerResponse(IndexerRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 573 at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchPage(IndexerRequest request, IParseIndexerResponse parser) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 514
at NzbDrone.Core.Indexers.HttpIndexerBase`1.TestConnection() in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 757

2024-01-20 14:27:43.0|Warn|Cardigann|Unable to connect to indexer.

[v1.12.2.4211] System.Net.WebException: Http request timed out
at NzbDrone.Common.Http.Dispatchers.ManagedHttpDispatcher.GetResponseAsync(HttpRequest request, CookieContainer cookies) in ./Prowlarr.Common/Http/Dispatchers/ManagedHttpDispatcher.cs:line 162
at NzbDrone.Common.Http.HttpClient.ExecuteRequestAsync(HttpRequest request, CookieContainer cookieContainer) in ./Prowlarr.Common/Http/HttpClient.cs:line 171
at NzbDrone.Common.Http.HttpClient.ExecuteAsync(HttpRequest request) in ./Prowlarr.Common/Http/HttpClient.cs:line 70
at NzbDrone.Core.Indexers.IndexerHttpClient.ExecuteProxiedAsync(HttpRequest request, ProviderDefinition definition) in ./Prowlarr.Core/Indexers/IndexerHttpClient.cs:line 42
at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchIndexerResponse(IndexerRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 573 at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchPage(IndexerRequest request, IParseIndexerResponse parser) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 514
at NzbDrone.Core.Indexers.HttpIndexerBase`1.TestConnection() in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 757

2024-01-20 14:28:01.6|Warn|Cardigann|Unable to connect to indexer.

[v1.12.2.4211] System.Net.WebException: Http request timed out
at NzbDrone.Common.Http.Dispatchers.ManagedHttpDispatcher.GetResponseAsync(HttpRequest request, CookieContainer cookies) in ./Prowlarr.Common/Http/Dispatchers/ManagedHttpDispatcher.cs:line 162
at NzbDrone.Common.Http.HttpClient.ExecuteRequestAsync(HttpRequest request, CookieContainer cookieContainer) in ./Prowlarr.Common/Http/HttpClient.cs:line 171
at NzbDrone.Common.Http.HttpClient.ExecuteAsync(HttpRequest request) in ./Prowlarr.Common/Http/HttpClient.cs:line 70
at NzbDrone.Core.Indexers.IndexerHttpClient.ExecuteProxiedAsync(HttpRequest request, ProviderDefinition definition) in ./Prowlarr.Core/Indexers/IndexerHttpClient.cs:line 42
at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchIndexerResponse(IndexerRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 573 at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchPage(IndexerRequest request, IParseIndexerResponse parser) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 514
at NzbDrone.Core.Indexers.HttpIndexerBase`1.TestConnection() in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 757

2024-01-20 14:28:01.6|Warn|ProwlarrErrorPipeline|Invalid request Validation failed:
-- : Unable to connect to indexer, indexer's server is unavailable. Try again later. Http request timed out
2024-01-20 14:28:30.1|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:29:23.1|Warn|RuTracker|Unable to connect to indexer.

[v1.12.2.4211] System.Net.WebException: Http request timed out
at NzbDrone.Common.Http.Dispatchers.ManagedHttpDispatcher.GetResponseAsync(HttpRequest request, CookieContainer cookies) in ./Prowlarr.Common/Http/Dispatchers/ManagedHttpDispatcher.cs:line 162
at NzbDrone.Common.Http.HttpClient.ExecuteRequestAsync(HttpRequest request, CookieContainer cookieContainer) in ./Prowlarr.Common/Http/HttpClient.cs:line 171
at NzbDrone.Common.Http.HttpClient.ExecuteAsync(HttpRequest request) in ./Prowlarr.Common/Http/HttpClient.cs:line 70
at NzbDrone.Core.Indexers.IndexerHttpClient.ExecuteProxiedAsync(HttpRequest request, ProviderDefinition definition) in ./Prowlarr.Core/Indexers/IndexerHttpClient.cs:line 42
at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchIndexerResponse(IndexerRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 573 at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchPage(IndexerRequest request, IParseIndexerResponse parser) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 514
at NzbDrone.Core.Indexers.HttpIndexerBase`1.TestConnection() in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 757

2024-01-20 14:29:36.6|Warn|RuTracker|Unable to connect to indexer.

[v1.12.2.4211] System.Net.WebException: Http request timed out
at NzbDrone.Common.Http.Dispatchers.ManagedHttpDispatcher.GetResponseAsync(HttpRequest request, CookieContainer cookies) in ./Prowlarr.Common/Http/Dispatchers/ManagedHttpDispatcher.cs:line 162
at NzbDrone.Common.Http.HttpClient.ExecuteRequestAsync(HttpRequest request, CookieContainer cookieContainer) in ./Prowlarr.Common/Http/HttpClient.cs:line 171
at NzbDrone.Common.Http.HttpClient.ExecuteAsync(HttpRequest request) in ./Prowlarr.Common/Http/HttpClient.cs:line 70
at NzbDrone.Core.Indexers.IndexerHttpClient.ExecuteProxiedAsync(HttpRequest request, ProviderDefinition definition) in ./Prowlarr.Core/Indexers/IndexerHttpClient.cs:line 42
at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchIndexerResponse(IndexerRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 573 at NzbDrone.Core.Indexers.HttpIndexerBase1.FetchPage(IndexerRequest request, IParseIndexerResponse parser) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 514
at NzbDrone.Core.Indexers.HttpIndexerBase`1.TestConnection() in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 757

2024-01-20 14:29:36.6|Warn|ProwlarrErrorPipeline|Invalid request Validation failed:
-- : Unable to connect to indexer, indexer's server is unavailable. Try again later. Http request timed out
2024-01-20 14:31:28.3|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.`

Trace Logs have been provided as applicable. Reports may be closed if the required logs are not provided.

  • I have read and followed the steps in the wiki link above and provided the required trace logs - the logs contain trace - that are relevant and show this issue.
@Dukobpa3 Dukobpa3 added Status: Needs Triage New Issue needing triage Type: Bug Issue is a bug labels Jan 20, 2024
@mynameisbogdan
Copy link
Contributor

Restarting Prowlarr and clicking on test all indexers fixes this?

@Dukobpa3
Copy link
Contributor Author

I even restarted host PC couple times but no

@mynameisbogdan
Copy link
Contributor

So if you "restart" Prowlarr and the issue is still there, then it's not what I was expecting to be.

Anything special about your setup? VPN, proxies?

@Dukobpa3
Copy link
Contributor Author

Strange but now restarting service helped.
Now all indexer available again.

I've restarted only service, not whole PC

@bakerboy448 bakerboy448 added Type: Support Issue is a support request. Bot will auto close and give a message. and removed Type: Bug Issue is a bug Status: Needs Triage New Issue needing triage labels Jan 20, 2024
@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Jan 20, 2024
@bakerboy448
Copy link
Contributor

bakerboy448 commented Jan 20, 2024

Or is this similar to the oddness of what you're seeing @mynameisbogdan on your setup

@mynameisbogdan mynameisbogdan added Type: Bug Issue is a bug Status: Investigating We're looking in to it and removed Type: Support Issue is a support request. Bot will auto close and give a message. labels Jan 20, 2024
@Prowlarr Prowlarr deleted a comment from github-actions bot Jan 20, 2024
@bakerboy448 bakerboy448 reopened this Jan 20, 2024
@Dukobpa3
Copy link
Contributor Author

Dukobpa3 commented Jan 20, 2024

But anyway something not good

Here is log started from exit:

2024-01-20 14:55:37.8|Info|Bootstrap|Starting Prowlarr - C:\ProgramData\Prowlarr\bin\Prowlarr.Console.exe - Version 1.12.2.4211
2024-01-20 14:55:39.7|Info|MigrationController|*** Migrating data source=C:\ProgramData\Prowlarr\prowlarr.db;cache size=-20000;datetimekind=Utc;journal mode=Wal;pooling=True;version=3;busytimeout=100 ***
2024-01-20 14:55:40.2|Warn|DiskProvider|Couldn't set permission for C:\ProgramData\Prowlarr. account:WorldSid rights:Modify accessControlType:Allow

[v1.12.2.4211] System.UnauthorizedAccessException: Attempted to perform an unauthorized operation.
   at System.Security.AccessControl.Win32.SetSecurityInfo(ResourceType type, String name, SafeHandle handle, SecurityInfos securityInformation, SecurityIdentifier owner, SecurityIdentifier group, GenericAcl sacl, GenericAcl dacl)
   at System.Security.AccessControl.NativeObjectSecurity.Persist(String name, SafeHandle handle, AccessControlSections includeSections, Object exceptionContext)
   at System.Security.AccessControl.NativeObjectSecurity.Persist(String name, AccessControlSections includeSections, Object exceptionContext)
   at System.Security.AccessControl.NativeObjectSecurity.Persist(String name, AccessControlSections includeSections)
   at System.Security.AccessControl.FileSystemSecurity.Persist(String fullPath)
   at System.IO.FileSystemAclExtensions.SetAccessControl(DirectoryInfo directoryInfo, DirectorySecurity directorySecurity)
   at NzbDrone.Windows.Disk.DiskProvider.SetEveryonePermissions(String filename) in ./Prowlarr.Windows/Disk/DiskProvider.cs:line 99


2024-01-20 14:55:40.3|Warn|AppFolderFactory|Coudn't set app folder permission

[v1.12.2.4211] System.UnauthorizedAccessException: Attempted to perform an unauthorized operation.
   at System.Security.AccessControl.Win32.SetSecurityInfo(ResourceType type, String name, SafeHandle handle, SecurityInfos securityInformation, SecurityIdentifier owner, SecurityIdentifier group, GenericAcl sacl, GenericAcl dacl)
   at System.Security.AccessControl.NativeObjectSecurity.Persist(String name, SafeHandle handle, AccessControlSections includeSections, Object exceptionContext)
   at System.Security.AccessControl.NativeObjectSecurity.Persist(String name, AccessControlSections includeSections, Object exceptionContext)
   at System.Security.AccessControl.NativeObjectSecurity.Persist(String name, AccessControlSections includeSections)
   at System.Security.AccessControl.FileSystemSecurity.Persist(String fullPath)
   at System.IO.FileSystemAclExtensions.SetAccessControl(DirectoryInfo directoryInfo, DirectorySecurity directorySecurity)
   at NzbDrone.Windows.Disk.DiskProvider.SetEveryonePermissions(String filename) in ./Prowlarr.Windows/Disk/DiskProvider.cs:line 99
   at NzbDrone.Common.EnvironmentInfo.AppFolderFactory.SetPermissions() in ./Prowlarr.Common/EnvironmentInfo/AppFolderFactory.cs:line 66


2024-01-20 14:55:40.3|Info|MigrationController|*** Migrating data source=C:\ProgramData\Prowlarr\logs.db;cache size=-20000;datetimekind=Utc;journal mode=Wal;pooling=True;version=3;busytimeout=100 ***
2024-01-20 14:55:40.7|Info|Microsoft.Hosting.Lifetime|Now listening on: http://[::]:9696
2024-01-20 14:55:40.9|Info|CommandExecutor|Starting 3 threads for tasks.
2024-01-20 14:55:42.3|Info|Microsoft.Hosting.Lifetime|Application started. Hosting environment: Production; Content root path: C:\ProgramData\Prowlarr\bin\
2024-01-20 14:55:45.6|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:55:45.9|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:59:16.8|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.
2024-01-20 14:59:28.3|Info|Prowlarr.Http.Authentication.BasicAuthenticationHandler|Basic was not authenticated. Failure message: Authorization header missing.```

@mynameisbogdan
Copy link
Contributor

mynameisbogdan commented Jan 20, 2024

Or is this similar to the oddness of what you're seeing on your setup

Yes, sounds very similar to my issue.

[v1.12.2.4211] System.UnauthorizedAccessException: Attempted to perform an unauthorized operation.

That's not related, and it's a support thing so you can hop on discord for that.

@Dukobpa3
Copy link
Contributor Author

Anything special about your setup? VPN, proxies?

I think no
I have Radarr/Sonarr/Prowlarr/Plex/qBittorrent/Transmission installed on one win10 server
(Transmission there temporary because I've just migrated to qBit and still use Transmission until it complete couple dowloads)

I also have Jacket installed on another server.

Nothing special like proxies or vpn or even domain names

@pbarone

This comment was marked as off-topic.

@mynameisbogdan

This comment was marked as off-topic.

@mynameisbogdan
Copy link
Contributor

mynameisbogdan commented Feb 17, 2024

My issue was fixed by switching from ipvlan to macvlan, but you said you don't use docker.

Still unknown on why it happens on bare installations on Windows.

@Dukobpa3
Copy link
Contributor Author

wasn't reproduced for me for a long time also

@Ahim13
Copy link

Ahim13 commented Mar 17, 2024

So if you "restart" Prowlarr and the issue is still there, then it's not what I was expecting to be.

Anything special about your setup? VPN, proxies?

I'm facing this issue now as well. But restarting the app then manually testing it, solves it immediately. @mynameisbogdan what was the issue you were thinking of?

@mynameisbogdan
Copy link
Contributor

Something with DNS and .NET's networking stack.

@Sebbyyy

This comment was marked as off-topic.

@mynameisbogdan

This comment was marked as off-topic.

@mynameisbogdan
Copy link
Contributor

I would ask those with the http request timeout issue to test disabling IPv6 by using export DOTNET_SYSTEM_NET_DISABLEIPV6=1.

@nopoz
Copy link

nopoz commented Apr 25, 2024

I've added DOTNET_SYSTEM_NET_DISABLEIPV6=1 to my env variables, but I'm still getting frequent indexer health issues that don't go away until I restart the Prowlarr docker container. Checking the sites in a browser, they seem fine. Re-testing the indexer in Prowlarr doesn't work until I restart the container. On version 1.16.2.4435.

Message:

Unable to connect to indexer.: Http request timed out

Exception:

System.Net.WebException: Http request timed out
   at NzbDrone.Common.Http.Dispatchers.ManagedHttpDispatcher.GetResponseAsync(HttpRequest request, CookieContainer cookies) in ./Prowlarr.Common/Http/Dispatchers/ManagedHttpDispatcher.cs:line 170
   at NzbDrone.Common.Http.HttpClient.ExecuteRequestAsync(HttpRequest request, CookieContainer cookieContainer) in ./Prowlarr.Common/Http/HttpClient.cs:line 171
   at NzbDrone.Common.Http.HttpClient.ExecuteAsync(HttpRequest request) in ./Prowlarr.Common/Http/HttpClient.cs:line 70
   at NzbDrone.Core.Indexers.IndexerHttpClient.ExecuteProxiedAsync(HttpRequest request, ProviderDefinition definition) in ./Prowlarr.Core/Indexers/IndexerHttpClient.cs:line 44
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.<>c.<<FetchIndexerResponse>b__56_0>d.MoveNext() in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 628
--- End of stack trace from previous location ---
   at Polly.ResiliencePipeline.<>c__9`2.<<ExecuteAsync>b__9_0>d.MoveNext()
--- End of stack trace from previous location ---
   at Polly.Outcome`1.GetResultOrRethrow()
   at Polly.ResiliencePipeline.ExecuteAsync[TResult,TState](Func`3 callback, TState state, CancellationToken cancellationToken)
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchIndexerResponse(IndexerRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 627
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchPage(IndexerRequest request, IParseIndexerResponse parser) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 568
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.TestConnection() in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 813

Docker Compose:

version: "3.0"
services:
prowlarr:
 image: ghcr.io/linuxserver/prowlarr:version-1.16.2.4435
 container_name: prowlarr
 networks:
   - arrs
 environment:
   - PUID=1337
   - PGID=666
   - TZ=America/Los_Angeles 
   - DOTNET_SYSTEM_NET_DISABLEIPV6=1
 volumes:
   - /mypath:/config
 ports:
   - 127.0.0.1:9929:9696
 restart: unless-stopped

networks:
arrs:
 external: true

Inspect Docker network "arrs":

$ docker inspect arrs
[
    {
        "Name": "arrs",
        "Id": "c1a6a06b2e7195ece12684c0e222b82c3207450e6d2f760376f83a3535625db2",
        "Created": "2023-11-07T01:53:19.857195779-08:00",
        "Scope": "local",
        "Driver": "bridge",
        "EnableIPv6": false,
        "IPAM": {
            "Driver": "default",
            "Options": null,
            "Config": [
                {
                    "Subnet": "172.16.2.0/24",
                    "IPRange": "172.16.2.0/24",
                    "Gateway": "172.16.2.1"
                }
            ]
        },
        "Internal": false,
        "Attachable": true,
        "Ingress": false,
        "ConfigFrom": {
            "Network": ""
        },
        "ConfigOnly": false,
        "Containers": {
            "17ce4e59468a44b79586e1c0599c6e372132e7594d289dd4105bf5d65ed21131": {
                "Name": "prowlarr",
                "EndpointID": "9b7703fb4a4253efac59f07078b793b3876453700acff71c9cb6ab8f41c23098",
                "MacAddress": "02:42:ac:10:02:07",
                "IPv4Address": "172.16.2.7/24",
                "IPv6Address": ""
            }  
        },
        "Options": {},
        "Labels": {}
    }
]

@nopoz
Copy link

nopoz commented Apr 25, 2024

Not sure if the process listening on IPV6 "any" (ie :::) is expected? The docker network is IPV4 and has IPV6 disabled. If I interact with the container and look for the Prowlarr listening port, it's listening on IPV6. Not sure if that's normal and/or desired. Doing a translation internally from IPV6 to IPV4 seems redundant and a possible area where networking could get mangled.

# docker exec -t -i prowlarr /bin/bash
root@17ce4e59468a:/# netstat -nap | grep LISTEN | grep 9696
tcp        0      0 :::9696                 :::*                    LISTEN      -

@nopoz
Copy link

nopoz commented Apr 25, 2024

I tried a bunch of stuff but found that the only way to get prowlarr to listen on ipv4 only is to stop the container and edit the config file to bind to 0.0.0.0 instead of *:

config.xml:

  <BindAddress>0.0.0.0</BindAddress>

Note that this can only be done by manually editing the config file. If you try to change it in the UI, it will throw an error telling you to use * instead.

I'm going see how this goes and if the timeouts come back.

netstat output after the config change:

root@7ee3286f7154:/# netstat -nap | grep LISTEN | grep 9696
tcp        0      0 0.0.0.0:9696            0.0.0.0:*               LISTEN      -

@Bingmano
Copy link

I am also having this issue with XSpeeds. It appears the latest update has altered something with IPv6 as this had not been happening prior to this update. The difference in my scenario from what i have read here is that if i get an email notification that the tracker is down, if i go into prowlarr and test it comes back immediately. I am getting the same type of timeout errors though:

2024-05-01 01:56:18.0|Warn|Cardigann|Unable to connect to indexer, please check your DNS settings and ensure IPv6 is working or disabled. https://apibay.org/precompiled/data_top100_recent.json

[v1.16.2.4435] System.Net.Http.HttpRequestException: An error occurred while sending the request.
 ---> System.IO.IOException: The request was aborted.
 ---> System.IO.IOException: The response ended prematurely while waiting for the next frame from the server.
   at System.Net.Http.Http2Connection.<ReadFrameAsync>g__ThrowMissingFrame|58_1()
   at System.Net.Http.Http2Connection.ReadFrameAsync(Boolean initialFrame)
   at System.Net.Http.Http2Connection.ProcessIncomingFramesAsync()
   --- End of inner exception stack trace ---
   at System.Net.Http.Http2Connection.ThrowRequestAborted(Exception innerException)
   at System.Net.Http.Http2Connection.Http2Stream.CheckResponseBodyState()
   at System.Net.Http.Http2Connection.Http2Stream.TryEnsureHeaders()
   at System.Net.Http.Http2Connection.Http2Stream.ReadResponseHeadersAsync(CancellationToken cancellationToken)
   at System.Net.Http.Http2Connection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.Http2Connection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   at NzbDrone.Common.Http.Dispatchers.ManagedHttpDispatcher.GetResponseAsync(HttpRequest request, CookieContainer cookies) in ./Prowlarr.Common/Http/Dispatchers/ManagedHttpDispatcher.cs:line 120
   at NzbDrone.Common.Http.HttpClient.ExecuteRequestAsync(HttpRequest request, CookieContainer cookieContainer) in ./Prowlarr.Common/Http/HttpClient.cs:line 171
   at NzbDrone.Common.Http.HttpClient.ExecuteAsync(HttpRequest request) in ./Prowlarr.Common/Http/HttpClient.cs:line 70
   at NzbDrone.Core.Indexers.IndexerHttpClient.ExecuteProxiedAsync(HttpRequest request, ProviderDefinition definition) in ./Prowlarr.Core/Indexers/IndexerHttpClient.cs:line 44
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.<>c.<<FetchIndexerResponse>b__56_0>d.MoveNext() in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 628
--- End of stack trace from previous location ---
   at Polly.ResiliencePipeline.<>c__9`2.<<ExecuteAsync>b__9_0>d.MoveNext()
--- End of stack trace from previous location ---
   at Polly.Outcome`1.GetResultOrRethrow()
   at Polly.ResiliencePipeline.ExecuteAsync[TResult,TState](Func`3 callback, TState state, CancellationToken cancellationToken)
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchIndexerResponse(IndexerRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 627
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchPage(IndexerRequest request, IParseIndexerResponse parser) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 568
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchReleases(Func`2 pageableRequestChainSelector, SearchCriteriaBase searchCriteria, Boolean isRecent) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 386


2024-05-01 01:56:18.0|Warn|XSpeeds|Unable to connect to indexer, please check your DNS settings and ensure IPv6 is working or disabled. https://www.xspeeds.eu/browse.php?category=0&include_dead_torrents=yes&sort=added&order=desc

[v1.16.2.4435] System.Net.Http.HttpRequestException: An error occurred while sending the request.
 ---> System.IO.IOException: The request was aborted.
 ---> System.IO.IOException: The response ended prematurely while waiting for the next frame from the server.
   at System.Net.Http.Http2Connection.<ReadFrameAsync>g__ThrowMissingFrame|58_1()
   at System.Net.Http.Http2Connection.ReadFrameAsync(Boolean initialFrame)
   at System.Net.Http.Http2Connection.ProcessIncomingFramesAsync()
   --- End of inner exception stack trace ---
   at System.Net.Http.Http2Connection.ThrowRequestAborted(Exception innerException)
   at System.Net.Http.Http2Connection.Http2Stream.CheckResponseBodyState()
   at System.Net.Http.Http2Connection.Http2Stream.TryEnsureHeaders()
   at System.Net.Http.Http2Connection.Http2Stream.ReadResponseHeadersAsync(CancellationToken cancellationToken)
   at System.Net.Http.Http2Connection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.Http2Connection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   at NzbDrone.Common.Http.Dispatchers.ManagedHttpDispatcher.GetResponseAsync(HttpRequest request, CookieContainer cookies) in ./Prowlarr.Common/Http/Dispatchers/ManagedHttpDispatcher.cs:line 120
   at NzbDrone.Common.Http.HttpClient.ExecuteRequestAsync(HttpRequest request, CookieContainer cookieContainer) in ./Prowlarr.Common/Http/HttpClient.cs:line 171
   at NzbDrone.Common.Http.HttpClient.ExecuteAsync(HttpRequest request) in ./Prowlarr.Common/Http/HttpClient.cs:line 70
   at NzbDrone.Core.Indexers.IndexerHttpClient.ExecuteProxiedAsync(HttpRequest request, ProviderDefinition definition) in ./Prowlarr.Core/Indexers/IndexerHttpClient.cs:line 44
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.<>c.<<FetchIndexerResponse>b__56_0>d.MoveNext() in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 628
--- End of stack trace from previous location ---
   at Polly.ResiliencePipeline.<>c__9`2.<<ExecuteAsync>b__9_0>d.MoveNext()
--- End of stack trace from previous location ---
   at Polly.Outcome`1.GetResultOrRethrow()
   at Polly.ResiliencePipeline.ExecuteAsync[TResult,TState](Func`3 callback, TState state, CancellationToken cancellationToken)
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchIndexerResponse(IndexerRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 627
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchPage(IndexerRequest request, IParseIndexerResponse parser) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 568
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchReleases(Func`2 pageableRequestChainSelector, SearchCriteriaBase searchCriteria, Boolean isRecent) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 386

@mynameisbogdan
Copy link
Contributor

Firstly try to update to latest, and then report back with new logs. I suspect it's something else in your case because TBP is also down for you with the same error.

System.IO.IOException: The response ended prematurely means the server to which you're making an HTTP request closed the connection without having sent back a complete response.

IPv6 related commit would be a25e790 from Mar 3 first time seen in build v1.14.2.4318. Another is 14ae062 which fixes an issue on aarch64.

@Bingmano
Copy link

Firstly try to update to latest, and then report back with new logs. I suspect it's something else in your case because TBP is also down for you with the same error.

System.IO.IOException: The response ended prematurely means the server to which you're making an HTTP request closed the connection without having sent back a complete response.

IPv6 related commit would be a25e790 from Mar 3 first time seen in build v1.14.2.4318. Another is 14ae062 which fixes an issue on aarch64.

thanks, didn't realize i was behind (running docker, linuxserver.io has not updated past 1.16). I updated to the new latest and will see what happens.

@mynameisbogdan
Copy link
Contributor

You should try again in 10-20 mins to update because some cache on our side was cleared and lsio is building the latest release.

@Bingmano
Copy link

Bingmano commented May 13, 2024

ok so after doing a new pull this morning, i received the below just now. As soon as i got the alert via email, i then clicked test all and it went back to healthy.

2024-05-13 12:35:42.7|Warn|XSpeeds|Unable to connect to indexer, please check your DNS settings and ensure IPv6 is working or disabled. https://www.xspeeds.eu/browse.php?category=0&include_dead_torrents=yes&sort=added&order=desc

[v1.17.2.4511] System.Net.Http.HttpRequestException: An error occurred while sending the request.
 ---> System.IO.IOException: The request was aborted.
 ---> System.IO.IOException: The response ended prematurely while waiting for the next frame from the server.
   at System.Net.Http.Http2Connection.<ReadFrameAsync>g__ThrowMissingFrame|58_1()
   at System.Net.Http.Http2Connection.ReadFrameAsync(Boolean initialFrame)
   at System.Net.Http.Http2Connection.ProcessIncomingFramesAsync()
   --- End of inner exception stack trace ---
   at System.Net.Http.Http2Connection.ThrowRequestAborted(Exception innerException)
   at System.Net.Http.Http2Connection.Http2Stream.CheckResponseBodyState()
   at System.Net.Http.Http2Connection.Http2Stream.TryEnsureHeaders()
   at System.Net.Http.Http2Connection.Http2Stream.ReadResponseHeadersAsync(CancellationToken cancellationToken)
   at System.Net.Http.Http2Connection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.Http2Connection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   at NzbDrone.Common.Http.Dispatchers.ManagedHttpDispatcher.GetResponseAsync(HttpRequest request, CookieContainer cookies) in ./Prowlarr.Common/Http/Dispatchers/ManagedHttpDispatcher.cs:line 120
   at NzbDrone.Common.Http.HttpClient.ExecuteRequestAsync(HttpRequest request, CookieContainer cookieContainer) in ./Prowlarr.Common/Http/HttpClient.cs:line 171
   at NzbDrone.Common.Http.HttpClient.ExecuteAsync(HttpRequest request) in ./Prowlarr.Common/Http/HttpClient.cs:line 70
   at NzbDrone.Core.Indexers.IndexerHttpClient.ExecuteProxiedAsync(HttpRequest request, ProviderDefinition definition) in ./Prowlarr.Core/Indexers/IndexerHttpClient.cs:line 44
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.ExecuteAuth(HttpRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 727
   at NzbDrone.Core.Indexers.Definitions.XSpeeds.DoLogin() in ./Prowlarr.Core/Indexers/Definitions/XSpeeds.cs:line 90
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchIndexerResponse(IndexerRequest request) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 671
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchPage(IndexerRequest request, IParseIndexerResponse parser) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 603
   at NzbDrone.Core.Indexers.HttpIndexerBase`1.FetchReleases(Func`2 pageableRequestChainSelector, SearchCriteriaBase searchCriteria, Boolean isRecent) in ./Prowlarr.Core/Indexers/HttpIndexerBase.cs:line 421

@mynameisbogdan
Copy link
Contributor

Sadly cherry picking the logs isn't helpful to diagnostic your issue, but I suspect you're either having some networking issues so maybe check if you're having package loss.

The issue discussed on this bug report is about getting Http request timed out and having to restart Prowlarr to fix the issue.

@Bingmano
Copy link

I'll take a look into it and start a new thread if i cannot find anything on my end, thanks.

@mynameisbogdan
Copy link
Contributor

Firstly you need to join our discord for support because we don't offer support on github and we're off-topic.

@nopoz
Copy link

nopoz commented May 13, 2024

Update: I haven't had this issue again since I changed the interface bind from * to 0.0.0.0. However, I since I don't know the root cause of the problem I'm not sure if this is just coincidence or not. If this is going to be a workaround going forward, a change to the code to allow users to make this change in the web UI would nice - otherwise they are forced to make the change in the config file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: Investigating We're looking in to it Type: Bug Issue is a bug
Projects
None yet
Development

No branches or pull requests

8 participants