Uberspace: Unable to load content: Error fetching content: HTTP code 200

[Lucki]

Hi there,

my FreshRSS instance is already running a few years or so and I didn't have any problems until a month ago.
I already had the latest version 1.23.1 in use since its release.

The general problem is, that no external content is loaded anymore besides the RSS feed itself.
This affects:

• Favicon - only the general world icon is shown
• Article content - no article bodies are loading and replacing the RSS feed body
• XPath feeds - XPath feeds aren't working at all anymore

Please help me debug this. I already went through https://freshrss.github.io/FreshRSS/en/admins/logs_and_errors.html but everything seems fine in those logs.

The only error message I get is in the FreshRSS protocol followed by an empty line:

Error fetching content: HTTP code 200: https://www.gamingonlinux.com/2024/05/vampire-survivors-gets-a-aaaa-update-with-functional-doors-a-train-and-rail-kart-racing/

Screenshot

Some time before I noticed this problem my hoster team (Uberspace) sent me a notice that they killed all php worker because I had the maximum number of 20 in use for some time. Since they're killed now I can't look if they came from FreshRSS or if that info is related at all - to my understanding FreshRSS would simply start the needed php workers again.

---

For the following logs I turned on 'environment' => 'development'.
The best related match to the problem seems to be: FreshRSS feeds actualization was already running, so aborting new run at … but the feeds itself do update.

users/Lucki/log.txt

[Wed, 01 May 2024 14:25:07 +0200] [warning] --- Error fetching content: HTTP code 200:  https://www.gamingonlinux.com/2024/05/the-huge-life-sim-life-by-you-from-paradox-hits-early-access-on-june-4/
[Wed, 01 May 2024 14:25:07 +0200] [warning] --- 
[Wed, 01 May 2024 14:31:43 +0200] [warning] --- Error fetching content: HTTP code 200:  https://www.gamingonlinux.com/2024/05/clothes-line-is-a-sweet-free-little-adventure-game-about-a-retired-old-lady/
[Wed, 01 May 2024 14:31:43 +0200] [warning] --- 
[Wed, 01 May 2024 14:57:20 +0200] [warning] --- Error fetching content: HTTP code 200:  https://www.gamingonlinux.com/2024/05/vampire-survivors-gets-a-aaaa-update-with-functional-doors-a-train-and-rail-kart-racing/
[Wed, 01 May 2024 14:57:20 +0200] [warning] --- 

users/_/log.txt

[Thu, 18 Apr 2024 23:00:04 +0200] [notice] --- FreshRSS starting feeds actualization at 2024-04-18T23:00:04+02:00
[Thu, 18 Apr 2024 23:00:04 +0200] [notice] --- FreshRSS actualize xxxx…
[Thu, 18 Apr 2024 23:00:04 +0200] [notice] --- FreshRSS actualize Lucki…
[Thu, 18 Apr 2024 23:00:04 +0200] [notice] --- FreshRSS actualize yyyy…
[Thu, 18 Apr 2024 23:00:04 +0200] [notice] --- FreshRSS actualization done for 3 users, using 4.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 0 seconds.
[Thu, 18 Apr 2024 23:10:02 +0200] [notice] --- FreshRSS feeds actualization was already running, so aborting new run at 2024-04-18T23:10:02+02:00
[Thu, 18 Apr 2024 23:20:02 +0200] [notice] --- FreshRSS feeds actualization was already running, so aborting new run at 2024-04-18T23:20:02+02:00
[Thu, 18 Apr 2024 23:30:04 +0200] [notice] --- FreshRSS feeds actualization was already running, so aborting new run at 2024-04-18T23:30:04+02:00
[Thu, 18 Apr 2024 23:40:07 +0200] [notice] --- FreshRSS starting feeds actualization at 2024-04-18T23:40:07+02:00
[Thu, 18 Apr 2024 23:40:07 +0200] [notice] --- FreshRSS actualize xxxx…
[Thu, 18 Apr 2024 23:40:07 +0200] [notice] --- FreshRSS actualize yyyy…
[Thu, 18 Apr 2024 23:40:07 +0200] [notice] --- FreshRSS actualize Lucki…
[Thu, 18 Apr 2024 23:40:33 +0200] [notice] --- FreshRSS actualization done for 3 users, using 12.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 26 seconds.
[Thu, 18 Apr 2024 23:50:02 +0200] [notice] --- FreshRSS starting feeds actualization at 2024-04-18T23:50:02+02:00
[Thu, 18 Apr 2024 23:50:02 +0200] [notice] --- FreshRSS actualize xxxx…
[Thu, 18 Apr 2024 23:50:02 +0200] [notice] --- FreshRSS actualize Lucki…
[Thu, 18 Apr 2024 23:50:02 +0200] [notice] --- FreshRSS actualize yyyy…
[Thu, 18 Apr 2024 23:50:02 +0200] [notice] --- FreshRSS actualization done for 3 users, using 4.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 0 seconds.
[Wed, 01 May 2024 16:00:04 +0200] [notice] --- FreshRSS feeds actualization was already running, so aborting new run at 2024-05-01T16:00:04+02:00
[Wed, 01 May 2024 16:10:08 +0200] [notice] --- FreshRSS feeds actualization was already running, so aborting new run at 2024-05-01T16:10:08+02:00
[Wed, 01 May 2024 16:20:03 +0200] [notice] --- FreshRSS feeds actualization was already running, so aborting new run at 2024-05-01T16:20:03+02:00
[Wed, 01 May 2024 16:30:04 +0200] [notice] --- FreshRSS starting feeds actualization at 2024-05-01T16:30:04+02:00
[Wed, 01 May 2024 16:30:04 +0200] [notice] --- FreshRSS actualize xxxx…
[Wed, 01 May 2024 16:30:05 +0200] [notice] --- FreshRSS actualize Lucki…
[Wed, 01 May 2024 16:30:40 +0200] [notice] --- FreshRSS actualize yyyy…
[Wed, 01 May 2024 16:30:46 +0200] [notice] --- FreshRSS actualization done for 3 users, using 14.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 41 seconds.
[Wed, 01 May 2024 16:40:02 +0200] [notice] --- FreshRSS feeds actualization was already running, so aborting new run at 2024-05-01T16:40:02+02:00
[Wed, 01 May 2024 16:50:02 +0200] [notice] --- FreshRSS feeds actualization was already running, so aborting new run at 2024-05-01T16:50:02+02:00
[Wed, 01 May 2024 17:00:05 +0200] [notice] --- FreshRSS feeds actualization was already running, so aborting new run at 2024-05-01T17:00:05+02:00

error_log_php

I'm on a shared host and don't have direct journalctl access. However, I can let specific logs forward into my log folder.

This [pool www] no free scoreboard slot seems to appear daily around 12:00 - I don't know what's causing it, but it seems unrelated because it only happens once a day.

[01-May-2024 06:56:07] NOTICE: error log file re-opened
[01-May-2024 06:56:07] WARNING: [pool www] child 5341 exited on signal 10 (SIGUSR1) after 59.264533 seconds from start
[01-May-2024 06:56:07] NOTICE: [pool www] child 6289 started
[01-May-2024 12:18:00] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:08] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:08] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:08] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:08] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:08] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:08] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:09] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:09] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:09] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:09] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:11] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:11] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:11] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:11] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:11] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:11] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:11] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:12] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:13] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:14] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:19] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:20] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:21] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:21] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:21] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:22] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:22] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:23] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:23] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:24] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:25] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:30] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:30] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:30] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:30] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:31] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:31] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:33] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:33] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:33] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:33] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:33] ERROR: [pool www] no free scoreboard slot
[01-May-2024 12:18:34] ERROR: [pool www] no free scoreboard slot

The apache access logs don't show special entries regarding FreshRSS, just the normal access from Firefox.

[beerisgood]

I‘m an uberspace user too and most of my feeds also didn’t load favicons anymore.

I already removed some feeds but re-adding didn’t solve the problem.

[Alkarex]

Hello,
Test a basic connection by creating a file ./FreshRSS/p/test.php

<?php
header('Content-Type: application/atom+xml; charset=UTF-8');
$ch = curl_init('https://github.com/FreshRSS/FreshRSS/releases.atom');
curl_setopt_array($ch, [
		CURLOPT_TIMEOUT => 10,
		CURLOPT_ENCODING => '',	//Enable all encodings
	]);
curl_exec($ch);
curl_close($ch);

And then access it via your Web browser https://your-server.example.net/test.php

If that works, check the write permission in ./data/ and all subfolders.

[Lucki]

I changed the value to 2 and the actualize script completes successfully, but I don't think all feeds were fetched, because I was able to manually request new entries directly after the actualize script run. I think only one feed was fetched from the actualize script.

$ php app/actualize_script.php
FreshRSS starting feeds actualization at 2024-05-04T01:01:38+02:00
FreshRSS actualize XXX…
FreshRSS actualize YYY…
FreshRSS actualize Lucki…
FreshRSS actualization done for 3 users, using 6.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 2 seconds.
Results: 
XXX OK
YYY OK
Lucki OK
End.

Something else: does refreshing feeds via the task bar work?

Yes, it's going through all the feeds and fetches new entries.

[Alkarex]

With a value of 2, the cron job will refresh 2 feeds each time. You could have a cron job running every 5 minutes, for instance.
I will try to make you a debugging code to find out whether it is possible to see the max_execution_time.

[Lucki]

Ah yes, I misinterpreted the meaning of the value. The cron has fetched quite a few feeds, but still hasn't gotten all when I checked manually now. The initial problem still remains though.

Thank you btw 🙏

[Alkarex]

Could you try #6436 ?
It just adds one debug line to print max_execution_time
P.S. And then check your cron output.

[Lucki]

I changed the PHP_INT_MAX value back so my checkout is exactly like your PR.

The max_execution_time is always 0.

Details

FreshRSS starting feeds actualization at 2024-05-08T17:00:09+02:00
FreshRSS PHP max_execution_time: 0
FreshRSS actualize Lucki…
FreshRSS actualization done for 3 users, using 4.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 6 seconds.
Results: 
Lucki OK
End.
FreshRSS starting feeds actualization at 2024-05-08T17:15:02+02:00
FreshRSS PHP max_execution_time: 0
FreshRSS actualize Lucki…
FreshRSS actualization done for 3 users, using 14.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 35 seconds.
Results: 
Lucki OK
End.
FreshRSS starting feeds actualization at 2024-05-08T17:30:03+02:00
FreshRSS PHP max_execution_time: 0
FreshRSS actualize Lucki…
FreshRSS actualization done for 3 users, using 4.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 5 seconds.
Results: 
Lucki OK
End.
FreshRSS starting feeds actualization at 2024-05-08T17:45:05+02:00
FreshRSS PHP max_execution_time: 0
FreshRSS actualize Lucki…
FreshRSS actualization done for 3 users, using 6.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 7 seconds.
Results: 
Lucki OK
End.
FreshRSS starting feeds actualization at 2024-05-08T18:00:03+02:00
FreshRSS PHP max_execution_time: 0
FreshRSS actualize Lucki…
FreshRSS actualization done for 3 users, using 4.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 6 seconds.
Results: 
Lucki OK
End.
FreshRSS starting feeds actualization at 2024-05-08T18:15:04+02:00
FreshRSS PHP max_execution_time: 0
FreshRSS actualize Lucki…
FreshRSS actualization done for 3 users, using 8.00 MiB of memory, in 0 day(s), 0 hour(s), 0 minute(s) and 12 seconds.
Results: 
Lucki OK
End.

In my initial debugging I muted a few feeds which I know are on slow servers or completely broken, maybe that's the reason the FreshRSS feeds actualization was already running, so aborting new run at … isn't appearing anymore in the logs. However, the initial problem still remains.

[Lucki]

I searched for the error message in the code and luckily there's only one occurrence:

FreshRSS/lib/lib_rss.php

Lines 478 to 479 in 227233b

	if ($c_status != 200 || $c_error != '' || $body === false) {
	Minz_Log::warning('Error fetching content: HTTP code ' . $c_status . ': ' . $c_error . ' ' . $url);

I added some debug messages and it's failing because the $body is false.

I followed this to add more debug options and this is the message I get when it's failing to fetch the content:

curl verbose not working

* Host www.computerbase.de:443 was resolved.
* IPv6: 2a00:f48:2000:1::137
* IPv4: 212.83.33.137
*   Trying 212.83.33.137:443...
* Connected to www.computerbase.de (212.83.33.137) port 443
* ALPN: curl offers h2,http/1.1
* Cipher selection: ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
*  CAfile: /etc/pki/tls/cert.pem
*  CApath: none
* SSL connection using TLSv1.2 / ECDHE-RSA-AES256-GCM-SHA384 / [blank] / UNDEF
* ALPN: server accepted h2
* Server certificate:
*  subject: CN=*.computerbase.de
*  start date: May  2 02:17:17 2024 GMT
*  expire date: Jul 31 02:17:16 2024 GMT
*  subjectAltName: host "www.computerbase.de" matched cert's "*.computerbase.de"
*  issuer: C=US; O=Let's Encrypt; CN=R3
*  SSL certificate verify ok.
* using HTTP/2
* [HTTP/2] [1] OPENED stream for https://www.computerbase.de/2024-05/venu-sq-2-garmin-nervt-fitness-watch-traeger-seit-wochen-mit-fehlern/
* [HTTP/2] [1] [:method: GET]
* [HTTP/2] [1] [:scheme: https]
* [HTTP/2] [1] [:authority: www.computerbase.de]
* [HTTP/2] [1] [:path: /2024-05/venu-sq-2-garmin-nervt-fitness-watch-traeger-seit-wochen-mit-fehlern/]
* [HTTP/2] [1] [user-agent: FreshRSS/1.23.2-dev (Linux; https://freshrss.org)]
* [HTTP/2] [1] [accept-encoding: deflate, gzip, br]
* [HTTP/2] [1] [accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8]
> GET /2024-05/venu-sq-2-garmin-nervt-fitness-watch-traeger-seit-wochen-mit-fehlern/ HTTP/2
Host: www.computerbase.de
User-Agent: FreshRSS/1.23.2-dev (Linux; https://freshrss.org)
Accept-Encoding: deflate, gzip, br
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8

* Request completely sent off
< HTTP/2 200 
< server: nginx
< date: Tue, 14 May 2024 10:20:00 GMT
< content-type: text/html; charset=UTF-8
< vary: Accept-Encoding
< cache-control: no-cache
< cross-origin-opener-policy: same-origin
< x-content-type-options: nosniff
< referrer-policy: no-referrer-when-downgrade
< feature-policy: camera 'none'; geolocation 'none'; microphone 'none'; payment 'none'; sync-xhr 'none'
< content-security-policy: frame-ancestors 'self'; upgrade-insecure-requests; report-uri /api/csp-report
< x-frame-options: SAMEORIGIN
< strict-transport-security: max-age=63072000; includeSubDomains; preload
< content-encoding: br
< 
* Connection #0 to host www.computerbase.de left intact

Doing this, I discovered that some content is indeed fetched but it's inconsistent even in the same feed. Here is the message I get when it's working:

curl verbose working

* Host www.tagesschau.de:443 was resolved.
* IPv6: 2a02:26f0:1700:784::1ff2, 2a02:26f0:1700:782::1ff2
* IPv4: 23.201.252.87
*   Trying 23.201.252.87:443...
* Connected to www.tagesschau.de (23.201.252.87) port 443
* ALPN: curl offers h2,http/1.1
* Cipher selection: ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
*  CAfile: /etc/pki/tls/cert.pem
*  CApath: none
* SSL connection using TLSv1.2 / ECDHE-RSA-AES256-GCM-SHA384 / [blank] / UNDEF
* ALPN: server accepted h2
* Server certificate:
*  subject: C=DE; ST=Hamburg; L=Hamburg; O=Norddeutscher Rundfunk (NDR); CN=www.tagesschau.de
*  start date: Sep 14 00:00:00 2023 GMT
*  expire date: Sep 13 23:59:59 2024 GMT
*  subjectAltName: host "www.tagesschau.de" matched cert's "www.tagesschau.de"
*  issuer: C=US; O=DigiCert Inc; OU=www.digicert.com; CN=GeoTrust RSA CA 2018
*  SSL certificate verify ok.
* using HTTP/2
* [HTTP/2] [1] OPENED stream for https://www.tagesschau.de/inland/gesellschaft/familie-studie-100.html
* [HTTP/2] [1] [:method: GET]
* [HTTP/2] [1] [:scheme: https]
* [HTTP/2] [1] [:authority: www.tagesschau.de]
* [HTTP/2] [1] [:path: /inland/gesellschaft/familie-studie-100.html]
* [HTTP/2] [1] [user-agent: FreshRSS/1.23.2-dev (Linux; https://freshrss.org)]
* [HTTP/2] [1] [accept-encoding: deflate, gzip, br]
* [HTTP/2] [1] [accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8]
> GET /inland/gesellschaft/familie-studie-100.html HTTP/2
Host: www.tagesschau.de
User-Agent: FreshRSS/1.23.2-dev (Linux; https://freshrss.org)
Accept-Encoding: deflate, gzip, br
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8

* Request completely sent off
< HTTP/2 200 
< content-type: text/html;charset=UTF-8
< x-generated-by: tagesschau-live-77c48ddc5f-7j49w
< content-language: en-US
< x-content-type-options: nosniff
< permissions-policy: accelerometer=(), camera=(), geolocation=(), gyroscope=(), magnetometer=(), microphone=(), payment=(), usb=()
< x-varnish: 43197
< x-varnish-cache: miss cached
< x-frame-options: sameorigin
< content-encoding: gzip
< content-length: 105878
< cache-control: max-age=178
< date: Tue, 14 May 2024 10:17:36 GMT
< vary: Accept-Encoding
< strict-transport-security: max-age=15768000 ; includeSubDomains ; preload
< 
* Connection #0 to host www.tagesschau.de left intact

The main difference I see is the presence of a content-length response header for the working one.

[Lucki]

Changing this line makes it working again:

FreshRSS/lib/lib_rss.php

Line 456 in 227233b

CURLOPT_ENCODING => '', //Enable all encodings

-		CURLOPT_ENCODING => '',	//Enable all encodings
+		CURLOPT_ENCODING => 'deflate, gzip',

It seems that FreshRSS doesn't know what to do with the brotli encoding.

[Alkarex]

@Lucki Congrats with the debugging :-) What systems are you running on? Are you using for instance our Docker images?

[Alkarex]

#6469

[Alkarex]

Everything works fine for me testing with our official Docker images (Debian, Alpine) and manually on Ubuntu. As such, I believe the problem is due to a misconfiguration on Uberspace.de.

Instead of manually patching the code, I suggest you edit the configuration file ./FreshRSS/data/config.php and add:

	// ...
	'curl_options' => array(
		CURLOPT_ENCODING => 'deflate, gzip',
		// ...
	),
	// ...

[Lucki]

Yes, this works as a workaround.

[Lucki]

Do favicon requests respect this setting? They haven't come back yet.

When this problem started I noticed that the favicons degraded one after another over time. Is there some timing involved and they'll reappear sometime later?

Edit:
🤦 It's actually local caching issue. Ctrl + F5 brought them back.

[Alkarex]

All good now with your favicons @Lucki ?

[Lucki]

Kind of, they mostly work now and a bunch that stopped working with this problem recovered.

I think that the remaining missing favicons have a different issue or aren't provided - I can't remember if they showed up before.