Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set per-feed curl options #508

Open
sanel opened this issue Mar 31, 2024 · 0 comments
Open

Set per-feed curl options #508

sanel opened this issue Mar 31, 2024 · 0 comments

Comments

@sanel
Copy link

sanel commented Mar 31, 2024

Is there a way to have per-feed a specific curl args set? I've noticed that some sites, with --compressed argument and http2, will return curl: (23) Failed writing received data to disk/application, probably due to non-conforming web server. For example:

# works
$ curl --compressed https://news.ycombinator.com/rss >/dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 11404    0 11404    0     0  14087      0 --:--:-- --:--:-- --:--:-- 14079

# fails, but looks like all content is downloaded
$ curl --compressed https://www.klix.ba/rss >/dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  7193    0  7193    0     0  42774      0 --:--:-- --:--:-- --:--:-- 42815
curl: (23) Failed writing received data to disk/application

# but this works
$ curl --compressed --http1.1 https://www.klix.ba/rss >/dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  7193    0  7193    0     0  44618      0 --:--:-- --:--:-- --:--:-- 44401

curl version where this happens:

curl 8.7.1 (x86_64-pc-linux-gnu) libcurl/8.7.1 OpenSSL/1.1.1w zlib/1.2.13 brotli/1.0.9 zstd/1.5.5 c-ares/1.19.1 libidn2/2.3.2 libpsl/0.21.1 libssh2/1.10.0 nghttp2/1.57.0 OpenLDAP/2.4.59
Release-Date: 2024-03-27
Protocols: dict file ftp ftps gopher gophers http https imap imaps ipfs ipns ldap ldaps mqtt pop3 pop3s rtsp scp sftp smb smbs smtp smtps telnet tftp
Features: alt-svc AsynchDNS brotli GSS-API HSTS HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM PSL SPNEGO SSL threadsafe TLS-SRP UnixSockets zstd
~/programs/projects/stylitics/ansible-playbooks $ 

but it works with older curl version, like:

curl 7.81.0 (x86_64-pc-linux-gnu) libcurl/7.81.0 OpenSSL/3.0.2 zlib/1.2.11 brotli/1.0.9 zstd/1.4.8 libidn2/2.3.2 libpsl/0.21.0 (+libidn2/2.3.2) libssh/0.9.6/openssl/zlib nghttp2/1.43.0 librtmp/2.3 OpenLDAP/2.5.16
Release-Date: 2022-01-05
Protocols: dict file ftp ftps gopher gophers http https imap imaps ldap ldaps mqtt pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp 
Features: alt-svc AsynchDNS brotli GSS-API HSTS HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets zstd

Funny thing is that Emacs 29.3 url package works without problems, with (setq elfeed-use-curl nil) set.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant