Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bluesky] Not downloading from likes #5528

Open
kannasama opened this issue Apr 28, 2024 · 3 comments
Open

[bluesky] Not downloading from likes #5528

kannasama opened this issue Apr 28, 2024 · 3 comments

Comments

@kannasama
Copy link

kannasama commented Apr 28, 2024

My general use case is to browse art and add the posts I like to my likes with the intent to run gallery-dl afterward to download said posts. This works fine for Twitter, danbooru, pixiv, and has worked fine for a while with bluesky.

To avoid extended runtimes, and minimize spamming of relevant APIs, I've configured the extractors to abort after 5-15 skipped posts, depending on extractor.

In the past month, posts from bluesky likes do not appear to be downloading.

Relevant extractor config:

"bluesky": {
    "archive": "~/gallery-dl/archive-bluesky.sqlite3",
    "username": "<redacted>",
    "password": "<redacted>",
    "original": true,
    "include": "likes",
    "skip": "abort:10"
  }

Verbose output:

[gallery-dl][debug] Version 1.26.9 - Executable
[gallery-dl][debug] Python 3.10.12 - Linux-5.15.146.1-microsoft-standard-WSL2-x86_64-with-glibc2.39
[gallery-dl][debug] requests 2.31.0 - urllib3 2.2.1
[gallery-dl][debug] Configuration Files ['${HOME}/.config/gallery-dl/config.json']
[gallery-dl][debug] Starting DownloadJob for 'https://bsky.app/profile/<user-redacted>'
[bluesky][debug] Using BlueskyUserExtractor for 'https://bsky.app/profile/<user-redacted>'
[bluesky][debug] Using BlueskyLikesExtractor for 'https://bsky.app/profile/<user-redacted>/likes'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): bsky.social:443
[urllib3.connectionpool][debug] https://bsky.social:443 "GET /xrpc/com.atproto.identity.resolveHandle?handle=<user-redacted> HTTP/1.1" 200 42
[urllib3.connectionpool][debug] https://bsky.social:443 "GET /xrpc/app.bsky.feed.getActorLikes?actor=<actor-redacted>&limit=100 HTTP/1.1" 200 None
[bluesky][debug] Skipping 3kqpfn6itge2c (repost)
[bluesky][debug] Skipping 3kqx5sjj4jp2x (repost)
[bluesky][debug] Skipping 3kqkwo7yozn2o (repost)
[bluesky][debug] Skipping 3kptfquni2v2p (repost)
[bluesky][debug] Skipping 3kmoutlui5z2t (repost)
[bluesky][debug] Skipping 3kovvrdg5oe2i (repost)
[bluesky][debug] Skipping 3ko7cati2qk2n (repost)
[bluesky][debug] Skipping 3kojd4qq4lq2p (repost)
[bluesky][debug] Skipping 3knnij3phdc2u (repost)
[bluesky][debug] Skipping 3kngqueahzz25 (repost)
[bluesky][debug] Skipping 3kma54pgkyy2h (repost)
[bluesky][debug] Skipping 3kmfhf3aatk2b (repost)
[bluesky][debug] Skipping 3kmhwjsdq6j2e (repost)
[bluesky][debug] Skipping 3klz3otcbhf2w (repost)
[bluesky][debug] Skipping 3klyq32vuxa2e (repost)
[bluesky][debug] Skipping 3km3ysjosbx2b (repost)
[bluesky][debug] Skipping 3km5z3kzkpo2n (repost)
[bluesky][debug] Skipping 3klvpd7sutc2j (repost)
[bluesky][debug] Skipping 3klnt5faj2g2h (repost)
[bluesky][debug] Skipping 3kloq5kqm6t2y (repost)
[bluesky][debug] Skipping 3klr4mz6ncv2v (repost)
[bluesky][debug] Skipping 3klm6umqrdl2z (repost)
[bluesky][debug] Skipping 3klom2wj4h222 (repost)
[bluesky][debug] Skipping 3klhnosfne52w (repost)
[bluesky][debug] Skipping 3klekg7ykoz2g (repost)
[bluesky][debug] Skipping 3kkskqldf7u2j (repost)
[bluesky][debug] Skipping 3klgeryvgyk2v (repost)
[urllib3.connectionpool][debug] https://bsky.social:443 "GET /xrpc/app.bsky.feed.getActorLikes?actor=<actor-redacted>&limit=100&cursor=3klggrfzp522x HTTP/1.1" 200 None
[bluesky][debug] Skipping 3klc5h5nhfo23 (repost)
[bluesky][debug] Skipping 3klfawfo74q2m (repost)
[bluesky][debug] Skipping 3kla2xoswho24 (repost)
[bluesky][debug] Skipping 3kkvnczw57h2t (repost)
[bluesky][debug] Skipping 3kl6z4ag5c32z (repost)
[bluesky][debug] Skipping 3kl7chgsyn52e (repost)
[bluesky][debug] Skipping 3kl6uhh3fhc2u (repost)
[bluesky][debug] Skipping 3kl7t3mc5ft2v (repost)
[bluesky][debug] Skipping 3kl7zowtwqd2o (repost)
[bluesky][debug] Skipping 3kkskyka5jr2r (repost)
[bluesky][debug] Skipping 3kksqojnje32x (repost)
[bluesky][debug] Skipping 3kl6aeztt3t2v (repost)
[bluesky][debug] Skipping 3kkva76tvnv2w (repost)
[bluesky][debug] Skipping 3kkvecevolp2g (repost)
[bluesky][debug] Skipping 3kl4i57xysp2v (repost)
[bluesky][debug] Skipping 3kl5ed6r54n2x (repost)
[bluesky][debug] Skipping 3kkw33qdj3c2o (repost)
[bluesky][debug] Skipping 3kkuxwgmj7o2z (repost)
[bluesky][debug] Skipping 3kl5iqguvre2e (repost)
[bluesky][debug] Skipping 3kl5eh5b5ae2a (repost)
[bluesky][debug] Skipping 3kkz7s3hela2f (repost)
[bluesky][debug] Skipping 3kkw674hyxx2w (repost)
[bluesky][debug] Skipping 3kkt6bdxdzr22 (repost)
[urllib3.connectionpool][debug] https://bsky.social:443 "GET /xrpc/app.bsky.feed.getActorLikes?actor=<actor-redacted>&limit=100&cursor=3kghnvjsrzz22 HTTP/1.1" 200 36
[urllib3.connectionpool][debug] https://bsky.social:443 "GET /xrpc/app.bsky.feed.getActorLikes?actor=<actor-redacted>&limit=100&cursor=3kaxnb3kbzz22 HTTP/1.1" 200 36
[urllib3.connectionpool][debug] https://bsky.social:443 "GET /xrpc/app.bsky.feed.getActorLikes?actor=<actor-redacted>&limit=100&cursor=3k3hmmnbrzz22 HTTP/1.1" 200 36
[urllib3.connectionpool][debug] https://bsky.social:443 "GET /xrpc/app.bsky.feed.getActorLikes?actor=<actor-redacted>&limit=100&cursor=3jvxly6zbzz22 HTTP/1.1" 200 36
[urllib3.connectionpool][debug] https://bsky.social:443 "GET /xrpc/app.bsky.feed.getActorLikes?actor=<actor-redacted>&limit=100&cursor=3jqhldqqrzz22 HTTP/1.1" 200 36
[urllib3.connectionpool][debug] https://bsky.social:443 "GET /xrpc/app.bsky.feed.getActorLikes?actor=<actor-redacted>&limit=100&cursor=3jkxkpcibzz22 HTTP/1.1" 200 36

The final API calls keep continuing until I abort the run.

@mikf
Copy link
Owner

mikf commented May 2, 2024

Wrongly marking every liked post as repost and skipping them was not supposed to happen. That's fixed in 6db1837, but likes are still a mess thanks to Bluesky's broken(?) API endpoint.

@kannasama
Copy link
Author

I figured bluesky changed something on their end. I'll update and give it a try later today.

@kannasama
Copy link
Author

I can confirm bluesky likes are functioning properly after the fix.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants