[Bug]: 'Rescan subscriptions' button doesn't detect new videos for playlists

[trinhit]

I've read the documentation

• I'm running the latest version of Tube Archivist and have read the release notes.
• I have read the how to open an issue guide, particularly the bug report section.

Operating System

Synology

Your Bug Report

Describe the bug

I subscribed to a playlist. When clicking on the Rescan subscriptions button for the first time, all videos in that playlist were added into download queue. After some time, more videos were added into the same playlist. However, clicking on Rescan subscriptions button again didn't detect newly added videos.

Steps To Reproduce

Pre-condition: I tested with a clean installation of TA with all default settings.

Step 1: Go to YouTube, create a public or unlisted playlist. Add a few videos into the playlist. Let's say the playlist has 3 videos at this moment.

Step 2: On TubeArchivist, go to /playlist page. Input the URL/ID of the playlist on Step 1 and click on Subscribe button.

Step 2: Go to /downloads page. Click on Rescan subscriptions button. We'll see 3 videos in the download queue.

Step 3: Go back to YouTube, add a few more videos into the same playlist.

Step 4: On TubeArchivist, go to /downloads page. Click on Rescan subscriptions button. Observation: The newly added videos on Step 3 don't show up on the download queue.

Expected behavior

Newly added videos of subscribed playlists should be added into download queue when clicking on Rescan subscriptions button.

Relevant log output

[2024-03-17 17:26:06,386: INFO/MainProcess] Task update_subscribed[ab98fc35-31f5-4070-93a6-9054022559a2] received
[2024-03-17 17:26:06,387: WARNING/ForkPoolWorker-6] update_subscribed create callback
[2024-03-17 17:26:06,563: WARNING/ForkPoolWorker-6] PLhIIJO_u92t5h-k0zjK55jCeT-AjuUBfi: get metadata from es
[2024-03-17 17:26:06,571: WARNING/ForkPoolWorker-6] PLhIIJO_u92t5h-k0zjK55jCeT-AjuUBfi: get metadata from youtube
[2024-03-17 17:26:07,273: WARNING/ForkPoolWorker-6] WARNING: [youtube:tab] Incomplete data received. Retrying (1/3)...
[2024-03-17 17:26:07,403: WARNING/ForkPoolWorker-6] WARNING: [youtube:tab] Incomplete data received. Retrying (2/3)...
[2024-03-17 17:26:07,512: WARNING/ForkPoolWorker-6] WARNING: [youtube:tab] Incomplete data received. Retrying (3/3)...
[2024-03-17 17:26:07,626: WARNING/ForkPoolWorker-6] WARNING: [youtube:tab] Incomplete data received. Giving up after 3 retries
[2024-03-17 17:26:07,708: WARNING/ForkPoolWorker-6] ab98fc35-31f5-4070-93a6-9054022559a2 success callback
[2024-03-17 17:26:07,712: INFO/ForkPoolWorker-6] Task update_subscribed[ab98fc35-31f5-4070-93a6-9054022559a2] succeeded in 1.3211056040599942s: None
[2024-03-17 17:26:07,712: WARNING/ForkPoolWorker-6] ab98fc35-31f5-4070-93a6-9054022559a2 return callback

Anything else?

Known workaround

A workaround that I discovered is as below:

1. Go to the /playlist page. Click on the playlist in question.
2. Click on Reindex button. Waiting a few seconds.
3. Go to the /downloads page. Click on Rescan subscriptions button. We'll see new videos added into the download queue.

[lamusmaser]

We already have a PR for this in #670 - this should be fixed once that is merged.

[lamusmaser]

After a closer review of the PR, it does not actually resolve this issue. This only resolves a smaller action that is similar.

[bbilly1]

v0.4.8 brings various playlist handling fixes, and should now correctly trigger refreshs. please update.