Autoplayer stopped working with Youtube Data API

[mgoltzsche]

Looks like something has changed within Youtube recently that broke auto-play.

First, when I start a fresh installation without Youtube API key or cookie configured and search for a track, it lists results but logs a lot of these errors:

ERROR    2023-09-02 20:50:53,216 [31:ThreadPoolExecutor-10_0] mopidy_youtube
  Playlist.videos list_playlistitems error "No data found on page"

Then, when I play a track from the search result, it downloads and plays the track but Autoplayer fails to add a related track:

[youtube] Extracting URL: https://www.youtube.com/watch?v=f-JARyd-qAo
[youtube] f-JARyd-qAo: Downloading webpage
WARNING: [youtube] unable to extract initial player response; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
[youtube] f-JARyd-qAo: Downloading ios player API JSON
[youtube] f-JARyd-qAo: Downloading android player API JSON
[youtube] f-JARyd-qAo: Downloading iframe API JS
[youtube] f-JARyd-qAo: Downloading player 0a835141
[youtube] f-JARyd-qAo: Downloading web player API JSON
[youtube] f-JARyd-qAo: Downloading m3u8 information
WARNING: [youtube] unable to extract yt initial data; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
WARNING: [youtube] Incomplete data received in embedded initial data; re-fetching using API.
[youtube] f-JARyd-qAo: Downloading initial data API JSON
[info] f-JARyd-qAo: Downloading 1 format(s): 251
[download] Destination: /var/lib/mopidy/cache/youtube/f-JARyd-qAo.webm
[download] 100% of    2.81MiB in 00:00:00 at 7.14MiB/s
ERROR    2023-09-02 20:55:09,894 [31:YouTubeAutoplayer-13 (_actor_loop)] mopidy_youtube
  No data found on page
ERROR    2023-09-02 20:55:09,894 [31:YouTubeAutoplayer-13 (_actor_loop)] mopidy_youtube
  Autoplayer error "No data found on page"

When I do the same with a Youtube Data API key configured, there are no errors logged during the search but auto-play also doesn't work and a different error is logged:

ERROR    2023-09-02 21:02:40,256 [31:YouTubeAutoplayer-13 (_actor_loop)] mopidy_youtube
  Autoplayer error "'items'"

I am using

• Mopidy-Youtube 3.7
• yt-dlp 2023.7.6

Please note that this happens only when the Youtube Music integration is disabled.
When using Youtube Music, auto-play still works.