Feature request: Consider adding support for GtkGraphicsOffload / zero-copy playback on Wayland

[rmader]

This is probably low-prio for now, however: GTK4 4.14 got a new feature allowing graphics offloading to the Wayland compositor (possibly in the future also for other platforms). See also https://blog.gtk.org/2023/11/15/introducing-graphics-offload/

Doing so allows using hardware features of modern GPUs / display controllers for YCbCr to RGB conversion and scaling, which in many cases can reduce power usage significantly - and in case for low-end hardware like embedded SoCs avoid frame skips.

I'm not very familiar with the mpv code, however it already has a native backend for Wayland offloading which could serve as inspiration (--vo=dmabuf-wayland). It's likely that this will only work in combination with hardware decoding (VA-API / V4L2 / Vulkan).

I personally have been involved with making the Gstreamer demo client use it (gtk4-demo --run=video_player, and also did a MR for another simple Gstreamer based client (https://gitlab.gnome.org/guidog/livi/-/merge_requests/35). In case you consider working on this, please feel free to contact me for questions/reviews etc.

---

See also: https://codeberg.org/avery42/delfin/issues/69

[gnome-mpv]

That'd be nice to have, but I don't think you can implement it with libmpv right now. There's no way to get dmabuf fd from mpv AFAIK.

[benjamin-otte]

Is that tracked in MPV somewhere? mpv-player/mpv#11031 ?

[gnome-mpv]

Is that tracked in MPV somewhere? mpv-player/mpv#11031 ?

Yeah, that looks right.