After some more debugging, here are two videos proving that #gtk4 / #GStreamer video playback with fullscreen GL/VK overlay works on a #RaspberryPi4 and #PinebookPro / #rk3399 on #weston / #Wayland, each maxing out their video decoders with 1080p@60 and 4k@60 respectively.

The message here is: no matter what hardware - if you want to make a video/camera app that needs to be highly efficient, you can do it with a proper, yet still lightweight toolkit now. No need for a custom kms/drm backend.

The obvious use-case would be video player, multimedia centers and video-chat software.

But there's more: let's say you want to build a FLOSS drone operator software that runs on a dedicated tablet - but can also be used on any laptop, just on the desktop? Some camera software that displays extra info like the temperature over the video? You'll probably want to use #GStreamer / #PipeWire anyway - #gtk4 can now be a pretty decent frontend, on some embedded device just like on the desktop :)

Most of the things needed will be part of upstream in upcoming #gtk / #GStreamer / #weston / #gnome releases, some things are still in the PoC stage, most importantly some patches for #v4l2 Gstreamer elements, see also my previous post: https://floss.social/@rmader/111738015095626519
Robert Mader (@[email protected])

Relevant unmerged work: - https://gitlab.gnome.org/GNOME/gtk/-/merge_requests/6618 - https://gitlab.freedesktop.org/wayland/weston/-/merge_requests/1443 - https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5727 Only for V4L2 devices: - https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5890

FLOSS.social
One more thing probably worth mentioning: there's not really anything special happening here from a technical side - it's just that we haven't plugged things together like that before in the #Wayland space. Thus there's bugs and small issues all over the place. But by ironing them out, it should become much easier for other toolkits, apps & compositors support the same. I.e. make #Wayland the central display platform for #linux and get over the whole X11 and native drm backend legacy.
@rmader next time you shoot something in weston, *please* press the super key and drag the windows with the middle button. otherwise it's a wasted opportunity and just a pain to watch :(