AlmaLinux: Issue with H.264 when client request color depth 32 bit (xorgxrdp) #3405
Description
xrdp version
0.10.2
Detailed xrdp version, build options
xrdp 0.10.2
A Remote Desktop Protocol Server.
Copyright (C) 2004-2024 Jay Sorg, Neutrino Labs, and all contributors.
See https://github.com/neutrinolabs/xrdp for more information.
Configure options:
--build=x86_64-redhat-linux-gnu
--host=x86_64-redhat-linux-gnu
--program-prefix=
--disable-dependency-tracking
--prefix=/usr
--exec-prefix=/usr
--bindir=/usr/bin
--sbindir=/usr/sbin
--sysconfdir=/etc
--datadir=/usr/share
--includedir=/usr/include
--libdir=/usr/lib64
--libexecdir=/usr/libexec
--localstatedir=/var
--sharedstatedir=/var/lib
--mandir=/usr/share/man
--infodir=/usr/share/info
--enable-fuse
--enable-pixman
--enable-painter
--enable-vsock
--enable-ipv6
--enable-openh264
--with-socketdir=/run/xrdp
--with-imlib2
build_alias=x86_64-redhat-linux-gnu
host_alias=x86_64-redhat-linux-gnu
CC=gcc
CFLAGS=-O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -march=x86-64-v2 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
LDFLAGS=-Wl,-z,relro -Wl,--as-needed -Wl,-z,now -specs=/usr/lib/rpm/redhat/redhat-hardened-ld -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1
CXX=g++
CXXFLAGS=-O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -march=x86-64-v2 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
LT_SYS_LIBRARY_PATH=/usr/lib64:
PKG_CONFIG_PATH=:/usr/lib64/pkgconfig:/usr/share/pkgconfig
Compiled with OpenSSL 3.0.7 1 Nov 2022
Operating system & version
RedHat Enterprise Linix 9.4 / Almalinux 9.5
Installation method
dnf / apt / zypper / pkg / etc
Which backend do you use?
xorgxrdp 0.10.3
What desktop environment do you use?
Xfce
Environment xrdp running on
Physical and virtual systems
What's your client?
Windows 11 Microsoft Client
Area(s) with issue?
Graphic glitches, Other
Steps to reproduce
We have just updates to the lastest version of xrdp and xorgxrdp on our RedHat and Alma Linux systems.
When we connect to the systems with 32 bit color depth, we only see a blue screen and the systemd journal contains lot's of lines with
[ERROR] Failed to create H.264 encoder
If we reduce the color depth to 24 or less, everything is working as expected.
There is also in the logs when conencting:
Color depth 32 bit:
[INFO ] client supports gfx protocol
Color depth <32 bit:
[WARN ] client requested gfx protocol with insufficient color depth
✔️ Expected Behavior
Seeing the Xfce desktop
❌ Actual Behavior
The window has just blue background, no Xfce desktop items visible
Anything else?
Please let me know if you need further details or logs.