I found the following issue that matches my problem in the upstream bugtracker: https://gitlab.freedesktop.org/drm/amd/-/issues/1407