According to sway developer (see issue on sway bugtracker) this is caused by also having the NVIDIA proprietary drivers installed (although the modules are not loaded) and a too old libglvnd (currently 1.3.2, last updated Aug 31 2020). Apparently the fix would be an updated libglvnd package.