OK, so it makes little sense to keep both devices available. Could you try to copy (overwrite) the file USB-Audio.conf in below to /usr/share/alsa/cards/USB-Audio.conf, re-login and retry? I'm not sure whether this has any good effect for pipewire, though. If not, we might need to fiddle with alsa-ucm or patching kernel.