Right, the flat volume an infamous feature of pulseaudio. Please check whether disabling it improves your situation. If yes, just keep your setup :)