That's the intended behaviour and basically how it has to be with the current PAM design... Feel free to report that upstream.