Hmm, it's quite strange that the problem happens only with the speaker. So, when you use the headphone from the same built-in HD-audio device, it's working fine? In anyway, please give alsa-info.sh output. Run with --no-upload option and attach the output.