So, actually what kind of hardware are you testing? If XZ-decompression takes such extremely long time, we have to address in XZ library side. XZ is used for the packaging itself, so this must be the pretty basis. It's no specific problem to depmod or kernel packaging. Check the standard xz program and see whether it takes longer than other systems. Then try profiling what takes too long on your problematic system.