Isn't the reason that we had to reduce the GPU memory size because initramfs was trying to use 32Mb more than it had available due to the GPU memory setting being 128M? So, if the initramfs is still to be set to the maximum available memory size at the time, and we take system memory to use for the GPU, initramfs will fail to load into the available memory.