There could be a raspberrypi-firmware-config package flavor that would require raspberry-firmware-extra and add start_x=1 and gpu_mem=128 to config.txt i think