OK, then it's likely a hairy timing issue. By moving the drivers from built-in to modules, the initialization of those devices are delayed, and this already made the things working. As a final solution, we'd need to ask upstream. Let's see.