I decided that, instead of setting clk-bcm2711-dvp as builtin which was needed as it didn't properly support being a module, to backport the fix, aimed at v5.11.