A potential workaround might be to tweak the uart4's Device Tree alias to something less than serial4, e.g. serial3 so that it shows up as ttyS3.