If you can write a udev rule which is good enough to prevent loading the sg module on every boot then fine. But currently, the fact that sg is a module and is loaded on every boot unconditionally defeats the whole purpose of the module concept. Quite frankly I don't see the problem to make this driver a builtin.