It would probably be reasonable to remove the recommends in the x11 pattern and make sure that the gnome / kde / other desktop patterns all require xll_opt rather then x11. I'm traveling this week, but can probably look at it once i'm back.