Trimming the kernel -- what's the point?

I know it's possible by using "make xconfig" or something similar to trim the kernel by eliminating stuff I'll never use and then recompile a slimmer, more svelte version of it that works just as well. But given the speed and memory size of most computers these days (including mine), is there any noticeable benefit in doing that? Will I ever notice a performance improvement? Paul Abrahams