Isn't carbon supposed to be better at absorbing high frequency vibrations? Not really something I've ever noticed when using carbon or alloy components though.
Personally I'd stick with your Al one, unless the carbon one matches your bike, in which case it's a no-brainer!