So long as you stick a 10-speed cassette on there too and they're compatible makers - i.e. Shimano/SRAM or Campagnolo, you'll be fine. If you just swap the wheels and leave the 11-speed cassette, you'll be able to set it up as an expensive singlespeed, but don't try changing gear - it'll be hit and miss and jumpy as the sprockets are spaced differently.