No reason at all, as long as you make sure that the brakes line up and are correctly adjusted.
I don't use QR on the rear of a fixie, but on the front there's no reason not to.
Also, as far as I'm aware you get extra points if the wheels on your fixie are not a matched pair.