I see no point in taking them off as it rains for 363 days of the year. I simply wouldn't buy a frame that doesn't have mudguard clearance. I don't understand why they would rattle or rub either if of decent quality and fitted properly.