Fair enough if you're a morning person, it might just be time you would be sleeping, but it does eat into your evening time as well. Time you could use to spend with family/friends, cooking well, leisure and sport activities other than cycling, doing all your boring admin/tidying/DIY jobs that you've been putting off for ages, and otherwise just chilling and relaxing and doing nothing at all! (which is important if you've spent several hours that day cycling).The time I spend commuting on the bike just means I'm not in bed asleep, which is what I would be doing if I drove to work, staying in bed for a couple of extra hours in the morning.
Things like having to rush home - once in 5 years - not enough for me to consider it a barrier.
It all boils down to how much someone really wants to do a big commute.
Plus sleep is important too! :P