Riding without purpose just feels wrong. I too find it difficult to go for rides if I'm not commuting or running errands.
I'm the same, but I do extend my evening commutes pretty often. Never my mornings, though - waking up to run outside and do 8 miles is enough for me.