The people who are racing against the clock I would guess that they are timing themselves anyway, either stopwatch, gps, strava etc so I don’t think the removing the publication of times would make any difference.
It's comparing yourself to EVERYBODY else's times that provides the 'racing' element.