Your swearing is perfectly understandable. You had a shock and reacted to it. That is NO excuse for what he then did. Totally, totally out of order.
Do you have any witnesses to the original incident? I assume you have witnesses for when he pushed you?
I would probably not report it to the police. I would be surprised if they would do anything, (although I could be wrong depending on the witnesses you have).
I suppose, how far you take this depends on the incident itself, how much it affected you, and how much of a danger you think this chap poses in the future, to you and others.