Three lanes of traffic and then back again
Seemed to be offended by you being on the bus stop, then you knocking on his door, then you holding him up so that he then has to cut across three lanes of traffic, and then back across again to squeeze you against a barrier
Had I been on the bike I would have seen red as well.
I would echo what others have said though, try to remain calm, try not to give them a second shot at you.
I would have gone to TFL (who would have passed the complaint onto Tower Transit), kept the video, and if the driver lied, sent the video in so that they could also see he was a liar as well as a reckless driver. I suspect the passengers on the bus got chucked around a bit as well.