1) Ignore your friends
or
2) Get new friends.
Be sensible, be aware, and assume that every driver is about to knock you off, until you get evidence otherwise. Look for quieter routes or ride with the cycling herd.
Then when you are fit and healthy, and they are having heart problems or can't manage to get around like you can, reflect on how dangerous NOT cycling is.