Imo it depends how well he knows your gf, perhaps they were very good friends and he hasnt seen her in a while. The fact is she shrugged him off which was all that was needed.
Because it was her that shrugged him off and put him straight then the guy must feel alittle small, i know i would. If you would of hit him then he's got what he wanted, a reaction from you. Thats to say he knew you were with her.
Women can stand up for themselves, let them do it...