I couldn't give any judgement because I am not sure about your situation.
If it was for me,i wouldn't be very upset just because of the reason you said above.I think we know what to do to protect ourselves as best as we can when bad things have happened to someone around us.We are all grownups and we understand things,if someone keep telling me about small things i may think that he is a little too feminized. Besides,if he is not by your side,there cann't be much practical help he could do for you.When i read your words,i thought he was not a very good man for he made jokes towards other people's misfortune,but most times we could make a wrong judgement just according to one circs.I think you know him better than all of us do.
Best wishes for you~