I’d say your response should be somewhere between standing up for yourself, and dismissive of their point. I wouldn’t go into a big speech, but I would probably tell them to mind their own business then and that you don’t take your emotional cues from their insults.