If you think it's bad, you should try being a JW female! We had it worse for ppl telling us how to live our lives. Well, at least I did. Well-meaning ppl who knew nothing about my background yet they thought they could map out my life for me.
Eventually I realised that they weren't paying my bills so it was none of their business what I did with my time. Nor would they be there to pick up the pieces if things fell apart, so I just smiled and let them know I'm fine, thank you. And leave it at that.
There's no need to justify yourself to anyone. It's none of their business. If you have to, remind them of that. And remind yourself, so you don't get too worried about what they say.