Skinny problem?

Consider yourself lucky? In any case, metabolic rate slows with age for some people so you may yet put on a few pounds. If you want to look less like a beanpole, dress in plaids, solid colors, horizontal stripes, etc. and wear bulkier clothing if you want to. But mostly, if people are making you uncomfortable they're probably just jealous. Recognize that and you'll be fine.