You are reacting to cultural training you have received, which has apparently taught you things such as:

* that a man wearing a hat indoors means that he is rude, or otherwise disrespectful;

* that baseball caps denote lower class, or perhaps immaturity.

You might benefit from pondering how upset the wearing of hats makes you, to figure out exactly what thoughts are triggered. Not to overturn your aversion to them, but to clarify what you actually think of the person wearing them, and why. That self-knowledge, in turn, might help you discern which people are more likely to please you in other ways.

Hats at dinner is a no-no...if it's a cap, it should be spun around so the spaghetti doesn't flip up and get stuck to the visor during midslurp...
as for slurping...that's an individual preference.

If a man is wearing a baseball cap all the time, even at home, while, for example, watching a movie with friends, it's probably about his background and an insecurity.
Add a bottle of beer in his hand to complete the picture.
I find it VERY unappealing.

Then you have to worry what he puts in the other hand.

Not at all Maxsterx
I am not in that picture

P.S.
I just checked your profile. Upsy daisy! Intimate encounter seeker... another one. I deleted smile from the reply. It looks better now.

The only men you see wearing a hat are pensioners. And rarely a younger guy, usually a flamboyant type, but that rarely happens.

Caps ... I like caps. Got a few myself that I like to wear during summer. The guy I'm seeing wears a cap too, not all the time though, and not on a dinner date either. Wearing a cap on a dinner date is okay if you'd go to McDonald's maybe, but not a restaurant.
*Dang, now I want a Big Mac*
.
.
.

Big Mac is wearing a hat. Is he a pensioner?

According to Wikipedia...

The Big Mac is a hamburger sold by international fast food restaurant chain McDonald's. It was introduced in the metropolitan area of Pittsburgh, United States, in 1967 and nationwide in 1968.

... so Big Mac is not yet a pensioner.

I wear my hat at the table.

I do take it off to go to bed

I'll take it off inside at home

I wear a hat for sun protection

When I wear a hat out I don't usually go to places with a hat check (in fact never have) so the hat stays on

The exception is if I go to a club that has a specific rule that hats must be removed. It always strikes me as an impracticable and unhealthy rule to insist on the removal of hats

agree with you!

When I was growing up in school, the boys were ALWAYS instructed to take off their hats indoors. What happened to manners anymore?

Can't stop thinking about the Rqndy Neuman song - "You can keep you hat on"!