I do think this is a good point ...
In my roleplays I switch outfits regularly. My characters have an outfit for fighting, one for doing guard duty, one for casual hanging around, one for working (mining or smithing) and of course one for swimming.

A blacksmith working with a helmet on is only explainable if said blacksmith is an Ynwnn and is working with gold or silver. anyone ever tried hammering on rocks or steel while wearing armor in reality? Even if it's just thick leather, this is bound to tire you out and cause overheating.
There is a tendency among players to distinguish themselves with their outfits, especially now more and more different combinations are becoming possible. I noticed an extreme form of this last weekend. Players were asked to put down their weapons on a guarded auction, one of them continuously refused because the sickle was part of his outfit.
In my opinion this is not very good RP but it's the player's choice and nothing that can be done about it really.