Well, dress codes do reflect on the culture and the office environment. There is something to that.
But as long as one is not working in a role, where they are expected to adhere to certain norms e.g a BD person, a CEO, etc
... its ok to then dress as per your comfort.
The CEO of one of the firms I used to work with used to say, I dont care what clothes you wear to office, as long as you wear them!!
And thats what matters