Can you say to a man that "I like your dress"?

Yes you can but be ready for a punch ! years ago it was a common sight to see the sign "Please adjust your dress before leaving." in mens toilets, especially in train station tiolets.