TBH, most people have extra clothing. It's very common for people who have timeshares or vacation condos of some sort to leave clothing and other necessities so that they don't need to pack it all every time. Of course, if you can't buy clothing off the shelf, you'll probably have a lot less than many people do.
Ah I'm much too much of a dandy for that to work for me, but I can see this working for some folks.
Also, the other problem for me is temperature, formality etc. -- for city i with mᵢ seasons, and nᵢ situations (casual, formal, etc.), I have to own ∑ᵢ mᵢnᵢ sets of clothing.
