My main complaint is the lack of a (decent) package manager; Windows Installer doesn't so much as handle updates by itself, forcing applications to spawn dozens of "updaters" and making it impossible to coordinate them.
(This is perspective as a home user - enterprise tools might be different)
(This is perspective as a home user - enterprise tools might be different)