It's not a zero sum game. We can live perfectly comfortable moved without a lot of the stuff have, or doing things slightly differently. Some things we as consumers wouldn't even really notice, like better insulation standards.
You're right and that's why I specifically said it's a net gain and not that there were no negative aspects to it. Constant economic growth pushes innovation, yes there are downsides just as there are with anything.