You don't even have to removal all of them; just make it so you can't use all of them.
You're depreciating your asset? You don't get to depreciate, and deduct repair/maintenance costs.
You're depreciating? You don't get to 1031 the asset as well (and avoid recapture).
Regarding government back loans, I think you're right, ish. It's very weird that it's a thing at all, and that you can use subsidized loans for up to 4 unit properties. BUT I do believe this availability has been an on-ramp to a career in real estate, and a wealth building mechanism, for many, many previously-disadvantaged people. It's definitely been bastardized into something else over the last decade.
That aside though, individuals are limited to a maximum of 10 government-backed morgages, and it becomes much more difficult to qualify for new ones after 4. While yes, that sounds like a lot, large real estate companies that are managing 10s of thousands of units are not utilizing these programs, and eliminating them would serve only to limit the "mom and pop landlords" that, frankly, tend to offer a lot more flexibility for tenants than large management companies do.
That would do the most damage.