I've used VS with ReSharper for many years, because ReSharper adds so much to it
That said, before I pulled the trigger and purchased a Rider license, I tried running VS without ReSharper. While it certainly was definitely faster, more responsive and used less memory, I still didn't find it as snappy as Rider. It also still had my laptop fans whining, and occasionaly became completely unresponsive.
It's a real shame - Visual Studio is without doubt an excellent IDE, but performance and reliability issues have plagued it since forever. I really wish a serious effort would be made to address these.
VS 2019 is actually as fast or faster than Rider for me. But that is without Resharper, and without it, I miss way too much functionality.