True, VGA being an analog interface was perfect for CRT-based monitors. Many modern LCD monitors still have it, not sure about the image quality though.
VGA is still pretty adequate. The main limitation is that if you hook up a VGA monitor, you can't watch most proprietary video, whether it be disc or streaming, because they need a more sophisticated connector for their DRM schemes. VGA cables have no real difficulty with 1080p or some even higher resolutions.
The only place to get used non-HDMI displays is at garage sales, Goodwill's auction site, or fleaBay.