I went to an Ivy League (recently, graduated in last 5 years). This describes me to a T. Started out in CS, dropped to a libarts major because I felt like I couldn't keep up with my peers.
I still work in SWE, and began doing it in HS when I was 17.
Partner and I discuss frequently that I would have been better off somewhere else.
I know loads of SWEs who dropped out of CS degrees outright or changed majors and graduated with a liberal arts degree (I myself am a SWE but a liberal arts grad; I never took a single CS course but worked as a sysadmin for the I/O department at my school). I can't think of a single one of them that regrets dropping out or switching. It certainly doesn't seem to have hurt their career opportunities or their compensation.
The only thing I've found that they do regret is spending the tuition money and walking away without a degree.
I still work in SWE, and began doing it in HS when I was 17.
Partner and I discuss frequently that I would have been better off somewhere else.