I understand perfectly what you mean. Contrary to other comments, I think that this can be ok, you should spend the majority of your time with folks that you find interesting. Not easy, and indeed I'm working on something to make this simpler. Feel free to reach me for a chat. My Linkedin: https://www.linkedin.com/in/lorenzo-pieri-a638b9a6/
That is however not what the parent asked about, the question was ”how do I cope?” not ”is this ok?”. Of course it’s ok to feel that way, most of the other comments are about how to cope instead of ”you don’t, give up and go someplace else”.
I often feel like talking about esoteric topics like math even though I’m surrounded by people who would gladly kill to never do math ever again. I however want to get along with these people, just like the original poster who wants to progress through people skills. If I was only surrounded by people who value the same things as me this would not be an issue, which is why answers like ”just go where other people are exactly like you” is not productive.