I always pinned this on being introverted and nothing to do with smarts. I could be popular with effort and actually being outgoing but it was exhausting and I would quickly find myself getting annoyed at popular people. What they did and talked about just wasn't stimulating.