I made that same exact argument in college to someone who was just trying to help me see how insane I was. Yes, it's slightly self-serving to love and find joy in love. But of all the forms of selfishness in existence, it's the most acceptable and least blamable one.