People are different, and I'm pretty sure "I'm just teasing" is nearly never the appropriate response if the other person is upset. Either a serious conversation or an apology are likely the right approach if the person does not like the way that you're interacting with them.