"You're only being creepy if the other person is not attracted to you."

No, you are not being creepy if the other person is not attracted to you, that's just his/her opinion of you. They don't decide or dictate who or what you are. Other people are not the arbiters of you.