What does "Am I throwing you off" mean?

Heard this from Nelly Fertato's Promiscuous Girl. I want to know what this means. Also have heard ppl say "you threw me off." English is my second language. So please help me out with this. Thanks a lot.