I don't file or pay taxes on my SS retirement income but if I work a part time job for awhile I file to get the taxes back (if I fall under the income level required). I've never quite comprehended why I pay SS or Medicare taxes when I work part time when I'm on both. You don't get those back just Fed and State.