When I tapped it back into position it required considerable force. I'm guessing it must have been installed wrong from the factory or maybe a previous owner farted around with it.
I should have thought to take pictures of the pin and receiver while I had it apart. You could see damage to the pin and a corresponding groove in the receiver where they had rubbed. At least that was my best guess, I'm far from a professional gunsmith.